DataPro and related utilities

From IARC 207 Wiki
Revision as of 17:50, 3 November 2015 by 137.229.29.173 (talk) (Created page with " ===Background=== This program and related utilities started out in 2006 or 2007 as a way to leverage the gp.py program for web page creation. Basically, as a way to allow we...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Background

This program and related utilities started out in 2006 or 2007 as a way to leverage the gp.py program for web page creation. Basically, as a way to allow web pages generated by that tool to display data coming from Array styled outputting data loggers (Campbell Scientific cr10x & cr23x etc). Along the way it turned into a more full featured data processing system written in python with a host of support utilities. Bob Busey wrote the original and then student (now staff member) Ross Spicer did a nice rewrite and organized it like a proper computer scientist might.<br.

Where to find it

The current release can be found on Ross' github page:
https://github.com/rwspicer/csv_utilities (example starter files here:) https://github.com/frankohanlon/DataPro_Sample_Files

There are several ways to get it. Easy way is just to download the package as a zip file. Proper way is to use open source tool Git (from command line or graphical interface):

git clone https://github.com/frankohanlon/DataPro_Sample_Files

Also useful if you decide to use it is this is a windows / linux graphical utility which helps generate the configuration files:
https://github.com/rwspicer/sc_apps

What is included

datapro.py -- Datapro 3.0 the data processing utility
step_function_utility.py -- applies a correction to data values over given 
                            time periods
rh_calculator.py -- given data on precipitation and dew point caclualtes the 
                    relative humidity
precip_utility.py -- allows for removal of bad pecipatation data
plotter.py -- used to plot csv files
PNGen.sh -- generates the plots for each csv file in a directory
get_ip -- a utility to get the ip adderess of a machine
rad_decoder.py -- takes a cdf File and converts to csv file
tz_shift.py -- for shifting between utc - 0 and akst timezones
wunder_formatter.py -- takes csv file data and converts it to a url that can 
                        be sent to weather under ground 
LoggerLink -- a porgram for uploading/ downloading data and programs from 
                cr1000 data loffers
noaa_data.py -- utility for retriving data form the noaa website

barrow_monthly.py -- a utility for getting the monthly data from a site in 
                     barrow
tutorial.py -- the utility that goes with the tutorial