IARC 207 Wiki - User contributions [en]

DataPro setup and workflow

2015-11-04T03:31:43Z

137.229.29.173:

==Initial setup==
It's good to settle on a standard directory structure if you can. For linux, most things go in a bin directory. You can do the same with windows. Recommended though to not put any spaces characters ' ' in folder names etc as I don't know if there are ill consequences. Be conservative, descriptive names, well organized, use underscore character in place of spaces. Logical places you might put them:
/var/data/bin/
/home/site/bin/
c:\data\bin/

Then, suggested directory structure for the site's themselves:
/var/data/$site_name - root directory of the site
/var/data/$research_area/$site_name - another logical location for the root directory of the site.
/var/data/$site_name/config/ - location of the configuration files used by datapro and related utilities for processing the data
/var/data/$site_name/raw/ - location for the raw data (I personally think a good practice is to have the original data from LoggerNet / loggerdata etc
/var/data/$site_name/outputs/ - location for the automatically processed data: raw data that has been analyzed by datapro
/var/data/$site_name/web/ - location for a shorter time series, like the last 3 weeks suitable for a web page.
/var/data/$site_name/qc/ - location for the automated qa/qc log
/var/data/$site_name/error/ - location for datapro error logs

To run:
python /var/data/bin/csv_utilities/datapro.py --key_file=/var/data/$site_name/config/keyfile.txt

Then, watch for error messages. Depending on your system there may be some python libraries that need to be installed. If you use windows, enthought python distribution is a nice all-encompassing choice or cygwin for making sure you have all of the right things on the computer.

If you have any questions just ask Bob Busey.

===Initial site set up workflow===

# create the initial directory structure listed above.
# I usually don't use the site creator though I certainly could. More often I start with an existing site's configuration files... copy them to a new config and edit to reflect the new site.
# the file that controls qa/qc parameters, filenames, any functions to be applied etc is the parameter csv file. It's often easiest to just edit this on a computer with a graphical spreadsheet program like Excel or Libre Office to get things proper. The header information can often be copied & pasted straight from the raw .dat file
# next, edit the .txt key file to reflect where file and directory locations are all placed.
# run datapro as shown above.
# if it works, awesome. if it doesn't, make note of the errors and try to address them.
# once it's running I do a couple more things. ln -s is used to create symlinks for a few other items. I maintain an automatically generated diagnostics web page at http://ngeedata.iarc.uaf.edu/data/data.html. It expects battery voltage to be placed in 'battery.csv' and Internal Panel Temperature to be in 'paneltemp.csv' if you don't use those names you can use ln -s to create a symlink. I then will also make sym links so that the processed data is available over the internet without making a second full copy of the data.

DataPro setup and workflow

2015-11-04T03:24:41Z

137.229.29.173: Created page with "==Initial setup== It's good to settle on a standard directory structure if you can. For linux, most things go in a bin directory. You can do the same with windows. Recommen..."

DataPro and related utilities

2015-11-04T02:50:55Z

137.229.29.173: Created page with " ===Background=== This program and related utilities started out in 2006 or 2007 as a way to leverage the gp.py program for web page creation. Basically, as a way to allow we..."

===Background===
This program and related utilities started out in 2006 or 2007 as a way to leverage the gp.py program for web page creation. Basically, as a way to allow web pages generated by that tool to display data coming from Array styled outputting data loggers (Campbell Scientific cr10x & cr23x etc). Along the way it turned into a more full featured data processing system written in python with a host of support utilities. Bob Busey wrote the original and then student (now staff member) Ross Spicer did a nice rewrite and organized it like a proper computer scientist might.<br.
===Where to find it===
The current release can be found on Ross' github page: 
https://github.com/rwspicer/csv_utilities
(example starter files here:)
https://github.com/frankohanlon/DataPro_Sample_Files

There are several ways to get it. Easy way is just to download the package as a zip file. Proper way is to use open source tool Git (from command line or graphical interface): 
<pre>git clone https://github.com/frankohanlon/DataPro_Sample_Files</pre>

Also useful if you decide to use it is this is a windows / linux graphical utility which helps generate the configuration files: 
https://github.com/rwspicer/sc_apps

===What is included===
<pre>
datapro.py -- Datapro 3.0 the data processing utility
step_function_utility.py -- applies a correction to data values over given
time periods
rh_calculator.py -- given data on precipitation and dew point caclualtes the
relative humidity
precip_utility.py -- allows for removal of bad pecipatation data
plotter.py -- used to plot csv files
PNGen.sh -- generates the plots for each csv file in a directory
get_ip -- a utility to get the ip adderess of a machine
rad_decoder.py -- takes a cdf File and converts to csv file
tz_shift.py -- for shifting between utc - 0 and akst timezones
wunder_formatter.py -- takes csv file data and converts it to a url that can
be sent to weather under ground
LoggerLink -- a porgram for uploading/ downloading data and programs from
cr1000 data loffers
noaa_data.py -- utility for retriving data form the noaa website

barrow_monthly.py -- a utility for getting the monthly data from a site in
barrow
tutorial.py -- the utility that goes with the tutorial
</pre>

Field Safety

2012-03-09T20:25:47Z

137.229.29.173:

==General==
For people who aren't able to attend the Learn To Return etc. safety workshops, here are some links that are another way to get some of the information.

==Worthy Goals==
* Annual Bear Safety Training & certification
* Annual CPR Training & certification
* Basic First aid or wilderness first aid every 3 years & certification
* Swiftwater Rescue & certification

==Bear Safety==
A fish and Game video:
* http://www.youtube.com/watch?v=LM0OghpVaFY
Commercial DVDs:
* Polar Bears: A Guide to Safety -- http://www.macecanada.com/canada/product/polar_video2.htm
* Working in Bear Country -- http://www.macecanada.com/canada/product/video2.htm

==ATV Safety==
Some decent videos here:
* http://www.youtube.com/user/ATVsafetyinstitute?feature=watch
A US Government website about safe ATV use:
* http://www.atvsafety.gov/safetytips.html

==Snowmachine Safety==
Some of these are a bit dated but the concepts are for the most part good. 
Skidoo / Bombardier Snowmobile safety:
* http://www.youtube.com/watch?v=aXgY1aaIx9Y 
Arctic Cat Snowmobile Safety (skip ahead to 2:18 to get through the cartoon start if it annoys you), first of three videos in the Arctic Cat film:
* http://youtu.be/d-T7IV7evxQ 
Lounsbury Snowmachine Safety website:
* http://www.lounsburyinc.com/snowmachinesafety/

==Cold Injuries==
Some classic Army videos (some are better than others) and videos from other sources:
* http://www.youtube.com/watch?v=ndU2gQ716j0&feature=related
* http://www.youtube.com/watch?v=tIY8fbtu_3E&feature=relmfu
* http://www.youtube.com/watch?v=J06qjb-iIqE
* http://www.youtube.com/watch?v=ca2P-UMuYts&feature=relmfu

===Hypothermia===
'''''From Wikipedia:''''' 
'''Mild''' 
''Symptoms of mild hypothermia may be vague with sympathetic nervous system excitation (shivering, hypertension, tachycardia, tachypnea, and vasoconstriction). These are all physiological responses to preserve heat. Cold diuresis, mental confusion, as well as hepatic dysfunction may also be present. Hyperglycemia may be present, as glucose consumption by cells and insulin secretion both decrease, and tissue sensitivity to insulin may be blunted. Sympathetic activation also releases glucose from the liver. In many cases, however, especially in alcoholic patients, hypoglycemia appears to be a more common presentation. Hypoglycemia is also found in many hypothermic patients because hypothermia often is a result of hypoglycemia.'' 
'''Moderate''' 
''Low body temperature results in shivering becoming more violent. Muscle mis-coordination becomes apparent. Movements are slow and labored, accompanied by a stumbling pace and mild confusion, although the victim may appear alert. Surface blood vessels contract further as the body focuses its remaining resources on keeping the vital organs warm. The victim becomes pale. Lips, ears, fingers and toes may become blue.'' 
'''Severe''' 
''As the temperature decreases further physiological systems falter and heart rate, respiratory rate, and blood pressure all decreases. This results in an expected HR in the 30s with a temperature of 28 °C (82 °F).
Difficulty in speaking, sluggish thinking, and amnesia start to appear; inability to use hands and stumbling is also usually present. Cellular metabolic processes shut down. Below 30 °C (86 °F), the exposed skin becomes blue and puffy, muscle coordination becomes very poor, walking becomes almost impossible, and the person exhibits incoherent/irrational behavior including terminal burrowing or even a stupor. Pulse and respiration rates decrease significantly, but fast heart rates (ventricular tachycardia, atrial fibrillation) can occur. Major organs fail. Clinical death occurs. Because of decreased cellular activity in stage 3 hypothermia, the body will actually take longer to undergo brain death.'' 
'''Youtube Links:'''
* http://www.youtube.com/watch?v=2aHCfU8xur8&feature=related
* http://www.youtube.com/watch?v=2dodsozxoiA&feature=related (A bit dated information-wise at this point and more focused on water hypothermia but should give a good foundation((fast forward to 6 minutes for symptoms)) )
* http://www.youtube.com/watch?v=Bg5IaDB71oQ
* http://www.youtube.com/watch?v=FrwsXcVFd4o

===Frostbite===
'''''From Wikipedia:''''' 
''At or below 0 °C (32 °F), blood vessels close to the skin start to constrict, and blood is shunted away from the extremities via the action of glomus bodies. The same response may also be a result of exposure to high winds. This constriction helps to preserve core body temperature. In extreme cold, or when the body is exposed to cold for long periods, this protective strategy can reduce blood flow in some areas of the body to dangerously low levels. This lack of blood leads to the eventual freezing and death of skin tissue in the affected areas. There are four degrees of frostbite. Each of these degrees has varying degrees of pain.'' 
'''First degree''' 
''This is called frostnip and this only affects the surface skin, which is frozen. On the onset, there is itching and pain, and then the skin develops white, red, and yellow patches and becomes numb. The area affected by frostnip usually does not become permanently damaged as only the skin's top layers are affected. Long-term insensitivity to both heat and cold can sometimes happen after suffering from frostnip.'' 
'''Second degree''' 
''If freezing continues, the skin may freeze and harden, but the deep tissues are not affected and remain soft and normal. Second-degree injury usually blisters 1–2 days after becoming frozen. The blisters may become hard and blackened, but usually appear worse than they are. Most of the injuries heal in one month, but the area may become permanently insensitive to both heat and cold.'' 
'''Third and fourth degrees''' 
''If the area freezes further, deep frostbite occurs. The muscles, tendons, blood vessels, and nerves all freeze. The skin is hard, feels waxy, and use of the area is lost temporarily, and in severe cases, permanently. The deep frostbite results in areas of purplish blisters which turn black and which are generally blood-filled. Nerve damage in the area can result in a loss of feeling. This extreme frostbite may result in fingers and toes being amputated if the area becomes infected with gangrene. If the frostbite has gone on untreated, they may fall off. The extent of the damage done to the area by the freezing process of the frostbite may take several months to assess, and this often delays surgery to remove the dead tissue.'' 
'''Youtube Links:'''
* http://www.youtube.com/watch?v=4itZQwoR-kc&feature=related (good overview)
* http://www.youtube.com/watch?v=p4jOo4x_hDk&feature=related (Recognizing frostbite)
* http://www.youtube.com/watch?v=p17NmmARxEI&feature=relmfu (Treating frostbite)
* http://www.youtube.com/watch?v=yn2dPV0tsig&feature=related (Another good treating frostbite video)

==Cold Water Safety==
''(Less time invested in this section)'' 
''Youtube Links:''
* Cold water safety : http://www.youtube.com/watch?v=yYDASDLcJ28&feature=related
* Ice thickness check : http://www.youtube.com/watch?v=Din2V5BW0Dk
* Dunker : http://www.youtube.com/watch?v=oLqXlEGxXxo&feature=related
* Another Dunker: http://www.youtube.com/watch?v=1EHFwl9BYQM&feature=related

==Other==
If you've never filled a backpack before or aren't sure where to get started on how to fill your daypack for a day in the field here are a couple of youtubes:
* http://www.youtube.com/watch?v=foliCq-W2yE&feature=related
* http://www.youtube.com/watch?v=Cm3jISWuVb0&feature=related

Another good item is the Alaska Safety Handbook, co-written by ConocoPhillips Alaska, Eni Petroleum, ExxonMobil, Pioneer Natural Resources Alaska, Shell Exploration & Appraisal here's a link to the 2010 edition:
* Alaska Safety Handbook -- http://nstc.apicc.org/downloads/2010ASH.pdf