IARC 207 Wiki - User contributions [en]

C2-Blueberry Notes

2018-11-17T23:21:37Z

24.237.87.170:

===2018===
* 3m AT/RH
** 2/23/18 19:00 + sensor funktastic
* super weird duplication of time stamps day 58 2100 (2/27/2018 to 259 1600) just going to delete second fwiw.
* There is another unexplained gap 5/24/2018.

====Older Notes====

<pre>
AT10m --
Is gap/bad data 3/23/2003 to 4/11/2003 legit?
6999 out 5/23/2004 12:00 to 6/10/2004 19:00
Is gap/bad data 1/26/2008 to 6/13/2008 legit?
Is gap/bad data 12/18/2008 to 8/5/2009 legit?
Is bad data 12/23/2011 to present legit?

AT1m --
Is gap/bad data 3/23/2003 to 4/11/2003 legit?
6999 out 5/23/2004 12:00 to 6/10/2004 19:00
Is bad data 12/23/2011 to 8/6/2012 musk ox?

AT3m --
Is gap/bad data 3/23/2003 to 4/11/2003 legit?
6999 out 5/23/2004 15:00 to 6/10/2004 17:00

Is bad data 12/23/2011 to 8/6/2012 musk ox?

Battery --
Data gap 3/23/2003 to 4/11/2003 legit?
Super Funk 5/23/2004 12:00 to 6/10/2004 19:00 --> could it be a bear?
Dead Battery: 1/26/2008 to 6/13/2008

SM10 --
</pre>

C1-Grid Notes

2018-11-10T23:32:37Z

24.237.87.170: /* Met Data */

===Met Data===
====1999 - 2003====
* All sensors good
====2004====
* I wonder if precip stops late august 2004 (added to fix.xls)
====2005====
* Precip -- undercatch this summer season
====2006====
* Precip -- undercatch this summer season
====2007====
* Precip -- undercatch this summer season
====2008====
* Precip -- undercatch this summer season
====2009====
* Air Temperature: All Good
* Rain:
** Start: 5/20/2009 9:00
** End: 10/13/2009 6:00
** Precip -- undercatch this summer season
* RH: All Good
* WS/WD: All Good
====2010====
* Air Temperature: All Good
* Rain:
** Start: 5/12/2010 7:00
** End: 8/8/2010 13:00 (start of legit data gap)
** Precip -- undercatch this summer season
* RH: All Good
* WS/WD: All Good
====2011====
* Dead Battery: 1/1/2011 to 2/10/2011 13:00
* Air Temperature: All Good
* Rain:
** Start: 5/12/2011 9:00
** End: 10/15/2011 21:00
** Precip -- undercatch this summer season
* RH: All Good
** Dead Battery: 1/1/2011 to 2/10/2011 13:00
* WS/WD: All Good
====2012====
* Air Temperature: All Good
* Rain:
** Start: 5/15/2012 11:00
** End: 10/7/2012 9:00
** Data seems plausible again... after the august 2012 site visit.
* RH: All Good
* WS/WD: All Good
====2013====
* Air Temperature: All Good
* Rain:
** Start: 5/24/2013 8:00
** End: 10/29/2013 7:00
** Data seems plausible again
* RH: All Good
* WS/WD: All Good
====2014====
* Dead Battery 1/27/2014 13:00 to 2/6/2014 11:00
* Air Temperature: All Good
* Rain:
** Start: 5/7/2014 12:00
** End: 10/4/2014 1:00
** Data seems plausible again
* RH: All Good
* WS/WD: All Good
====2015====
* Dead Battery 1/1/15 0:00 to 1/25/15 12:00
* Air Temperature: All Good
* Rain:
** Start: 5/6/2015 9:00
** End: 9/25/2015 11:00
** Data seems plausible again
** precip remove calibration tips: 7/30/15 12:00 to 14:00
* RH: All Good
* WS/WD: All Good
====2016====
* Lognet vs loggerdata, two different programs fighting to change the timezone
** 3/29/2016 0;00 to 3/30/2016 7:00
* Air Temperature 1m snow covered:
* Rain:
** Start:
** End:
** Data is good
** WS/WD: All Good

====2017====
* Air Temperature 1m snow covered:
* Rain:
** Start:
** End:
* AT/RH 3m - funky electrical stuff:
**11/11/2017 14:00 & 15:00
** 11/21/2017 07:00 to 18:00
** 12/18/2017 19:00 to 12/23/2017 19:00
** WS/WD: All Good

====2018====
* Air Temperature 1m snow covered:
* Rain:
** Start:
** End:
** Data is good
** WS/WD: All Good

===Soils Data===
I think this is the thermistor model here (found an old spreadsheet from Andy):
D:\projects_usb_drive\UAF\From Crane\archived files from past workers\ANDYS\STUFF\Thermistortemplate.xls
=IF(A3>60,6999,IF(A3<3,6999,IF(A3=0,6999,IF(A3=-6999,-6999,IF(A3=6999,6999,1/(0.00128+0.000237*(LN(A3*1000))+0.0000000906*((LN(A3*1000))^3))-273.15)))))

Here is the info that matches that from my 'thermistor_information.xls'
Alpha 13A5001-DOC 5/29/1998 25694 275 ±0.1 C 1.28E-03 2.37E-04 9.06E-08
Found a spreadsheet here:
D:\projects_usb_drive\UAF\From Crane\archived files from past workers\ANDYS\ANDYWORK\SEWARD_PEN\COUNCIL\C1_3MTOWER_GRID_\WORKING\2000C1.xls
String 1:
Therm 1 = 5 cmbgs
Therm 2 = 10 cmbgs
Therm 3 = 15 cmbgs
Therm 4 = 20 cmbgs
Therm 5 = 30 cmbgs
Therm 6 = 40 cmbgs
String 2:
Therm 7 = 25 cmbgs
Therm 8 = 40 cmbgs
Therm 9 = 55 cmbgs
Therm 10 = 75 cmbgs
Therm 11 = 100 cmbgs
Therm 12 = 125 cmbgs
Soil Moisture:
5, 10, 15, 20, 30, 40 cmbgs

August 2008:
YSI 44004 Jessie 06D2432 -- ±0.2 C 0.001465769 0.000238619 0.000000100 -13.4 From Jessie installed on SP in August 2008

* I'll just note here, I wanted to extract old soil moisture data and using datapro on ''raw/c1-grid/RAW/CR10X_final_storage_1.dat'' the date index was totally screwed up. Well, the starting data was correct but the y values were out of order in a big way. I ended up grepping the 228 array into another text file and used that as the source for datapro. Messed me up for a good day or so.
 
* Ended up reprocessing the soil moisture data, the data archive was a mix of garbage and who knows what.

'''Need to confirm depths for all thermistors... otherwise complete'''
====1999====
* Soil temps: Good
* Soil Moisture: OK - Use data from archive

====2000====
* Soil temps: Good
* Soil Moisture: OK - Use data from archive
====2001====
* Soil temps: Good
* Soil Moisture: OK -- Use data from archive
====2002====
* Soil temps: Good
* Soil Moisture: OK -- Use reprocessed data
====2003====
* Soil temps: Couple blips in April, added to QA sheets.
* Soil Moisture: OK -- Use reprocessed data
====2004====
* Soil temps: Good
* Soil Moisture: OK -- Use reprocessed data
====2005====
* Soil temps: '''Accidentally Dropped from Record?'''
* Soil Moisture: OK -- Use reprocessed data
====2006====
* Soil temps: '''Accidentally Dropped from Record?'''
* Soil Moisture: OK -- Use reprocessed data
====2007====
* Soil temps: '''Accidentally Dropped from Record?'''
* Soil Moisture: OK -- Use reprocessed data
====2008====
* Soil temps: '''Accidentally Dropped from Record?;''' Need to add third string on bit of 2008 here.
* Soil Moisture: OK -- Use reprocessed data
====2009====
* Soil temps:OK
* Soil Moisture: OK -- Use reprocessed data
====2010====
* Soil temps: OK
* Soil Moisture: OK -- Use reprocessed data

====2011====
* Soil temps: Cable Chewed Fall 2011.
* Soil Moisture: OK -- Use reprocessed data

====2012====
* Soil temps:
* Soil Moisture: OK -- Use reprocessed data

====2013====
* Soil temps:
* Soil Moisture: OK -- Use reprocessed data

====2014====
* Soil temps:
* Soil Moisture: OK -- Use reprocessed data

====2015====
* Soil temps:
* Soil Moisture: OK -- Use reprocessed data

====MRC Probe====
* 2012 Summer jacked about 8 cm (from photo, Lumix TSC4)
* 2013: Did not visit
* 2014 7/22/14: Jacked out 16 cm (from photo)
* 2016 August: 37 cm (Cohen fieldbook)

@ Installation, 7/24/2011:
T1 7.6 cmbgs
T2 12.7 cm bgs
T3 22.9 cm bgs
T4 37.7 cm bgs
T5 52.5 cm bgs
T6 67.3 cm bgs
T7 82.7 cm bgs
T8 108 cm bgs

C1-Grid Notes

2018-11-10T02:30:33Z

24.237.87.170: /* 2015 */

===Met Data===
====1999 - 2003====
* All sensors good
====2004====
* I wonder if precip stops late august 2004 (added to fix.xls)
====2005====
* Precip -- undercatch this summer season
====2006====
* Precip -- undercatch this summer season
====2007====
* Precip -- undercatch this summer season
====2008====
* Precip -- undercatch this summer season
====2009====
* Air Temperature: All Good
* Rain:
** Start: 5/20/2009 9:00
** End: 10/13/2009 6:00
** Precip -- undercatch this summer season
* RH: All Good
* WS/WD: All Good
====2010====
* Air Temperature: All Good
* Rain:
** Start: 5/12/2010 7:00
** End: 8/8/2010 13:00 (start of legit data gap)
** Precip -- undercatch this summer season
* RH: All Good
* WS/WD: All Good
====2011====
* Air Temperature: All Good
** Dead Battery: 1/1/2011 to 2/10/2011 13:00
* Rain:
** Start: 5/12/2011 9:00
** End: 10/15/2011 21:00
** Precip -- undercatch this summer season
* RH: All Good
** Dead Battery: 1/1/2011 to 2/10/2011 13:00
* WS/WD: All Good
====2012====
* Air Temperature: All Good
* Rain:
** Start: 5/15/2012 11:00
** End: 10/7/2012 9:00
** Data seems plausible again... after the august 2012 site visit.
* RH: All Good
* WS/WD: All Good
====2013====
* Air Temperature: All Good
* Rain:
** Start: 5/24/2013 8:00
** End: 10/29/2013 7:00
** Data seems plausible again
* RH: All Good
* WS/WD: All Good
====2014====
* Air Temperature: All Good
* Rain:
** Start: 5/7/2014 12:00
** End: 10/4/2014 1:00
** Data seems plausible again
* RH: All Good
* WS/WD: All Good
====2015====
* Air Temperature: All Good
* Rain:
** Start: 5/6/2015 9:00
** End: 9/25/2015 11:00
** Data seems plausible again
** precip remove calibration tips: 7/30/15 12:00 to 14:00
* RH: All Good
* WS/WD: All Good
====2016====
* Air Temperature 1m snow covered:
* Rain:
** Start:
** End:
** Data is good
** WS/WD: All Good

====2017====
* Air Temperature 1m snow covered:
* Rain:
** Start:
** End:
** Data is good
** WS/WD: All Good

====2018====
* Air Temperature 1m snow covered:
* Rain:
** Start:
** End:
** Data is good
** WS/WD: All Good

===Soils Data===
I think this is the thermistor model here (found an old spreadsheet from Andy):
D:\projects_usb_drive\UAF\From Crane\archived files from past workers\ANDYS\STUFF\Thermistortemplate.xls
=IF(A3>60,6999,IF(A3<3,6999,IF(A3=0,6999,IF(A3=-6999,-6999,IF(A3=6999,6999,1/(0.00128+0.000237*(LN(A3*1000))+0.0000000906*((LN(A3*1000))^3))-273.15)))))

Here is the info that matches that from my 'thermistor_information.xls'
Alpha 13A5001-DOC 5/29/1998 25694 275 ±0.1 C 1.28E-03 2.37E-04 9.06E-08
Found a spreadsheet here:
D:\projects_usb_drive\UAF\From Crane\archived files from past workers\ANDYS\ANDYWORK\SEWARD_PEN\COUNCIL\C1_3MTOWER_GRID_\WORKING\2000C1.xls
String 1:
Therm 1 = 5 cmbgs
Therm 2 = 10 cmbgs
Therm 3 = 15 cmbgs
Therm 4 = 20 cmbgs
Therm 5 = 30 cmbgs
Therm 6 = 40 cmbgs
String 2:
Therm 7 = 25 cmbgs
Therm 8 = 40 cmbgs
Therm 9 = 55 cmbgs
Therm 10 = 75 cmbgs
Therm 11 = 100 cmbgs
Therm 12 = 125 cmbgs
Soil Moisture:
5, 10, 15, 20, 30, 40 cmbgs

August 2008:
YSI 44004 Jessie 06D2432 -- ±0.2 C 0.001465769 0.000238619 0.000000100 -13.4 From Jessie installed on SP in August 2008

* I'll just note here, I wanted to extract old soil moisture data and using datapro on ''raw/c1-grid/RAW/CR10X_final_storage_1.dat'' the date index was totally screwed up. Well, the starting data was correct but the y values were out of order in a big way. I ended up grepping the 228 array into another text file and used that as the source for datapro. Messed me up for a good day or so.
 
* Ended up reprocessing the soil moisture data, the data archive was a mix of garbage and who knows what.

'''Need to confirm depths for all thermistors... otherwise complete'''
====1999====
* Soil temps: Good
* Soil Moisture: OK - Use data from archive

====2000====
* Soil temps: Good
* Soil Moisture: OK - Use data from archive
====2001====
* Soil temps: Good
* Soil Moisture: OK -- Use data from archive
====2002====
* Soil temps: Good
* Soil Moisture: OK -- Use reprocessed data
====2003====
* Soil temps: Couple blips in April, added to QA sheets.
* Soil Moisture: OK -- Use reprocessed data
====2004====
* Soil temps: Good
* Soil Moisture: OK -- Use reprocessed data
====2005====
* Soil temps: '''Accidentally Dropped from Record?'''
* Soil Moisture: OK -- Use reprocessed data
====2006====
* Soil temps: '''Accidentally Dropped from Record?'''
* Soil Moisture: OK -- Use reprocessed data
====2007====
* Soil temps: '''Accidentally Dropped from Record?'''
* Soil Moisture: OK -- Use reprocessed data
====2008====
* Soil temps: '''Accidentally Dropped from Record?;''' Need to add third string on bit of 2008 here.
* Soil Moisture: OK -- Use reprocessed data
====2009====
* Soil temps:OK
* Soil Moisture: OK -- Use reprocessed data
====2010====
* Soil temps: OK
* Soil Moisture: OK -- Use reprocessed data

====2011====
* Soil temps: Cable Chewed Fall 2011.
* Soil Moisture: OK -- Use reprocessed data

====2012====
* Soil temps:
* Soil Moisture: OK -- Use reprocessed data

====2013====
* Soil temps:
* Soil Moisture: OK -- Use reprocessed data

====2014====
* Soil temps:
* Soil Moisture: OK -- Use reprocessed data

====2015====
* Soil temps:
* Soil Moisture: OK -- Use reprocessed data

====MRC Probe====
* 2012 Summer jacked about 8 cm (from photo, Lumix TSC4)
* 2013: Did not visit
* 2014 7/22/14: Jacked out 16 cm (from photo)
* 2016 August: 37 cm (Cohen fieldbook)

@ Installation, 7/24/2011:
T1 7.6 cmbgs
T2 12.7 cm bgs
T3 22.9 cm bgs
T4 37.7 cm bgs
T5 52.5 cm bgs
T6 67.3 cm bgs
T7 82.7 cm bgs
T8 108 cm bgs

NGEE Teller SW Notes

2018-11-08T02:11:07Z

24.237.87.170: /* Stage 2017 */

[[NGEE]]
===General===
* Look over bash script... need to make sure that QA corrections take place after stage is corrected to match rebar values...
* I'm looking at the 2017 April 27 & 28 discharge measurement times and the corrected data looks great but the raw data looks like it has the shift applied too early. Perhaps that is unavoidable? I'll think on it. but currently not fixed 11/7/2018

===Latest===
* Unofficially processed through 9/2018
** there are some early winter 2017 peaks I think should be considered.
* hoping to establish stage/discharge curve in 2018

===Stage 2016===

8/13/2016 3:00 PTs offset
9/14/2016 22:00 PT1 Position Reset & PT2 Removed
* 2016 Offsets for corrected PT 1 Stage:
"2016-08-13 03:00:00",-0.61
"2016-08-15 02:30:00",-0.49
"2016-09-14 22:00:00",-1.83

===Stage 2017===

4/1/2017 3:00 Station Turned back on, PT2 in place further downstream
10/1/2017 20:00 PT2 Removed
4/28/2017 1:50 shift in pt2? then

* Offset for 4/1/2017+
"2017-04-01 01:30:00",-3.10

===Stage 2018===
6/15/2018 12:40 AKDT 12cm above rebar 1; 20.5 cm in front of rebar 1
9/24/2018 18:50 AKDT 3cm above rebar 1; 13cm in front of rebar 1
9/26/2018 10:48 AKDT 5cm above rebar 1; 14.5cm in front of rebar 1

===Site Downloads / visits:===
* Bob 4/21/2016 (CR1000)
* Lily 7/13/2016 (CR1000)
* Bob/Lily 8/12/2016 (CR1000)
* Bob 9/14/2016
* Bob 4/1/2017
* Bob 5/2017
* Bob/Lily 10/1/2017
* Bob 3/30/2018
* Bob 6/13 & 15/2018
* Bob 9/26/2018

===From Computer Notes===
Need to put into a spreadsheet pressure transducer value / date / manual stage reading.... need to review notes.

Related: discharge measurements
Related: Get manual stage & discharge measurements into UTC time.

Then once that is complete can look at using
/var/site/uaf_sp/bin/teller_sw.sh
and the step utility function to correct everything to proper heights.
...should think about gedit plug ins too to make it more like xed.

Original Google Doc:
* https://docs.google.com/spreadsheets/d/159Q7kFOTAE0pZyx2WgFBhe4qVnLEEM8diSVuSYGRkjE/edit#gid=1602029777
Summary Google Doc:
* https://docs.google.com/spreadsheets/d/1gxLKzjoDvJkFmkDe0SVBhRRbokB-rvEpH77nN8cyLo0/edit#gid=1602029777

2/8: So.... including precip helps but there is still a period in september / october 2016 that confuses me with the diurnal signal looking more like air temperature driven. Emily and I sort of think that the heating of the cable might be playing a role here but I haven't looked too hard yet.

NGEE Teller SW Notes

2018-11-08T00:39:44Z

24.237.87.170: /* General */

[[NGEE]]
===General===
* Look over bash script... need to make sure that QA corrections take place after stage is corrected to match rebar values...
* I'm looking at the 2017 April 27 & 28 discharge measurement times and the corrected data looks great but the raw data looks like it has the shift applied too early. Perhaps that is unavoidable? I'll think on it. but currently not fixed 11/7/2018

===Latest===
* Unofficially processed through 9/2018
** there are some early winter 2017 peaks I think should be considered.
* hoping to establish stage/discharge curve in 2018

===Stage 2016===

8/13/2016 3:00 PTs offset
9/14/2016 22:00 PT1 Position Reset & PT2 Removed
* 2016 Offsets for corrected PT 1 Stage:
"2016-08-13 03:00:00",-0.61
"2016-08-15 02:30:00",-0.49
"2016-09-14 22:00:00",-1.83

===Stage 2017===

4/1/2017 3:00 Station Turned back on, PT2 in place further downstream
10/1/2017 20:00 PT2 Removed
4/28/2017 1:50 shift in pt2? then

===Stage 2018===
6/15/2018 12:40 AKDT 12cm above rebar 1; 20.5 cm in front of rebar 1
9/24/2018 18:50 AKDT 3cm above rebar 1; 13cm in front of rebar 1
9/26/2018 10:48 AKDT 5cm above rebar 1; 14.5cm in front of rebar 1

===Site Downloads / visits:===
* Bob 4/21/2016 (CR1000)
* Lily 7/13/2016 (CR1000)
* Bob/Lily 8/12/2016 (CR1000)
* Bob 9/14/2016
* Bob 4/1/2017
* Bob 5/2017
* Bob/Lily 10/1/2017
* Bob 3/30/2018
* Bob 6/13 & 15/2018
* Bob 9/26/2018

===From Computer Notes===
Need to put into a spreadsheet pressure transducer value / date / manual stage reading.... need to review notes.

Related: discharge measurements
Related: Get manual stage & discharge measurements into UTC time.

Then once that is complete can look at using
/var/site/uaf_sp/bin/teller_sw.sh
and the step utility function to correct everything to proper heights.
...should think about gedit plug ins too to make it more like xed.

Original Google Doc:
* https://docs.google.com/spreadsheets/d/159Q7kFOTAE0pZyx2WgFBhe4qVnLEEM8diSVuSYGRkjE/edit#gid=1602029777
Summary Google Doc:
* https://docs.google.com/spreadsheets/d/1gxLKzjoDvJkFmkDe0SVBhRRbokB-rvEpH77nN8cyLo0/edit#gid=1602029777

2/8: So.... including precip helps but there is still a period in september / october 2016 that confuses me with the diurnal signal looking more like air temperature driven. Emily and I sort of think that the heating of the cable might be playing a role here but I haven't looked too hard yet.

NGEE Teller SW Notes

2018-11-08T00:32:24Z

24.237.87.170: /* Latest */

[[NGEE]]
===General===
* Look over bash script... need to make sure that QA corrections take place after stage is corrected to match rebar values...
===Latest===
* Unofficially processed through 9/2018
** there are some early winter 2017 peaks I think should be considered.
* hoping to establish stage/discharge curve in 2018

===Stage 2016===

8/13/2016 3:00 PTs offset
9/14/2016 22:00 PT1 Position Reset & PT2 Removed
* 2016 Offsets for corrected PT 1 Stage:
"2016-08-13 03:00:00",-0.61
"2016-08-15 02:30:00",-0.49
"2016-09-14 22:00:00",-1.83

===Stage 2017===

4/1/2017 3:00 Station Turned back on, PT2 in place further downstream
10/1/2017 20:00 PT2 Removed
4/28/2017 1:50 shift in pt2? then

===Stage 2018===
6/15/2018 12:40 AKDT 12cm above rebar 1; 20.5 cm in front of rebar 1
9/24/2018 18:50 AKDT 3cm above rebar 1; 13cm in front of rebar 1
9/26/2018 10:48 AKDT 5cm above rebar 1; 14.5cm in front of rebar 1

===Site Downloads / visits:===
* Bob 4/21/2016 (CR1000)
* Lily 7/13/2016 (CR1000)
* Bob/Lily 8/12/2016 (CR1000)
* Bob 9/14/2016
* Bob 4/1/2017
* Bob 5/2017
* Bob/Lily 10/1/2017
* Bob 3/30/2018
* Bob 6/13 & 15/2018
* Bob 9/26/2018

===From Computer Notes===
Need to put into a spreadsheet pressure transducer value / date / manual stage reading.... need to review notes.

Related: discharge measurements
Related: Get manual stage & discharge measurements into UTC time.

Then once that is complete can look at using
/var/site/uaf_sp/bin/teller_sw.sh
and the step utility function to correct everything to proper heights.
...should think about gedit plug ins too to make it more like xed.

Original Google Doc:
* https://docs.google.com/spreadsheets/d/159Q7kFOTAE0pZyx2WgFBhe4qVnLEEM8diSVuSYGRkjE/edit#gid=1602029777
Summary Google Doc:
* https://docs.google.com/spreadsheets/d/1gxLKzjoDvJkFmkDe0SVBhRRbokB-rvEpH77nN8cyLo0/edit#gid=1602029777

2/8: So.... including precip helps but there is still a period in september / october 2016 that confuses me with the diurnal signal looking more like air temperature driven. Emily and I sort of think that the heating of the cable might be playing a role here but I haven't looked too hard yet.

NGEE Teller SW Notes

2018-11-08T00:30:27Z

24.237.87.170: /* Stage 2016 */

[[NGEE]]
===Latest===
* Unofficially processed through 9/2018
** there are some early winter 2017 peaks I think should be considered.
* hoping to establish stage/discharge curve in 2018

===Stage 2016===

8/13/2016 3:00 PTs offset
9/14/2016 22:00 PT1 Position Reset & PT2 Removed
* 2016 Offsets for corrected PT 1 Stage:
"2016-08-13 03:00:00",-0.61
"2016-08-15 02:30:00",-0.49
"2016-09-14 22:00:00",-1.83

===Stage 2017===

4/1/2017 3:00 Station Turned back on, PT2 in place further downstream
10/1/2017 20:00 PT2 Removed
4/28/2017 1:50 shift in pt2? then

===Stage 2018===
6/15/2018 12:40 AKDT 12cm above rebar 1; 20.5 cm in front of rebar 1
9/24/2018 18:50 AKDT 3cm above rebar 1; 13cm in front of rebar 1
9/26/2018 10:48 AKDT 5cm above rebar 1; 14.5cm in front of rebar 1

===Site Downloads / visits:===
* Bob 4/21/2016 (CR1000)
* Lily 7/13/2016 (CR1000)
* Bob/Lily 8/12/2016 (CR1000)
* Bob 9/14/2016
* Bob 4/1/2017
* Bob 5/2017
* Bob/Lily 10/1/2017
* Bob 3/30/2018
* Bob 6/13 & 15/2018
* Bob 9/26/2018

===From Computer Notes===
Need to put into a spreadsheet pressure transducer value / date / manual stage reading.... need to review notes.

Related: discharge measurements
Related: Get manual stage & discharge measurements into UTC time.

Then once that is complete can look at using
/var/site/uaf_sp/bin/teller_sw.sh
and the step utility function to correct everything to proper heights.
...should think about gedit plug ins too to make it more like xed.

Original Google Doc:
* https://docs.google.com/spreadsheets/d/159Q7kFOTAE0pZyx2WgFBhe4qVnLEEM8diSVuSYGRkjE/edit#gid=1602029777
Summary Google Doc:
* https://docs.google.com/spreadsheets/d/1gxLKzjoDvJkFmkDe0SVBhRRbokB-rvEpH77nN8cyLo0/edit#gid=1602029777

2/8: So.... including precip helps but there is still a period in september / october 2016 that confuses me with the diurnal signal looking more like air temperature driven. Emily and I sort of think that the heating of the cable might be playing a role here but I haven't looked too hard yet.

NGEE Teller SW Notes

2018-11-02T22:34:24Z

24.237.87.170: /* Stage 2018 */

[[NGEE]]
===Latest===
* Unofficially processed through 9/2018
** there are some early winter 2017 peaks I think should be considered.
* hoping to establish stage/discharge curve in 2018

===Stage 2016===

8/13/2016 3:00 PTs offset
9/14/2016 22:00 PT1 Position Reset & PT2 Removed
===Stage 2017===

4/1/2017 3:00 Station Turned back on, PT2 in place further downstream
10/1/2017 20:00 PT2 Removed
4/28/2017 1:50 shift in pt2? then

===Stage 2018===
6/15/2018 12:40 AKDT 12cm above rebar 1; 20.5 cm in front of rebar 1
9/24/2018 18:50 AKDT 3cm above rebar 1; 13cm in front of rebar 1
9/26/2018 10:48 AKDT 5cm above rebar 1; 14.5cm in front of rebar 1

===Site Downloads / visits:===
* Bob 4/21/2016 (CR1000)
* Lily 7/13/2016 (CR1000)
* Bob/Lily 8/12/2016 (CR1000)
* Bob 9/14/2016
* Bob 4/1/2017
* Bob 5/2017
* Bob/Lily 10/1/2017
* Bob 3/30/2018
* Bob 6/13 & 15/2018
* Bob 9/26/2018

===From Computer Notes===
Need to put into a spreadsheet pressure transducer value / date / manual stage reading.... need to review notes.

Related: discharge measurements
Related: Get manual stage & discharge measurements into UTC time.

Then once that is complete can look at using
/var/site/uaf_sp/bin/teller_sw.sh
and the step utility function to correct everything to proper heights.
...should think about gedit plug ins too to make it more like xed.

Original Google Doc:
* https://docs.google.com/spreadsheets/d/159Q7kFOTAE0pZyx2WgFBhe4qVnLEEM8diSVuSYGRkjE/edit#gid=1602029777
Summary Google Doc:
* https://docs.google.com/spreadsheets/d/1gxLKzjoDvJkFmkDe0SVBhRRbokB-rvEpH77nN8cyLo0/edit#gid=1602029777

2/8: So.... including precip helps but there is still a period in september / october 2016 that confuses me with the diurnal signal looking more like air temperature driven. Emily and I sort of think that the heating of the cable might be playing a role here but I haven't looked too hard yet.

NGEE Teller SW Notes

2018-11-02T18:41:09Z

24.237.87.170: /* Stage 2018 */

[[NGEE]]
===Latest===
* Unofficially processed through 9/2018
** there are some early winter 2017 peaks I think should be considered.
* hoping to establish stage/discharge curve in 2018

===Stage 2016===

8/13/2016 3:00 PTs offset
9/14/2016 22:00 PT1 Position Reset & PT2 Removed
===Stage 2017===

4/1/2017 3:00 Station Turned back on, PT2 in place further downstream
10/1/2017 20:00 PT2 Removed
4/28/2017 1:50 shift in pt2? then

===Stage 2018===
6/15
9/24/2018 18:50 AKDT 3cm above rebar 1; 13cm in front of rebar 1
9/26/2018 10:48 AKDT 5cm above rebar 1; 14.5cm in front of rebar 1

===Site Downloads / visits:===
* Bob 4/21/2016 (CR1000)
* Lily 7/13/2016 (CR1000)
* Bob/Lily 8/12/2016 (CR1000)
* Bob 9/14/2016
* Bob 4/1/2017
* Bob 5/2017
* Bob/Lily 10/1/2017
* Bob 3/30/2018
* Bob 6/13 & 15/2018
* Bob 9/26/2018

===From Computer Notes===
Need to put into a spreadsheet pressure transducer value / date / manual stage reading.... need to review notes.

Related: discharge measurements
Related: Get manual stage & discharge measurements into UTC time.

Then once that is complete can look at using
/var/site/uaf_sp/bin/teller_sw.sh
and the step utility function to correct everything to proper heights.
...should think about gedit plug ins too to make it more like xed.

Original Google Doc:
* https://docs.google.com/spreadsheets/d/159Q7kFOTAE0pZyx2WgFBhe4qVnLEEM8diSVuSYGRkjE/edit#gid=1602029777
Summary Google Doc:
* https://docs.google.com/spreadsheets/d/1gxLKzjoDvJkFmkDe0SVBhRRbokB-rvEpH77nN8cyLo0/edit#gid=1602029777

2/8: So.... including precip helps but there is still a period in september / october 2016 that confuses me with the diurnal signal looking more like air temperature driven. Emily and I sort of think that the heating of the cable might be playing a role here but I haven't looked too hard yet.

SS Site Visit 2018-10

2018-10-30T23:03:08Z

24.237.87.170: Created page with "From Go on 10/19: *https://drive.google.com/drive/folders/1zS3maTvdQy8Aa2fGAXcW9jAY1oZI4M15 I visited in early October * replaced SR50A transducers * replaced skin temperatu..."

From Go on 10/19:
*https://drive.google.com/drive/folders/1zS3maTvdQy8Aa2fGAXcW9jAY1oZI4M15

I visited in early October
* replaced SR50A transducers
* replaced skin temperature sensors

Super-Site

2018-10-30T23:02:06Z

24.237.87.170: /* Visits */

[[Super Site Tower]] 
[[Super Site LI-COR Parts Inventory]]

====Visits====
* [[SS Jan 2011 Trip 1]]
* [[SS Feb 2011 Trip 1]]
* [[SS Mar 2011 Trip 1]]
* [[SS Mar 2011 Trip 2]]
* [[SS June/Jul 2011 Trip 1]]
* [[SS May 2016 Trip 1]]
* [[SS August 2016 Trip 1]]
* [[SS Site Visit 2017-08-03]]
* [[SS Site Visit 2017-09-12]]
* [[SS Site Visit 2017-09-26]]
* [[SS Site Visit 2017-10-13]]
* [[SS Site Visit 2017-12-15]]
* [[SS Site Visit 2018-03-03]]
* [[SS Site Visit 2018-03-22]]
* [[SS Site Visit 2018-04-18]]
* [[SS Site Visit 2018-05-01 to 04]]
* [[SS Site Visit 2018-05-22]]
* [[SS Site Visit 2018-07-02]]
* [[SS Site Visit 2018-07-06]]
* [[SS Site Visit 2018-07-21]]
* [[SS Site Visit 2018-08-01]]
* [[SS Site Visit 2018-09-08]]
* [[SS Site Visit 2018-10]]
* [[SS To Do Next Visit]]

===Current Programs===
CSI Signature Values on 2014-08-11... checked from Dropbow/Logger_programs/super-site/:

==> SS_Diag_Diagnostic.dat <==
"TOA5","SS_Diag","CR1000","29724","CR1000.Std.20","CPU:ss_diag_2011-01-25.CR1","30274","Diagnostic"
30274 ss_diag_2011-01-25.CR1

==> SS_Eco_1_AirTemps.dat <==
"TOA5","SS_Eco_1","CR1000","13604","CR1000.Std.22","CPU:ss_eco1_2012-07-10.CR1","10119","AirTemps"
10119 ss_eco1_2012-07-10.CR1

==> SS_HeatFlux_1_Diagnostic.dat <==
"TOA5","SS_HeatFlux_1","CR1000","47954","CR1000.Std.24","CPU:ss_hf_2012-10-09.CR1","31220","Diagnostic"
31220 ss_hf_2012-10-09.CR1

==> SS_Met_AirTemps.dat <==
"TOA5","SS_Met","CR1000","30801","CR1000.Std.20","CPU:ss_met_2013-03-06.CR1","47292","AirTemps"
47292 ss_met_2013-03-06.CR1

==> SS_SnowTemp_Diagnostic.dat <==
"TOA5","SS_SnowTemp","CR1000","22972","CR1000.Std.16","CPU:ss_snow_pro_2011-10-10.CR1","19271","Diagnostic"
19271 ss_snow_pro_2011-10-10.CR1

==> SS_Soil_Diagnostic.dat <==
"TOA5","SS_Soil","CR1000","29723","CR1000.Std.20","CPU:ss_soil_2010-11-03.CR1","11488","Diagnostic"
11488 ss_soil_2010-11-03.CR1

===PFA Cameras===
user: pfa

This is the tower uplooking Serial to USB converter:
root@pfa-CF-AX3SEGJR:/home/PFA_/public_html/original/dc# udevadm info -a -n /dev/ttyUSB0 | grep '{serial}' | head -n1
ATTRS{serial}=="0000:00:14.0"

Forest Floor: /dev/serial/by-path/pci-0000:00:14.0-usb-0:1:1.0-port0
Tower Top: /dev/serial/by-path/pci-0000:00:14.0-usb-0:2:1.0-port0

If you see a message like this in the logs:
Error 10003: eph_waitsig got -2
The camera is probably not turned on. To power on the tower top camera, press the button on the beige box for 2-3 seconds. To turn on the Forest Floor camera you will need to open the domed box and physically turn the power on. 

Images recorded on the cron schedule show here:
* http://monitors.iarc.uaf.edu/poker-flat-research-range/cameras.php
Manually recorded measurements, such as when running the scrip from a terminal window, show up here:
/home/PFA_/public_html/original/dc

===Computers currently at Shed (7/2017)===
* Eddy Flux Tower Top Toughbook CF-31
** 64 bit Windows 7
** hostname: ''tower''
** purpose: log & manage tower top LICOR 7200
* Eddy Flux Forest Floor Toughbook CF-31
** 64 bit Windows 7
** hostname: ''ForestFloor''
** purpose: log & manage forest floor LICOR 7200
* ss-main Toughbook cf-19
** Debian
** hostname: ss-main
** purpose: logs super-site met etc. CR1000 systems
* DTS Toughbook CF-19
** Windows 7
** hostname: ''dts-jics-PC''
** purpose: log & manage DTS system
* MS700 Hyperspectral computer: Sony Vaio laptop
** Japanese Windows 10
** hostname: ''JAMSTECVAIO''
** purpose: LoggerNet for MS700 CR3000 logger
* All Sky Cam Laptop
** Ubuntu 16.04
** hostname: ''pfa-CF-AX3SEGJR''
** purpose: downloads images from up & down looking cameras
* Fiberswitch Small Dell Notepad
** Windows 10
** hostname: ''DELL-HK''
** purpose: manages HR400 system
* JICS PC#1 Toshiba Laptop
** Windows 7
** hostname: ''JICS1-PC''
** purpose: Dropbox backup at the moment for Eddy Flux data
====Other Computer Items====
* Hawking Technology Wireless Access Point
** Signal ID: SS_Wifi
* Ubiquiti M2 Bullet
** Located at tower top w/ power of ethernet injector in shed, this is our access to the Poker Internet Infrastructure.
* Net Gear 16 Port 10/100 Switch
===Forest Floor Flux Bonus info===
* batch file to automove data to dropbox:
move c:\users\user\documents\* "C:\Users\user\Dropbox (JAMSTEC_PFRRdata)\pfrrflux\usprr_flux_original\archive_rawflux\floor\2018\"
* scheduled task set up to run this daily.

===Tower Flux Bonus info===
* Use this batch file to transfer flux data to dropbox:
move c:\users\user\documents\* "C:\Users\user\Dropbox (JAMSTEC_PFRRdata)\PFRRflux\USprr_Flux_Original\Archive_rawflux\Tower\2018\7200RS\"

* Winscp script set up plus batch file running through task scheduler to transfer data from ss-met to dropbox:
"C:\Program Files (x86)\WinSCP\WinSCP.com" /script="c:\users\user\scripting\winscp_metdata.txt"

* contents of '''winscp_metdata.txt'''
open sftp://192.168.10.110
synchronize local "C:\Users\user\Dropbox (JAMSTEC_PFRRdata)\PFRRflux\USprr_Flux_Original\MeteorologicalData\Met" /var/opt/CampbellSci/LoggerNet/4.1/SS_Met
synchronize local "C:\Users\user\Dropbox (JAMSTEC_PFRRdata)\PFRRflux\USprr_Flux_Original\MeteorologicalData\Soil" /var/opt/CampbellSci/LoggerNet/4.1/SS_Soil
exit
* Current raw archive:
C:\Users\user\Dropbox (JAMSTEC_PFRRdata)\PFRRflux\USprr_Flux_Original\Archive_rawflux\Tower\2018\7200RS

* Both of these batch files run as separate scheduled tasks under Task scheduler.
** Met data transfers at 9:10 AK STD
** Flux data transfers at 1:08 AK STD

===Older Content===

Here's a page started by Bob. Not sure how often I'll be adding stuff but it's been on my to-do list. Thought I'd start with packages added to the toughbook.
===COTS network system===
It's not the cheapest way to go but I thought going for commercial hardware for the network components would be the way to go. We'll see once the site is operational for a winter or two. Presently, what I have going on is something like this:

This antenna picks up WiFi from a building at PFRR: 
[http://www.radiolabs.com/products/antennas/2.4gig/backfire.php RadioLabs very directional antenna] 

This WiFi adapter has a linux compatible chipset and was easy to setup: 
[http://www.radiolabs.com/products/wireless/wave-magnum.php RadioLabs Magnum II USB Adapter] 
This powered USB extender (extend using ethernet cable from box to box) allows the usb wifi adapter to be up on the tower, minimizing the coax losses on the run to the antenna: 
[http://www.networktechinc.com/usbc5.html XTENDEX USB-C5-CE] 
I picked up some underground burial suitable Cat5E to go from the computer usb extender to the tower usb extender: 
[http://www.buy.com/prod/75ft-outdoor-waterproof-cat5e-ethernet-cable-direct-burial/q/sellerid/18349122/loc/101/211959049.html purchase link] 
So those items combine to get you to the computer.

I have two CSI white boxes. One to house the computer and one to house the tower USB & WiFi stuff. Each is lined with blueboard, sealed with duct seal, and has some extra desiccant to keep it dry, hopefully warm enough in the cold, time will tell on that though. I'll crunch the numbers at some point to see how much heat is being generated / how quickly it's dissipating.
I don't expect to need to use the toughbook directly, should be available for sshing from UAF proper or via wired ethernet onsite but on the off chance I do need to connect locally, I have a VGA adapter connected to the computer and will leave a surplussed CRT monitor out at the site. Connection to the laptop will be via a bluetooth keyboard/touchpad combo: 
[http://www.mwave.com/mwave/skusearch_v3.asp?scriteria=5177008&pagetitle=Solidtek%20KB-3962B-BT%20Mini%20Bluetooth%20Wireless%20Keyboard%20B purchase link] 

The computer is then connected to a network switch. This allows it to connect to the local NL100 and handle any local DHCP traffic. Probably a future upgrade will be a wireless bridge to allow other computers access to the internet / reduce the amount of brittle cabling laying about in the shed. See below for information and particulars of the software setup.

====Toughbook Setup====
Stock Debian with a few extra packages installed like Numpy, TeamViewer, LoggerNet for Linux

Currently use a Ubiqiti device to provide local network accesss.
192.168.10.x subnet I think.

====PakBus etc.====
Computer MD485:
RS485 & RS232 Active
RS485@ 38k
RS232@ 115.2k

Logger MD485s are setup:
RS485 & CSI/O active
CSI/O Mode -- Modem Enabled
Transparent communication mode
CSI/O @ 38k
RS485 @ 38k

Data loggers:
add-device pakbus-port {PakBusPort} as-child {ComPort};
add-device CR1000 {SS_Met} as-child {PakBusPort}; (420)
add-device CR1000 {SS_Soil} as-child {PakBusPort}; (421)
add-device CR1000 {SS_Diag} as-child {PakBusPort}; (422)
add-device CR1000 {SS_SnowTemp} as-child {PakBusPort}; (424)
add-device CR1000 {SS_Eco_1} as-child {PakBusPort}; (423)
add-device CR1000 {SS_HeatFlux_1} as-child {PakBusPort}; (425)

====Field Visit Checklists====

NGEE Seward Survey Notes

2018-10-30T23:01:11Z

24.237.87.170:

===2017 Additions===
* March 28 2017 - confirmed in fieldbook, pg 1 of bob busey ngee 2017 snow surveys (UAF Trimble R8)
** Rover at 1.219m to bottom of antenna mount
** Base at 1.435m to antenna phase center (137cm to OPUS ARP))
* March 27 2017 - 4/14/2017
* Teller top GCP 127cm nail to bumper (121.5cm to OPUS ARP)

* On the 4/21/2016 to 5/2/2016 trip RTK corrections were supplied from a point measured on the first trip that wasn't surveyed properly. So, make note if a transformation has been applied... perhaps I will include the points on this page or a link to the corrections.
* kind of wanted to get a placeholder here for things to forget about.
* I guess I can also add for the purposes of the second trip the base was treated as here in the original data:
Point ID Northing Easting Height
tlrbcp02 7178309.855 454856.459 83.358

* Running raw gps data through Opus results in the site moving to:
Point ID Northing Easting Height
tlrbcp02--OPUS 7178293.021 454866.017 75.523

* On the first trip there were three bases (at the moment positions listed here are uncorrected from OPUS :
Point ID Northing Easting Height
telsnw2 7178275.291 455045.841 85.667 [Initial base... dug down 1m or so into a snow drift... not suitable for permanent]
nrtel8bs 7180048.627 454031.405 261.143 [Top line base... turns out could only access the GP1-2 line, GP7-11 line, and most of the GP17-21 line] ... moved base to tlrbcp01 after telemetry problems
tlrbcp01 7178216.425 454700.166 88.422 [Located on the bottom of watershed, 3 foot screed stake in ground here], used after base repositioned to bottom of hill for Bob, Cathy, and Lily measurements

1 ) export points from trimble biz center as csv
2 ) organize points for layout & naming convention as is done in google sheet
3 ) convert geopdf to geotiff in arc
4 ) Compare OPUS position to position used in snow melt survey
5 ) compute difference
6 ) apply difference to points using rtk for snow melt survey (just x & y for now)
7 )

Adjust a point using output from OPUS:
http://geoline.com/wp-content/uploads/2014/01/TechTalk_TBC_Workflow_OPUS_.xml-files.pdf

* Could we use the XYZ data to better constrain the creek position?

<pre>
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750980.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751120.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751040.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751141.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751140.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751191.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750960.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751030.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751122.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750990.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750962.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750951.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750931.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750950.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751151.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750961.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751130.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751121.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751142.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/2016September_Files/2016-09-13/31752570.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/2016September_Files/2016-09-10 (Bottom GCP)/31752541.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/2016September_Files/New folder/31752553.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/2016September_Files/2016-08-24 (House)/31752370.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/2016September_Files/2016-09-12 (Top Nail)/31752560.T02
9//home/bob/Dropbox/uaf/Teller 2016 Surveys/2016September_Files/2016-09-13-2 Kougarok/31752571.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Council/31752321.T02
/home/bob/Dropbox/uaf/GIS/kougarok_m64-2017/31752571.T02
/home/bob/Dropbox/uaf/GIS/Cherry/Eagle 4/32912824.T02
/home/bob/Dropbox/uaf/GIS/Cherry/Eagle 1/31752821.T02
/home/bob/Dropbox/uaf/GIS/Cherry/FAI_Airport/31752155.T02
/home/bob/Dropbox/uaf/GIS/Cherry/Eagle 5/32912831.T02
/home/bob/Dropbox/uaf/GIS/Cherry/Eagle 3/32912822.T02
/home/bob/Dropbox/uaf/GIS/Cherry/August 2/31752321.T02
/home/bob/Dropbox/uaf/GIS/Cherry/Eagle 2/32912820.T02
/home/bob/Dropbox/uaf/GIS/Cherry/Eagle 6/32912833.T02
/home/bob/Dropbox/uaf/GIS/ABOVE Aug 2017/icecut-base.T02
/home/bob/Dropbox/uaf/GIS/ABOVE Aug 2017/southplot-base.T02
/home/bob/Dropbox/uaf/GIS/ABOVE Aug 2017/southplot-base-short.T02
/home/bob/Dropbox/uaf/GIS/ABOVE Aug 2017/happy-valley-base.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750851.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750850.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31751141.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31751191.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31752751.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750840.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750891.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750960.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750900.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750841.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31751151.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31752741.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31751121.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750901.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750851.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750850.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912820.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/icecut-base.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31752761.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912832.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/southplot-base.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/southplot-base-short.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31752751.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750840.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750891.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912830.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750900.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912824.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912821.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750841.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912831.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912822.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31752741.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912823.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912833.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750890.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/happy-valley-base.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750901.T02
/home/bob/Dropbox/uaf/GIS/2018 Fall Nome/Trip GPS Data/31752673.T02
/home/bob/Dropbox/uaf/GIS/2018 Fall Nome/Trip GPS Data/31752671.T02
/home/bob/Dropbox/uaf/GIS/2018 Fall Nome/Trip GPS Data/31752682.T02
/home/bob/Dropbox/uaf/GIS/2018 Fall Nome/Trip GPS Data/31752651.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750851.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750850.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31751141.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31751191.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750840.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750891.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750960.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750900.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750841.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750951.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31752741.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31751121.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750890.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750901.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092400.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092341.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092370.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092390.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092371.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092271.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092360.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092391.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092403.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092270.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092402.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092300.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092408.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092301.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092272.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092331.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092320.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092405.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092361.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092330.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092407.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092302.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092401.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092409.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092340.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092406.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092404.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (April)/79090872.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (April)/79090880.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (April)/79090871.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (April)/79090870.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (April)/79090881.T02
/home/bob/Dropbox/surveyGPS/31752020.T02
</pre>

===2018 Kougarok Fall Survey Loose Ends===
* Looks like we only did 2 of the n points at KG-DSLT-4 (or maybe once things are set I should re-open the original Trimble Job File and see if they went missing for some reason.
* Completely missed KG-AS-2
*

NGEE Seward Survey Notes

2018-10-22T19:42:39Z

24.237.87.170:

===2017 Additions===
* March 28 2017 - confirmed in fieldbook, pg 1 of bob busey ngee 2017 snow surveys (UAF Trimble R8)
** Rover at 1.219m to bottom of antenna mount
** Base at 1.435m to antenna phase center (137cm to OPUS ARP))
* March 27 2017 - 4/14/2017
* Teller top GCP 127cm nail to bumper (121.5cm to OPUS ARP)

* On the 4/21/2016 to 5/2/2016 trip RTK corrections were supplied from a point measured on the first trip that wasn't surveyed properly. So, make note if a transformation has been applied... perhaps I will include the points on this page or a link to the corrections.
* kind of wanted to get a placeholder here for things to forget about.
* I guess I can also add for the purposes of the second trip the base was treated as here in the original data:
Point ID Northing Easting Height
tlrbcp02 7178309.855 454856.459 83.358

* Running raw gps data through Opus results in the site moving to:
Point ID Northing Easting Height
tlrbcp02--OPUS 7178293.021 454866.017 75.523

* On the first trip there were three bases (at the moment positions listed here are uncorrected from OPUS :
Point ID Northing Easting Height
telsnw2 7178275.291 455045.841 85.667 [Initial base... dug down 1m or so into a snow drift... not suitable for permanent]
nrtel8bs 7180048.627 454031.405 261.143 [Top line base... turns out could only access the GP1-2 line, GP7-11 line, and most of the GP17-21 line] ... moved base to tlrbcp01 after telemetry problems
tlrbcp01 7178216.425 454700.166 88.422 [Located on the bottom of watershed, 3 foot screed stake in ground here], used after base repositioned to bottom of hill for Bob, Cathy, and Lily measurements

1 ) export points from trimble biz center as csv
2 ) organize points for layout & naming convention as is done in google sheet
3 ) convert geopdf to geotiff in arc
4 ) Compare OPUS position to position used in snow melt survey
5 ) compute difference
6 ) apply difference to points using rtk for snow melt survey (just x & y for now)
7 )

Adjust a point using output from OPUS:
http://geoline.com/wp-content/uploads/2014/01/TechTalk_TBC_Workflow_OPUS_.xml-files.pdf

* Could we use the XYZ data to better constrain the creek position?

<pre>
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750980.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751120.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751040.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751141.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751140.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751191.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750960.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751030.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751122.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750990.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750962.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750951.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750931.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750950.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751151.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31750961.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751130.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751121.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Base Fiiles/31751142.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/2016September_Files/2016-09-13/31752570.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/2016September_Files/2016-09-10 (Bottom GCP)/31752541.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/2016September_Files/New folder/31752553.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/2016September_Files/2016-08-24 (House)/31752370.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/2016September_Files/2016-09-12 (Top Nail)/31752560.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/2016September_Files/2016-09-13-2 Kougarok/31752571.T02
/home/bob/Dropbox/uaf/Teller 2016 Surveys/Council/31752321.T02
/home/bob/Dropbox/uaf/GIS/kougarok_m64-2017/31752571.T02
/home/bob/Dropbox/uaf/GIS/Cherry/Eagle 4/32912824.T02
/home/bob/Dropbox/uaf/GIS/Cherry/Eagle 1/31752821.T02
/home/bob/Dropbox/uaf/GIS/Cherry/FAI_Airport/31752155.T02
/home/bob/Dropbox/uaf/GIS/Cherry/Eagle 5/32912831.T02
/home/bob/Dropbox/uaf/GIS/Cherry/Eagle 3/32912822.T02
/home/bob/Dropbox/uaf/GIS/Cherry/August 2/31752321.T02
/home/bob/Dropbox/uaf/GIS/Cherry/Eagle 2/32912820.T02
/home/bob/Dropbox/uaf/GIS/Cherry/Eagle 6/32912833.T02
/home/bob/Dropbox/uaf/GIS/ABOVE Aug 2017/icecut-base.T02
/home/bob/Dropbox/uaf/GIS/ABOVE Aug 2017/southplot-base.T02
/home/bob/Dropbox/uaf/GIS/ABOVE Aug 2017/southplot-base-short.T02
/home/bob/Dropbox/uaf/GIS/ABOVE Aug 2017/happy-valley-base.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750851.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750850.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31751141.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31751191.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31752751.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750840.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750891.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750960.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750900.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750841.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31751151.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31752741.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31751121.T02
/home/bob/Dropbox/uaf/GIS/teller-2017-snow2/31750901.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750851.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750850.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912820.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/icecut-base.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31752761.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912832.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/southplot-base.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/southplot-base-short.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31752751.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750840.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750891.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912830.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750900.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912824.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912821.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750841.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912831.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912822.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31752741.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912823.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/32912833.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750890.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/happy-valley-base.T02
/home/bob/Dropbox/uaf/GIS/Summer-Fall2017 RAW Trimble/31750901.T02
/home/bob/Dropbox/uaf/GIS/2018 Fall Nome/Trip GPS Data/31752673.T02
/home/bob/Dropbox/uaf/GIS/2018 Fall Nome/Trip GPS Data/31752671.T02
/home/bob/Dropbox/uaf/GIS/2018 Fall Nome/Trip GPS Data/31752682.T02
/home/bob/Dropbox/uaf/GIS/2018 Fall Nome/Trip GPS Data/31752651.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750851.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750850.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31751141.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31751191.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750840.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750891.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750960.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750900.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750841.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750951.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31752741.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31751121.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750890.T02
/home/bob/Dropbox/uaf/GIS/teller_may2017/teller_may2017_download/31750901.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092400.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092341.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092370.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092390.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092371.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092271.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092360.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092391.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092403.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092270.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092402.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092300.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092408.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092301.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092272.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092331.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092320.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092405.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092361.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092330.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092407.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092302.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092401.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092409.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092340.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092406.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (August 2017)/79092404.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (April)/79090872.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (April)/79090880.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (April)/79090871.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (April)/79090870.T02
/home/bob/Dropbox/uaf/GIS/Ground Control/LANL T02 files (April)/79090881.T02
/home/bob/Dropbox/surveyGPS/31752020.T02
</pre>

SS To Do Next Visit

2018-10-22T18:24:09Z

24.237.87.170: /* Fall List */

===Publications List===
* https://docs.google.com/document/d/1oWPf0fkpGD2vz_pspbcvLZecad_XLVn2EDaAP5bg3O4/edit?pli=1

===2018===
====Fall List====
* Photograph tag & equipment for:
** LICOR units (tower & forest)
*** Property Tag 36113 (I think this may be Y Kim)
*** Property Tag 36114 (I think this may be Y Kim)
** 3 CR1000s
*** Property Tag '''36104'''
*** Property Tag '''36106'''
*** Property Tag '''36117'''
* Might add a SR50A to the soil pit
* might add a SI111 to the soil pit
* might add a UPS for the heat flux logger system in case there are power problems
** the network switch connecting the toughbook to the LI7200 and the LI7200 to the fluxprocessor
* Need to find out OS version of tower wind master pro
* need to remove battery from sky cam laptop
* bring out NL100/200.
* error message associated with heat flux memory card... replace memory card.
* order a LiCor network cable for forest floor.

====Summer List====
** https://catalog.orientalmotor.com/viewitems/mb-series-ac-centrifugal-fans-blowers/mb-series-50mm-centrifugal-fans-blowers
* More PAR sensors and hardware for in-situ
* Polish Battery Backup System
* replace Loggernet computer
** bring out an NL100 or USB to serial adapter
* Submit PRs for Summer 2018 Instrument Recalibrations
** Vaisala HMP155s
** MetOne 010C
** Kipp & Zonen CNR4
* Late Fall recalibrations:
** LI-7200s
Ss soil has room on c5 for sdi12 rest or sr50a are on c3, c4 is open for other stuff.
* C5 -- SDI12 ID 8 = Shed
* C7 -- SDI12 ID 9 = Forest Floor Radiation Stand

Just moved cs616 to 5v to see if that does anything. Need to confirm this doesn't mess up and create noise in signals.
* Replace SR50A transducers
* Dig second pit for soil instruments
* clean up outdoor power cords
* waterproof a bit some of the tower blowers (might be as easy as more cable ties / tape to keep the white box deals right side up.
* I brought out a collection of one and two hole deals for securing loose cabling here and there in and out of the shed. That could be sorted out.
* connect those shop power strips and get one more for inside?
* buy and add more PAR top and bottom (4x and matching hardware)
* add another tipping bucket.
* bring solder out for ff atrh blower and electrical goo

===Nearly end of summer status====
* Get a handle on remaining budget
* re-calibrate as many sensors as able
* buy a couple more sensors as able
* licor training if possible
* write program for new soil pit box
** soil moisture at 2+ depths
** soil temp

DataPro setup and workflow

2018-10-19T21:20:48Z

24.237.87.170: /* Version 2 of this workflow description */

==Initial setup==
It's good to settle on a standard directory structure if you can. For linux, most things go in a bin directory. You can do the same with windows. Recommended though to not put any spaces characters ' ' in folder names etc as I don't know if there are ill consequences. Be conservative, descriptive names, well organized, use underscore character in place of spaces. Logical places you might put them:
/var/site/bin/
/home/site/bin/
c:\data\bin/

Then, suggested directory structure for the site's themselves:
/var/site/$site_name - root directory of the site
/var/site/$research_area/$site_name - another logical location for the root directory of the site.
/var/site/$site_name/config/ - location of the configuration files used by datapro and related utilities for processing the data
/var/site/$site_name/raw/ - location for the raw data (I personally think a good practice is to have the original data from LoggerNet / loggerdata etc
/var/site/$site_name/outputs/ - location for the automatically processed data: raw data that has been analyzed by datapro
/var/site/$site_name/web/ - location for a shorter time series, like the last 3 weeks suitable for a web page.
/var/site/$site_name/qc/ - location for the automated qa/qc log
/var/site/$site_name/error/ - location for datapro error logs

To run:
python /var/site/bin/csv_utilities/datapro.py --key_file=/var/site/$site_name/config/keyfile.txt

Then, watch for error messages. Depending on your system there may be some python libraries that need to be installed. If you use windows, enthought python distribution is a nice all-encompassing choice or cygwin for making sure you have all of the right things on the computer.

If you have any questions just ask Bob Busey or Ross Spicer.

===Initial site set up workflow===

# create the initial directory structure listed above.
# I usually don't use the site creator though I certainly could. More often I start with an existing site's configuration files... copy them to a new config and edit to reflect the new site.
# the file that controls qa/qc parameters, filenames, any functions to be applied etc is the parameter csv file. It's often easiest to just edit this on a computer with a graphical spreadsheet program like Excel or Libre Office to get things proper. The header information can often be copied & pasted straight from the raw .dat file
# next, edit the .txt key file to reflect where file and directory locations are all placed.
# run datapro as shown above.
# if it works, awesome. if it doesn't, make note of the errors and try to address them.
# once it's running I do a couple more things. ln -s is used to create symlinks for a few other items. I maintain an automatically generated diagnostics web page at http://ngeedata.iarc.uaf.edu/data/data.html. It expects battery voltage to be placed in 'battery.csv' and Internal Panel Temperature to be in 'paneltemp.csv' if you don't use those names you can use ln -s to create a symlink. I then will also make sym links so that the processed data is available over the internet without making a second full copy of the data.

==Version 2 of this workflow for fully automated sites ==

Here is the code for DataPro plus some other information...: 
[[DataPro_and_related_utilities]]
===Grab these items===
cd /var/site/lib
git clone https://github.com/rwspicer/csv_utilities.git
git clone https://github.com/frankohanlon/bash_utils.git
git clone https://github.com/frankohanlon/python_utils.git

All of this definitely works in linux / mac osx. I think datapro runs in Windows but a lot of the helper utilities and stuff are more linux / osx specific just due to that being where all of this stuff is running. Probably wouldn't be too hard to get it running in windows if you wanted to. I have some other utilities, too. Check out these in here: 
* bin.zip (ask Bob for access to this if you want to implement)
Roughly, speaking I use crontab for scheduling. I keep the schedule as a file in the bin directory. It is called 'main_cron'. To load it into the crontab (from the command line): 
<pre>$ crontab main_cron</pre>

That loads it up. If you look at main_cron (which is a text file) you'll see line 16 is the schedule for running bash script 'cron_04min.sh'.
<pre>6 * * * * (/var/site/bin/cron_04min.sh) > /var/site/logs/ND_4min_log.txt</pre>

If you open 'cron_04min.sh' you'll see a few things. I use the information on lines 2 & 3 to track how long it takes for this script to run:
<pre>CRONSTART=`date +%s%N`
CRONTIME=$(date +'"%G-%m-%d %H:00:00",')</pre>
Those basically use the program date to output a couple quantities. The first is the starting time for this batch file, units are in seconds. The second is the standard CSI format date/time. You'll see I also track station processing time. In some sense it's a meaningless quantity but in another, I've caught problems early when I've noticed the total processing time deviating from it's usual. When Ross rewrote datapro he also made it way more efficient so this became less important. So these lines are for the cron_04min total run time and there are some other commands that track individual batch files. 

Line 4 identifies one of the utility scripts and assigns the location to a variable name. This one particular one reviews the latest output from the instruments and then tallies up how many bad data points there are. I'd like to track this in a more sophisticated fashion at some point but haven't gotten to it yet:
<pre>STATUS=/home/bbusey/working_files/bin/utilities/status_update.py</pre>

Line 7-13 are the ones in cron_04min.sh that handle the example site, ss_met. Line 7 is just the tracking starter again:
<pre>START=`date +%s%N`</pre>

Line 8 triggers another batch file, which is full of things related to ss_met.
<pre>~/working_files/bin/process_ss_met.sh</pre>

I've been trying to get a bit more structured in file naming. So most of the bash scripts that are run from the crontab start with the prefix 'cron' and then here, the processing bash script for the super-site met station has the prefix 'process'.
 
Here are lines 9-13. They run after 'process_ss_met.sh' has completed.
<pre>END=`date +%s%N`
ELAPSED=`echo "scale=8; ($END - $START) / 1000000000" | bc`
temp1=$CRONTIME$ELAPSED
echo $temp1 >> /home/bbusey/working_files/global_status/outputs/ss_met_process.csv
echo "Super Site Met: "$ELAPSED
</pre>
END dumps the current time in seconds into a variable.... 
ELAPSED is a bit of math using the program bc, total run time for process script is computed here. 
The line where we set temp1 variable to a couple quantities is just putting the elapsed time into that TOA5 CSI format. Column 1 is the date/time and column 2 is the total run time in seconds.
the echo $temp1 >> etc puts this quantity into a text file for logging and later visualization on the diagnostic page. 

So, everything else in that file is just extra essentially. Next i wanted to step through 'ss_met.sh' That first script is basically the wrapper for it. The first eleven lines once again initialize some variables, in this case paths to directories, locations of important scripts. I put them at the top to make it so that when things change from time to time there is less search & replace:
<pre>#!/bin/sh
SHELL=/bin/bash
START=`date +%s%N`
CRONTIME=$(date +'"%G-%m-%d %H:00:00",')
DATAPRO="/home/bbusey/working_files/bin/csv_utilities/datapro.py"
GLOM="/home/bbusey/working_files/bin/utilities/glom_together.py"
TRACK_DELAY="/home/bbusey/working_files/bin/utilities/track_delay.py"
DATA_CLIPPER="/home/bbusey/working_files/bin/dataclip_wrapper"
STATUS="/home/bbusey/working_files/bin/utilities/status_update.py"
ROOT_DIR="/home/bbusey/working_files/ss_met"
</pre>

Lines 16-23 in 'process_ss_met.sh' is basically DataPro running through the data in several different data tables. Here's one:
<pre>python $DATAPRO --key_file=$ROOT_DIR/config/ss-met_AT_key_2012-07.txt</pre>

With DataPro there are two important files,this key file, and the csv paramter file. If you pop open this key file you'll see roughly that it covers:
* where the input data file is (I call the *.dat file from LoggerNet the raw data). So, this is the raw data straight from LoggerNet.
* the location & file name of the csv parameter file. The parameter file basically maps the many columns of the raw data to a series ouf output file names (after processing). It also includes coefficients for a number of functions that can be applied to the data as well as some QA thresholds.
* the directory where this processed data should be dumped into.
* Also specified whether it is a CR10X array based logger or table data based logger. Either works but if you have a CR10X outputting julian days etc then you'll need to specify the Array ID in the key file.

With the processing complete the first of the additional diagnostic parameters is computed. I have a utility called TRACK_DELAY which does like it sounds, looks at the current time and looks at the last date in the output file and computes the difference. The quantity is tracked like a bunch of the others and also shows up on the diagnostic web page. I think this is the one that I watch the most.
<pre>python $TRACK_DELAY --infile=$ROOT_DIR/outputs/battery.csv --timezone=Etc/GMT+0</pre>

So, once datapro has run through the raw data from each of the .dat logged by this logger, there is a bit more data management that takes place. On line 27 you'll see:
<pre>$DATA_CLIPPER $ROOT_DIR/ _3wks.csv 4 2016</pre>

Data clipper trims the output data to a header plus in this case 2016 lines of data, the most recent 3 weeks roughly speaking. So, directory structure is basically:
<pre>ss_met/config === location of the configuration files, the key file and csv parameter files
ss_met/raw == the location of the raw .dat from loggernet
ss_met/outputs == the location of all of the processed data for ss_met
ss_met/web == the trimmed data after running the $DATA_CLIPPER routine.
ss_met/web/one/ == the files in here are just the very last line of data from the ss_met/outputs/ files. A subset of these are used by the diagnostics web page.
</pre>
Lines 32 to 52 are some reformatting utilities. Basically, grouping common variables together for display on a web page.
<pre>python $GLOM $ROOT_DIR/config/ss-met-glom_at.txt</pre>

Once again there is a key file here for the glom utility and a corresponding csv parameter file. 

Lines 55 & 56 transfer the processed data to the IARC web page for public viewing. 

Line 58 is a short utility which runs through all of the data files and counts up all of the bad data points. Tracking over time, if I'm paying attention then I see when the automated QA/QC captures something funky.
<pre>python $STATUS $ROOT_DIR/outputs/ $ROOT_DIR/outputs/data_status.csv</pre>

Finally, line 60-64 wrap up the processing bash script, computing the total time again like was done for the cron job:
<pre>END=`date +%s%N`
ELAPSED=`echo "scale=8; ($END - $START) / 1000000000" | bc`
echo $ELAPSED
temp1=$CRONTIME$ELAPSED
echo $temp1 >> $ROOT_DIR/outputs/site_process.csv
</pre>
I think that's basically all of the processing and stuff that takes place. I didn't mention it above but there are a number of data manipulation functions built into datapro so, like unit conversions if you want, thermistor resistance to temperature, that sort of thing. And it's pretty easy to add more if you the ones that are there don't suffice (and if you do then we can add them back into the main DataPro archive). Check out bin/csv_utilities/csv_lib/equations.py

 
So, that's basically the processing component. In the web_site.zip below I included all the configuration files etc for the super-site met as a fully reproducible example if you want. Or you could also check out the files listed on the wiki.

 Moving on to the web page part, here is the javascript / css / html for getting the diagnostic page up and running:
* web_site.zip (see Bob if you want to try this out)
data.html is this page: 
http://ngeedata.iarc.uaf.edu/data/data.html

I pretty much use a bunch of javascript to put the page together using the contents of all of those outputted data files from earlier. the files in the ss_met/outputs/one are read in and populate the html table among other things. As far as how the page comes together, check out web_site/diag.json. Here's an entry for the ss_met site again:
<pre>
{
"StationName": "ss_met",
"StationDescriptiveName": "SuperSite Met Station",
"StationAltName": "ss_met",
"DataFileNameBase": "ss_met/outputs/",
"last_data_file": "/web/one/battery_1.csv",
"timezone": "Etc/GMT+0"
},
</pre>
There are echoes in this configuration from the old EE Internet gp.py that was used on the old Bullen point web page setup:
 http://ine.uaf.edu/werc/projects/bullen/stations.html

 I got started with this whole datapro enterprise trying to get old CR10X Array based data files to be shown using the gp.py python stuff that EE Internet wrote. So, with data.html, the key piece of the puzzle which starts everything running is down at the bottom of the page, javascript on lines 85-92:
<pre>
<script type="text/javascript">
function init() {
make_diag_table();
data_toggle('ss_met/web/delay_3wks.csv','Oldness @ Super Site Met');
}

</script>
</pre>

The init() function is found in:
<pre>web_site/js/interface_to_dygraph_diagpage.js</pre>
Check out line 17 of that file for function make_diag_table(). That's pretty much where the magic happens, that function. You'll see that there are a few hard coded files that the javascript looks for. Some sites don't have all of these, or the battery voltage file might have a different name. I use symlinks on linux to still make sure there is an appropriate file there.

 
I think that's the gist of everything. The last piece of the puzzle I guess is:
<pre>web_site/ss_met_summary.html</pre>

I write that file by hand (well, more accurately I do a file save-as from an existing one and then edit it to reflect the new station being worked on. The file name ties into the diag.json. The name for this is "StationAltName" from the diag.json plus the suffix "_summary.html".

DataPro setup and workflow

2018-10-19T20:55:28Z

24.237.87.170: /* Initial setup */

==Initial setup==
It's good to settle on a standard directory structure if you can. For linux, most things go in a bin directory. You can do the same with windows. Recommended though to not put any spaces characters ' ' in folder names etc as I don't know if there are ill consequences. Be conservative, descriptive names, well organized, use underscore character in place of spaces. Logical places you might put them:
/var/site/bin/
/home/site/bin/
c:\data\bin/

Then, suggested directory structure for the site's themselves:
/var/site/$site_name - root directory of the site
/var/site/$research_area/$site_name - another logical location for the root directory of the site.
/var/site/$site_name/config/ - location of the configuration files used by datapro and related utilities for processing the data
/var/site/$site_name/raw/ - location for the raw data (I personally think a good practice is to have the original data from LoggerNet / loggerdata etc
/var/site/$site_name/outputs/ - location for the automatically processed data: raw data that has been analyzed by datapro
/var/site/$site_name/web/ - location for a shorter time series, like the last 3 weeks suitable for a web page.
/var/site/$site_name/qc/ - location for the automated qa/qc log
/var/site/$site_name/error/ - location for datapro error logs

To run:
python /var/site/bin/csv_utilities/datapro.py --key_file=/var/site/$site_name/config/keyfile.txt

Then, watch for error messages. Depending on your system there may be some python libraries that need to be installed. If you use windows, enthought python distribution is a nice all-encompassing choice or cygwin for making sure you have all of the right things on the computer.

If you have any questions just ask Bob Busey or Ross Spicer.

===Initial site set up workflow===

# create the initial directory structure listed above.
# I usually don't use the site creator though I certainly could. More often I start with an existing site's configuration files... copy them to a new config and edit to reflect the new site.
# the file that controls qa/qc parameters, filenames, any functions to be applied etc is the parameter csv file. It's often easiest to just edit this on a computer with a graphical spreadsheet program like Excel or Libre Office to get things proper. The header information can often be copied & pasted straight from the raw .dat file
# next, edit the .txt key file to reflect where file and directory locations are all placed.
# run datapro as shown above.
# if it works, awesome. if it doesn't, make note of the errors and try to address them.
# once it's running I do a couple more things. ln -s is used to create symlinks for a few other items. I maintain an automatically generated diagnostics web page at http://ngeedata.iarc.uaf.edu/data/data.html. It expects battery voltage to be placed in 'battery.csv' and Internal Panel Temperature to be in 'paneltemp.csv' if you don't use those names you can use ln -s to create a symlink. I then will also make sym links so that the processed data is available over the internet without making a second full copy of the data.

==Version 2 of this workflow description ==

Here is the code for DataPro plus some other information... I should figure out a good way to transfer the rest of this to the wiki at some point, too: 
[[DataPro_and_related_utilities]]

All of this definitely works in linux / mac osx. I think datapro runs in Windows but a lot of the helper utilities and stuff are more linux / osx specific just due to that being where all of this stuff is running. Probably wouldn't be too hard to get it running in windows if you wanted to. I have some other utilities, too. Check out these in here: 
* bin.zip (ask Bob for access to this if you want to implement)
Roughly, speaking I use crontab for scheduling. I keep the schedule as a file in the bin directory. It is called 'main_cron'. To load it into the crontab (from the command line): 
<pre>$ crontab main_cron</pre>

That loads it up. If you look at main_cron (which is a text file) you'll see line 16 is the schedule for running bash script 'cron_04min.sh'.
<pre>6 * * * * (/home/bbusey/working_files/bin/cron_04min.sh) > /home/bbusey/working_files/bin/logs/ND_4min_log.txt</pre>

If you open 'cron_04min.sh' you'll see a few things. I use the information on lines 2 & 3 to track how long it takes for this script to run:
<pre>CRONSTART=`date +%s%N`
CRONTIME=$(date +'"%G-%m-%d %H:00:00",')</pre>
Those basically use the program date to output a couple quantities. The first is the starting time for this batch file, units are in seconds. The second is the standard CSI format date/time. You'll see I also track station processing time. In some sense it's a meaningless quantity but in another, I've caught problems early when I've noticed the total processing time deviating from it's usual. When Ross rewrote datapro he also made it way more efficient so this became less important. So these lines are for the cron_04min total run time and there are some other commands that track individual batch files. 

Line 4 identifies one of the utility scripts and assigns the location to a variable name. This one particular one reviews the latest output from the instruments and then tallies up how many bad data points there are. I'd like to track this in a more sophisticated fashion at some point but haven't gotten to it yet:
<pre>STATUS=/home/bbusey/working_files/bin/utilities/status_update.py</pre>

Line 7-13 are the ones in cron_04min.sh that handle the example site, ss_met. Line 7 is just the tracking starter again:
<pre>START=`date +%s%N`</pre>

Line 8 triggers another batch file, which is full of things related to ss_met.
<pre>~/working_files/bin/process_ss_met.sh</pre>

I've been trying to get a bit more structured in file naming. So most of the bash scripts that are run from the crontab start with the prefix 'cron' and then here, the processing bash script for the super-site met station has the prefix 'process'.
 
Here are lines 9-13. They run after 'process_ss_met.sh' has completed.
<pre>END=`date +%s%N`
ELAPSED=`echo "scale=8; ($END - $START) / 1000000000" | bc`
temp1=$CRONTIME$ELAPSED
echo $temp1 >> /home/bbusey/working_files/global_status/outputs/ss_met_process.csv
echo "Super Site Met: "$ELAPSED
</pre>
END dumps the current time in seconds into a variable.... 
ELAPSED is a bit of math using the program bc, total run time for process script is computed here. 
The line where we set temp1 variable to a couple quantities is just putting the elapsed time into that TOA5 CSI format. Column 1 is the date/time and column 2 is the total run time in seconds.
the echo $temp1 >> etc puts this quantity into a text file for logging and later visualization on the diagnostic page. 

So, everything else in that file is just extra essentially. Next i wanted to step through 'ss_met.sh' That first script is basically the wrapper for it. The first eleven lines once again initialize some variables, in this case paths to directories, locations of important scripts. I put them at the top to make it so that when things change from time to time there is less search & replace:
<pre>#!/bin/sh
SHELL=/bin/bash
START=`date +%s%N`
CRONTIME=$(date +'"%G-%m-%d %H:00:00",')
DATAPRO="/home/bbusey/working_files/bin/csv_utilities/datapro.py"
GLOM="/home/bbusey/working_files/bin/utilities/glom_together.py"
TRACK_DELAY="/home/bbusey/working_files/bin/utilities/track_delay.py"
DATA_CLIPPER="/home/bbusey/working_files/bin/dataclip_wrapper"
STATUS="/home/bbusey/working_files/bin/utilities/status_update.py"
ROOT_DIR="/home/bbusey/working_files/ss_met"
</pre>

Lines 16-23 in 'process_ss_met.sh' is basically DataPro running through the data in several different data tables. Here's one:
<pre>python $DATAPRO --key_file=$ROOT_DIR/config/ss-met_AT_key_2012-07.txt</pre>

With DataPro there are two important files,this key file, and the csv paramter file. If you pop open this key file you'll see roughly that it covers:
* where the input data file is (I call the *.dat file from LoggerNet the raw data). So, this is the raw data straight from LoggerNet.
* the location & file name of the csv parameter file. The parameter file basically maps the many columns of the raw data to a series ouf output file names (after processing). It also includes coefficients for a number of functions that can be applied to the data as well as some QA thresholds.
* the directory where this processed data should be dumped into.
* Also specified whether it is a CR10X array based logger or table data based logger. Either works but if you have a CR10X outputting julian days etc then you'll need to specify the Array ID in the key file.

With the processing complete the first of the additional diagnostic parameters is computed. I have a utility called TRACK_DELAY which does like it sounds, looks at the current time and looks at the last date in the output file and computes the difference. The quantity is tracked like a bunch of the others and also shows up on the diagnostic web page. I think this is the one that I watch the most.
<pre>python $TRACK_DELAY --infile=$ROOT_DIR/outputs/battery.csv --timezone=Etc/GMT+0</pre>

So, once datapro has run through the raw data from each of the .dat logged by this logger, there is a bit more data management that takes place. On line 27 you'll see:
<pre>$DATA_CLIPPER $ROOT_DIR/ _3wks.csv 4 2016</pre>

Data clipper trims the output data to a header plus in this case 2016 lines of data, the most recent 3 weeks roughly speaking. So, directory structure is basically:
<pre>ss_met/config === location of the configuration files, the key file and csv parameter files
ss_met/raw == the location of the raw .dat from loggernet
ss_met/outputs == the location of all of the processed data for ss_met
ss_met/web == the trimmed data after running the $DATA_CLIPPER routine.
ss_met/web/one/ == the files in here are just the very last line of data from the ss_met/outputs/ files. A subset of these are used by the diagnostics web page.
</pre>
Lines 32 to 52 are some reformatting utilities. Basically, grouping common variables together for display on a web page.
<pre>python $GLOM $ROOT_DIR/config/ss-met-glom_at.txt</pre>

Once again there is a key file here for the glom utility and a corresponding csv parameter file. 

Lines 55 & 56 transfer the processed data to the IARC web page for public viewing. 

Line 58 is a short utility which runs through all of the data files and counts up all of the bad data points. Tracking over time, if I'm paying attention then I see when the automated QA/QC captures something funky.
<pre>python $STATUS $ROOT_DIR/outputs/ $ROOT_DIR/outputs/data_status.csv</pre>

Finally, line 60-64 wrap up the processing bash script, computing the total time again like was done for the cron job:
<pre>END=`date +%s%N`
ELAPSED=`echo "scale=8; ($END - $START) / 1000000000" | bc`
echo $ELAPSED
temp1=$CRONTIME$ELAPSED
echo $temp1 >> $ROOT_DIR/outputs/site_process.csv
</pre>
I think that's basically all of the processing and stuff that takes place. I didn't mention it above but there are a number of data manipulation functions built into datapro so, like unit conversions if you want, thermistor resistance to temperature, that sort of thing. And it's pretty easy to add more if you the ones that are there don't suffice (and if you do then we can add them back into the main DataPro archive). Check out bin/csv_utilities/csv_lib/equations.py

 
So, that's basically the processing component. In the web_site.zip below I included all the configuration files etc for the super-site met as a fully reproducible example if you want. Or you could also check out the files listed on the wiki.

 Moving on to the web page part, here is the javascript / css / html for getting the diagnostic page up and running:
* web_site.zip (see Bob if you want to try this out)
data.html is this page: 
http://ngeedata.iarc.uaf.edu/data/data.html

I pretty much use a bunch of javascript to put the page together using the contents of all of those outputted data files from earlier. the files in the ss_met/outputs/one are read in and populate the html table among other things. As far as how the page comes together, check out web_site/diag.json. Here's an entry for the ss_met site again:
<pre>
{
"StationName": "ss_met",
"StationDescriptiveName": "SuperSite Met Station",
"StationAltName": "ss_met",
"DataFileNameBase": "ss_met/outputs/",
"last_data_file": "/web/one/battery_1.csv",
"timezone": "Etc/GMT+0"
},
</pre>
There are echoes in this configuration from the old EE Internet gp.py that was used on the old Bullen point web page setup:
 http://ine.uaf.edu/werc/projects/bullen/stations.html

 I got started with this whole datapro enterprise trying to get old CR10X Array based data files to be shown using the gp.py python stuff that EE Internet wrote. So, with data.html, the key piece of the puzzle which starts everything running is down at the bottom of the page, javascript on lines 85-92:
<pre>
<script type="text/javascript">
function init() {
make_diag_table();
data_toggle('ss_met/web/delay_3wks.csv','Oldness @ Super Site Met');
}

</script>
</pre>

The init() function is found in:
<pre>web_site/js/interface_to_dygraph_diagpage.js</pre>
Check out line 17 of that file for function make_diag_table(). That's pretty much where the magic happens, that function. You'll see that there are a few hard coded files that the javascript looks for. Some sites don't have all of these, or the battery voltage file might have a different name. I use symlinks on linux to still make sure there is an appropriate file there.

 
I think that's the gist of everything. The last piece of the puzzle I guess is:
<pre>web_site/ss_met_summary.html</pre>

I write that file by hand (well, more accurately I do a file save-as from an existing one and then edit it to reflect the new station being worked on. The file name ties into the diag.json. The name for this is "StationAltName" from the diag.json plus the suffix "_summary.html".

SS To Do Next Visit

2018-10-19T18:24:18Z

24.237.87.170: /* Fall List */

===Publications List===
* https://docs.google.com/document/d/1oWPf0fkpGD2vz_pspbcvLZecad_XLVn2EDaAP5bg3O4/edit?pli=1

===2018===
====Fall List====
* Photograph tag & equipment for:
** LICOR units (tower & forest)
*** Property Tag 36113 (I think this may be a typo)
*** Property Tag 36114
** 3 CR1000s
*** Property Tag '''36104'''
*** Property Tag '''36106'''
*** Property Tag '''36117'''
* Might add a SR50A to the soil pit
* might add a SI111 to the soil pit
* might add a UPS for the heat flux logger system in case there are power problems
** the network switch connecting the toughbook to the LI7200 and the LI7200 to the fluxprocessor
* Need to find out OS version of tower wind master pro
* need to remove battery from sky cam laptop
* bring out NL100/200.
* error message associated with heat flux memory card... replace memory card.

====Summer List====
** https://catalog.orientalmotor.com/viewitems/mb-series-ac-centrifugal-fans-blowers/mb-series-50mm-centrifugal-fans-blowers
* More PAR sensors and hardware for in-situ
* Polish Battery Backup System
* replace Loggernet computer
** bring out an NL100 or USB to serial adapter
* Submit PRs for Summer 2018 Instrument Recalibrations
** Vaisala HMP155s
** MetOne 010C
** Kipp & Zonen CNR4
* Late Fall recalibrations:
** LI-7200s
Ss soil has room on c5 for sdi12 rest or sr50a are on c3, c4 is open for other stuff.
* C5 -- SDI12 ID 8 = Shed
* C7 -- SDI12 ID 9 = Forest Floor Radiation Stand

Just moved cs616 to 5v to see if that does anything. Need to confirm this doesn't mess up and create noise in signals.
* Replace SR50A transducers
* Dig second pit for soil instruments
* clean up outdoor power cords
* waterproof a bit some of the tower blowers (might be as easy as more cable ties / tape to keep the white box deals right side up.
* I brought out a collection of one and two hole deals for securing loose cabling here and there in and out of the shed. That could be sorted out.
* connect those shop power strips and get one more for inside?
* buy and add more PAR top and bottom (4x and matching hardware)
* add another tipping bucket.
* bring solder out for ff atrh blower and electrical goo

===Nearly end of summer status====
* Get a handle on remaining budget
* re-calibrate as many sensors as able
* buy a couple more sensors as able
* licor training if possible
* write program for new soil pit box
** soil moisture at 2+ depths
** soil temp

SS To Do Next Visit

2018-10-19T18:24:07Z

24.237.87.170: /* Fall List */

===Publications List===
* https://docs.google.com/document/d/1oWPf0fkpGD2vz_pspbcvLZecad_XLVn2EDaAP5bg3O4/edit?pli=1

===2018===
====Fall List====
* Photograph tag & equipment for:
** LICOR units (tower & forest)
*** Property Tag 36113 (I think this may be a typo)
*** Property Tag 36114
** 3 CR1000s
*** Property Tag '''36104'''
*** Property Tag '''36106'''
*** Property Tag '''361117'''
* Might add a SR50A to the soil pit
* might add a SI111 to the soil pit
* might add a UPS for the heat flux logger system in case there are power problems
** the network switch connecting the toughbook to the LI7200 and the LI7200 to the fluxprocessor
* Need to find out OS version of tower wind master pro
* need to remove battery from sky cam laptop
* bring out NL100/200.
* error message associated with heat flux memory card... replace memory card.

====Summer List====
** https://catalog.orientalmotor.com/viewitems/mb-series-ac-centrifugal-fans-blowers/mb-series-50mm-centrifugal-fans-blowers
* More PAR sensors and hardware for in-situ
* Polish Battery Backup System
* replace Loggernet computer
** bring out an NL100 or USB to serial adapter
* Submit PRs for Summer 2018 Instrument Recalibrations
** Vaisala HMP155s
** MetOne 010C
** Kipp & Zonen CNR4
* Late Fall recalibrations:
** LI-7200s
Ss soil has room on c5 for sdi12 rest or sr50a are on c3, c4 is open for other stuff.
* C5 -- SDI12 ID 8 = Shed
* C7 -- SDI12 ID 9 = Forest Floor Radiation Stand

Just moved cs616 to 5v to see if that does anything. Need to confirm this doesn't mess up and create noise in signals.
* Replace SR50A transducers
* Dig second pit for soil instruments
* clean up outdoor power cords
* waterproof a bit some of the tower blowers (might be as easy as more cable ties / tape to keep the white box deals right side up.
* I brought out a collection of one and two hole deals for securing loose cabling here and there in and out of the shed. That could be sorted out.
* connect those shop power strips and get one more for inside?
* buy and add more PAR top and bottom (4x and matching hardware)
* add another tipping bucket.
* bring solder out for ff atrh blower and electrical goo

===Nearly end of summer status====
* Get a handle on remaining budget
* re-calibrate as many sensors as able
* buy a couple more sensors as able
* licor training if possible
* write program for new soil pit box
** soil moisture at 2+ depths
** soil temp

NGEE Kougarok M64 Notes

2018-10-17T22:15:12Z

24.237.87.170: /* 2018 */

[[NGEE]]
===Site Visits===
* 6/24/2017 (Bob and Lily Site Install)
* 8/19/2017 (Lily and ABOVE Team)
* 10/5/2017 (Bob and Lily Fall Visit)
* 4/3/2018 (Snow Team)
* 6/14/2018 (Bob and Nathan)
* 9/22/2018 (Bobs and CAS)

===Processed through===
* AT/RH/Precip / WS / WD / BP through 4/3/2018
* Radiation through 4/3/2018
* VATP through 4/3/2018

===Met Notes===
====2017====
* Fall 2017: Muskox knock over precip bucket.
* 10/16/2017 12:00 end of precip season for kougarok.
====2018====
* 6/14/2018 Fixed precip bucket, noticed Musk ox twisted tower center mast at some point so Wind Direction and Radiation have been off for a TBD amount of time.
** NAN through 6/15/2018 00:00 time step (the test tips)
* 9/22/2018 musk ox twisted center mast a bit again. WD off, Radiation still pretty closer to still on.

===Radiation Notes===
====2017====
* I have open questions about PRI index value but the data from the sensors themselves looks ok.
* I reviewed photos from June 2017 station visit and October 2017 station visit. The radiation arm appears to have not moved over this interval.

====2018====
* I know we leveled the radiometer arm on the snow survey trip in early April but I can't remember if the cross arm had moved... I think it maybe had...?
** I thought maybe Cathy/Bob visited the station and grabbed pictures a day or two before I was able to get up there.
* Declaring data bad '''5/14/18 13:00 till station visit on 6/14/18 22:00'''
* second bump was gentle enough there is no obvious error in SW data from June till September visit even though the Musk Ox twisted 10 degrees or something the station.

===Radiation Snippet===
*... for trying to pin down when the muskox move the CNR4...
* Need to compared albedo here to K2 Met... & incoming shortwave radiation
** ... albedo didn't show anything but incoming shortwave radiation shows a shift on 5/14/18 13:00 so I'm going to 6999 from there till June station visit.
<pre>
import numpy
import pandas
stryear="2018.csv"

sensor_k2 = "/var/site/uaf_sp/k-met/outputs/k2_met_albedo_" + stryear
df_k2 = pandas.read_csv(sensor_k2, skiprows=3, index_col=0)
df_k2.index = pandas.to_datetime(df_k2.index)
df_k2 [df_k2>1]= numpy.NaN
df_k2 = df_k2.resample('24H').mean()

path="/var/site/uaf_sp/ngee_koug_met/outputs/years/albedo_Avg/albedo_Avg_" + stryear
df4 = pandas.read_csv(sensor4, skiprows=3, index_col=0)
df4.index = pandas.to_datetime(df4.index)
df4 [df4>100]= numpy.NaN
df4 = df4.resample('24H').mean()
df4.rename(columns = {'Avg' : 'Albedo'}, inplace=True)

outfile = "/var/site/uaf_sp/ngee_koug_met/outputs/koug_summary_albedo.csv"
dataset=pandas.concat([ df4, df_k2] ,axis=1)
dataset.to_csv(outfile)
</pre>

===Soil Notes===
* VATP looks good

NGEE Kougarok M64 Notes

2018-10-17T22:14:38Z

24.237.87.170: /* Radiation Notes */

[[NGEE]]
===Site Visits===
* 6/24/2017 (Bob and Lily Site Install)
* 8/19/2017 (Lily and ABOVE Team)
* 10/5/2017 (Bob and Lily Fall Visit)
* 4/3/2018 (Snow Team)
* 6/14/2018 (Bob and Nathan)
* 9/22/2018 (Bobs and CAS)

===Processed through===
* AT/RH/Precip / WS / WD / BP through 4/3/2018
* Radiation through 4/3/2018
* VATP through 4/3/2018

===Met Notes===
====2017====
* Fall 2017: Muskox knock over precip bucket.
* 10/16/2017 12:00 end of precip season for kougarok.
====2018====
* 6/14/2018 Fixed precip bucket, noticed Musk ox twisted tower center mast at some point so Wind Direction and Radiation have been off for a TBD amount of time.
** NAN through 6/15/2018 00:00 time step (the test tips)
* 9/22/2018 musk ox twisted center mast a bit again. WD off, Radiation still pretty closer to still on.

===Radiation Notes===
====2017====
* I have open questions about PRI index value but the data from the sensors themselves looks ok.
* I reviewed photos from June 2017 station visit and October 2017 station visit. The radiation arm appears to have not moved over this interval.

====2018====
* I know we leveled the radiometer arm on the snow survey trip in early April but I can't remember if the cross arm had moved... I think it maybe had...?

* Declaring data bad '''5/14/18 13:00 till station visit on 6/14/18 22:00'''
* second bump was gentle enough there is no obvious error in SW data from June till September visit even though the Musk Ox twisted 10 degrees or something the station.

===Radiation Snippet===
*... for trying to pin down when the muskox move the CNR4...
* Need to compared albedo here to K2 Met... & incoming shortwave radiation
** ... albedo didn't show anything but incoming shortwave radiation shows a shift on 5/14/18 13:00 so I'm going to 6999 from there till June station visit.
<pre>
import numpy
import pandas
stryear="2018.csv"

sensor_k2 = "/var/site/uaf_sp/k-met/outputs/k2_met_albedo_" + stryear
df_k2 = pandas.read_csv(sensor_k2, skiprows=3, index_col=0)
df_k2.index = pandas.to_datetime(df_k2.index)
df_k2 [df_k2>1]= numpy.NaN
df_k2 = df_k2.resample('24H').mean()

path="/var/site/uaf_sp/ngee_koug_met/outputs/years/albedo_Avg/albedo_Avg_" + stryear
df4 = pandas.read_csv(sensor4, skiprows=3, index_col=0)
df4.index = pandas.to_datetime(df4.index)
df4 [df4>100]= numpy.NaN
df4 = df4.resample('24H').mean()
df4.rename(columns = {'Avg' : 'Albedo'}, inplace=True)

outfile = "/var/site/uaf_sp/ngee_koug_met/outputs/koug_summary_albedo.csv"
dataset=pandas.concat([ df4, df_k2] ,axis=1)
dataset.to_csv(outfile)
</pre>

===Soil Notes===
* VATP looks good

NGEE Kougarok M64 Notes

2018-10-17T22:01:16Z

24.237.87.170: /* Met Notes */

[[NGEE]]
===Site Visits===
* 6/24/2017 (Bob and Lily Site Install)
* 8/19/2017 (Lily and ABOVE Team)
* 10/5/2017 (Bob and Lily Fall Visit)
* 4/3/2018 (Snow Team)
* 6/14/2018 (Bob and Nathan)
* 9/22/2018 (Bobs and CAS)

===Processed through===
* AT/RH/Precip / WS / WD / BP through 4/3/2018
* Radiation through 4/3/2018
* VATP through 4/3/2018

===Met Notes===
====2017====
* Fall 2017: Muskox knock over precip bucket.
* 10/16/2017 12:00 end of precip season for kougarok.
====2018====
* 6/14/2018 Fixed precip bucket, noticed Musk ox twisted tower center mast at some point so Wind Direction and Radiation have been off for a TBD amount of time.
** NAN through 6/15/2018 00:00 time step (the test tips)
* 9/22/2018 musk ox twisted center mast a bit again. WD off, Radiation still pretty closer to still on.

===Radiation Notes===
* I have open questions about PRI index value but the data from the sensors themselves looks ok.
* Snippet for trying to pin down when the muskox move the CNR4...
** Need to compare albedo here to K2 Met...
** ... albedo didn't show anything but incoming shortwave radiation shows a shift on 5/14 so I'm going to 6999 from there till June station visit.
** second bump was gentle enough there is no obvious error in SW data from June till September visit even though the Musk Ox twisted 10 degrees or something the station.
** Declaring data bad '''5/14/18 13:00 till station visit on 6/14/18 22:00'''
<pre>
import numpy
import pandas
stryear="2018.csv"

sensor_k2 = "/var/site/uaf_sp/k-met/outputs/k2_met_albedo_" + stryear
df_k2 = pandas.read_csv(sensor_k2, skiprows=3, index_col=0)
df_k2.index = pandas.to_datetime(df_k2.index)
df_k2 [df_k2>1]= numpy.NaN
df_k2 = df_k2.resample('24H').mean()

path="/var/site/uaf_sp/ngee_koug_met/outputs/years/albedo_Avg/albedo_Avg_" + stryear
df4 = pandas.read_csv(sensor4, skiprows=3, index_col=0)
df4.index = pandas.to_datetime(df4.index)
df4 [df4>100]= numpy.NaN
df4 = df4.resample('24H').mean()
df4.rename(columns = {'Avg' : 'Albedo'}, inplace=True)

outfile = "/var/site/uaf_sp/ngee_koug_met/outputs/koug_summary_albedo.csv"
dataset=pandas.concat([ df4, df_k2] ,axis=1)
dataset.to_csv(outfile)
</pre>

===Soil Notes===
* VATP looks good

Processing Data Workflow

2018-10-17T21:06:55Z

24.237.87.170:

# Visit Site & Download Data with Toughbook
## data should go in ~/Dropbox/logger_data/$YEAR/$SITE/
## general naming convention for data files is: $SITE_$TABLE-$YEAR_$MONTH_$DAY.dat
# Back in camp/town/place with internet access, put toughbook online so Dropbox can mirror data to other computers
# Next, out of the field and back in the office: copy this data from dropbox to /var/site/$AREA/$SITE/raw or similar (e.g. (/var/site/utq/utq_A/raw/)
# Most processing scripts are located in /var/site/bin/ with a name like process_$SITE.sh (e.g. process_teller_bottom.sh)
# to this script add lines in each appropriate section so that datapro can process this new data
# In the initial cut here (I'm just starting to do this 10/2018) I have two bash functions in the script. They're related. 1) is delete all the processed data in /var/site/$AREA/$SITE/outputs and 2) is apply the manual QA. In the bash script, I comment the calls to do those two things first run so that the processing is quicker. So, edit the bash file to comment the two function calls, too.
# next, run the bash script.
# once done the data will appear here: /var/site/$AREA/$SITE/outputs/. I have a web page that can be used for visualizations. /var/site/$AREA/$SITE/index.html after the automated processing has fixed everything then I review this page to catch things it misses (for instance, animal damage knocking a radiometer off level, other oddities where the data appears right but isn't quite.)
# Any manual corrections go in an excel spreadsheet. /var/site/$AREA/$SITE/qc/$SENSORNAME_fixes.xlsx
# there should be a line in the process_$SITE.sh subroutine for manual fixes for this file (most don't have this line until there is manually correcting to do).
# After manual corrections are complete and script is updated, re-run /var/site/bin/process_$SITE.sh with everything uncommented so that final dataset is created from scratch and manual edits are applied.
# upload the final product from local computer to main server / or data archive etc (ngeedata / ocotal / project data portal)

Processing Data Workflow

2018-10-17T20:23:26Z

24.237.87.170: Created page with "# Visit Site & Download Data with Toughbook ## data should go in ~/Dropbox/logger_data/$YEAR/$SITE/ ## general naming convention for data files is: $SITE_$TABLE-$YEAR_$MONTH_D..."

# Visit Site & Download Data with Toughbook
## data should go in ~/Dropbox/logger_data/$YEAR/$SITE/
## general naming convention for data files is: $SITE_$TABLE-$YEAR_$MONTH_DAY.dat
# Back in town, put toughbook online so it can be mirrored by other computers
# Back to office, copy this data from dropbox to /var/site/$AREA/$SITE/raw or similar
# Most processing scripts are located in /var/site/bin/ with name like process_$SITE.sh
# to this script add lines in each appropriate section so that datapro can process this new data
# In the initial cut here (I'm just starting to do this 10/2018) I have two bash functions in the script. They're related. 1) is delete all the processed data in /var/site/$AREA/$SITE/outputs and 2) is apply the manual QA. In the bash script, I comment the calls to do those two things first run so that the processing is quicker. So, edit the bash file to comment the two function calls, too.
# next, run the bash script.
# once done the data will appear here: /var/site/$AREA/$SITE/outputs/. I have a web page that can be used for visualizations. /var/site/$AREA/$SITE/index.html after the automated processing has fixed everything then I review this page to catch things it misses (for instance, animal damage knocking a radiometer off level, other oddities where the data appears right but isn't quite.)
# Any manual corrections go in an excel spreadsheet. /var/site/$AREA/$SITE/qc/$SENSORNAME_fixes.xlsx
# there should be a line in the process_$SITE.sh subroutine for manual fixes for this file (most don't have this line until there is manually correcting to do).
# After manual corrections are complete and script is updated, re-run /var/site/bin/process_$SITE.sh with everything uncommented so that final dataset is created from scratch and manual edits are applied.
# upload the final product from local computer to main server / or data archive etc

Main Page

2018-10-17T20:07:56Z

24.237.87.170: /* IARC Project Site Logs and To-Do lists */

= Water and Environmental Research Center Hydrologic Research Sites Wikipedia =

''ngeedata.iarc.uaf.edu/mediawiki is the current web site as of 8/2015'' 
--Bob 

'''This is a collaborative website for people involved with WERC's research stations, in any of several different projects:'''

== Some Good Things to Know ==

* [[New Person]] in the department guide
* [[North Slope Training Procedures - Bullen/Foothills/Kuparuk projects]]
* [[Common Instrumentation]] links
* [[Software]] we use
* [[Troubleshooting]] sensors etc.
* [[Common Sensor Wiring]]
* [[PAKBUS and RADIOS]] we use (WERC)
* [[Pakbus IDs]] (IARC)
* [[Datalogger programming]]
* [[Laboratory Scale Logging Computer]]
* [[Field Safety]]
** '''New for 2018''' Fill out this form before every trip involving students:
*** https://drive.google.com/file/d/1Jnpk4dewkk1wqafJZju-f7uUy15N6iXt/view

* [[Computers]]
* [[Handy Tools]]
* [[Potentially Useful Technologies]]
* [[IARC 106 Storage]]
* [[Desiccant Drying]]
* [[Land Permits]]

== Field Procedures ==
* [[Eppley PSP and PIR info]] EY June 2017
* [[HOBO]] U20 Water Level Loggers
* [[Sediment Sampling Procedures]] Erica Lamb
* Setting up [[Novatel GPS units]]
* Setting up [[Freewave Radios to work with Novatel GPS units]]
* Dealing with [[Plant Cams]]
* Making [[discharge measurements with ADCP]]
* [[Spring Stream Gauging Field Supplies]] Umiat Project Supplies List
* [[Winriver II]] Software for RDI ADCP Discharge Measurements
* Using the [[RDI StreamPro ADCP]]
* Using the [[RDI Rio Grande ADCP]]
* [[Bluetooth Communiciations]] for ADCP Discharge Measurements
* Using the [[Sontek RiverSurveyor S5 ADCP]]
* [[Quality Assurance/Control of ADCP Measurements]]
* Using the [[Sontek handheld ADP]]
* Using the [[Sontek Rivercat and Toughbook]]
* Using the [[Flo-Mate]] flow meter
* [[WERC Snow Survey Procedure]]
* Checking the [[TPS]] precipitation sensor.
* [[Trimble R8 Fast-Static Surveys]]
* A [[Thaw probe design]]
* Alternative to the Gieck Stand-- [[variable terrain rain gage stand]]
* [[Tripod setup|Cheap tripod setup]] 
*Using [[Isco 3700 Auto-Sampler]]
* Update a [[CR10X Operating System]]
* Add a [[scheduled task in windows]]
* [[Change an SDI Address]]
* [[HMP155 USB Interface Commands]]
* [[Soldering Guidance]]
* [[RTK GPS Survey]]
* [[AR Parrot and remote robotics type stuff]]
* [[Sediment Collection Instructions]]

== WERC Project Site Logs and To-Do lists ==
* [[Sag Sediment Study - Toniolo]]
* [[TEON - Arp]]
* [[WERC Toughbook Names/Passwords]]
* [[Ambler Inventory Spring 2015]] Ambler Inventory Spring 2015 Upark
* [[Sagavanirktok R Dalton Hwy Flooding]] Logistics and Planning
* [[Umiat/ADOT Project July 2013 Field Trip]] Umiat/NSlope sites priorities
* [[Ambler/ADOT Project May 2013 Field Trip]] Bettles Crew Logistics & Planning
* [[Umiat/ADOT Project May 2013 Field Trip]] Umiat Crew Logistics & Planning
* [[Umiat/ADOT and USFWS Project May 2013 Field Trip]] Toolik Crew Logistics & Planning
* [[Spring Stream Gauging Field Supplies]] Umiat Project Supplies List
* [[Umiat/Ambler Project GPS/ADCP/Base/Boat Box Tote Inventory]] What you should have in your Base/Boat GPS/ADCP Box for each trip
* [[Umiat/Ambler Project Electronics Tote Inventory]] What you should have in your electronics tote for each trip
* [[Kanex Inventory]] Nathan Stephan
* [[Umiat Project Station Inventories]]
* [[ADOT Project Toughbook Software List]]
* [[Umiat May 2010 Field Trip]] Logistics Planning
* [[Umiat May 2011 Field Trip]] Planning
* [[April 2010 Snow Survey Trip]] TO DO List
* [[all projects]] todo and site logs
* [[Sept 2009 Field Trip ]] General ToDo List
* [[Sept 2008 Field Trip - Emily and Ken]] General ToDo List
* [[June 2008 Field Trip - Emily and Ken]] General ToDo List
* [[North Slope Kuparuk]]
* [[North Slope Bullen]]
* [[North Slope Foothills]]
== IARC Project Site Logs and To-Do lists ==
* [[IARC Ocotal Move]]
* [[Super-Site]]
** [[SS To Do Next Visit]]
* [[NGEE]]
** [[NGEE To Do Next Visit]]
** [[Seward Peninsula Sites]]
*** https://wiki.alaska.edu/display/iarcsp/Seward+Peninsula+Wiki
* [[Office of Special Projects]]
* [[Field Trips]]
* [[IARC Fieldbooks]]
* [[IARC Base Radios]]
* [[Processing Data Workflow]]

=== IARC Incomplete Sensors & Caibrations===
* [[IARC East30 Sensors]]

=== IARC Archived:===
** [[Cherry TFS sites]]
** [[Cherry ARM sites]]
** [[BNZ LTER]]
** [[Jessie Cable & Bob Bolton EPSCOR in CPCRW project]]
** [[Barrow Soil Moisture]] Anna L's SM experiment in Barrow
** [[Chas Sites]]

== WERC Field Books ==
* [[ken 2005 1]]
* [[ken 2005-2]]
* [[ken 2006-1]]
* [[ken 2007-1]]
* [[ken 2008-2]]
* [[ken 2008-3]]

== Equipment Manuals ==

* [[Equipment Manuals]]

== ''Meta-topics'' on the use & setup of the WERC wiki ==
* editing wiki pages
* [[implementing site todo lists and logs]]

Main Page

2018-10-17T20:07:42Z

24.237.87.170: /* IARC Project Site Logs and To-Do lists */

= Water and Environmental Research Center Hydrologic Research Sites Wikipedia =

''ngeedata.iarc.uaf.edu/mediawiki is the current web site as of 8/2015'' 
--Bob 

'''This is a collaborative website for people involved with WERC's research stations, in any of several different projects:'''

== Some Good Things to Know ==

* [[New Person]] in the department guide
* [[North Slope Training Procedures - Bullen/Foothills/Kuparuk projects]]
* [[Common Instrumentation]] links
* [[Software]] we use
* [[Troubleshooting]] sensors etc.
* [[Common Sensor Wiring]]
* [[PAKBUS and RADIOS]] we use (WERC)
* [[Pakbus IDs]] (IARC)
* [[Datalogger programming]]
* [[Laboratory Scale Logging Computer]]
* [[Field Safety]]
** '''New for 2018''' Fill out this form before every trip involving students:
*** https://drive.google.com/file/d/1Jnpk4dewkk1wqafJZju-f7uUy15N6iXt/view

* [[Computers]]
* [[Handy Tools]]
* [[Potentially Useful Technologies]]
* [[IARC 106 Storage]]
* [[Desiccant Drying]]
* [[Land Permits]]

== Field Procedures ==
* [[Eppley PSP and PIR info]] EY June 2017
* [[HOBO]] U20 Water Level Loggers
* [[Sediment Sampling Procedures]] Erica Lamb
* Setting up [[Novatel GPS units]]
* Setting up [[Freewave Radios to work with Novatel GPS units]]
* Dealing with [[Plant Cams]]
* Making [[discharge measurements with ADCP]]
* [[Spring Stream Gauging Field Supplies]] Umiat Project Supplies List
* [[Winriver II]] Software for RDI ADCP Discharge Measurements
* Using the [[RDI StreamPro ADCP]]
* Using the [[RDI Rio Grande ADCP]]
* [[Bluetooth Communiciations]] for ADCP Discharge Measurements
* Using the [[Sontek RiverSurveyor S5 ADCP]]
* [[Quality Assurance/Control of ADCP Measurements]]
* Using the [[Sontek handheld ADP]]
* Using the [[Sontek Rivercat and Toughbook]]
* Using the [[Flo-Mate]] flow meter
* [[WERC Snow Survey Procedure]]
* Checking the [[TPS]] precipitation sensor.
* [[Trimble R8 Fast-Static Surveys]]
* A [[Thaw probe design]]
* Alternative to the Gieck Stand-- [[variable terrain rain gage stand]]
* [[Tripod setup|Cheap tripod setup]] 
*Using [[Isco 3700 Auto-Sampler]]
* Update a [[CR10X Operating System]]
* Add a [[scheduled task in windows]]
* [[Change an SDI Address]]
* [[HMP155 USB Interface Commands]]
* [[Soldering Guidance]]
* [[RTK GPS Survey]]
* [[AR Parrot and remote robotics type stuff]]
* [[Sediment Collection Instructions]]

== WERC Project Site Logs and To-Do lists ==
* [[Sag Sediment Study - Toniolo]]
* [[TEON - Arp]]
* [[WERC Toughbook Names/Passwords]]
* [[Ambler Inventory Spring 2015]] Ambler Inventory Spring 2015 Upark
* [[Sagavanirktok R Dalton Hwy Flooding]] Logistics and Planning
* [[Umiat/ADOT Project July 2013 Field Trip]] Umiat/NSlope sites priorities
* [[Ambler/ADOT Project May 2013 Field Trip]] Bettles Crew Logistics & Planning
* [[Umiat/ADOT Project May 2013 Field Trip]] Umiat Crew Logistics & Planning
* [[Umiat/ADOT and USFWS Project May 2013 Field Trip]] Toolik Crew Logistics & Planning
* [[Spring Stream Gauging Field Supplies]] Umiat Project Supplies List
* [[Umiat/Ambler Project GPS/ADCP/Base/Boat Box Tote Inventory]] What you should have in your Base/Boat GPS/ADCP Box for each trip
* [[Umiat/Ambler Project Electronics Tote Inventory]] What you should have in your electronics tote for each trip
* [[Kanex Inventory]] Nathan Stephan
* [[Umiat Project Station Inventories]]
* [[ADOT Project Toughbook Software List]]
* [[Umiat May 2010 Field Trip]] Logistics Planning
* [[Umiat May 2011 Field Trip]] Planning
* [[April 2010 Snow Survey Trip]] TO DO List
* [[all projects]] todo and site logs
* [[Sept 2009 Field Trip ]] General ToDo List
* [[Sept 2008 Field Trip - Emily and Ken]] General ToDo List
* [[June 2008 Field Trip - Emily and Ken]] General ToDo List
* [[North Slope Kuparuk]]
* [[North Slope Bullen]]
* [[North Slope Foothills]]
== IARC Project Site Logs and To-Do lists ==
* [[IARC Ocotal Move]]
* [[Super-Site]]
** [[SS To Do Next Visit]]
* [[NGEE]]
** [[NGEE To Do Next Visit]]
** [[Seward Peninsula Sites]]
*** https://wiki.alaska.edu/display/iarcsp/Seward+Peninsula+Wiki
* [[Office of Special Projects]]
* [[Field Trips]]
* [[IARC Fieldbooks]]
* [[IARC Base Radios]]
=== IARC Incomplete Sensors & Caibrations===
* [[IARC East30 Sensors]]
* [[Processing Data Workflow]]

=== IARC Archived:===
** [[Cherry TFS sites]]
** [[Cherry ARM sites]]
** [[BNZ LTER]]
** [[Jessie Cable & Bob Bolton EPSCOR in CPCRW project]]
** [[Barrow Soil Moisture]] Anna L's SM experiment in Barrow
** [[Chas Sites]]

== WERC Field Books ==
* [[ken 2005 1]]
* [[ken 2005-2]]
* [[ken 2006-1]]
* [[ken 2007-1]]
* [[ken 2008-2]]
* [[ken 2008-3]]

== Equipment Manuals ==

* [[Equipment Manuals]]

== ''Meta-topics'' on the use & setup of the WERC wiki ==
* editing wiki pages
* [[implementing site todo lists and logs]]

NGEE

2018-10-17T19:57:06Z

24.237.87.170: /* Notes */

===Trips===
* [[NGEE April 11 2012 Trip]]
* [[NGEE September 3 2012 Trip]]
* [[NGEE September 24 2012 Trip]]
* [[NGEE Barrow Wiring Layout]]
* [[NGEE Barrow Intensive Sites Initial Wiring]]
* [[NGEE Barrow 2013 Boring Trip]]
* [[NGEE Barrow 2013 Site Install Trip|[NGEE Barrow 2013 Site Install Trip 5/7]]
* [[NGEE Barrow 2013 Site Install Trip 2|NGEE Barrow 2013 Site Install Trip June]]
* [[NGEE Barrow 2013 Site D Install Trip August 2013]]
* [[March 2014 Barrow]]
* [[August 2014 Barrow]]
* [[NGEE December 2014 Barrow]]
* [[NGEE May 2015 Barrow]]
* [[NGEE June 2015 Barrow]]
* [[NGEE July 2015 Nome]]
* [[NGEE August 2015 Barrow]]
* [[NGEE September 2015 Barrow]]
* [[NGEE September 2015 Nome]]
* [[NGEE Barrow Remainder Items]]
* [[NGEE Spring 2016]]
* [[NGEE Barrow April 2016]]
* [[NGEE Nome April 2016 pt 1]]
* [[NGEE Nome April 2016 pt2]]
* [[NGEE Barrow August 2016]]
* [[NGEE Barrow September 2016]]
* [[2016 NGEE August Nome Trip]]
* [[2016 NGEE September Nome Trip]]
* [[2017 NGEE March Nome Trip]]
* [[2017 NGEE April Nome Trip]]
* [[2017 NGEE June Nome Trip]]
* [[2017 NGEE Barrow Trip]]
* [[CPCRW 2012-10-12]]
* [[CPCRW 2013-07-15]]
* [[2017 NGEE GIPL July Nome Trip]]
* [[2017 NGEE Nome August trip]]
* [[2017 NGEE Nome October trip]]
* [[2018 NGEE Nome March Trip]]
* [[2018 NGEE Nome June Trip]]
* [[2018 NGEE Nome September Trip]]
* [[2018 NGEE Fall Utqiagvik Trip]]

===Safety===
* Before every trip be sure to submit a Field Emergency Plan to your director & travel coordinator.
* Also update the field supplemental as needed.
* Annually, review the NGEE team safety document. Find it online:
** http://ngee-arctic.ornl.gov/sites/default/files/ngee_project_field_safety_manual_rev_2016V6.pdf
** http://ngee-arctic.ornl.gov/ngee-safety

===Notes===
* [https://docs.google.com/presentation/d/1T_palR7wRBEKsoz4xnVHhwOiYpCi0hiD9_usjw4haWc/edit#slide=id.p Slides of BEO Control Shed]
* https://ngee-arctic.atlassian.net/wiki/display/MOD/NGEE-Arctic+Modeling+Home
* [[NGEE Barrow Intensive Sites Initial Wiring]]
* Programs:
** https://github.com/frankohanlon/ngee/
* [[NGEE Site A Instrumentation History]]
* [[NGEE Site B Instrumentation History]]
* [[NGEE Site C Instrumentation History]]
* [[NGEE Site D Instrumentation History]]
* [[NGEE Data Log Record]]
* [[NGEE Backup Instrumentation]]
* [[Several Important Network Devices]]
* [[NGEE-Barrow Manual QA Notes]]
* [[NGEE-Nome Sites]]
* [[NGEE-Barrow Telemetry Testing]]
* [[NGEE Data Archive Direct Links]]
* [[NGEE Download ARM Data]]
* [[NGEE Barrow Computer Network Links]]
* [[NGEE Seward Survey Notes]]
* [[NGEE Teller Bottom Notes]]
* [[NGEE Teller SW Notes]]
* [[NGEE Teller Top Notes]]
* [[NGEE Kougarok M64 Notes]]
* [[K2 Met Notes]]

===Metadata type stuff===
* [[NGEE Data Archive Direct Links]]
* Snake River observations from the NWS:
** http://aprfc.arh.noaa.gov/rivobs/rivobs.php
* Still to be collated: [[NGEE-Barrow Calibration and Serial Numbers]]
* Thermistor Probe Calibrations ([https://docs.google.com/open?id=0B0bJdr7FBoY-MG9FTjFCb2w2c28])
* Thermistor Strings and Triple Calibrations ([https://docs.google.com/open?id=0B0bJdr7FBoY-WkVfMDdLX3Zjc2c])
* Timezone - UTC
* PakBus IDs - A = 400; B = 401; C = 402; D = 404; BRW_Grid = 403

====Lists====
* [[NGEE To Do Next Visit]]
* [[Guruplug Setup]]
* [[Webcam Tips]]
* [[To-Do in October 2016]]

* [[NGEE Iridium System Brainstorm]]

NGEE Kougarok M64 Notes

2018-10-17T01:27:22Z

24.237.87.170: /* Radiation Notes */

[[NGEE]]
===Site Visits===
* 6/24/2017 (Bob and Lily Site Install)
* 8/19/2017 (Lily and ABOVE Team)
* 10/5/2017 (Bob and Lily Fall Visit)
* 4/3/2018 (Snow Team)
* 6/14/2018 (Bob and Nathan)
* 9/22/2018 (Bobs and CAS)

===Processed through===
* AT/RH/Precip / WS / WD / BP through 4/3/2018
* Radiation through 4/3/2018
* VATP through 4/3/2018

===Met Notes===
* Fall 2017: Muskox knock over precip bucket.
* 10/16/2017 12:00 end of precip season for kougarok.
* 6/14/2018 Fixed precip bucket, noticed Musk ox twisted tower center mast at some point so Wind Direction and Radiation have been off for a TBD amount of time.
** NAN through 6/15/2018 00:00 time step (the test tips)
* 9/22/2018 musk ox twisted center mast a bit again. WD off, Radiation still pretty closer to still on.

===Radiation Notes===
* I have open questions about PRI index value but the data from the sensors themselves looks ok.
* Snippet for trying to pin down when the muskox move the CNR4...
** Need to compare albedo here to K2 Met...
** ... albedo didn't show anything but incoming shortwave radiation shows a shift on 5/14 so I'm going to 6999 from there till June station visit.
** second bump was gentle enough there is no obvious error in SW data from June till September visit even though the Musk Ox twisted 10 degrees or something the station.
** Declaring data bad '''5/14/18 13:00 till station visit on 6/14/18 22:00'''
<pre>
import numpy
import pandas
stryear="2018.csv"

sensor_k2 = "/var/site/uaf_sp/k-met/outputs/k2_met_albedo_" + stryear
df_k2 = pandas.read_csv(sensor_k2, skiprows=3, index_col=0)
df_k2.index = pandas.to_datetime(df_k2.index)
df_k2 [df_k2>1]= numpy.NaN
df_k2 = df_k2.resample('24H').mean()

path="/var/site/uaf_sp/ngee_koug_met/outputs/years/albedo_Avg/albedo_Avg_" + stryear
df4 = pandas.read_csv(sensor4, skiprows=3, index_col=0)
df4.index = pandas.to_datetime(df4.index)
df4 [df4>100]= numpy.NaN
df4 = df4.resample('24H').mean()
df4.rename(columns = {'Avg' : 'Albedo'}, inplace=True)

outfile = "/var/site/uaf_sp/ngee_koug_met/outputs/koug_summary_albedo.csv"
dataset=pandas.concat([ df4, df_k2] ,axis=1)
dataset.to_csv(outfile)
</pre>

===Soil Notes===
* VATP looks good

NGEE Kougarok M64 Notes

2018-10-17T00:54:18Z

24.237.87.170: /* Radiation Notes */

[[NGEE]]
===Site Visits===
* 6/24/2017 (Bob and Lily Site Install)
* 8/19/2017 (Lily and ABOVE Team)
* 10/5/2017 (Bob and Lily Fall Visit)
* 4/3/2018 (Snow Team)
* 6/14/2018 (Bob and Nathan)
* 9/22/2018 (Bobs and CAS)

===Processed through===
* AT/RH/Precip / WS / WD / BP through 4/3/2018
* Radiation through 4/3/2018
* VATP through 4/3/2018

===Met Notes===
* Fall 2017: Muskox knock over precip bucket.
* 10/16/2017 12:00 end of precip season for kougarok.
* 6/14/2018 Fixed precip bucket, noticed Musk ox twisted tower center mast at some point so Wind Direction and Radiation have been off for a TBD amount of time.
** NAN through 6/15/2018 00:00 time step (the test tips)
* 9/22/2018 musk ox twisted center mast a bit again. WD off, Radiation still pretty closer to still on.

===Radiation Notes===
* I have open questions about PRI index value but the data from the sensors themselves looks ok.
* Snippet for trying to pin down when the muskox move the CNR4...
** Need to compare albedo here to K2 Met...
** ... albedo didn't show anything but incoming shortwave radiation shows a shift on 5/14 so I'm going to 6999 from there till June station visit.
** second bump was gentle enough there is no obvious error in SW data from June till September visit even though the Musk Ox twisted 10 degrees or something the station.
<pre>
import numpy
import pandas
stryear="2018.csv"

sensor_k2 = "/var/site/uaf_sp/k-met/outputs/k2_met_albedo_" + stryear
df_k2 = pandas.read_csv(sensor_k2, skiprows=3, index_col=0)
df_k2.index = pandas.to_datetime(df_k2.index)
df_k2 [df_k2>1]= numpy.NaN
df_k2 = df_k2.resample('24H').mean()

path="/var/site/uaf_sp/ngee_koug_met/outputs/years/albedo_Avg/albedo_Avg_" + stryear
df4 = pandas.read_csv(sensor4, skiprows=3, index_col=0)
df4.index = pandas.to_datetime(df4.index)
df4 [df4>100]= numpy.NaN
df4 = df4.resample('24H').mean()
df4.rename(columns = {'Avg' : 'Albedo'}, inplace=True)

outfile = "/var/site/uaf_sp/ngee_koug_met/outputs/koug_summary_albedo.csv"
dataset=pandas.concat([ df4, df_k2] ,axis=1)
dataset.to_csv(outfile)
</pre>

===Soil Notes===
* VATP looks good

K2 Met Notes

2018-10-16T23:14:00Z

24.237.87.170:

[[NGEE]]
===2018===
* Site Visit 2018-09-23
====Met Data====
* All Good through 9/23/18
* Winter Season for Precip Ends: 5/8/18 5:00
====Radiation Data====
* All Good through 9/23/2018

===2017===
* Site Visit / Station down for maintenance: 6/21/2017 12:00 to 6/26/2017 13:00

==== Met Data====
** 6/26/2017 14:00 - 16:00 3m AT/RH bad
** Winter Season for Precip Ends: 5/7/17 10:00
** Winter Season for Precip Begins: 10/16/17 3:00

===Soil Information:===
D:\projects_usb_drive\UAF\From Crane\archived files from past workers\ANDYS\ANDYWORK\SEWARD_PEN\KOUGAROK\K2_10MTOWER_\WORKING\2000K2.XLS
=IF(F3>60,6999,IF(F3<3,6999,IF(F3=0,6999,IF(F3=-6999,-6999,IF(F3=6999,6999,1/(0.00128+0.000237*(LN(F3*1000))+0.0000000906*((LN(F3*1000))^3))-273.15)))))
Pre-Fire:
Thermistor String 1 -- 0, 5, 10, 15, 20, 30
Thermistor String 2 -- 20, 35, 50, 70, 95, 120
Soil Moisture: 5, 10, 15, 20, 25, 30

K2 Met Notes

2018-10-16T23:13:46Z

24.237.87.170:

===2018===
* Site Visit 2018-09-23
====Met Data====
* All Good through 9/23/18
* Winter Season for Precip Ends: 5/8/18 5:00
====Radiation Data====
* All Good through 9/23/2018

===2017===
* Site Visit / Station down for maintenance: 6/21/2017 12:00 to 6/26/2017 13:00

==== Met Data====
** 6/26/2017 14:00 - 16:00 3m AT/RH bad
** Winter Season for Precip Ends: 5/7/17 10:00
** Winter Season for Precip Begins: 10/16/17 3:00

===Soil Information:===
D:\projects_usb_drive\UAF\From Crane\archived files from past workers\ANDYS\ANDYWORK\SEWARD_PEN\KOUGAROK\K2_10MTOWER_\WORKING\2000K2.XLS
=IF(F3>60,6999,IF(F3<3,6999,IF(F3=0,6999,IF(F3=-6999,-6999,IF(F3=6999,6999,1/(0.00128+0.000237*(LN(F3*1000))+0.0000000906*((LN(F3*1000))^3))-273.15)))))
Pre-Fire:
Thermistor String 1 -- 0, 5, 10, 15, 20, 30
Thermistor String 2 -- 20, 35, 50, 70, 95, 120
Soil Moisture: 5, 10, 15, 20, 25, 30

NGEE Teller Top Notes

2018-10-16T19:54:49Z

24.237.87.170:

[[NGEE]]
===Latest===
* Met Data QA'd through last visit (9/2018)
* Radiation Data QA'd through last visit (9/2018)
* Partway through processing soil.

===Met 2017===
* HMP155 August 2017
** failure looks legit... not a data gap.
* HMP155 Cuts out on 10/25 8:00
** replaced AT portion with new AT thermistor.
** DP & RH left NAN
* HMP155 replaced on March 2018 visit
* Rain corrected through most recent download.
* Wind Speed / Direction
** Propeller replaced 6/28/2017
** No Rime fall 2017

===Met 2018===
* Wind
** all rime conditions corrected for through 3/2018 in QC spreadsheet.
* Rain NAN through snowmelt
* Radiometer leveled and desiccant replaced 6/12/2018
* Radiometer leveled again 9/24/2018
* Tipping bucket leveled 6/12/2018 & 9/24/2018
* AT/RH corrected through 3/30/2018 20:00 after sensor destroyed over winter season.

===Radiation 2017===
* There is a gap 10/2/2017 0:00 to 10/2/2017 22:00
** I think this is when we removed the sensor from the field to change the desiccant.
*** as in, the screws were stripped and so we drilled and retapped back in town.

===Radiation 2018===
* All good through March visit.
** There is a weird thing in 2018 where the lower SW has values higher than the upper SW. I assume this is due to snow/ frost up top. Perhaps related to how close the snow surface is to the sensor this year resulting in a lower wind speed later in the winter.

===Soil 2017===
* 2017 heat flux plates prior to fall were being measured on wrong channel.
* 2017-03-12 02:00:00 Upper heat flux plate has a value that isn't ever flipped by the qc program.
* 2017-03-12 02:00:00 Lower heat flux plate has a value that isn't ever flipped by the qc program.
* Easy Perl one liners to accomplish this:
perl -pi -e 's/"2017-03-12 02:00:00",149.2/"2017-03-12 02:00:00",6999.00/g;' $TT_SOIL_DIR/outputs/SoilPit_HeatFlux_Lower.csv
perl -pi -e 's/"2017-03-12 02:00:00",140.8/"2017-03-12 02:00:00",6999.00/g;' $TT_SOIL_DIR/outputs/SoilPit_HeatFlux_Upper.csv
* 2017 Soil pit soil moisture -- all corrected
* 2017 Soil heat flux plates also all corrected
* with Vlad determined only good VATP are 2/5/25/50/60/100
* Soil Temperature: VATP
** I think I have everything corrected though I don't entirely believe the '''100cm probe.
* 8/16/2017 from Lily's field book page 50:
** '''VATP was heaved 9.5cm above standing water table. I pushed it back down'''

===Soil 2018===
* 2018 soil pit soil moisture -- all corrected through most recent visit (3/2018)
*

===Snow 2018===
* Snow temperature profile
** Weird shift (looks like mux wonky 1/22 to 1/28/2018)

Site Downloads / visits:
* Lily / Bob 6/28/2017
* Lily 8/16/2017
* Lily 8/20/2017
* Bob 6/12/2018

NGEE Teller SW Notes

2018-10-16T19:54:14Z

24.237.87.170:

[[NGEE]]
===Latest===
* Unofficially processed through 9/2018
** there are some early winter 2017 peaks I think should be considered.
* hoping to establish stage/discharge curve in 2018

===Stage 2016===

8/13/2016 3:00 PTs offset
9/14/2016 22:00 PT1 Position Reset & PT2 Removed
===Stage 2017===

4/1/2017 3:00 Station Turned back on, PT2 in place further downstream
10/1/2017 20:00 PT2 Removed
4/28/2017 1:50 shift in pt2? then

===Stage 2018===
6/15
9/26

===Site Downloads / visits:===
* Bob 4/21/2016 (CR1000)
* Lily 7/13/2016 (CR1000)
* Bob/Lily 8/12/2016 (CR1000)
* Bob 9/14/2016
* Bob 4/1/2017
* Bob 5/2017
* Bob/Lily 10/1/2017
* Bob 3/30/2018
* Bob 6/13 & 15/2018
* Bob 9/26/2018

===From Computer Notes===
Need to put into a spreadsheet pressure transducer value / date / manual stage reading.... need to review notes.

Related: discharge measurements
Related: Get manual stage & discharge measurements into UTC time.

Then once that is complete can look at using
/var/site/uaf_sp/bin/teller_sw.sh
and the step utility function to correct everything to proper heights.
...should think about gedit plug ins too to make it more like xed.

Original Google Doc:
* https://docs.google.com/spreadsheets/d/159Q7kFOTAE0pZyx2WgFBhe4qVnLEEM8diSVuSYGRkjE/edit#gid=1602029777
Summary Google Doc:
* https://docs.google.com/spreadsheets/d/1gxLKzjoDvJkFmkDe0SVBhRRbokB-rvEpH77nN8cyLo0/edit#gid=1602029777

2/8: So.... including precip helps but there is still a period in september / october 2016 that confuses me with the diurnal signal looking more like air temperature driven. Emily and I sort of think that the heating of the cable might be playing a role here but I haven't looked too hard yet.

NGEE Teller Bottom Notes

2018-10-16T19:53:57Z

24.237.87.170:

[[NGEE]]
===Latest===
* Met Data QA'd through: 9/24/2018
* Radiation Data QA'd through: 9/24/2018
* Soil through:
* Snow profile through:
* Snow through: 2016-2017 season
* Spectral through:

===Met===
====Met 2016====
* All fixed prior to start of this page... I'll go back and add notes as time allows.
* But, station put up in early April 2016 as a temporary setup on a
* Summer Precip Ends: 11/04/2016 02:00
* '''Need to revisit data grouper to address the pandas change with respect to NAN and averaging. 10/12/2018''' (for AT/RH/DP in 2016 April)

====Met 2017====
* all good / corrected... same as above, I will add notes later.
* Last Winter Season Precip: 04/21/2017 18:00
* Start of Winter Season for Precip: 10/15/2017 13:00

====Met 2018====
* Barometric Pressure good through 6/2018 visit
* Wind Speed & Direction good through 6/2018 visit
* Air Temperature / Dewpoint / Relative Humidity good through 6/2018 visit
* Rain Gage destroyed by moose 12/25/2017.
** Bucket fixed 6/13/2018 around 21:00 - 22:00 (tips in data were test tips with new bucket).
** QA file reflects this.

===Radiation===
====Radiation 2016====
* all good / corrected

====Radiation 2017====
* all good / corrected

====Radiation 2018====
* SW & LW & Skin Temp look good through 6/2018 visit.

===Soil===
* I need to dig into the fieldbook notes to see if the VATP jacked at all in 2017.

====Soil 2016====

====Soil 2017====
* Heat Flux plates nonworking until 10/2017
====Soil 2018====
* 2018 heat flux plates look decent.
** it could be that top & bottom are flipped and also that what should be the top is actually flipped in sign?...need to compare to top.
* VATP
** Blip during station visit at 6/13/2018 21:00

===Snow===
====Snow 2016-2017====

===Snow 2017-2018===

===Station History / Site Downloads / visits:===
====September 24 & 26 2018====
* B Busey / Bolton / CAS
* memory problem on logger 9/24 but due to food poisoning just downloaded data.
* returned 9/26 and upgraded the OS to latest
* resent program & readdressed.
* I don't yet know the problem here? Error in CF card perhaps? In 2019 I will replace the CF card with another.

====June 13 & 15 2018====
* Station Maintenance @
** 6/13/2018 20:00 UTC
** 6/15/2018 20:00 UTC
**
* B Busey & N Wales
* fixed animal damage
** snow sensor knocked over 12/25/2017
** tipping bucket removed probably around then, too.
* fixed program bug

====April 10 2016====
* Temporary station built above flood plain. Station put in at end of first snow survey trip of Teller.
* At that point this was labeled the blue site (the blue electrical tape IDed this site in the logistics phase).
* Site established around 4/10/2016
** AT/RH
** 4 component Radiation
** Surface water
====April 21 - May 5 1 2016====
* Station visited nearly daily during ablation trip
====July 2016====
* LC visited and downloaded data.
* Temporary station had fallen over (knocked by an animal).
====August 12 - 22 2016====
* LC & B Busey improve upon site making Teller Bottom site and splitting off the Teller Surface Water Station.
* Wind Speed / Direction added
* W

NGEE Kougarok M64 Notes

2018-10-16T19:53:29Z

24.237.87.170:

NGEE Kougarok M64 Notes

2018-10-16T19:14:58Z

24.237.87.170: /* Radiation Notes */

===Site Visits===
* 6/24/2017 (Bob and Lily Site Install)
* 8/19/2017 (Lily and ABOVE Team)
* 10/5/2017 (Bob and Lily Fall Visit)
* 4/3/2018 (Snow Team)
* 6/14/2018 (Bob and Nathan)
* 9/22/2018 (Bobs and CAS)

===Processed through===
* AT/RH/Precip / WS / WD / BP through 4/3/2018
* Radiation through 4/3/2018
* VATP through 4/3/2018

===Met Notes===
* Fall 2017: Muskox knock over precip bucket.
* 10/16/2017 12:00 end of precip season for kougarok.
* 6/14/2018 Fixed precip bucket, noticed Musk ox twisted tower center mast at some point so Wind Direction and Radiation have been off for a TBD amount of time.
** NAN through 6/15/2018 00:00 time step (the test tips)
* 9/22/2018 musk ox twisted center mast a bit again. WD off, Radiation still pretty closer to still on.

===Radiation Notes===
* I have open questions about PRI index value but the data from the sensors themselves looks ok.
* Snippet for trying to pin down when the muskox move the CNR4...
** Need to compare albedo here to K2 Met...
<pre>
import numpy
import pandas
stryear="2018"
path="/var/site/uaf_sp/ngee_koug_"
sensor4 = path + "met/outputs/years/albedo_Avg/albedo_Avg_" + stryear + ".csv"
df4 = pandas.read_csv(sensor4, skiprows=3, index_col=0)
df4.index = pandas.to_datetime(df4.index)
df4 [df4>100]= numpy.NaN
df4 = df4.resample('24H').mean()
df4.rename(columns = {'Avg' : 'Albedo'}, inplace=True)
outfile = path + "met/outputs/ngee_koug_albedo.csv"
df4.to_csv(outfile)
</pre>

===Soil Notes===
* VATP looks good

NGEE Kougarok M64 Notes

2018-10-16T19:09:35Z

24.237.87.170: /* Radiation Notes */

===Site Visits===
* 6/24/2017 (Bob and Lily Site Install)
* 8/19/2017 (Lily and ABOVE Team)
* 10/5/2017 (Bob and Lily Fall Visit)
* 4/3/2018 (Snow Team)
* 6/14/2018 (Bob and Nathan)
* 9/22/2018 (Bobs and CAS)

===Processed through===
* AT/RH/Precip / WS / WD / BP through 4/3/2018
* Radiation through 4/3/2018
* VATP through 4/3/2018

===Met Notes===
* Fall 2017: Muskox knock over precip bucket.
* 10/16/2017 12:00 end of precip season for kougarok.
* 6/14/2018 Fixed precip bucket, noticed Musk ox twisted tower center mast at some point so Wind Direction and Radiation have been off for a TBD amount of time.
** NAN through 6/15/2018 00:00 time step (the test tips)
* 9/22/2018 musk ox twisted center mast a bit again. WD off, Radiation still pretty closer to still on.

===Radiation Notes===
* I have open questions about PRI index value but the data from the sensors themselves looks ok.
* Snippet for trying to pin down when the muskox move the CNR4...
<pre>
import numpy
import pandas
stryear="2018"
path="/var/site/uaf_sp/ngee_koug_"
sensor4 = path + "met/outputs/years/albedo_Avg/albedo_Avg_" + stryear + ".csv"
df4 = pandas.read_csv(sensor4, skiprows=3, index_col=0)
df4.index = pandas.to_datetime(df4.index)
df4 [df4>100]= numpy.NaN
df4 = df4.resample('24H').mean()
df4.rename(columns = {'Avg' : 'Albedo'}, inplace=True)
outfile = path + "met/outputs/ngee_koug_albedo.csv"
df4.to_csv(outfile)
</pre>

===Soil Notes===
* VATP looks good

NGEE Kougarok M64 Notes

2018-10-16T01:12:42Z

24.237.87.170:

NGEE Kougarok M64 Notes

2018-10-16T00:13:09Z

24.237.87.170: /* Met Notes */

NGEE Kougarok M64 Notes

2018-10-16T00:12:12Z

24.237.87.170: /* Site Visits */

NGEE Teller SW Notes

2018-10-16T00:11:17Z

24.237.87.170:

===Latest===
* Unofficially processed through 9/2018
** there are some early winter 2017 peaks I think should be considered.
* hoping to establish stage/discharge curve in 2018

===Stage 2016===

8/13/2016 3:00 PTs offset
9/14/2016 22:00 PT1 Position Reset & PT2 Removed
===Stage 2017===

4/1/2017 3:00 Station Turned back on, PT2 in place further downstream
10/1/2017 20:00 PT2 Removed
4/28/2017 1:50 shift in pt2? then

===Stage 2018===
6/15
9/26

===Site Downloads / visits:===
* Bob 4/21/2016 (CR1000)
* Lily 7/13/2016 (CR1000)
* Bob/Lily 8/12/2016 (CR1000)
* Bob 9/14/2016
* Bob 4/1/2017
* Bob 5/2017
* Bob/Lily 10/1/2017
* Bob 3/30/2018
* Bob 6/13 & 15/2018
* Bob 9/26/2018

===From Computer Notes===
Need to put into a spreadsheet pressure transducer value / date / manual stage reading.... need to review notes.

Related: discharge measurements
Related: Get manual stage & discharge measurements into UTC time.

Then once that is complete can look at using
/var/site/uaf_sp/bin/teller_sw.sh
and the step utility function to correct everything to proper heights.
...should think about gedit plug ins too to make it more like xed.

Original Google Doc:
* https://docs.google.com/spreadsheets/d/159Q7kFOTAE0pZyx2WgFBhe4qVnLEEM8diSVuSYGRkjE/edit#gid=1602029777
Summary Google Doc:
* https://docs.google.com/spreadsheets/d/1gxLKzjoDvJkFmkDe0SVBhRRbokB-rvEpH77nN8cyLo0/edit#gid=1602029777

2/8: So.... including precip helps but there is still a period in september / october 2016 that confuses me with the diurnal signal looking more like air temperature driven. Emily and I sort of think that the heating of the cable might be playing a role here but I haven't looked too hard yet.

NGEE Teller Top Notes

2018-10-16T00:05:19Z

24.237.87.170: /* Met 2018 */

===Latest===
* Met Data QA'd through last visit (9/2018)
* Radiation Data QA'd through last visit (9/2018)
* Partway through processing soil.

===Met 2017===
* HMP155 August 2017
** failure looks legit... not a data gap.
* HMP155 Cuts out on 10/25 8:00
** replaced AT portion with new AT thermistor.
** DP & RH left NAN
* HMP155 replaced on March 2018 visit
* Rain corrected through most recent download.
* Wind Speed / Direction
** Propeller replaced 6/28/2017
** No Rime fall 2017

===Met 2018===
* Wind
** all rime conditions corrected for through 3/2018 in QC spreadsheet.
* Rain NAN through snowmelt
* Radiometer leveled and desiccant replaced 6/12/2018
* Radiometer leveled again 9/24/2018
* Tipping bucket leveled 6/12/2018 & 9/24/2018
* AT/RH corrected through 3/30/2018 20:00 after sensor destroyed over winter season.

===Radiation 2017===
* There is a gap 10/2/2017 0:00 to 10/2/2017 22:00
** I think this is when we removed the sensor from the field to change the desiccant.
*** as in, the screws were stripped and so we drilled and retapped back in town.

===Radiation 2018===
* All good through March visit.
** There is a weird thing in 2018 where the lower SW has values higher than the upper SW. I assume this is due to snow/ frost up top. Perhaps related to how close the snow surface is to the sensor this year resulting in a lower wind speed later in the winter.

===Soil 2017===
* 2017 heat flux plates prior to fall were being measured on wrong channel.
* 2017-03-12 02:00:00 Upper heat flux plate has a value that isn't ever flipped by the qc program.
* 2017-03-12 02:00:00 Lower heat flux plate has a value that isn't ever flipped by the qc program.
* Easy Perl one liners to accomplish this:
perl -pi -e 's/"2017-03-12 02:00:00",149.2/"2017-03-12 02:00:00",6999.00/g;' $TT_SOIL_DIR/outputs/SoilPit_HeatFlux_Lower.csv
perl -pi -e 's/"2017-03-12 02:00:00",140.8/"2017-03-12 02:00:00",6999.00/g;' $TT_SOIL_DIR/outputs/SoilPit_HeatFlux_Upper.csv
* 2017 Soil pit soil moisture -- all corrected
* 2017 Soil heat flux plates also all corrected
* with Vlad determined only good VATP are 2/5/25/50/60/100
* Soil Temperature: VATP
** I think I have everything corrected though I don't entirely believe the '''100cm probe.
* 8/16/2017 from Lily's field book page 50:
** '''VATP was heaved 9.5cm above standing water table. I pushed it back down'''

===Soil 2018===
* 2018 soil pit soil moisture -- all corrected through most recent visit (3/2018)
*

===Snow 2018===
* Snow temperature profile
** Weird shift (looks like mux wonky 1/22 to 1/28/2018)

Site Downloads / visits:
* Lily / Bob 6/28/2017
* Lily 8/16/2017
* Lily 8/20/2017
* Bob 6/12/2018

NGEE Teller Top Notes

2018-10-16T00:04:42Z

24.237.87.170: /* Latest */

===Latest===
* Met Data QA'd through last visit (9/2018)
* Radiation Data QA'd through last visit (9/2018)
* Partway through processing soil.

===Met 2017===
* HMP155 August 2017
** failure looks legit... not a data gap.
* HMP155 Cuts out on 10/25 8:00
** replaced AT portion with new AT thermistor.
** DP & RH left NAN
* HMP155 replaced on March 2018 visit
* Rain corrected through most recent download.
* Wind Speed / Direction
** Propeller replaced 6/28/2017
** No Rime fall 2017

===Met 2018===
* Wind
** all rime conditions corrected for through 3/2018 in QC spreadsheet.
* Rain NAN through snowmelt
* Radiometer leveled and desiccant replaced 6/12/2018
* Tipping bucket leveled 6/12/2018
* AT/RH corrected through 3/30/2018 20:00 after sensor destroyed over winter season.

===Radiation 2017===
* There is a gap 10/2/2017 0:00 to 10/2/2017 22:00
** I think this is when we removed the sensor from the field to change the desiccant.
*** as in, the screws were stripped and so we drilled and retapped back in town.

===Radiation 2018===
* All good through March visit.
** There is a weird thing in 2018 where the lower SW has values higher than the upper SW. I assume this is due to snow/ frost up top. Perhaps related to how close the snow surface is to the sensor this year resulting in a lower wind speed later in the winter.

===Soil 2017===
* 2017 heat flux plates prior to fall were being measured on wrong channel.
* 2017-03-12 02:00:00 Upper heat flux plate has a value that isn't ever flipped by the qc program.
* 2017-03-12 02:00:00 Lower heat flux plate has a value that isn't ever flipped by the qc program.
* Easy Perl one liners to accomplish this:
perl -pi -e 's/"2017-03-12 02:00:00",149.2/"2017-03-12 02:00:00",6999.00/g;' $TT_SOIL_DIR/outputs/SoilPit_HeatFlux_Lower.csv
perl -pi -e 's/"2017-03-12 02:00:00",140.8/"2017-03-12 02:00:00",6999.00/g;' $TT_SOIL_DIR/outputs/SoilPit_HeatFlux_Upper.csv
* 2017 Soil pit soil moisture -- all corrected
* 2017 Soil heat flux plates also all corrected
* with Vlad determined only good VATP are 2/5/25/50/60/100
* Soil Temperature: VATP
** I think I have everything corrected though I don't entirely believe the '''100cm probe.
* 8/16/2017 from Lily's field book page 50:
** '''VATP was heaved 9.5cm above standing water table. I pushed it back down'''

===Soil 2018===
* 2018 soil pit soil moisture -- all corrected through most recent visit (3/2018)
*

===Snow 2018===
* Snow temperature profile
** Weird shift (looks like mux wonky 1/22 to 1/28/2018)

Site Downloads / visits:
* Lily / Bob 6/28/2017
* Lily 8/16/2017
* Lily 8/20/2017
* Bob 6/12/2018

NGEE Teller Bottom Notes

2018-10-12T21:05:41Z

24.237.87.170: /* Latest */

===Latest===
* Met Data QA'd through: 9/24/2018
* Radiation Data QA'd through: 9/24/2018
* Soil through:
* Snow profile through:
* Snow through: 2016-2017 season
* Spectral through:

===Met===
====Met 2016====
* All fixed prior to start of this page... I'll go back and add notes as time allows.
* But, station put up in early April 2016 as a temporary setup on a
* Summer Precip Ends: 11/04/2016 02:00
* '''Need to revisit data grouper to address the pandas change with respect to NAN and averaging. 10/12/2018''' (for AT/RH/DP in 2016 April)

====Met 2017====
* all good / corrected... same as above, I will add notes later.
* Last Winter Season Precip: 04/21/2017 18:00
* Start of Winter Season for Precip: 10/15/2017 13:00

====Met 2018====
* Barometric Pressure good through 6/2018 visit
* Wind Speed & Direction good through 6/2018 visit
* Air Temperature / Dewpoint / Relative Humidity good through 6/2018 visit
* Rain Gage destroyed by moose 12/25/2017.
** Bucket fixed 6/13/2018 around 21:00 - 22:00 (tips in data were test tips with new bucket).
** QA file reflects this.

===Radiation===
====Radiation 2016====
* all good / corrected

====Radiation 2017====
* all good / corrected

====Radiation 2018====
* SW & LW & Skin Temp look good through 6/2018 visit.

===Soil===
* I need to dig into the fieldbook notes to see if the VATP jacked at all in 2017.

====Soil 2016====

====Soil 2017====
* Heat Flux plates nonworking until 10/2017
====Soil 2018====
* 2018 heat flux plates look decent.
** it could be that top & bottom are flipped and also that what should be the top is actually flipped in sign?...need to compare to top.
* VATP
** Blip during station visit at 6/13/2018 21:00

===Snow===
====Snow 2016-2017====

===Snow 2017-2018===

===Station History / Site Downloads / visits:===
====September 24 & 26 2018====
* B Busey / Bolton / CAS
* memory problem on logger 9/24 but due to food poisoning just downloaded data.
* returned 9/26 and upgraded the OS to latest
* resent program & readdressed.
* I don't yet know the problem here? Error in CF card perhaps? In 2019 I will replace the CF card with another.

====June 13 & 15 2018====
* Station Maintenance @
** 6/13/2018 20:00 UTC
** 6/15/2018 20:00 UTC
**
* B Busey & N Wales
* fixed animal damage
** snow sensor knocked over 12/25/2017
** tipping bucket removed probably around then, too.
* fixed program bug

====April 10 2016====
* Temporary station built above flood plain. Station put in at end of first snow survey trip of Teller.
* At that point this was labeled the blue site (the blue electrical tape IDed this site in the logistics phase).
* Site established around 4/10/2016
** AT/RH
** 4 component Radiation
** Surface water
====April 21 - May 5 1 2016====
* Station visited nearly daily during ablation trip
====July 2016====
* LC visited and downloaded data.
* Temporary station had fallen over (knocked by an animal).
====August 12 - 22 2016====
* LC & B Busey improve upon site making Teller Bottom site and splitting off the Teller Surface Water Station.
* Wind Speed / Direction added
* W

NGEE Teller Bottom Notes

2018-10-12T21:04:22Z

24.237.87.170: /* Met 2016 */

===Latest===
* Met Data QA'd through: 6/15/2018
* Radiation Data QA'd through: 6/15/2018
* Soil through:
* Snow profile through:
* Snow through: 2016-2017 season
* Spectral through:

===Met===
====Met 2016====
* All fixed prior to start of this page... I'll go back and add notes as time allows.
* But, station put up in early April 2016 as a temporary setup on a
* Summer Precip Ends: 11/04/2016 02:00
* '''Need to revisit data grouper to address the pandas change with respect to NAN and averaging. 10/12/2018''' (for AT/RH/DP in 2016 April)

====Met 2017====
* all good / corrected... same as above, I will add notes later.
* Last Winter Season Precip: 04/21/2017 18:00
* Start of Winter Season for Precip: 10/15/2017 13:00

====Met 2018====
* Barometric Pressure good through 6/2018 visit
* Wind Speed & Direction good through 6/2018 visit
* Air Temperature / Dewpoint / Relative Humidity good through 6/2018 visit
* Rain Gage destroyed by moose 12/25/2017.
** Bucket fixed 6/13/2018 around 21:00 - 22:00 (tips in data were test tips with new bucket).
** QA file reflects this.

===Radiation===
====Radiation 2016====
* all good / corrected

====Radiation 2017====
* all good / corrected

====Radiation 2018====
* SW & LW & Skin Temp look good through 6/2018 visit.

===Soil===
* I need to dig into the fieldbook notes to see if the VATP jacked at all in 2017.

====Soil 2016====

====Soil 2017====
* Heat Flux plates nonworking until 10/2017
====Soil 2018====
* 2018 heat flux plates look decent.
** it could be that top & bottom are flipped and also that what should be the top is actually flipped in sign?...need to compare to top.
* VATP
** Blip during station visit at 6/13/2018 21:00

===Snow===
====Snow 2016-2017====

===Snow 2017-2018===

===Station History / Site Downloads / visits:===
====September 24 & 26 2018====
* B Busey / Bolton / CAS
* memory problem on logger 9/24 but due to food poisoning just downloaded data.
* returned 9/26 and upgraded the OS to latest
* resent program & readdressed.
* I don't yet know the problem here? Error in CF card perhaps? In 2019 I will replace the CF card with another.

====June 13 & 15 2018====
* Station Maintenance @
** 6/13/2018 20:00 UTC
** 6/15/2018 20:00 UTC
**
* B Busey & N Wales
* fixed animal damage
** snow sensor knocked over 12/25/2017
** tipping bucket removed probably around then, too.
* fixed program bug

====April 10 2016====
* Temporary station built above flood plain. Station put in at end of first snow survey trip of Teller.
* At that point this was labeled the blue site (the blue electrical tape IDed this site in the logistics phase).
* Site established around 4/10/2016
** AT/RH
** 4 component Radiation
** Surface water
====April 21 - May 5 1 2016====
* Station visited nearly daily during ablation trip
====July 2016====
* LC visited and downloaded data.
* Temporary station had fallen over (knocked by an animal).
====August 12 - 22 2016====
* LC & B Busey improve upon site making Teller Bottom site and splitting off the Teller Surface Water Station.
* Wind Speed / Direction added
* W

NGEE Teller Bottom Notes

2018-10-12T20:48:40Z

24.237.87.170: /* Met 2017 */

===Latest===
* Met Data QA'd through: 6/15/2018
* Radiation Data QA'd through: 6/15/2018
* Soil through:
* Snow profile through:
* Snow through: 2016-2017 season
* Spectral through:

===Met===
====Met 2016====
* All fixed prior to start of this page... I'll go back and add notes as time allows.
* But, station put up in early April 2016 as a temporary setup on a
* Summer Precip Ends: 11/04/2016 02:00

====Met 2017====
* all good / corrected... same as above, I will add notes later.
* Last Winter Season Precip: 04/21/2017 18:00
* Start of Winter Season for Precip: 10/15/2017 13:00

====Met 2018====
* Barometric Pressure good through 6/2018 visit
* Wind Speed & Direction good through 6/2018 visit
* Air Temperature / Dewpoint / Relative Humidity good through 6/2018 visit
* Rain Gage destroyed by moose 12/25/2017.
** Bucket fixed 6/13/2018 around 21:00 - 22:00 (tips in data were test tips with new bucket).
** QA file reflects this.

===Radiation===
====Radiation 2016====
* all good / corrected

====Radiation 2017====
* all good / corrected

====Radiation 2018====
* SW & LW & Skin Temp look good through 6/2018 visit.

===Soil===
* I need to dig into the fieldbook notes to see if the VATP jacked at all in 2017.

====Soil 2016====

====Soil 2017====
* Heat Flux plates nonworking until 10/2017
====Soil 2018====
* 2018 heat flux plates look decent.
** it could be that top & bottom are flipped and also that what should be the top is actually flipped in sign?...need to compare to top.
* VATP
** Blip during station visit at 6/13/2018 21:00

===Snow===
====Snow 2016-2017====

===Snow 2017-2018===

===Station History / Site Downloads / visits:===
====September 24 & 26 2018====
* B Busey / Bolton / CAS
* memory problem on logger 9/24 but due to food poisoning just downloaded data.
* returned 9/26 and upgraded the OS to latest
* resent program & readdressed.
* I don't yet know the problem here? Error in CF card perhaps? In 2019 I will replace the CF card with another.

====June 13 & 15 2018====
* Station Maintenance @
** 6/13/2018 20:00 UTC
** 6/15/2018 20:00 UTC
**
* B Busey & N Wales
* fixed animal damage
** snow sensor knocked over 12/25/2017
** tipping bucket removed probably around then, too.
* fixed program bug

====April 10 2016====
* Temporary station built above flood plain. Station put in at end of first snow survey trip of Teller.
* At that point this was labeled the blue site (the blue electrical tape IDed this site in the logistics phase).
* Site established around 4/10/2016
** AT/RH
** 4 component Radiation
** Surface water
====April 21 - May 5 1 2016====
* Station visited nearly daily during ablation trip
====July 2016====
* LC visited and downloaded data.
* Temporary station had fallen over (knocked by an animal).
====August 12 - 22 2016====
* LC & B Busey improve upon site making Teller Bottom site and splitting off the Teller Surface Water Station.
* Wind Speed / Direction added
* W

NGEE Teller Bottom Notes

2018-10-12T20:47:52Z

24.237.87.170: /* Met 2016 */

===Latest===
* Met Data QA'd through: 6/15/2018
* Radiation Data QA'd through: 6/15/2018
* Soil through:
* Snow profile through:
* Snow through: 2016-2017 season
* Spectral through:

===Met===
====Met 2016====
* All fixed prior to start of this page... I'll go back and add notes as time allows.
* But, station put up in early April 2016 as a temporary setup on a
* Summer Precip Ends: 11/04/2016 02:00

====Met 2017====
* all good / corrected... same as above, I will add notes later.

====Met 2018====
* Barometric Pressure good through 6/2018 visit
* Wind Speed & Direction good through 6/2018 visit
* Air Temperature / Dewpoint / Relative Humidity good through 6/2018 visit
* Rain Gage destroyed by moose 12/25/2017.
** Bucket fixed 6/13/2018 around 21:00 - 22:00 (tips in data were test tips with new bucket).
** QA file reflects this.

===Radiation===
====Radiation 2016====
* all good / corrected

====Radiation 2017====
* all good / corrected

====Radiation 2018====
* SW & LW & Skin Temp look good through 6/2018 visit.

===Soil===
* I need to dig into the fieldbook notes to see if the VATP jacked at all in 2017.

====Soil 2016====

====Soil 2017====
* Heat Flux plates nonworking until 10/2017
====Soil 2018====
* 2018 heat flux plates look decent.
** it could be that top & bottom are flipped and also that what should be the top is actually flipped in sign?...need to compare to top.
* VATP
** Blip during station visit at 6/13/2018 21:00

===Snow===
====Snow 2016-2017====

===Snow 2017-2018===

===Station History / Site Downloads / visits:===
====September 24 & 26 2018====
* B Busey / Bolton / CAS
* memory problem on logger 9/24 but due to food poisoning just downloaded data.
* returned 9/26 and upgraded the OS to latest
* resent program & readdressed.
* I don't yet know the problem here? Error in CF card perhaps? In 2019 I will replace the CF card with another.

====June 13 & 15 2018====
* Station Maintenance @
** 6/13/2018 20:00 UTC
** 6/15/2018 20:00 UTC
**
* B Busey & N Wales
* fixed animal damage
** snow sensor knocked over 12/25/2017
** tipping bucket removed probably around then, too.
* fixed program bug

====April 10 2016====
* Temporary station built above flood plain. Station put in at end of first snow survey trip of Teller.
* At that point this was labeled the blue site (the blue electrical tape IDed this site in the logistics phase).
* Site established around 4/10/2016
** AT/RH
** 4 component Radiation
** Surface water
====April 21 - May 5 1 2016====
* Station visited nearly daily during ablation trip
====July 2016====
* LC visited and downloaded data.
* Temporary station had fallen over (knocked by an animal).
====August 12 - 22 2016====
* LC & B Busey improve upon site making Teller Bottom site and splitting off the Teller Surface Water Station.
* Wind Speed / Direction added
* W

NGEE Teller Bottom Notes

2018-10-12T20:17:02Z

24.237.87.170: /* September 24 & 26 */

===Latest===
* Met Data QA'd through: 6/15/2018
* Radiation Data QA'd through: 6/15/2018
* Soil through:
* Snow profile through:
* Snow through: 2016-2017 season
* Spectral through:

===Met===
====Met 2016====
* All fixed prior to start of this page... I'll go back and add notes as time allows.
* But, station put up in early April 2016 as a temporary setup on a
====Met 2017====
* all good / corrected... same as above, I will add notes later.

====Met 2018====
* Barometric Pressure good through 6/2018 visit
* Wind Speed & Direction good through 6/2018 visit
* Air Temperature / Dewpoint / Relative Humidity good through 6/2018 visit
* Rain Gage destroyed by moose 12/25/2017.
** Bucket fixed 6/13/2018 around 21:00 - 22:00 (tips in data were test tips with new bucket).
** QA file reflects this.

===Radiation===
====Radiation 2016====
* all good / corrected

====Radiation 2017====
* all good / corrected

====Radiation 2018====
* SW & LW & Skin Temp look good through 6/2018 visit.

===Soil===
* I need to dig into the fieldbook notes to see if the VATP jacked at all in 2017.

====Soil 2016====

====Soil 2017====
* Heat Flux plates nonworking until 10/2017
====Soil 2018====
* 2018 heat flux plates look decent.
** it could be that top & bottom are flipped and also that what should be the top is actually flipped in sign?...need to compare to top.
* VATP
** Blip during station visit at 6/13/2018 21:00

===Snow===
====Snow 2016-2017====

===Snow 2017-2018===

===Station History / Site Downloads / visits:===
====September 24 & 26 2018====
* B Busey / Bolton / CAS
* memory problem on logger 9/24 but due to food poisoning just downloaded data.
* returned 9/26 and upgraded the OS to latest
* resent program & readdressed.
* I don't yet know the problem here? Error in CF card perhaps? In 2019 I will replace the CF card with another.

====June 13 & 15 2018====
* Station Maintenance @
** 6/13/2018 20:00 UTC
** 6/15/2018 20:00 UTC
**
* B Busey & N Wales
* fixed animal damage
** snow sensor knocked over 12/25/2017
** tipping bucket removed probably around then, too.
* fixed program bug

====April 10 2016====
* Temporary station built above flood plain. Station put in at end of first snow survey trip of Teller.
* At that point this was labeled the blue site (the blue electrical tape IDed this site in the logistics phase).
* Site established around 4/10/2016
** AT/RH
** 4 component Radiation
** Surface water
====April 21 - May 5 1 2016====
* Station visited nearly daily during ablation trip
====July 2016====
* LC visited and downloaded data.
* Temporary station had fallen over (knocked by an animal).
====August 12 - 22 2016====
* LC & B Busey improve upon site making Teller Bottom site and splitting off the Teller Surface Water Station.
* Wind Speed / Direction added
* W

NGEE Teller Bottom Notes

2018-10-12T20:16:40Z

24.237.87.170: /* September 24 & 26 */

===Latest===
* Met Data QA'd through: 6/15/2018
* Radiation Data QA'd through: 6/15/2018
* Soil through:
* Snow profile through:
* Snow through: 2016-2017 season
* Spectral through:

===Met===
====Met 2016====
* All fixed prior to start of this page... I'll go back and add notes as time allows.
* But, station put up in early April 2016 as a temporary setup on a
====Met 2017====
* all good / corrected... same as above, I will add notes later.

====Met 2018====
* Barometric Pressure good through 6/2018 visit
* Wind Speed & Direction good through 6/2018 visit
* Air Temperature / Dewpoint / Relative Humidity good through 6/2018 visit
* Rain Gage destroyed by moose 12/25/2017.
** Bucket fixed 6/13/2018 around 21:00 - 22:00 (tips in data were test tips with new bucket).
** QA file reflects this.

===Radiation===
====Radiation 2016====
* all good / corrected

====Radiation 2017====
* all good / corrected

====Radiation 2018====
* SW & LW & Skin Temp look good through 6/2018 visit.

===Soil===
* I need to dig into the fieldbook notes to see if the VATP jacked at all in 2017.

====Soil 2016====

====Soil 2017====
* Heat Flux plates nonworking until 10/2017
====Soil 2018====
* 2018 heat flux plates look decent.
** it could be that top & bottom are flipped and also that what should be the top is actually flipped in sign?...need to compare to top.
* VATP
** Blip during station visit at 6/13/2018 21:00

===Snow===
====Snow 2016-2017====

===Snow 2017-2018===

===Station History / Site Downloads / visits:===
====September 24 & 26====
* B Busey / Bolton / CAS
* memory problem on logger 9/24 but due to food poisoning just downloaded data.
* returned 9/26 and upgraded the OS to latest
* resent program & readdressed.
* I don't yet know the problem here? Error in CF card perhaps? In 2019 I will replace the CF card with another.

====June 13 & 15 2018====
* Station Maintenance @
** 6/13/2018 20:00 UTC
** 6/15/2018 20:00 UTC
**
* B Busey & N Wales
* fixed animal damage
** snow sensor knocked over 12/25/2017
** tipping bucket removed probably around then, too.
* fixed program bug

====April 10 2016====
* Temporary station built above flood plain. Station put in at end of first snow survey trip of Teller.
* At that point this was labeled the blue site (the blue electrical tape IDed this site in the logistics phase).
* Site established around 4/10/2016
** AT/RH
** 4 component Radiation
** Surface water
====April 21 - May 5 1 2016====
* Station visited nearly daily during ablation trip
====July 2016====
* LC visited and downloaded data.
* Temporary station had fallen over (knocked by an animal).
====August 12 - 22 2016====
* LC & B Busey improve upon site making Teller Bottom site and splitting off the Teller Surface Water Station.
* Wind Speed / Direction added
* W

NGEE Teller Bottom Notes

2018-10-12T20:16:21Z

24.237.87.170: /* June 12 & 15 2018 */

===Latest===
* Met Data QA'd through: 6/15/2018
* Radiation Data QA'd through: 6/15/2018
* Soil through:
* Snow profile through:
* Snow through: 2016-2017 season
* Spectral through:

===Met===
====Met 2016====
* All fixed prior to start of this page... I'll go back and add notes as time allows.
* But, station put up in early April 2016 as a temporary setup on a
====Met 2017====
* all good / corrected... same as above, I will add notes later.

====Met 2018====
* Barometric Pressure good through 6/2018 visit
* Wind Speed & Direction good through 6/2018 visit
* Air Temperature / Dewpoint / Relative Humidity good through 6/2018 visit
* Rain Gage destroyed by moose 12/25/2017.
** Bucket fixed 6/13/2018 around 21:00 - 22:00 (tips in data were test tips with new bucket).
** QA file reflects this.

===Radiation===
====Radiation 2016====
* all good / corrected

====Radiation 2017====
* all good / corrected

====Radiation 2018====
* SW & LW & Skin Temp look good through 6/2018 visit.

===Soil===
* I need to dig into the fieldbook notes to see if the VATP jacked at all in 2017.

====Soil 2016====

====Soil 2017====
* Heat Flux plates nonworking until 10/2017
====Soil 2018====
* 2018 heat flux plates look decent.
** it could be that top & bottom are flipped and also that what should be the top is actually flipped in sign?...need to compare to top.
* VATP
** Blip during station visit at 6/13/2018 21:00

===Snow===
====Snow 2016-2017====

===Snow 2017-2018===

===Station History / Site Downloads / visits:===
====September 24 & 26====
* B Busey / Bolton / et al
* memory problem on logger 9/24 but due to food poisoning just downloaded data.
* returned 9/26 and upgraded the OS to latest
* resent program & readdressed.
* I don't yet know the problem here? Error in CF card perhaps? In 2019 I will replace the CF card with another.

====June 13 & 15 2018====
* Station Maintenance @
** 6/13/2018 20:00 UTC
** 6/15/2018 20:00 UTC
**
* B Busey & N Wales
* fixed animal damage
** snow sensor knocked over 12/25/2017
** tipping bucket removed probably around then, too.
* fixed program bug

====April 10 2016====
* Temporary station built above flood plain. Station put in at end of first snow survey trip of Teller.
* At that point this was labeled the blue site (the blue electrical tape IDed this site in the logistics phase).
* Site established around 4/10/2016
** AT/RH
** 4 component Radiation
** Surface water
====April 21 - May 5 1 2016====
* Station visited nearly daily during ablation trip
====July 2016====
* LC visited and downloaded data.
* Temporary station had fallen over (knocked by an animal).
====August 12 - 22 2016====
* LC & B Busey improve upon site making Teller Bottom site and splitting off the Teller Surface Water Station.
* Wind Speed / Direction added
* W

NGEE Teller Top Notes

2018-08-15T18:49:02Z

24.237.87.170: /* Soil 2018 */

===Latest===
* Met Data QA'd through last visit (3/2018)
* Radiation Data QA'd through last visit (3/2018)
* Partway through processing soil.

===Met 2017===
* HMP155 August 2017
** failure looks legit... not a data gap.
* HMP155 Cuts out on 10/25 8:00
** replaced AT portion with new AT thermistor.
** DP & RH left NAN
* HMP155 replaced on March 2018 visit
* Rain corrected through most recent download.
* Wind Speed / Direction
** Propeller replaced 6/28/2017
** No Rime fall 2017

===Met 2018===
* Wind
** all rime conditions corrected for through 3/2018 in QC spreadsheet.
* Rain NAN through snowmelt
* Radiometer leveled and desiccant replaced 6/12/2018
* Tipping bucket leveled 6/12/2018
* AT/RH corrected through 3/30/2018 20:00 after sensor destroyed over winter season.

===Radiation 2017===
* There is a gap 10/2/2017 0:00 to 10/2/2017 22:00
** I think this is when we removed the sensor from the field to change the desiccant.
*** as in, the screws were stripped and so we drilled and retapped back in town.

===Radiation 2018===
* All good through March visit.
** There is a weird thing in 2018 where the lower SW has values higher than the upper SW. I assume this is due to snow/ frost up top. Perhaps related to how close the snow surface is to the sensor this year resulting in a lower wind speed later in the winter.

===Soil 2017===
* 2017 heat flux plates prior to fall were being measured on wrong channel.
* 2017-03-12 02:00:00 Upper heat flux plate has a value that isn't ever flipped by the qc program.
* 2017-03-12 02:00:00 Lower heat flux plate has a value that isn't ever flipped by the qc program.
* Easy Perl one liners to accomplish this:
perl -pi -e 's/"2017-03-12 02:00:00",149.2/"2017-03-12 02:00:00",6999.00/g;' $TT_SOIL_DIR/outputs/SoilPit_HeatFlux_Lower.csv
perl -pi -e 's/"2017-03-12 02:00:00",140.8/"2017-03-12 02:00:00",6999.00/g;' $TT_SOIL_DIR/outputs/SoilPit_HeatFlux_Upper.csv
* 2017 Soil pit soil moisture -- all corrected
* 2017 Soil heat flux plates also all corrected
* with Vlad determined only good VATP are 2/5/25/50/60/100
* Soil Temperature: VATP
** I think I have everything corrected though I don't entirely believe the '''100cm probe.
* 8/16/2017 from Lily's field book page 50:
** '''VATP was heaved 9.5cm above standing water table. I pushed it back down'''

===Soil 2018===
* 2018 soil pit soil moisture -- all corrected through most recent visit (3/2018)
*

===Snow 2018===
* Snow temperature profile
** Weird shift (looks like mux wonky 1/22 to 1/28/2018)

Site Downloads / visits:
* Lily / Bob 6/28/2017
* Lily 8/16/2017
* Lily 8/20/2017
* Bob 6/12/2018