Difference between revisions of "Amy Jacobs Notes"

From IARC 207 Wiki
Jump to navigation Jump to search
imported>Ekyoucha
imported>Ekyoucha
 
Line 23: Line 23:
 
**DBM3: Need to load Soils
 
**DBM3: Need to load Soils
  
Betty Pingo Met and Radiation:
+
  Betty Pingo Met and Radiation:
 
*Betty Wetland Met:  
 
*Betty Wetland Met:  
 
**1997: Deleted repeat day, 12/13/1997, first entry.  Checked WERCOD and discovered they had done the same.
 
**1997: Deleted repeat day, 12/13/1997, first entry.  Checked WERCOD and discovered they had done the same.
Line 35: Line 35:
 
**2008: Missing Upland NetRad value for entire year.  I loaded into IARCOD with the ‘7777’ marker for the Upland Net Rad.  The reason I did so was that Wetland Net Rad was also missing this value for the entire year and the '7777' marker was used.
 
**2008: Missing Upland NetRad value for entire year.  I loaded into IARCOD with the ‘7777’ marker for the Upland Net Rad.  The reason I did so was that Wetland Net Rad was also missing this value for the entire year and the '7777' marker was used.
  
Betty Pingo Wetland Soils
+
  Betty Pingo Wetland Soils
  
 
*Betty Pingo Soils Wetland (Greta Myerchin's noted changes):
 
*Betty Pingo Soils Wetland (Greta Myerchin's noted changes):
Line 68: Line 68:
  
  
Imnavait Basin Met
+
  Imnavait Basin Met
  
 
*IB1986m:  
 
*IB1986m:  
Line 287: Line 287:
  
  
North Slope Lake Chemistry  
+
  North Slope Lake Chemistry  
  
 
No timestamps for data values.  I copied them over from the original formatted data tables.   
 
No timestamps for data values.  I copied them over from the original formatted data tables.   
Line 344: Line 344:
 
MSB-NC-CT:  Updated duplicate depth of 13 timestamp to ’14:20’ for 2nd occurrence.
 
MSB-NC-CT:  Updated duplicate depth of 13 timestamp to ’14:20’ for 2nd occurrence.
  
Imnavait Flume Snow Depth
+
  Imnavait Flume Snow Depth
  
 
ih2006-2007snow.csv:  Deleted  734 rows that were from 2008 from data file.  These values all contained the ‘6999’ missing value marker.
 
ih2006-2007snow.csv:  Deleted  734 rows that were from 2008 from data file.  These values all contained the ‘6999’ missing value marker.
  
  
North Headwater Met
+
  North Headwater Met
  
 
NH2003m:  Decimal dates ‘235.92’ to ‘236.88’ have the incorrect  Date timestamps.  Should be one day later.
 
NH2003m:  Decimal dates ‘235.92’ to ‘236.88’ have the incorrect  Date timestamps.  Should be one day later.
  
Putuligayuk River Gage Discharge
+
  Putuligayuk River Gage Discharge
  
 
PR1999q:  Removed February 29th timestamps, since 1999 is not a leap year.
 
PR1999q:  Removed February 29th timestamps, since 1999 is not a leap year.
Line 367: Line 367:
  
  
Sagwon Bluffs Met
+
  Sagwon Bluffs Met
  
 
SH1988m:
 
SH1988m:
Line 413: Line 413:
  
  
Lower Kuparuk Met
+
  Lower Kuparuk Met
  
 
LK1994m:   
 
LK1994m:   
Line 419: Line 419:
 
• Set 2nd occurrence of decimal date ‘52’ to ‘53’, since it was incorrect.
 
• Set 2nd occurrence of decimal date ‘52’ to ‘53’, since it was incorrect.
  
Green Cabin Lake Met
+
  Green Cabin Lake Met
 
   
 
   
 
GL1997m:  Removed duplicate entries for 21:00 and 22:00 hour, starting at 227.88.
 
GL1997m:  Removed duplicate entries for 21:00 and 22:00 hour, starting at 227.88.
Line 429: Line 429:
 
GL2000m: Removed duplicate decimal date ‘109.63’, second occurrence.
 
GL2000m: Removed duplicate decimal date ‘109.63’, second occurrence.
  
East Headwater Met
+
  East Headwater Met
  
 
EH1997m:  Changed second occurrence of decimal date ’33.95’ to ‘337.25’.
 
EH1997m:  Changed second occurrence of decimal date ’33.95’ to ‘337.25’.
Line 440: Line 440:
  
  
Upper Headwater Met
+
  Upper Headwater Met
  
 
UH1999m:   
 
UH1999m:   
Line 464: Line 464:
 
WH1999m:  Inserted missing marker value ‘6999’ for decimal date range ‘175.63’ to ‘175.71’.
 
WH1999m:  Inserted missing marker value ‘6999’ for decimal date range ‘175.63’ to ‘175.71’.
  
Upper Kuparuk River Discharge
+
  Upper Kuparuk River Discharge
  
 
UK1994q:  Deleted duplicate decimal date ‘160.875’, that contained ‘6999’
 
UK1994q:  Deleted duplicate decimal date ‘160.875’, that contained ‘6999’
Line 476: Line 476:
  
  
Upper Kuparuk Met
+
  Upper Kuparuk Met
 
   
 
   
 
UK1995m:  Deleted duplicate decimal dates ‘191.75’ and ‘191.79’ that contained ‘7777’ markers.  Started loading in AT1, RH1, WS1 values at decimal date ‘191.75’.
 
UK1995m:  Deleted duplicate decimal dates ‘191.75’ and ‘191.79’ that contained ‘7777’ markers.  Started loading in AT1, RH1, WS1 values at decimal date ‘191.75’.
Line 498: Line 498:
 
UK2006r:  Inserted missing marker ‘7777’ for ‘--‘  for decimal date range: ‘193.667’ to ‘234.417’.
 
UK2006r:  Inserted missing marker ‘7777’ for ‘--‘  for decimal date range: ‘193.667’ to ‘234.417’.
  
Upper Kuparuk Snow
+
  Upper Kuparuk Snow
  
 
UK2006-2007snow:  Deleted 2nd occurrence of timestamp ’07/15/07 19:00’.
 
UK2006-2007snow:  Deleted 2nd occurrence of timestamp ’07/15/07 19:00’.
  
  
Upper Kuparuk Soils
+
  Upper Kuparuk Soils
  
 
UK1999t:  Inserted missing marker ‘6999’ for decimal dates ‘217’ to ‘229’.
 
UK1999t:  Inserted missing marker ‘6999’ for decimal dates ‘217’ to ‘229’.
Line 516: Line 516:
 
UK2008h:  Inserted missing marker ‘6999’  3,408 times, starting at decimal date ‘136.17’.   
 
UK2008h:  Inserted missing marker ‘6999’  3,408 times, starting at decimal date ‘136.17’.   
  
West Kuparuk Met
+
  West Kuparuk Met
  
 
   WK1997m:   
 
   WK1997m:   
Line 535: Line 535:
  
  
West Kuparuk Radiation
+
  West Kuparuk Radiation
  
  
Line 556: Line 556:
  
  
West Kuparuk Soils
+
  West Kuparuk Soils
  
 
Only loaded daily values for West Kupark, since the hourly values did not contain all of the depths.
 
Only loaded daily values for West Kupark, since the hourly values did not contain all of the depths.
Line 572: Line 572:
 
• Inserted missing marker ‘6999’ for decimal dates in range ‘248’ to ‘250’
 
• Inserted missing marker ‘6999’ for decimal dates in range ‘248’ to ‘250’
  
West Dock Met
+
  West Dock Met
  
 
WD1997m:  Deleted 2nd occurrence of decimal date range ‘325.38’ to ‘326.33’.
 
WD1997m:  Deleted 2nd occurrence of decimal date range ‘325.38’ to ‘326.33’.
Line 588: Line 588:
 
• For decimal date ‘313.875’, updated to the correct timestamp of ‘11/9/07 21:00’
 
• For decimal date ‘313.875’, updated to the correct timestamp of ‘11/9/07 21:00’
  
West Dock Radiation
+
  West Dock Radiation
  
 
WD1997r:  Deleted 2nd occurrence of decimal date range ‘325.38’ to ‘326.33’.
 
WD1997r:  Deleted 2nd occurrence of decimal date range ‘325.38’ to ‘326.33’.
Line 612: Line 612:
  
  
Upper May Creek Soils
+
  Upper May Creek Soils
  
 
DUM2_MayCreek_Soil_2009:  Inserted missing markers ‘6999’ and ‘7777’ for decimal date ‘254.54’
 
DUM2_MayCreek_Soil_2009:  Inserted missing markers ‘6999’ and ‘7777’ for decimal date ‘254.54’
  
Itikmalakpak Soils
+
  Itikmalakpak Soils
  
 
DUM1_Itikmalakpak_Soil_2009.csv:   
 
DUM1_Itikmalakpak_Soil_2009.csv:   
Line 622: Line 622:
 
• Deleted 2nd occurrence of timestamp range ‘7/31/2009 11:00’ to ‘7/31/2009 12:00’
 
• Deleted 2nd occurrence of timestamp range ‘7/31/2009 11:00’ to ‘7/31/2009 12:00’
  
Ribdon Soils
+
  Ribdon Soils
  
 
DBM2_Ribdon_ Soil_ 2006.csv:   
 
DBM2_Ribdon_ Soil_ 2006.csv:   
Line 630: Line 630:
 
DBM2_Ribdon_Soil_2008.csv:  Starting at decimal date ‘295.38’, inserted missing marker ‘6999’ for all values except for 135cm soil temp, 150cm soil temp, 10cm soil water and 20 cm soil water.  For those four variables, I used the missing marker ‘7777’, which is what was used for the rest of the data file.
 
DBM2_Ribdon_Soil_2008.csv:  Starting at decimal date ‘295.38’, inserted missing marker ‘6999’ for all values except for 135cm soil temp, 150cm soil temp, 10cm soil water and 20 cm soil water.  For those four variables, I used the missing marker ‘7777’, which is what was used for the rest of the data file.
  
Anaktuvuk Soils
+
  Anaktuvuk Soils
  
 
DUS2_Anaktuvuk_Soil_2009:   
 
DUS2_Anaktuvuk_Soil_2009:   
Line 638: Line 638:
 
• Deleted 2nd occurrence of timestamp range ‘7/7/2009 12:00’ to ‘8/6/2009 11:00’.
 
• Deleted 2nd occurrence of timestamp range ‘7/7/2009 12:00’ to ‘8/6/2009 11:00’.
  
Juniper Soils
+
  Juniper Soils
  
 
DBM3_Juniper_Soil_ 2006.csv:  Inserted missing markers ‘6999’ and ‘7777’ for decimal date range: ‘1’ to ‘184.46’.
 
DBM3_Juniper_Soil_ 2006.csv:  Inserted missing markers ‘6999’ and ‘7777’ for decimal date range: ‘1’ to ‘184.46’.
Line 644: Line 644:
 
DBM3_Juniper_Soil_ 2008.csv:  Deleted 2nd occurrence of decimal date range ‘250.5’ to ‘250.83’.
 
DBM3_Juniper_Soil_ 2008.csv:  Deleted 2nd occurrence of decimal date range ‘250.5’ to ‘250.83’.
  
Sag-Ivishak Soil
+
  Sag-Ivishak Soil
  
 
DBM4_Sag-Ivishak_Soil_2008:   
 
DBM4_Sag-Ivishak_Soil_2008:   
Line 651: Line 651:
 
• Inserted missing marker ‘6999’ for decimal date ‘243.33’ for value that was ‘NAN’
 
• Inserted missing marker ‘6999’ for decimal date ‘243.33’ for value that was ‘NAN’
  
Upper Kadleroshilik Met Soils
+
  Upper Kadleroshilik Met Soils
  
 
DBM5_Upper_Kad_Soil_2007:   
 
DBM5_Upper_Kad_Soil_2007:   
Line 658: Line 658:
  
  
Bullen Met Soils
+
  Bullen Met Soils
  
 
DBM8_Bullen_Soil_2008:  Deleted 2nd occurrence of decimal date ‘166.63’
 
DBM8_Bullen_Soil_2008:  Deleted 2nd occurrence of decimal date ‘166.63’
  
Kadleroshilik Soils
+
  Kadleroshilik Soils
  
 
DBS1_Kadleroshilik_Soil_2009:  For decimal date ‘247.42’, inserted missing marker value ‘6999’ for the ‘NAN’ value
 
DBS1_Kadleroshilik_Soil_2009:  For decimal date ‘247.42’, inserted missing marker value ‘6999’ for the ‘NAN’ value
  
  
Shaviovik Soils
+
  Shaviovik Soils
  
 
DBS2_Shaviovik_Soil_2009:   
 
DBS2_Shaviovik_Soil_2009:   
Line 673: Line 673:
 
• Inserted missing marker value ‘6999’ for decimal date range ‘255.04’ to ‘255.38’
 
• Inserted missing marker value ‘6999’ for decimal date range ‘255.04’ to ‘255.38’
  
UPPER HEADWATER PRECIP update datavalues
+
  UPPER HEADWATER PRECIP update datavalues
 +
 
 
Updated datavalues from 77770 for precip for DatastreamID=4145, Upper_Headwater_precip, SiteID=956, VariableID=84
 
Updated datavalues from 77770 for precip for DatastreamID=4145, Upper_Headwater_precip, SiteID=956, VariableID=84
  

Latest revision as of 13:11, 2 May 2019

Media:AmysWERCnotes.docx

  • Fixed (by Emily) and loaded:
    • DUM7: Snow depth error for 2010
    • DBM5: Error in 2001 met file, Errors in 2007,2008
    • DBM6: Snow depth error 2010 met file
    • DUM2: 2011 on 2/14 at 4pm, error
    • DFM3: 5/16/2007 09:00-19:00 errors

NOTE:

    • DUM4: Loaded as ‘6999’ for 9/29/2009 at 15:00 and 16:00
    • DBM1: Missing WS value in 2008 met file
    • DBM2: Error in 2008 Soils data
    • DUM2: Need to load Soil
    • DUM3: Need to load Soil
    • DUS2: Need to load Soil
    • DUS1: Not found
    • DUM4: Need to load Soils
    • DUM5: Need to load Soils
    • DFM2: Confirm soils end date
    • DFM2: No Soils loaded past 2007
    • DBM3: Need to load Soils
 Betty Pingo Met and Radiation:
  • Betty Wetland Met:
    • 1997: Deleted repeat day, 12/13/1997, first entry. Checked WERCOD and discovered they had done the same.
    • 2005: Had 6999.0 for marker. Updated 873 rows in database to NULL and QualifierID to 14 where the DataValue was ‘6999’
    • 2004: Had 6999.0 for marker. Updated 196 rows in database to NULL and QualifierID to 14 for DatastreamID = 1060
    • 2006: Inserted missing marker ‘6999’ for data points in the date range: 2/16/06 13:00 to 4/15/06 18:00.
  • Betty Rad:
    • 1996: Removed a blank line (line number 7831). Removed duplicate decimal date 258.63
    • 1997: Duplicate 347 decimal date. Removed first occurrence. Note: This decimal date had a duplicate in 1997 BM Met.
    • 2004: Missing reflected shortwave radiation on 6/26/2004 13:00 and 6/26/2004 14:00. I loaded into IARCOD with the missing marker ‘6999'.
    • 2008: Missing Upland NetRad value for entire year. I loaded into IARCOD with the ‘7777’ marker for the Upland Net Rad. The reason I did so was that Wetland Net Rad was also missing this value for the entire year and the '7777' marker was used.
 Betty Pingo Wetland Soils
  • Betty Pingo Soils Wetland (Greta Myerchin's noted changes):
    • BPW1999: Duplicate 281 decimal date. I removed the decimal date for 281 that contained ‘6999’.
    • BPW2006: No data points in range 2/16/2006 13:00 to 04/15/2006 18:00. Inserted value ‘6999'.
    • BPW2007: Replaced ‘69999.0’ with ‘6999’ for SoilTemp06.
  • Betty Pingo Soils Wetland (New changes):
    • BPW1999: 12/31/1999 is missing timestamps from 01:00-23:00. 1/1/2000 0:00 is also missing. I put in the missing marker ‘6999’ for these timestamps.
    • BPW2006: No data points in range 2/16/2006 13:00 to 4/15/2006 18:00. Inserted value '6999'.
    • BPW2008: Replaced ‘6999.0’ with ‘6999’ for SoilTemp06.

Greta Myerchin's changes that have been fixed on website: BPW2001, BPW2002, BPW2004

Betty Pingo Upland Soils

  • Betty Pingo Soils Upland (Greta Myerchin’s noted changes):
    • BPU1994: For 15cm, 35cm, and 60cm data points, inserted ‘6999’ in the range 5/24/1994 19:00 to 5/27/1994 23:00.
  • Betty Pingo Soils Upland (New Changes)
    • BPU2003:

• Decimal dates 287.58 and 287.63 are missing. Inserted missing marker data point value ‘6999’. • Decimal dates 338.17,338.21,338.25,338.29,338.33,338.38 are missing. Inserted missing marker data point value ‘6999’.

    • BPU2006: Inserted missing marker ‘6999’ into data points for date range: 2/16/06 13:00 to 4/15/06 18:00.

Greta Myerchin’s changes that have been fixed on website: BPU2005, BPU2006


 Imnavait Basin Met
  • IB1986m:
    • Used the IB1986m.dat file from Greta Myerchin that was sent to her on 2/22/2010 by Rob Geick.
    • Missing decimal date 286.75. Inserted missing marker value ‘6999’ for all variables.
  • IB1987m: Changed column name from rainfall (mm) to 1.5m wind speed. This is because WERCOD has loaded in 1.5m wind speed values that match the precip values from IB1987m.
  • IB1988m: Missing decimal date 107.46. Inserted missing marker value ‘6999’ for all variables.
  • IB1989m:
    • Used the IB1989m.dat file from Greta Myerchin that was sent to her on 2/22/2010 by Rob Geick.
    • Relative humidity is being shown as being collected at a height of 2m in one location and 1m in another. In WERCOD, the RH sensor height is given as 1m—so this is the RH sensor height that I used.
    • What date did the 1.5m AT/RH/WS move to 1m? I used 4/21/1989 15:00.
  • IB1989m fixes. These were wrong on the website, but were corrected in file from Greta M:
    • Decimal date 41.88 changed the 10m wind speed data point value from ‘6999.4’ to ‘6999’.
    • Decimal date 48.96 looks wrong. WERCOD shifted all data values to the left. However it is using the value ‘0.9’ for both 10m and 2m air temp. I put in ‘6999’ for 10m air temp.
    • For decimal date range 111.42 to 111.58 changed the 10 meter wind speed data point value to ‘6999’ from ‘6999.4’.
    • What date did the 1.5m AT/RH/WS move to 1m?
    • Decimal date 138.58 changed the 10m wind speed data point value from ‘6999.4’ to ‘6999’.
    • For decimal date range 153.54 to 153.83 changed the 10 meter wind speed data point value to ‘6999’ from 6999.4’


  • IB1990m:
    • Used the IB1990m.dat file from Greta Myerchin that was sent to her on 2/22/2010 by Rob Geick.
    • Relative humidity is being shown as being collected at a height of 2m in one location and 1m in another. In WERCOD, the RH sensor height is given as 1m—so this is the RH sensor height that I used.
  • IB1991m:
    • Used the IB1991m.dat file from Greta Myerchin that was sent to her on 2/22/2010 by Rob Geick.
    • Relative humidity is being shown as being collected at a height of 2m in one location and 1m in another. In WERCOD, the RH sensor height is given as 1m—so this is the RH sensor height that I used.
    • In IB1991m.dat from Greta Myerchin, the column header at the top of the file indicates that the WS order is WS1, then WS10. However, the column headers right above the data say WS10, WS1. WERCOD entered it as WS10 appearing first, so that is what I did.
    • Only two wind speeds are in IB1991m. In WERCOD, it was WS10 and WS1 that were loaded. WS3 is missing for IB1991.
  • IB1992m:
    • Relative humidity is being shown as being collected at a height of 2m in one location and 1m in another. In WERCOD, the RH sensor height is given as 1m—so this is the RH sensor height that I used.
  • IB1993m:
    • Used the IB1993m.dat file from Greta Myerchin that was sent to her on 2/22/2010 by Rob Geick.
    • Deleted rows that came after decimal date 366.
  • IB1995:
    • Used the IB1995m.dat file from Greta Myerchin that was sent to her on 2/22/2010 by Rob Geick.
    • Put a comment that there is no 3mAT data between 4/21/1989 15:00 to 1/1/1995 0:00 in datastream for 3mAT in IARCOD. Precip has also started again, but there is a note that it is from Site A.
  • IB1999m: Duplicate decimal dates for 150.46 Deleted 2nd occurrence, since that is what WERCOD had done.
  • IB2000m: Removed character after precip at timestamp ‘9/14/2000 18:00’.
  • IB2001: Used the IB2001m.dat file from Greta Myerchin that was sent to her on 2/22/2010 by Rob Geick
  • IB2003: Used the IB2003m.dat file from Greta Myerchin that was sent to her on 2/22/2010 by Rob Geick
  • IB2004m: 2mAT starts on 1/1/2000 1:00. There was no 2mAT from 1/1/2000 1:00 to 1/1/2004 0:00. No 2mAT from 1/1/2005 01:00 to 1/1/2006 0:00. Made a note in Datastreams in IARCOD.
    • NOTE: WERCOD has values for 3mAT, even though it was changed to 2mAT in 1989.
  • IB2006:
    • Used the IB2006m.dat file from Greta Myerchin that was sent to her on 2/22/2010 by Rob Geick. No 10m air temperature or 1m relative humidity.
    • In WERCOD precipitation was not loaded for this year. It also appears that they loaded in a different data file than I received from Greta Myerchin, since the wind speeds have three decimal places. However, there are still no 10m air temperature and 1m relative humidity in WERCOD.
  • IB2007:
    • Does not appear to have been loaded into WERCOD for all variables.
    • Loading in IB2007_old.csv until ‘9/8/2007 19:00’. After this time, will switch to IB2007_new.csv.
  • IB2009:
    • Received copy of file from Rob Geick on 6/21/2011. Rob and Greta Myerchin have reviewed this file. Does not include 3m wind speed.
 Imnavait Basin Radiation

IB1986r: Missing decimal date 286.75. Inserted missing marker value ‘6999’ for all variables.

IB1999r: • Duplicate decimal dates for 150.46 Selected decimal date that included all values. • Starting at decimal date 123.17 there are 759 missing values . I did a search and replace. Replaced all missing values with ‘6999’. IB2000r: Missing values for decimal date 257.83. Inserted ‘7777’

IB2003r: • Decimal date 118.63: Inserted ‘7777’ for net radiation. • Missing values starting at decimal date ‘331.08’ to ‘331.46’. Inserted ‘7777’.

IB2002-2008: Loaded in this column order: terrestrial longwave, atmospheric longwave, reflected shortwave, incident shortwave, net radiation. Emailed Rob Geick about order on 6/28/2011. Imnavait Basin Snow

Precipitation in cm until 1994, where it switches to mm.

Rob Geick said not to load this data, as it was really not WERC. Imnavait Basin Soils

IB1986t: Column header descriptions do not match. Used the column headers from the top of the file, which said ‘10cm Snow Temp, Surface Temp, 05cm Soil Temp and 10cm Soil Temp’. Checked Greta Myerchin’s standardized soils and this is what she had done.

IB1989t: Decimal date ‘138.58’ was missing. Inserted ‘6999’ for all values.

IB1991t: Column headers did not match. Went with the first version in the file, since that is what Greta Myerchin had done with standardized soils.

IB1996t: Duplicate decimal dates 121-126. Deleted those with missing marker.

IB1997t: Used the 1/1/1997 data value from IB1997t, not IB1996t. These files contain different values for the same date.

IB1998t: There was no 10cm snow temp, only two surface temps. One of the surface temps contained ‘6999’ for the entire year, so I only loaded the surface temp that contained values. Greta Myerchin did the same thing with the standardized soils file.

IB1999t: • Confirmed with Rob Geick that the file from web was correct (since he sent me the IB1999t.dat file on 6/30/2011). The standardized soils file from Greta Myerchin has totally different values. • One of the surface temps contained ‘6999’ for the entire year, so I only loaded the surface temp that contained values.

IB2000-2003t: One of the surface temps contained ‘6999’ for the entire year, so I only loaded the surface temp that contained values. Greta Myerchin did the same thing with the standardized soils file.


IB2004t: • One of the surface temps contained ‘6999’ for the entire year, so I only loaded the surface temp that contained values. Greta Myerchin added a new column ‘Surf Temp 1cm’ for the ‘6999’ values. • Deleted duplicate row for ‘10/27/04’.

There is not a soils file for 2005.


IB2006h: • Replaced ‘#NUM!’ with ‘6999’ marker • Did not load last column of ‘6999’ values.

2008: Loaded from IB2008th until decimal date ‘254.54’. After that loaded in from file IB2008t2h, starting with decimal date ‘254.58’.

IB2008t2h: • Replaced missing values with ‘6999’ • Used headers right above data column, so did not load 15cm soil temp.

Imnavait Basin Site A Met

IA1985m: Inserted multiple missing decimal dates and used ‘6999’ for the missing values.

IA1987m: Inserted missing decimal date ’75.54’ and used ‘6999’ for missing values.

IA1988m: • Inserted missing values on the midnight hour on 7/28/1988 and 8/1/1988 to 8/28/1988. Used missing value marker ‘6999’ • Inserted missing decimal date from ‘303.5’ to ‘303.87’ and used ‘6999’ for missing values.

IA1989m: • Inserted missing marker ‘6999’ for wind speed for decimal dates in range ’42.46’ to ’42.58’. • Inserted missing marker ‘6999’ for wind speed for decimal dates in range ‘109.88’ to ’110.67’. • Inserted missing marker ‘6999’ for wind speed for decimal dates in range ‘226.46’ to ’228.54’. •

IA1991m: • Inserted missing decimal date ‘122.41’ and used ‘6999’ for missing values. • On decimal date ‘122.458’, changed a value to ‘6999’ from ‘6999.007’ and inserted missing values at end of row. • Inserted missing decimal date ‘132.5’ with missing marker ‘6999’. • Inserted missing decimal dates ‘205.33’ to ‘206.37’ with missing marker ‘6999’. • Inserted missing decimal dates ‘242.58’ to ‘243.33’ with missing marker ‘6999’. • Inserted missing decimal dates ‘309.62’ to ‘309.66’ with missing marker ‘6999’. • For decimal date range ‘235.62’ to ‘236.25’. Moved data values over to the right one column. Inserted missing marker ‘6999’ into 2m relative humidity and updated 1m relative humidity to value before ‘6999’. It appears that the 2m relative humidity ‘6999’ values were appended to 1m relative humidity and messed up column order. • For decimal date ‘236.792’ moved values over to the left one column and inserted ‘6999’ for 2m relative humidity. Also updated 1m relative humidity to 96.


IA1992m: • Inserted decimal date ‘119.83’ with missing marker ‘6999’. • Ends at decimal date ‘244.958’.

Imnavait Basin Site A Radiation

IA1985R: • Inserted missing decimal dates in range ‘213.75’ to ‘213.96with the missing value marker ‘6999’. • Inserted missing decimal dates in range ‘216 to ‘216.37’ with the missing value marker ‘6999’. IA1987R: Inserted missing decimal date ‘75.54’ with the missing marker ‘6999’

IA1990R: Deleted last two columns. Appear to be terrestrial longwave and atmospheric longwave data values have been inserted twice.

Imnavait Flume Discharge

Formula for converting decimal dates to dates:

1. Reference Cell: =INT(87*365.255)-1 2. Formula for daily and hourly data: =DATE(YEAR($A$13+B14),MONTH($A$13+B14),DAY($A$13+B14)) + IF(MINUTE($A$13+B14)>29,TIME(HOUR($A$13+B14)+1,0,0),TIME(HOUR($A$13+B14),0,0)) 3. Formula for minute data is reference cell plus decimal date. 4. To check for duplicates: =IF(COUNTIF($B$2:$B$190258,B2)>1,"DUPLICATE","UNIQUE")

5. To go by Minutes, add decimal date to Reference cell. Example: $A$3+B9 IH1986q: Removed duplicate decimal date ‘206.792’.

IH1987q: • Removed duplicate decimal date ‘179.25’. IH1990q: • Removed second decimal date ‘140.583’, since it appeared twice. IH1991q: • Removed second decimal date ‘129.6’, since it appeared twice. • Removed second decimal date ‘129.67’, since it appeared twice. • Removed second decimal date ‘129.71’, since it appeared twice.

IH1993q: • Did not load the daily values, since they all had the missing marker value of ‘7777’. • Removed second decimal date ‘146.88’, since it appeared twice.

IH1995q: • Removed second decimal date ‘133.75’, since it appeared twice. • Removed second decimal date ‘137.63’, since it appeared twice. • Removed second decimal date ‘143.46’, since it appeared twice. • Removed second decimal date ‘146.38’, since it appeared twice.

IH1997q: • Removed second decimal date ‘146.71’, since it appeared twice. • Removed second and third decimal date ‘154.38’, since it appeared three times.

IH1998q: • Removed second decimal date ‘141.38’, since it appeared twice.

IH1999q: • Removed second decimal date ‘150.54’, since it appeared twice. • Starting at decimal date ‘219.21’ to decimal date ‘262.5’, there are duplicates for each decimal date. Removed second set of duplicate values.

IH2001q: • Removed second and third decimal date ‘177.88’ rows, since it appeared three times.

General Processing notes for Imnavait Flume Discharge: • Processed years 1985-2001 as minute data, since it was not exactly hourly data. At various times, there were data points that did not occur on the hour. I tried to process hourly, but could not get one value for the hour. Thought it best to enter it as minute and at a later date create an hourly file. • Processed 2004 as hourly data. • Processed 2002-2003, 2005-2008 as minute data, occurring every 15 minutes.

To process the actual discharge, used a grep command: ‘grep -E '^[^,]*,[^,]*,[^,]*,[0-9]' ih2006q.csv > ih2006q_actual.csv’ for 2005, 2006 and 2008.


 North Slope Lake Chemistry 

No timestamps for data values. I copied them over from the original formatted data tables.

If there were no timestamps for each depth, I used the timestamp for the original formatted data table ONLY when the depths were unique.


NSL 05_12 WChem

Kuparuk Dead Arm Lake 2 - Shore, KDA2-2: • Missing Turbidity values from ‘12/15/05 12:46’ to ‘12/15/05 13:04’ • Time is recorded in original formatted data tables as 12:36, 12:34, 12:31, 12:39, 12:42, etc. This is the way I entered the values also.


NSL 06-01 WChem

Lake 9817 – Shore: • LDO data value 12.9 is assigned to LDO Depth 7, should be LDO Depth 8 at 14:48. LDO Depth 7 at 14:44 should be ‘9999’.


Lake 9312 - Raft B: • Stable RDO not entered.

Lake 9817 - Hole 2 • WaterTemp (variableid=101) is entered twice. Second time is pH values. Deleted 2nd occurrence.

Mine Site B North - North East: • First data value (VariableID=101 at 3.5 depth) is given as SiteID=1 and not as SiteID=2. Updated this data value to SiteID=2.

Lake 9312 - Raft A:

• LDO at depth of 5 was entered as ‘15..3’. Updated to ’15.3’

Mine Site B South - Center

• Second 14 depth has a timestamp of ‘1533’ and not ‘1646’


NSL 06-02 WChem

Kuparuk Dead Arm Lake 2 - Center, KDA2-1: Updated timestamp for 2nd occurrence of depth 15 and depth 18 to 10:33 and 10:59 (from 10:00).

Lake 9312 - Raft A: All timestamps are now at 12:56, since I created separate datastreams for Depths 10.5a and 10.5b.

Lake 9817 - Hole 3: Updated duplicate depth 5 timestamp to ’12:50’ for 2nd occurrence.

MS13-NC-CT: • Update timestamp for second reading of Depth 9 to ‘2/14/06 10:17’. • Updated the MethodID for LDO and LDO Temp to the Hatch method id.

MSB-SC-CT: Updated timestamp for 2nd occurrence of depth 8 to ’15:18’.


NSL 06-03 WChem

MSB-NC-CT: Updated duplicate depth of 13 timestamp to ’14:20’ for 2nd occurrence.

 Imnavait Flume Snow Depth

ih2006-2007snow.csv: Deleted 734 rows that were from 2008 from data file. These values all contained the ‘6999’ missing value marker.


 North Headwater Met

NH2003m: Decimal dates ‘235.92’ to ‘236.88’ have the incorrect Date timestamps. Should be one day later.

 Putuligayuk River Gage Discharge

PR1999q: Removed February 29th timestamps, since 1999 is not a leap year.

PR2000q: • Duplicate date at ‘6/9/00 12:00’. Removed 2nd occurrence. • Duplicate date at ‘6/10/00 12:00’. Removed 2nd occurrence. • Duplicate date at ‘6/11/00 12:00’. Removed 2nd occurrence. • Duplicate date at ‘6/12/00 12:00’. Removed 2nd occurrence. • Duplicate date at ‘6/13/00 12:00’. Removed 2nd occurrence. • Duplicate date at ‘6/14/00 12:00’. Removed 2nd occurrence. • Duplicate date at ‘6/15/00 22:00’. Removed 2nd occurrence.


 Sagwon Bluffs Met

SH1988m: • Duplicate date at ‘5.67’. Removed 2nd occurrence. • Duplicate decimal date at ‘129.54’. Removed 2nd occurrence.

SH1994m: For decimal date ‘161.25’, inserted ‘6999’ for precipitation, since it was missing the value.

SH1996m: Duplicate decimal date ‘91’. Changed to decimal date ‘90’, since that decimal date was missing. This row contained all ‘6999’ values.

SH2004m: • Column headers do not appear to match column data. E-mailed Rob Geick about this on 7/20/ 2011. Rob sent a revised 2004 met file on 7/20/11. • Inserted missing marker ‘6999’ for missing wind direction values for decimal date ‘161.67’ to ‘246.38’.

SH2008m: Inserted missing marker ‘6999’ for missing values for 794 instances.

Sagwon Bluffs Radiation:

SH1996r: Changed first occurrence of decimal date ‘91’ to ‘90’.

SH2004R: • Inserted missing marker ‘7777’ for decimal date ‘119.54’ for all data values. • Inserted missing marker ‘6999’ for decimal date ‘119.54’ for atmospheric longwave radiation. • Inserted missing marker ‘6999’ starting at decimal date ‘122.17’ for missing atmospheric longwave radiation data values. • Inserted missing marker ‘7777’ for decimal date ‘245.79’ for all data values. • Starting on decimal date ‘119.58’ to ‘143.50’ net radiation value is missing. Inserted missing marker value ‘6999’.

SH2006R: Inserted missing marker ‘6999’ for atmospheric longwave on decimal date ‘117.5’. Sagwon Bluffs Snow:

SW1992M: Removed decimal dates ‘275’ to ‘366’, since they appear in the 1993 file. All of these values were ‘6999’ in 1992, but had actual values in 1993.

Sagwon Bluffs Soils:

SH2004h: Added in missing marker ‘6999’ for missing values.

SH2005h: Inserted ‘6999’ for ‘#NUM!’ values.

SH2006h: Inserted ‘6999’ for missing values.

SH2007h: Inserted ‘6999’ for missing values.

SH2008h1: Inserted ‘6999’ for missing values.


 Lower Kuparuk Met

LK1994m: • Decimal date ‘50’ occurred twice. Set 2nd occurrence of decimal date ‘50’ to decimal date ‘51’. • Set 2nd occurrence of decimal date ‘52’ to ‘53’, since it was incorrect.

 Green Cabin Lake Met

GL1997m: Removed duplicate entries for 21:00 and 22:00 hour, starting at 227.88.

GL1998m: Removed duplicate decimal date ‘261.5’, second occurrence.

GL1999m: Removed duplicate decimal date ‘228.96’, second occurrence.

GL2000m: Removed duplicate decimal date ‘109.63’, second occurrence.

 East Headwater Met

EH1997m: Changed second occurrence of decimal date ’33.95’ to ‘337.25’.

EH1998m: Deleted decimal date ‘0’ that occurred after decimal date ‘106.42’ and after ‘107.42’,

EH2001m: Inserted missing marker value of ‘6999’ for decimal date range ‘114.67’ to ‘119.21’.

EH2005m: Inserted missing marker value of ‘6999’, starting at decimal date ‘9.04’ for missing values. Inserted missing marker value of ‘6999’ and ‘7777’ for decimal dates ‘137.92’ to ‘140.54’.


 Upper Headwater Met

UH1999m: • Deleted duplicate decimal dates for ‘201.88’. • Deleted duplicate decimal dates for ‘203.21’. • Deleted duplicate decimal dates for ‘203.92’. • Deleted duplicate decimal dates for ‘204.04’ • Deleted duplicate decimal dates for ‘204.13’ • Deleted duplicate decimal dates for ‘204.21’ • Deleted duplicate decimal dates for ‘238.33’ • Deleted duplicate decimal dates for ‘239.46’ • Deleted duplicate decimal dates for ‘239.88’ • Deleted duplicate decimal dates for ‘240.04’ • Deleted duplicate decimal dates for ‘204.29’ • Deleted duplicate decimal dates for ‘240.42’

UH2001m: Added missing marker ‘7777’ for decimal dates ‘145’ and ‘279.04’

UH2007m: Removed extra ‘0s’ at end of the rows.

West Headwater Met

WH1999m: Inserted missing marker value ‘6999’ for decimal date range ‘175.63’ to ‘175.71’.

 Upper Kuparuk River Discharge

UK1994q: Deleted duplicate decimal date ‘160.875’, that contained ‘6999’

UK1996q: • Deleted duplicate decimal date ‘175.58’, second occurrence. • Deleted duplicate decimal dates for range ‘260’ to ‘261’

UK2002q: Decimal date ‘216.083’: timestamp not in correct format. Changed to ‘08/04/02 2:00’ from its Excel date number format.


 Upper Kuparuk Met

UK1995m: Deleted duplicate decimal dates ‘191.75’ and ‘191.79’ that contained ‘7777’ markers. Started loading in AT1, RH1, WS1 values at decimal date ‘191.75’.

UK2004m: Duplicate timestamp ‘12/13/04 17:00’. Deleted second occurrence.

UK2005m: • Rob Geick sent a revised UK2005.csv file on 8/29/2011. He also said to understand that the precip data values that contained a ‘0’ when the air temperature was below freezing, should be updated to ‘7777’. • Inserted missing marker ‘6999’ for decimal dates ‘245.54’ to ‘245.63’ in the UK2005m_revised file. And for decimal dates ‘245.79’, ‘245.83’

Upper Kuparuk Radiation

UK1997r: Inserted missing marker ‘6999’ for decimal date ‘212.54’.

UK2001r: Inserted missing marker ‘6999’ starting at decimal date ‘116’, 3151 times.

UK2004r: Deleted duplicate row with timestamp of ‘12/13/2004 17:00’.

UK2005r: Inserted missing marker ‘6999’ for timestamps in range ‘6/1/2005 1:00’ to ‘6/1/2005 9:00’. Inserted missing marker ‘6999’ an additional 83 times.

UK2006r: Inserted missing marker ‘7777’ for ‘--‘ for decimal date range: ‘193.667’ to ‘234.417’.

 Upper Kuparuk Snow

UK2006-2007snow: Deleted 2nd occurrence of timestamp ’07/15/07 19:00’.


 Upper Kuparuk Soils

UK1999t: Inserted missing marker ‘6999’ for decimal dates ‘217’ to ‘229’.

UK2000t: Inserted missing marker ‘6999’ starting at decimal date ’60 to ‘176’ for missing values.

UK2004h: Inserted missing marker ‘6999’ for date range ‘6/13/2004 19:00’ to ‘6/23/2004 19:00’.

UK2007h: Deleted 2nd occurrence of decimal date ‘196.79’

UK2008h: Inserted missing marker ‘6999’ 3,408 times, starting at decimal date ‘136.17’.

 West Kuparuk Met
 WK1997m:  

• Inserted missing marker ‘6999’, starting at decimal date ‘144.17’, 350 times. • Changed timestamp for 2nd occurrence of decimal date ‘274.04’ to ‘274.38’ to 10/2/1997 from 10/1/1997, since it appeared that it should have the decimal date ‘275.04’ to ‘275.38’. This pattern occurred for the rest of the year, so I updated all of the remaining timestamps in the same manner.

WK1998m: • Inserted missing marker ‘6999’, starting at decimal date ‘109.5’. Missing markers were missing for multiple rows. There should have been 10 ‘6999’ missing markers per row and there were only 9. • Used this column order to load in variables: 1m air temp, 3m air temp, 10m air temp, 1m relative humidity, 10m relative humidity, pressure, 1m wind speed, 10m wind speed, wind direction, precipitation.

WK1999m: Inserted missing marker ‘6999’ for 10m relative humidity for the entire year.

WK2000m: Inserted missing marker ‘6999’, starting at decimal date ‘126.5’, 3909 times.

WK2001m: Deleted 1st occurrence of decimal date ‘257.62’, since it contained all missing marker values ‘6999’ and was a repeat of a timestamp that had values.

WK2004m: Inserted missing marker ‘6999’, starting at decimal date ‘248.21’ numerous times.


 West Kuparuk Radiation


There was no 2001 radiation file for West Kuparuk on the website.

Read in WK1994 and WK1995 in this column order: atmospheric longwave, terrestrial longwave, incident shortwave, reflected shortwave and net radiation.

WK1997r: Updated the timestamps, starting at 2nd occurrence of 10/1/1997. It appears that the decimal date was incorrect for the rest of the year, causing repeat timestamps to occur.

WK2002r: • Inserted missing marker ‘7777’ for decimal date ‘113.63’. • Inserted missing marker ‘6999’, starting at decimal date ‘117.21’, numerous times.

WK2004r: The values all look off. I loaded them anyways, but perhaps this file should be reviewed.

WK2008r: • Inserted missing marker ‘7777’ for decimal date ‘120.58’ • Inserted missing marker ‘6999’ for decimal date ‘217.29’ • Inserted missing marker ‘6999’ for decimal date ‘224.04’


 West Kuparuk Soils

Only loaded daily values for West Kupark, since the hourly values did not contain all of the depths.

WK1996t: • Inserted missing marker ‘6999’ for decimal date range ‘272’ to ‘278’ for missing data values. • Inserted missing marker ‘6999’ for decimal date range ‘232’ to ‘239’ for missing data values. • Updated timestamp for the 2nd occurrence of timestamp ‘6/5/1997 0:00’ to ‘6/6/1997 0:00’, since 6/6/1997 contained the missing data values and not 6/5 (which had data values). • Updated 2nd occurrence of decimal date ‘157’ to ‘158’, since it appeared that the decimal dates where copied from the previous year and included duplicate decimal dates for ‘157’.

WK1999t: Updated the missing marker ‘6999’ from 14 values per row to 12 values per row. The entire year is missing.

WK2004t: • Inserted missing marker ‘6999’ for 75cm Soil temp for entire year • Inserted missing marker ‘6999’ for decimal dates in range ‘248’ to ‘250’

 West Dock Met

WD1997m: Deleted 2nd occurrence of decimal date range ‘325.38’ to ‘326.33’.

WD1999m: Updated timestamps, starting at ‘11/2/99 23:00’ to ‘11/2/99 00:00’ to ‘11/2/99 11:00’. Before the timestamp was incrementing the day and not the hour.

WD2002m: Inserted missing marker ‘6999’ for numerous data values, starting at decimal date ’18.96’

WD2003m: Inserted missing marker ‘6999’ for numerous data values, starting at decimal date ‘205.5’

WD2005m: Insert missing marker ‘6999’ for numerous data values, starting at decimal date ‘224.71’

WD2007m: • Deleted 2nd occurrence of decimal date range ‘322.625’ to ‘328.458’ • For decimal date ‘313.875’, updated to the correct timestamp of ‘11/9/07 21:00’

 West Dock Radiation

WD1997r: Deleted 2nd occurrence of decimal date range ‘325.38’ to ‘326.33’.

WD1999r: Updated timestamps, starting at ‘11/2/99 23:00’ to ‘11/2/99 00:00’ to ‘11/2/99 11:00’. Before the timestamp was incrementing the day and not the hour.

WD2002r: • Inserted missing marker ‘7777’ for decimal date ‘115.42’ • Inserted missing marker ‘7777’ for decimal date ‘251.42’

WD2005r: Inserted missing marker ‘6999’ for decimal dates ‘183.29’ and ‘183.33’

WD2007r: • Deleted 2nd occurrence of decimal date range ‘249.79’ to ‘250.33’ • Deleted 2nd occurrence of decimal date range ‘263.42’ to ‘263.71’ • Deleted 2nd occurrence of decimal date range ‘270.63’ to ‘270.88’ • Deleted 2nd occurrence of decimal date range ‘273.5’ to ‘273.75’ • Deleted 2nd occurrence of decimal date range ‘274.75’ to ‘275.75’ • Deleted 2nd occurrence of decimal date range ‘278.63’ to ‘279.17’ • Deleted 2nd occurrence of decimal date range ‘283.00’ to ‘283.21’ • Deleted 2nd occurrence of decimal date range ‘283.46’ to ‘283.67’ • Deleted 2nd occurrence of decimal date range ‘286.33’ to ‘286.50’


 Upper May Creek Soils

DUM2_MayCreek_Soil_2009: Inserted missing markers ‘6999’ and ‘7777’ for decimal date ‘254.54’

 Itikmalakpak Soils

DUM1_Itikmalakpak_Soil_2009.csv: • Inserted missing marker ‘6999’ for ‘NAN’ • Deleted 2nd occurrence of timestamp range ‘7/31/2009 11:00’ to ‘7/31/2009 12:00’

 Ribdon Soils

DBM2_Ribdon_ Soil_ 2006.csv: • Deleted 2nd=4th occurrence of decimal date ‘239.54’. • Deleted 2nd occurrence of decimal date range ‘246.5 to 246.58’

DBM2_Ribdon_Soil_2008.csv: Starting at decimal date ‘295.38’, inserted missing marker ‘6999’ for all values except for 135cm soil temp, 150cm soil temp, 10cm soil water and 20 cm soil water. For those four variables, I used the missing marker ‘7777’, which is what was used for the rest of the data file.

 Anaktuvuk Soils

DUS2_Anaktuvuk_Soil_2009: • Inserted missing marker ‘7777’ at decimal date ‘160.5’ • Inserted missing marker value ‘7777’ at decimal date ‘161.33’ • Inserted missing marker value ‘7777’ for decimal date range ‘218.38’ to ‘218.46’ • Deleted 2nd occurrence of timestamp range ‘7/7/2009 12:00’ to ‘8/6/2009 11:00’.

 Juniper Soils

DBM3_Juniper_Soil_ 2006.csv: Inserted missing markers ‘6999’ and ‘7777’ for decimal date range: ‘1’ to ‘184.46’.

DBM3_Juniper_Soil_ 2008.csv: Deleted 2nd occurrence of decimal date range ‘250.5’ to ‘250.83’.

 Sag-Ivishak Soil

DBM4_Sag-Ivishak_Soil_2008: • Inserted missing marker ‘6999’ for decimal date ‘169.38’ for value that was ‘NAN’. • Inserted missing marker ‘6999’ for decimal date ‘225.17’ for value that was ‘NAN’ • Inserted missing marker ‘6999’ for decimal date ‘243.33’ for value that was ‘NAN’

 Upper Kadleroshilik Met Soils

DBM5_Upper_Kad_Soil_2007: • Inserted missing markers ‘6999’ and ‘7777’ for decimal date range ‘240.63’ to ‘240.75’. • Deleted 2nd occurrence of decimal date ‘287’


 Bullen Met Soils

DBM8_Bullen_Soil_2008: Deleted 2nd occurrence of decimal date ‘166.63’

 Kadleroshilik Soils

DBS1_Kadleroshilik_Soil_2009: For decimal date ‘247.42’, inserted missing marker value ‘6999’ for the ‘NAN’ value


 Shaviovik Soils

DBS2_Shaviovik_Soil_2009: • Inserted missing marker value ‘6999’ for decimal date ‘247.63’ • Inserted missing marker value ‘6999’ for decimal date range ‘255.04’ to ‘255.38’

 UPPER HEADWATER PRECIP update datavalues

Updated datavalues from 77770 for precip for DatastreamID=4145, Upper_Headwater_precip, SiteID=956, VariableID=84

Updated DatastreamID= 5822, West_Kuparuk_(WK)_Met_precipitation, from ‘6669’ to NULL for the precip values (VariableID = 84) and SiteID=960 ARM Barrow:

I did a sort on the file ‘sort –u’ to only have unique rows of data.

Formula used to compute timestamp:

=DATE(YEAR($O$1+B2),MONTH($O$1+B2),DAY($O$1+B2)) + IF(SECOND($O$1+B2)>29,TIME(HOUR($O$1+B2),MINUTE($O$1+B2)+1,0),TIME(HOUR($O$1+B2),MINUTE($O$1+B2),0))