NGEE Download ARM Data

From IARC 207 Wiki
Revision as of 12:06, 10 February 2016 by imported>Bob (Created page with "===Procedure for Selecting Data=== ===Procedure for downloading Data=== * Probably easiest to do this from linux. I found '''lftp''' is a simple ftp program that I've be...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Procedure for Selecting Data

Procedure for downloading Data

  • Probably easiest to do this from linux. I found lftp is a simple ftp program that I've been using for retrieving some Japanese data over FTP.
  • once installed... change to the directory you wish to download into:
    $ cd /home/bob/Documents/barrow_arm/sensor1/
  • start up lftp:
    bob@elephant ~/Documents/barrow_arm/sensor1 $ lftp ftp.archive.arm.gov
  • change to the proper remote directory:
    lftp ftp.archive.arm.gov:~> cd youchae1/174468_extractedData
  • download the data:
    lftp ftp.archive.arm.gov:/youchae1/174468_extractedData> mget *

Reformatting the Data

Ross has made a Python tool to get from netCDF files to csv. It's part of the standard DataPro tool suite.

  • https://github.com/rwspicer/csv_utilities
    • From a command line... where you wish these files to appear:
    • git clone https://github.com/rwspicer/csv_utilities.git
    • Then, the file for this one is rad_decoder.py
    • more to come once I hash this out...