Use "moist" as the machine for rerunning the weather data. Here is the order of commands for processing:
- Log into moist as ldm.
- Delete the ldm queue - "bin/ldmadmin.rerun delqueue".
- Create a new queue - "bin/ldmadmin.rerun mkqueue".
- Start up the ldm - "bin/ldmadmin.rerun start".
- Ingest the data using the commands described below.
- Stop the ldm once you are sure all the data has been processed - "bin/ldmadmin.rerun stop".
The best way to tell what data is missing is to compart /home/disk/data/raw/ddplus with /hoem/disk/sunny_data/raw/ddplus and see which files are smaller or missing on /home/disk/data/raw/ddplus. You can also look in /home/disk/data/mcidas/ir to see what satellite data is misssing. For each hour of data you want to ingest, you have to run different commands for each of the data types. Also, make sure to pause and let the LDM server work on the data - the queue is only 1 GB and if you ingest too much you can overwrite older data on the queue before it gets processed. Usually the slowest data to be processed is the NEXRAD data, so check in /home/disk/data/images/nexrad/ATX/BREF1.
In the following commands YYYYMMDDHH stands for the hour you are ingesting.
All data for an hour
~ldm/local/bin/rerun_hour YYYYMMDDHH
This basically runs all the commands shown below.
UNIWISC (aka MCIDAS)
cd /home/disk/sunny_data/raw/mcidas/YYYYMMDDHH
foreach i ( * )
~ldm/bin/pqinsert -v -l - -f UNIWISC -q /var/tmp/ldm.pq "$i"
end
IDS|DDPLUS (aka DDPLUS)
~ldm/bin/pqing -v -l - -f "IDS|DDPLUS" -q /var/tmp/ldm.pq /home/disk/sunny_data/raw/ddplus/YYYYMMDDHH.wmo
HDS
~ldm/bin/pqing -v -l - -f HDS -q /var/tmp/ldm.pq /home/disk/sunny_data/raw/hds/YYYYMMDDHH.wmo
NEXRAD (aka NNEXRAD)
ldm/bin/pqing -v -l - -f "IDS|DDPLUS" -q /var/tmp/ldm.pq /home/disk/sunny_data/raw/nexrad/YYYYMMDDHH.wmo
--
HarryEdmon - 16 May 2006