global hydro-estimator satellite rainfall estimates operational readiness review
DESCRIPTION
Global Hydro-Estimator Satellite Rainfall Estimates Operational Readiness Review. March 20, 2012 Prepared by: Limin Zhao 1 , Clay Davenport 3 , Peter Keehn 2 , Bob Kuligowski 2 and Walter Wolf 2 - PowerPoint PPT PresentationTRANSCRIPT
Global Hydro-Estimator Satellite Rainfall Estimates
Operational Readiness Review March 20, 2012
Prepared by: Limin Zhao1, Clay Davenport3, Peter Keehn2, Bob Kuligowski2 and Walter Wolf2
Other Contributors: Rusty Pennoyer, Yi Song, Kathy Moore, Zhaohui Cheng, Larisa Koval, Ed Ladd, Doyle George, Jessica Staude, George
Lawless and Joseph McIlvenny1NOAA/NESDIS/OSPO2NOAA/NESDIS/STAR
3 SSAIApril 6, 2012 1GHE Operational Readiness Review
22
Review AgendaIntroduction 1:00 pm – 1:25 pmRisks and Actions 1:25 pm – 1:40 pmSystem Requirements 1:40 pm – 2:05 pmSystem Description 2:05 pm – 2:35 pmBreak 2:35 pm – 2:45 pmSystem Test 2:45 pm – 3:25 pmSystem Operational Readiness 3:25 pm – 3:50 pmSummary 3:50 pm – 4:00 pm
2April 6, 2012 GHE Operational Readiness Review
33
OutlineOutline Introduction Risks and Action System Requirements System Description System Test System Operational Readiness Summary
3April 6, 2012 GHE Operational Readiness Review
IntroductionLimin Zhao
NESDIS/OSPO
4April 6, 2012 4GHE Operational Readiness Review
5
Meet SPSRB User Request # 1010-0019 from NWSProvide satellite global rainfall estimate from Hydro-
Estimator products will combine rainfall estimate derived from
GOES-East , GOES-West, METEOSAT-7, METEOSAT-9, MTSAT
available within 50 minutes of observation (or 20 minutes of data receipt)
Meet SPSRB User Request # 1006-0009 from NWSProvide multi-day rainfall accumulations from Hydro-
Estimator Retire the operational CONUS-only HE
Provide the same product to NWS users from GHE
GHE Project Objectives
April 6, 2012 GHE Operational Readiness Review
6
GHE Stakeholders Developers
STAR Bob Kuligowski
Walter Wolf
Peter Keehn
Yi Song
OSPOClay Davenport
Limin Zhao
April 6, 2012 GHE Operational Readiness Review
7
GHE StakeholdersOperations and Maintenance
OSPO Products Area Lead – Limin Zhao
OSPO QA Lead – Zhaohui Cheng
Operational Implementation and Maintenance TeamClay DavenportWilliam Pennoyer Jessica Staude
Science Maintenance Team Bob KuligowskiZhihua Zhang
April 6, 2012 GHE Operational Readiness Review
8
GHE Stakeholders Users
NWSDan Beardsley (NWS)David Kitzmiller (NWS/OHD)
NESDISLiqun Ma (NESDIS/SPB)Sheldon Kusselson (NESDIS/SAB)
HRCKonstantine Georgakakos, Bob Jubach (HRC)
April 6, 2012 GHE Operational Readiness Review
9
GHE Project Task and Milestones
Tasks:Defined in “FY12_Geo_Global_Hydro_Estimator_V4.ppt” (SPSRB
PSDI), and reviewers can find it at ftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/ORR
Key milestones: Preliminary Design Review – WaivedCritical Design Review – Aug, 2011 Sept 9, 2011Software Code Review – Oct, 2011 Oct 11, 2011System Readiness Review – Jan, 2012 WaivedOperational Readiness Review – Feb, 2012 April 6, 2012SPSRB Briefing – Mar 2012 April 18, 2012Operations Commence – Mar 2012 April 30, 2012
April 6, 2012 GHE Operational Readiness Review
10
GHE Project - Timeline
April 6, 2012 GHE Operational Readiness Review
1111
GHE ORR – Review Objectives Review Project Plan
Review the open Risks and Action
Review the System Requirements
Review the System Description including operations concept, external interfaces, software
architecture and detailed design
Review the System Test Report including operational code, unit test data, and system test data
Review System Operational Readiness
11April 6, 2012 GHE Operational Readiness Review
1212
ORR ReviewersReviewersORR Review Lead:
Antonio Irving and Zhaohui Cheng
ORR Review Team:Limin Zhao (PAL)Donna McNamara (Distribution)Carl Bauer and George Lawless (Security) Joseph Mani and Ed Ladd (IT Architect and System)Bob Kuligowski (PREPOP)Dan Beardsley (User)
ORR Review Consultants:Tom Schott (OSD)Dave Benner (SPSD)Linda Stathoplos (MOD)
12April 6, 2012 GHE Operational Readiness Review
ORR Guidelines and Check List
Guidelines for the ORR review is the OSPO QA process assetORR reviewers can access this document at
ftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/ORR
The ORR Review Check List “GHE_ORR_Checklists.xls” can be accessed by the GHE ORR reviewers atftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/ORR
April 6, 2012 13GHE Operational Readiness Review
1414
OutlineOutline Introduction Risks and Actions System Requirements System Description System Test System Operational Readiness Summary
14April 6, 2012 GHE Operational Readiness Review
Risks and Actions Limin Zhao
NESDIS/OSPO
15April 6, 2012 15GHE Operational Readiness Review
CDR Risks and Actions
16April 6, 2012 16GHE Operational Readiness Review
17
CDR Report (1/4)7 project risk and actions identified at CDR have
been addressed5 have been closed1 related to archive is closed/deferred for
future consideration.1 closed/removed since the issue is no longer
exist
3 non-risk related comments from the CDR reviewers are addressed in the following slides
Assessments and updates for above risks and comments are documented and can be found in: ftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/ORR/HydroEstimater_Review_Item_Disposition_CDR_v1.1.xls
April 6, 2012 17GHE Operational Readiness Review
18
CDR Report (2/4)CDR Report (2/4)Reviewer Tom Schott
#8 Comment What was decided about whether to show all of the most recent data from each satellite, or leave the much older data blank in the composite?
Responses The composites for each time period will be repeated every 15 min out to 1 hour. Areas without any available satellite data will be filled with missing values. The repeated compositing will allow users with tight latency requirements to get the data very quickly, but will allow users with looser latency requirements to get a more complete dataset. This is preferred to using the most recent data from each satellite because that approach mixes rainfall rates from multiple time periods (with a spread up to 1 hour due to the relatively long latency of MTSAT) and the users will have no way of knowing which time periods to associate with a particular feature.
Status ClosedApril 6, 2012 18GHE Operational Readiness Review
19
Reviewer Tom Schott
#9 Comment
Should submit a NCDC request for archive
Responses The primary user has no archive requirement, but NESDIS takes initiative to submit the archive request through the Advanced Tracking and Resource tool for Archive Collections (ATRAC) at NCDC (project #56).
Status Closed
CDR Report (3/4)CDR Report (3/4)
April 6, 2012 19GHE Operational Readiness Review
20
CDR Report (4/4)CDR Report (4/4)
Reviewer G. Lawless
#10 Comment
In future, it would be useful to include the project schedule for reference
Responses The project schedule and milestones are included in the ORR.
Status Closed
April 6, 2012 20GHE Operational Readiness Review
Risks and Actions Since CDR
21April 6, 2012 21GHE Operational Readiness Review
22
Pre-ORR Risks and Actions Pre-ORR Risk 1: SRR was waived. Going straight to ORR. Risk Assessment: Low Impact: If the overall system information is not provided at
the ORR then the system most likely will not be ready for the operational transition, and the project might fall behind schedule and increase costs
Likelihood: Low Mitigation:
Include key system review components, such as, unit test and system test, within ORR
Status: Closed
April 6, 2012 GHE Operational Readiness Review
23
GHE ORR – Entry Criteria Entry # 1 - The ORR reviewers have access to the review version of the
following artifacts Critical Design Review Report Requirements Allocation Document (RAD) Review Item Disposition Spreadsheet (RID) Operational Readiness Review Document (ORRD)
Entry # 2 - The ORR reviewers have access to the review version of SPSRB Documents User Manuals Algorithm Theoretical Basis Document (ATBD) System Maintenance Manual
Entry # 3 - The ORR reviewers have access to the Software Code Review report
Entry # 4 - The ORR reviewers have access to the review version of the Operations Procedure
April 6, 2012 GHE Operational Readiness Review
24
Risks and Actions - SummaryRisks and Actions - SummaryThis CDR report has closed the GHE CDR
3 CDR risks were identified, and proper actions have been taken to addresses the issues. 2 closed and 1 related archive is deferred.
4 pre-CDR risks were identified, and 3 are closed, and 1 removed.
3 non-risk-associated comments are addressed.1 pre-ORR risk was identified, and proper actions have
been taken to addresses the issue. The risk is no closed.The entry criteria and exit criteria for the GHE ORR have
been established.
24April 6, 2012 24GHE Operational Readiness Review
25
GHE ORR – Exit Criteria
Exit # 1 - All open items in RID have been satisfactorily disposed of.
Exit # 2 - The updated RAD is satisfactory. Exit # 3 - The SPSRB documents (UM, SMM and ATBD)
have been reviewed and are deemed to be satisfactory. Exit # 4 - Test and validation results are satisfactory. Exit # 5 - The operation readiness are satisfactory. Exit # 6 - The security impact assessment (SIA) has been
completed.
April 6, 2012 GHE Operational Readiness Review
2626
OutlineOutline Introduction Risks and Actions System Requirements System Description System Test System Operational Readiness Summary
26April 6, 2012 GHE Operational Readiness Review
System Requirements Limin Zhao
NESDIS/OSPO
27April 6, 2012 27GHE Operational Readiness Review
GHE Requirements SPSRB Requests
1010-0019, “Global Hydro-Estimator Satellite Rainfall Estimates”
Transition global Hydro-Estimator from STAR to OSPO to replace current CONUS Hydro-Estimator.
1006-0009, “Making Multi-day (more than 24hrs) NESDIS Hydro-Estimator Rain Estimates Operationally”
Make 2-7 day HE totals over CONUS
9712-8, “Implement Graphical Auto-Estimator on AWIPS.”The original request for automated satellite products at NESDIS,
which led to the Auto-Estimator and Hydro-Estimator over the CONUS.
April 6, 2012 GHE Operational Readiness Review 28
GHE Requirements Product Specifics
Product name
Geographic Coverage
Horizontal Resolution
Mapping Uncertainty
Measurement Range
Measurement Precision
Measurement Accuracy
Latency Refresh Rate
Instantaneous rainfall rate , 1-hour, 3-hour, 6-hour, 24-hour and multi-day rainfall accumulations
Global from 60°S to 60°N
4 km 4 km 0 ~ 76 mm/h
9 mm/h at rates of 10 mm/h, with higher values at higher rates
6 mm/h at rates of 10 mm/h, with higher values at higher rates
20 min 20 min
29April 6, 2012 GHE Operational Readiness Review
GHE RequirementsAllocation Document
Requirements Allocation Document (RAD) v1r0Established at Critical Design Review (CDR), as a CDR
artifact. Contains the basic and derived requirements for the work
productsRAD Document Guidelines in STAR EPL process asset DG-
6.2 at http://www.star.nesdis.noaa.gov/star/EPL_index.php
Requirements Allocation Document (RAD) v2r0Updated to include the allocation of the requirements to
system components and product components for Operational Readiness Review (ORR)
As a ORR artifact, can be obtained at ftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/ORR
April 6, 2012 30GHE Operational Readiness Review
31
GHE Requirements Basic Requirement 0.0
Basic Requirement 0.0: The Global Hydro-Estimator (GHE) project shall adopt the standard practices of the Satellite Products and Services Review Board, as established in the SPSRB Policy on Fiscal Year 2010 (FY10) Annual Review for Satellite Product Development. (process)
April 6, 2012 GHE Operational Readiness Review
32
GHE Requirements Basic Requirement 1.0
• Basic Requirement 1.0: Integrated Product Team (IPT) shall generate real-time estimates of rainfall at the full IR pixel scale for the entire globe. (product, functional)User request: (1010-0019, “Global Hydro-Estimator Satellite Rainfall Estimates”).
April 6, 2012 GHE Operational Readiness Review
33
GHE Requirements Basic Requirement 1.0
• Derived Requirement 1.1: The Global Hydro-Estimator algorithm shall be applied to data from GOES-E and GOES–W, METEOSAT-7 and -9, and MTSAT geosynchronous satellites, using GFS model data for the adjustments for the effects of moisture availability, evaporation, orographic modulation, and thermodynamic profile effects.
Derived Requirement 1.1.1: All satellite and model data shall be obtained from OSPO servers via ADDE.
Derived Requirement 1.1.2: The satellite imagery to be processed for rain rates shall be received as McIDAS AREA files.
April 6, 2012 GHE Operational Readiness Review
34
GHE Requirements Basic Requirement 1.0
Derived Requirement 1.1.3: Each of the five satellites shall run as a separate job to create a rainfall image within its field of view.
Derived Requirement 1.1.3.1: IPT shall develop routines to calculate the rainfall rates for each satellite/sector.
Derived Requirement 1.1.4: Data from GFS model shall be obtained in McIDAS GRID format and converted into McIDAS AREA format to match satellite imagery.
April 6, 2012 GHE Operational Readiness Review
35
GHE Requirements Basic Requirement 1.0
Derived Requirement 1.1.5: Static Local Data (Global Terrain Maps and Lookup tables for viewing angle corrections) shall be obtained in McIDAS AREA format.
Derived Requirement 1.1.5.1: IPT shall develop routines to calculate non-satellite inputs.
Derived Requirement 1.1.6: IPT shall develop routine to create a global composite rainfall image.
April 6, 2012 GHE Operational Readiness Review
36
GHE Requirements Basic Requirement 1.0
• Derived Requirement 1.2: The GHE system shall be able to run in the STAR Development Environment and OSPO Test Environment (Linux).
Derived Requirement 1.3: The GHE system shall be able to run in the ESPC Operations Environment (Linux).
April 6, 2012 GHE Operational Readiness Review
37
Basic Requirement 2.0:The rainfall products shall include: (1) instantaneous rainfall rate and 1-hour rain rate over global; (2)1-hour, 3-hour, and 6-hour rainfall estimate, daily rainfall estimate, 2-day rainfall estimate, 3-day rainfall estimate, 4-day rainfall estimate, 5-day rainfall estimate, 6-day rainfall estimate and 7-day rainfall estimate over CONUS.
User requests: (1010-0019, “Global Hydro-Estimator Satellite Rainfall Estimates”; 1006-0009, “Making Multiday (more than 24hrs) NESDIS Hydro-Estimator Rain Estimated Operationally”).
GHE Requirements Basic Requirement 2.0
April 6, 2012 GHE Operational Readiness Review
38
GHE Requirements Basic Requirement 2.0
• Derived Requirement 2.1: The GHE rainfall products shall have geographical coverage from 60°S to 60°N.
Derived Requirement 2.2: The GHE rainfall products shall have horizontal resolution of 4 km.
Derived Requirement 2.3: The GHE rainfall products shall have mapping uncertainty of 4 km.
Derived Requirement 2.4: The GHE rainfall products shall have measurement range of 0 ~ 76 mm/h.
April 6, 2012 GHE Operational Readiness Review
39
GHE Requirements Basic Requirement 2.0
• Derived Requirement 2.5: The GHE rainfall products shall have measurement precision of 9 mm/h at rates of 10 mm/h, with higher values at higher rates.
Derived Requirement 2.6: The GHE rainfall products shall have measurement accuracy of 6 mm/h at rates of 10 mm/h, with higher values at higher rates.
Derived Requirement 2.7: The GHE rainfall products shall be in netCDF4/McIDAS formats.
April 6, 2012 GHE Operational Readiness Review
40
GHE Requirements Basic Requirement 3.0
Basic Requirement 3.0: Global Rainfall Rates shall be generated and distributed within 50 minutes of observation (or 20 minutes of data receipt) to NWS, the Hydrologic Research Center, and NESDIS users through both DDS and McIDAS ADDE servers. (product) Derived Requirement 3.1: The GHE system
shall be able to push the data to DDSDerived Requirement 3.2: The GHE system
shall be able to push the data to SATEPSDIST1
April 6, 2012 GHE Operational Readiness Review
41
GHE Requirements Basic Requirement 4.0
Basic Requirement 4.0: The GHE system shall have QC monitoring capability.
Derived Requirement 4.1: The GHE Product files shall include overall quality control flags.
Derived Requirement 4.2: The GHE system shall be capable of monitoring input data latency and overall quality.
Derived Requirement 4.3: The GHE system shall be capable of monitoring product latency.
Derived Requirement 4.4: The GHE system shall be capable of monitoring product distribution status to ensure that the data/products are successfully available for transfer to the user community.
April 6, 2012 GHE Operational Readiness Review
42
GHE Requirements Basic Requirement 4.0
Derived Requirement 4.5: The GHE system shall be capable of monitoring product quality. Derived Requirement 4.5.1: The GHE system shall be
able to push data to the ESPC web servers Derived Requirement 4.5.2: The GHE system shall have a
web interface for displaying the products images, processing and distribution status and timelineness, etc.
Derived Requirement 4.6: The GHE system shall have the validation capability Derived Requirement 4.6.1: The GHE system shall be
capable of validating the hourly rain rate with radar data Derived Requirement 4.6.2: The GHE system shall be
capable of validating the daily rainfall total with CPC daily gauge data
April 6, 2012 GHE Operational Readiness Review
43
GHE Requirements Basic Requirement 5.0
Basic Requirement 5.0: The GHE system shall generate metadata for each rainfall product.
Derived Requirement 5.1: The GHE system shall write a metadata text file associated with the GHE products.
April 6, 2012 GHE Operational Readiness Review
44
GHE Requirements Basic Requirement 5.0
• Derived Requirement 5.2: The GHE product metadata shall include overall quality and summary level metadata.
Derived Requirement 5.3: The GHE metadata shall comply with ISO standards (defer).
April 6, 2012 GHE Operational Readiness Review
45
GHE Requirements Basic Requirement 6.0
Basic Requirement 6.0: The Integrated Product Team shall perform validation and verification of the GHE products.
Derived Requirement 6.1: GHE products shall be validated by comparing with retrieved instantaneous rainfall rates to Tropical Rainfall Measuring Mission (TRMM) spaceborne Precipitation Radar (PR) between 35ºS and 35ºN.
Derived Requirement 6.2: The IPT shall verify that the GHE products in the output files are generated correctly and documented.
April 6, 2012 GHE Operational Readiness Review
46
GHE Requirements Basic Requirement 7.0
• Basic Requirement 7.0: The GHE software shall be delivered to the OSPO team for testing and operational implementation.
April 6, 2012 GHE Operational Readiness Review
47
GHE RequirementsBasic Requirement 8.0
Defer after ORR
Basic Requirement 8.0: The global Hydro-Estimator Rainfall products (netCDF4) and corresponding metadata shall be archived at NCDC/CLASS.
Derived Requirement 8.1: Distribution of the Archive Products to NCDC/CLASS shall be in accordance with a Data Submission Agreement (DSA). STAR plans to work with OSPO to create a DSA with CLASS.
April 6, 2012 GHE Operational Readiness Review
48
GHE Requirements Basic Requirement 9.0
Basic Requirement 9.0: The GHE shall maintain heritage with operational CONUS Hydro-Estimator and ensure continuity/consistency.
Derived Requirement 9.1: The current operational HE-SPE shall be integrated into the global Hydro-Estimator , and be taken as its sub-system.
April 6, 2012 GHE Operational Readiness Review
49
GHE RequirementsBasic Requirement 10.0
Basic Requirement 10.0: The GHE system shall comply with OSPO Code Review Security check lists.
Derived Requirement 10.1: The GOES PS system shall comply with OSPO data integrity check list.
Derived Requirement 10.2: The GHE system shall
comply with OSPO development security check list.
Derived Requirement 10.3: The GHE system shall comply with OSPO code check list.
April 6, 2012 GHE Operational Readiness Review
50
GHE RequirementsBasic Requirement 11.0
Basic Requirement 11.0: The GHE system shall have a data ingest capability.
Derived Requirement 11.1: The GHE system shall ingest GOES-E Imager data.
Derived Requirement 11.2: The GHE system shall
ingest GOES-W Imager data.
Derived Requirement 11.3: The GHE system shall ingest METEOSAT-9 SEVIRI data.
April 6, 2012 GHE Operational Readiness Review
51
GHE RequirementsBasic Requirement 11.0
Derived Requirement 11.4 : The GHE system shall ingest METEOSAT-7 MVRI data.
Derived Requirement 11.5: The GHE system shall
ingest MTSAT Imager data.
Derived Requirement 11.6: The GHE system shall ingest GFS forecast data.
Derived Requirement 11.7: The GHE system shall ingest ancillary data for product generation and product validation.
April 6, 2012 GHE Operational Readiness Review
52
GHE RequirementsBasic Requirement 12.0
Basic Requirement 12.0: The IPT shall deliver a GHE document package to OSPO.
Derived Requirement 12.1: The GHE document package shall include an Algorithm Theoretical Basis Document (ATBD).
Derived Requirement 12.2: The GHE document
package shall include a System Maintenance Manual (SMM).
Derived Requirement 12.3: The GHE document package shall include an External Users Manual (EUM).
April 6, 2012 GHE Operational Readiness Review
53
GHE RequirementsBasic Requirement 12.0
Derived Requirement 12.4 : The GHE document package shall include an Internal Users Manual (IUM).
Derived Requirement 12.5: The GHE document package shall include the Operations Procedures (OP).
April 6, 2012 GHE Operational Readiness Review
54
GHE Requirements Summary
The Global Hydro-Estimator Requirements have been established.
The Global Hydro-Estimator Requirements have been documented in the Requirements Allocation Document (RAD).
The Global Hydro-Estimator Requirements are traceable to drivers (customer needs or expectations) and other requirements.
The Global Hydro-Estimator Requirements have been allocated in the Requirements Allocation Document (RAD).
April 6, 2012 GHE Operational Readiness Review
5555
OutlineOutline Introduction Risks and Action System Requirements System Description System Test System Operational Readiness Summary
55April 6, 2012 GHE Operational Readiness Review
System DescriptionClay Davenport and Limin Zhao
NESDIS/OSPO
56April 6, 2012 56GHE Operational Readiness Review
57
GHE System Design
The GHE system provides an infrastructure that will enable the implementation of the GHE algorithms to meet requirements.
April 6, 2012 GHE Operational Readiness Review
58
GHE Major Components
Calculation of non-satellite inputs
Calculation of Rainfall Rate for each satellite/sector
Composite Rainfall Rate outputs
NetCDF and GRIB ConvertersApril 6, 2012 GHE Operational Readiness Review
59
GHE IT Architecture and Network Connection
April 6, 2012 GHE Operational Readiness Review
Note: CLASS is not in the picture since no archival is required
60
GHE Context Diagram
NCEP GFS Model Server
Ancillary Data
Satellite Servers
Algorithm Packages
File Server
GHE
Products
Products
Input Data
Model Data
LookupTables
Satellite Imagery
April 6, 2012 GHE Operational Readiness Review
61
GHESystem Level (1/2)
PW RHOrog
EQL
Satellite Data
GOES-11GOES-13
Meteosat-7Meteosat-9MTSAT-1R
NCEP GFS Model Data
Zenith Angle Adjustment
Parallax Adjustmen
t
Rain Rates
Topo Maps
Joyce model
April 6, 2012 GHE Operational Readiness Review
62
GHESystem Level (2/2)
GOES-11 Rain Rates
GOES-13 Rain Rates
Meteo-9 Rain Rates
Meteo-7 Rain Rates
MTSAT-1R Rain Rates
Global Rain Composite
Merger Algorithm
April 6, 2012 GHE Operational Readiness Review
63
System DescriptionProduction (1/2)
Two Dedicated Servers for GHE - GHE1/GHE2Development – GHE2 Sever
Development and testing of GHE under $ANCHOR/GHE_dev
Testing and Backup– GHE2 Server Pre-operational codes (DAP) received from STAR has been
thoughly tested on GHE2 at ESPC since Jan 2012. ($ANCHOR/GHE_test)
GHE2 will also as served as the backup server for the operational GHE ($ANCHOR/GHE).
Production – GHE1 Server GHE will be run to generate the operational products on GHE1
The products will be distributed to users through ESPC Data Distribution System (DDS) and McIDAS ADDE server on GHE1
April 6, 2012 GHE Operational Readiness Review
64
System DescriptionProduction (2/2)
ESPC GOES Ingest Systems provides all GEO satellite input data
ESPC Model Server provides GFS model data
The global HE product system is hosted on GHE1/GHE2, which collects the satellite inputs and required ancillary data to run the HE algorithm
The products are generated in McIDAS area and then converted into netCDF4 for archive
April 6, 2012 GHE Operational Readiness Review
System DescriptionHardware/Software
The Configuration of GHE1/GHE2 2 quad core CPUs 2.66 GHz 8 GB memory 200 GB additional disk space gfortran version 4.1.2 gcc version 4.1.2 McIDAS version 2010.1 Shell scripts
NetCDF and HDF5 lib were installed NetCDF version 4.1.3 HDF5 version 1.8.6
GRIB1/GRIB2 lib are installed Grib1 lib are part of SPE codes GRIB2 version 2
CVS version control
April 6, 2012 65GHE Operational Readiness Review
66
System DescriptionInput Data Sources
Satellite Data for Product Generation GOES-W&-E GWR (McIDAS Area)
Meteosat-7 & -9 (McIDAS Area)
MTSAT (McIDAS Area)
Ancillary Data for Product Generation NCEP GFS Model data (GRIB2 converted to McIDAS)
Global Terrain Maps (McIDAS Area)
Lookup Tables for Viewing Angle Corrections (McIDAS Area)
Ancillary Data for Product Validation Radar (netCDF)
CPC Daily Rainfall from gauge (GRIB2)April 6, 2012 GHE Operational Readiness Review
67
System Description Inputs - McIDAS AREA Files (1/2)
The satellite imagery to be processed for rain rates will be received as McIDAS AREA filesFive satellites provide global coverage
April 6, 2012 GHE Operational Readiness Review
68
System Description Inputs - McIDAS AREA Files (2/2)
In order to maximize coverage in both space and time, 13 different types of AREA files need to be pulled from the serversGOES-W: GEFDSK04I4 (3 hourly), GENHEM04I4 (30 min),
GECONS04I4 (15 min), GESHEM04I4 (30 min)GOES-E: GWFDSK04I4 (3 hr), GWNEM04I4 (30 min),
GWSHEM04I4 (30 min), GWPACU04I4(15 min)Meteosat-9: MSGLOB09I (15 min)Meteosat-7: INDOEXIR (30 min)MTSAT: MTGLOB04I2 (60 min), MTNHEM04I2 (30 min),
MTSHEM04I2 (6 hourly)
April 6, 2012 GHE Operational Readiness Review
69
System Description Inputs - GFS Model Data
Model data are pulled every 6 hoursAlways selects the most current model run containing
data for the selected timeWill continue to work throughout two missed model
runsExtracts vertical profiles of temperature and humidity
at each grid point, total precipitable water, and 700 mb winds
Data is obtained in McIDAS GRID format, converted into AREA format to match satellite imagery
April 6, 2012 GHE Operational Readiness Review
70
System Description Inputs - Static Local Data
Cloud-top temperatures are modified from a lookup table based on apparent temperature, zenith angle, latitude, and season (Joyce CPC model)
Global topographic files and land/sea masks, in AREA format, from SSEC and USGS
April 6, 2012 GHE Operational Readiness Review
71
Product PrecedenceModel-based adjustments (PW, RH, Orography,
Stability) used by all satellites, are run as standalone jobs every hour
Each of the five satellite rainfall products is run as its own job (attempts every 15 minutes, skipped if no new satellite data)
Compositing programs create spatial mosaics and time summations; time summations run with each new rain image, global composite runs hourly
April 6, 2012 GHE Operational Readiness Review
72
Product PrecedenceModel Data (1/2)
Precipitable water and relative humidity are directly taken from the GFS model, and interpolated between model runs for an hourly product
Data transformed into a global AREA file
Each satellite run will extract the portion of the global field required
April 6, 2012 GHE Operational Readiness Review
73
Product PrecedenceModel Data (2/2)
Orographic and equilibrium level files have to be derived from GFS model dataOrographic data combined model winds with USGS
digital terrain dataStability calculated by running model profiles through
1D model
Built separately for each satellite field, not a single global product
Have traditionally been made every six hours, without interpolation
April 6, 2012 GHE Operational Readiness Review
Product PrecedenceSatellite Runs (1/4)
Each of the five satellites will run as a separate job to create a rainfall image within its field of view
Satellites are spaced 58~82˚ apart, with a 108˚ FOV providing overlapping coverage
Latitudinal coverage to 62˚N and 62˚SEach job is completely independent of the others
and they can all run simultaneouslyLatencies to data receipt range from 6-32 minutes
after image time74April 6, 2012 GHE Operational Readiness Review
Product PrecedenceSatellite Runs (2/4)
Zenith-angle adjustments to cloud-top temperature calculated from Bob Joyce’s model developed for CPC
Parallax adjustments to locations based on corrected temperatures and model profile data to determine cloud height
Rain calculation based primarily on corrected cloud-top temperatures and geometry, adjusted by other derived products
75April 6, 2012 GHE Operational Readiness Review
Product PrecedenceSatellite Runs (3/4)
GOES products are the most complicatedNeed to follow a hierarchy to grab the best
available from Full-disk data (available every 3 hours), to hemispheric data (every 30 minutes), to CONUS/PACUS products (15 minutes)
Can lose South American data for up to 3 hours during RSOs
Frequent gaps in southeast Pacific76April 6, 2012 GHE Operational Readiness Review
Product PrecedenceSatellite Runs (4/4)
Meteosat-9 covers Europe and Africa every 15 minutes
Meteosat-7 covers Indian Ocean and central Asia every 30 minutes
MTSAT covers Australia, east Asia, and the western PacificNorthern hemisphere every 30 minutesSouthern hemisphere every 60 minutes
77April 6, 2012 GHE Operational Readiness Review
Product PrecedenceComposites (1/2)
Each satellite will have its own routine to create an hourly time summation of the observed precipitation
Summation routine runs by pixel, adapts for different sized images being summed
Time-weighted average – each pixel weighted by the portion of the hour it represents 78April 6, 2012 GHE Operational Readiness Review
Product PrecedenceComposites (2/2)
Mosaic program will run hourly to create a global composite rainfall image
Creates ‘seamless’ smooth averaging in the overlap regions using zenith angle weighting
Will also run for previous hours to catch later-arriving data
79April 6, 2012 GHE Operational Readiness Review
80
System Description Output Files
Output files are in McIDAS AREA format and netCDF
Output files will be post-processed for final display and distribution to users and web
Composites over multiple time lengths instantaneous rainfall rate and 1-hour, 3-hour,
and 6-hour rainfall estimate, daily rainfall, 2-day, 3-day, 4-day, 5-day, 6-day and 7-day rainfall estimate.
April 6, 2012 GHE Operational Readiness Review
81
System Description Products
Detailed Product SpecificationsParameters Specifications
Environmental parameter Instantaneous rainfall rate , 1-hour, 3-hour, 6-hour, 24-hour and multi-day rainfall accumulations
Geographical Coverage global from 60S to 60N
Horizontal Resolution/grid spacing
4 km
Mapping Uncertainty 4 km
Measurement Range 0 ~ 76 mm/h
Measurement Precision 9 mm/h at rates of 10 mm/h, with higher values at higher rates
Measurement Accuracy 6 mm/h at rates of 10 mm/h, with higher values at higher rates
Latency 20 mins
Refresh 20 mins
Formats McIDAS, netCDF4
April 6, 2012 GHE Operational Readiness Review
8282
OutlineOutline Introduction Risks and Action System Requirements System Description System Test System Operational Readiness Summary
82April 6, 2012 GHE Operational Readiness Review
GHE System Test Clay Davenport
NESDIS/OSPO
83April 6, 2012 83GHE Operational Readiness Review
GHE Unit Test Description
Each test has been done following the scenarioDescribe the test itemShow scheduled execution times (cron schedule)Show predefined McIDAS area numbers used for
intermediate and final outputShow directory listing of output files indicating
the file creation time is consistent with the scheduled execution time
Test results are available for review in Appendix
April 6, 2012 84GHE Operational Readiness Review
GHE System Test Objectives
Ensure that all requirements specified for the product processing system and products are satisfied, and the products meet the users’ needs and expectations.
April 6, 2012 85GHE Operational Readiness Review
GHE System Test Test Plan
The execution of integrated code consists of a series GHE runs configured with specified system test input data to verify all requirement items are satisfactory at the system test level.
April 6, 2012 86GHE Operational Readiness Review
GHE System TestTest Environment
The unit test is performed on GHE2, and the integration test is on GHE1The machines are located at the ESPC/OSPO
2 quad core CPUs 2.66 GHz 8 GB memory 200 GB additional disk space gfortran version 4.1.2 gcc version 4.1.2 McIDAS version 2010.1
NetCDF and HDF5 lib were installed NetCDF version 4.1.3 HDF5 version 1.8.6
GRIB1/GRIB2 lib are installed Grib1 lib are part of SPE codes GRIB2 version 2
April 6, 2012 87GHE Operational Readiness Review
GHE System TestTest Dataset
The system works off of the McIDAS data servers which provide all required real time data.GOES-E, GOES-W, METEOSAT, MTSAT, INDOEX IR images
(McIDAS format)GFS forecast models (McIDAS format)NCEP Stage IV radar/gauge data (ftpprd.ncep.noaa.gov)NCEP gauge data (ftp.emc.ncep.noaa.gov)
April 6, 2012 88GHE Operational Readiness Review
GHE System TestTest Configuration
Define output locationsscripts/setup_ghe.shsrc/globalghe.incdata/RESOLV.SRV
Compile source codeRun ghe_build.sh in src/ directory and move
executables to bin/ directoryRun makefile in ghe_ncd_code/main directoryRun makefile in SPE directory
Load ghe_crontab into cron daemonApril 6, 2012 89GHE Operational Readiness Review
GHE System TestTest Items
Production Component GHE Core process GHE/SPE process GHE/NetCDF process
Validation Component Hourly (Radar) Daily (Gauge)
Dissemination Component DDS – hourly for HRC user Satepsdist1 – all products for SAB users Sandia/Cyclone/Tornado – status and logs for operator monitoring GP5/GP50 – gifs for Web monitoring Satepsanone – test data
QC Monitoring
April 6, 2012 90GHE Operational Readiness Review
GHE System Test Test Sequence (1/2)
Set up the cronjob for generating GHE products to run at full GHE capacity This driver is capable of generating the global rainfall
products, including SPE and netCDF outputs GFS model data reevaluated every 60 minutes Instantaneous rain data generated every 15-60 minutes,
depending on sector Set up the cronjob for generating composite rain products
Instantaneous and hourly composites generated every 15 minutes
3- and 6-hourly composites generated at top of every hour SPE and global netCDF for HRC at top of every hour
April 6, 2012 91GHE Operational Readiness Review
GHE System Test Test Sequence (2/2)
Set up the cronjob for generating daily product at 1300 UTC every day. All observations collected during a calendar day (1200 –
1200 UTC) is processed at 1300 UTC the following day. Daily products are merged to create 2- through 7-day
global totals. Set up the cronjob for generating gif images Setup the cronjob for data and images transfer to data
distribution server and web farms Set up the cronjob for daily clean-up
April 6, 2012 92GHE Operational Readiness Review
System Test Core Product – GOES-East Rain
April 6, 2012 93GHE Operational Readiness Review
Available 17 minutes after scan time (29 minutes during full disk)
System Test Core Product – GOES-West Rain
April 6, 2012 94GHE Operational Readiness Review
Available 18 minutes after scan time (29 minutes during full disk)
System Test Core Product – Meteosat-9 Rain
April 6, 2012 95GHE Operational Readiness Review
Available 28 minutes after scan time, 4x per hour, full disk
System Test Core Product – Meteosat-7 Rain
April 6, 2012 96GHE Operational Readiness Review
Available 18 minutes after scan time, 2x per hour, full disk
System Test Core Product – MTSAT Rain
April 6, 2012 97GHE Operational Readiness Review
Available 36 minutes after scan time; scans at :30 are normally full disk, scans at :00 are NHEM or SHEM only
System Test Core Product – Merged Global File
Global instantaneous files, required at 20 min latency for N.A. and 50 minutes for globe
Produced at :19 for GOES, updated at :34 and :49 to capture later files
April 6, 2012 98GHE Operational Readiness Review
System Test Core Product – Global Daily Rain
Global daily rain total, 12Z-12Z, generated at 13:19 Z each day from 6-hour totals
April 6, 2012 99GHE Operational Readiness Review
System Test Core Product – Multi-day Rain Totals
Seven-day shown, available for each of 1-2-3-4-5-6 days
April 6, 2012 100GHE Operational Readiness Review
System Test Core Product – SPE
Generated immediately after instantaneous global merge r is made (~:19)
April 6, 2012 101GHE Operational Readiness Review
System Test Core Product – NetCDF Output
Log extracts showing the completion of the netCDF routine every 15 minutes
globalmerge_20120329_123401.log:Ending NETCDF at Thu Mar 29 12:36:32 UTC 2012
globalmerge_20120329_124901.log:Ending NETCDF at Thu Mar 29 12:52:06 UTC 2012
globalmerge_20120329_130401.log:Ending NETCDF at Thu Mar 29 13:07:48 UTC 2012
globalmerge_20120329_131901.log:Ending NETCDF at Thu Mar 29 13:21:00 UTC 2012
globalmerge_20120329_133401.log:Ending NETCDF at Thu Mar 29 13:36:42 UTC 2012
globalmerge_20120329_134901.log:Ending NETCDF at Thu Mar 29 13:52:14 UTC 2012
globalmerge_20120329_140401.log:Ending NETCDF at Thu Mar 29 14:07:51 UTC 2012
globalmerge_20120329_141901.log:Ending NETCDF at Thu Mar 29 14:20:58 UTC 2012
globalmerge_20120329_143401.log:Ending NETCDF at Thu Mar 29 14:36:36 UTC 2012
globalmerge_20120329_144901.log:Ending NETCDF at Thu Mar 29 14:52:11 UTC 2012
globalmerge_20120329_150401.log:Ending NETCDF at Thu Mar 29 15:07:53 UTC 2012
globalmerge_20120329_151901.log:Ending NETCDF at Thu Mar 29 15:20:58 UTC 2012
April 6, 2012 102GHE Operational Readiness Review
System Test Validation of Product Quality
• Algorithm• The HE has been run in operations since 2002• Two changes were made during the GHE
implementation• Replace NAM model data with GFS model data
for the global application• Extend the orographic and EQL adjustment over
global• The same algo is applied to each individual satellite• The global composite is then generated from
retrievals from each individual satellite
April 6, 2012 103GHE Operational Readiness Review
System Test Validation of Product Quality
• Product Quality Verification• Verified against the spec for instantaneous rain
rate• Verified against the current operational HE
products over CONUS• Verified against the same global products
generated from STAR• Validated against radar for hourly and gauge for
daily totals
April 6, 2012 104GHE Operational Readiness Review
System Test Validation – Instantaneous Rain Rate
Comparison with 1-h totals from the current global HE using TRMM Precipitation Radar (PR) as the benchmark for 24 March – 1 April 2012 shows slight but possibly not statistically meaningful differences:
Spec was calculated using the STAR version for May-November 2005. This data sample is much smaller (9 days) which results in much greater uncertainty in the statistics, so it is not surprising that it is outside of spec for this short period. However, performance of the OSPO version is similar to the STAR version which provides confidence that spec would be met for a longer study period.
April 6, 2012 105GHE Operational Readiness Review
System Test Validation – Daily Rainfall
Compared to NCEP daily gauges
April 6, 2012 106GHE Operational Readiness Review
Global H-EAREA THRESH NUMRN NUMEST NBIAS VBIAS CORR RMSE SUCC MISS FAR SKIL 621 0.0 184133. 112025. 61. 56. 0.50 5.54 0.42 0.58 0.19 0.89 621 7.0 72021. 37617. 52. 58. 0.14 15.73 0.27 0.73 0.25 0.50 621 26.0 11921. 6303. 53. 62. 0.22 29.29 0.28 0.72 0.29 0.48 621 52.0 1364. 741. 54. 57. 0.60 47.96 0.06 0.94 0.42 0.44 621 WTAVG 467191. 261395. 56. 56. 0.42 12.08 0.31 0.69 0.25 0.76
System Test Validation - Hourly Rainfall
Compared to NCEP Stage IV analysis
April 6, 2012 107GHE Operational Readiness Review
Global H-EAREA THRESH NUMRN NUMEST NBIAS VBIAS CORR RMSE SUCC MISS FAR SKIL 997 0.0 36867. 75690. 205. 72. 0.31 5.34 0.33 0.67 1.72 0.97 997 7.0 32515. 31743. 98. 61. 0.09 31.35 0.21 0.79 0.77 0.29 997 26.0 20138. 8408. 42. 42. 0.26 44.21 0.11 0.89 0.26 0.24 997 52.0 7285. 1818. 25. 35. 0.39 61.78 0.10 0.90 0.13 0.30 997 WTAVG 496121. 264616. 53. 67. 0.30 15.44 0.14 0.86 0.38 0.81
System Test Dissemination – DDS, SATEPSDIST1 and
SATEPSANON netCDF and SPE distribution go primarily to
the NWS and HRC
DDS connection has been tested without sending data – appending for the distribution rule be setup
Products are being send via SATEPSANON and verified as acceptable to the primary user
Products are being send to SATEPSDIST1
April 6, 2012 108GHE Operational Readiness Review
System Test Dissemination – Web Farms
3-hour total GIF (among others) sent to web page on GP50/GP5 every hour
Doubles as quick QC check for programmers
April 6, 2012 109GHE Operational Readiness Review
110
System Test Dissemination- Monitoring
List of continuously updating status files
Used to power the GUI monitor -rw-r--r-- 1 Pprecip precip 1184436 Mar 29 15:25 globalmerge.status
-rw-r--r-- 1 Pprecip precip 1087973 Mar 29 15:31 raingoesen.status
-rw-r--r-- 1 Pprecip precip 614463 Mar 29 15:19 raingoeses.status
-rw-r--r-- 1 Pprecip precip 1104953 Mar 29 15:32 raingoeswn.status
-rw-r--r-- 1 Pprecip precip 607832 Mar 29 15:04 raingoesws.status
-rw-r--r-- 1 Pprecip precip 591739 Mar 29 15:21 rainindia.status
-rw-r--r-- 1 Pprecip precip 1179035 Mar 29 15:31 rainmeteo.status
-rw-r--r-- 1 Pprecip precip 588631 Mar 29 15:11 rainmtsat.status
-rw-r--r-- 1 Pprecip precip 310877 Mar 29 15:04 setupworld.status
-rw-r--r-- 1 Pprecip precip 321352 Mar 29 15:20 transfergifs.status
April 6, 2012 110GHE Operational Readiness Review
System Test Dissemination- Monitoring
GUI Monitor installed on Sandia for Operator
April 6, 2012 111GHE Operational Readiness Review
System Test Verify Users’ Needs - Time Latency
Time latency of sector rain products from March 20-29, 2012
Satellite Number of images
Average latency(minutes)
GOES-E (NH) 754 19.04
GOES-E (SH) 263 18.93
GOES-W (NH) 654 19.13
GOES-W (SH) 297 17.97
Meteosat-9 927 27.97
India (Meteosat-7) 429 16.34
MTSAT 465 36.71
April 6, 2012 112GHE Operational Readiness Review
System Test Verify Users’ Needs - Time Latency
North American composite (SPE) generated and sent at :20 after each hour
Global composite first built at :19 after nominal time, with rebuilds at :34, :49, and 1:04 after.
The file at :49 after will usually be complete (MTSAT takes 36-40 minutes to process)
May be possible to adjust times to get global product closer to MTSAT time
April 6, 2012 113GHE Operational Readiness Review
System Test Verify Users’ need - Coverage
Global coverage to +/- 64 degrees
April 6, 2012 114GHE Operational Readiness Review
System Test Verify Users’ Need – Product Accuracy
Comparison to current operational H-E (daily gauges, US only, from 2/15 to 3/18/12). Test results show slight improvement of GHE over the current operational HE
All pixels
Weighted by precipitation thresholds
Num Bias
Vol Bias
R RMSE Success
False Alarm
OPS 1.03 1.35 .619 8.59 .730 .297
GHE 0.96 1.03 .615 7.56 .675 .286
Num Bias
Vol Bias
R RMSE Success
False Alarm
OPS 1.30 1.30 .408 23.51 .613 .865
GHE 1.04 1.04 .437 20.52 .558 .598
April 6, 2012 115GHE Operational Readiness Review
116116
OutlineOutline Introduction Risks and Actions System Requirements System Description System Test System Operational Readiness Summary
116April 6, 2012 GHE Operational Readiness Review
System Operational Readiness
Limin ZhaoNESDIS/OSPO
117April 6, 2012 117GHE Operational Readiness Review
118
System Operational ReadinessProduction Environment
Two Dedicated Servers for GHE - GHE1/GHE2Development – GHE2 Sever
Development and testing of GHE under $ANCHOR/GHE_dev
Testing and Backup– GHE2 Server Pre-operational codes (DAP) received from STAR has been
thoughly tested on GHE2 at ESPC since Jan 2012. ($ANCHOR/GHE_test)
GHE2 will also as served as the backup server for the operational GHE ($ANCHOR/GHE).
Production – GHE1 Server GHE will be run to generate the operational products on GHE1
The products will be distributed to users through ESPC Data Distribution System (DDS) and McIDAS ADDE server on GHE1
April 6, 2012 GHE Operational Readiness Review
119
System Operational ReadinessInput Data Sources
Satellite Data for Product Generation GOES-W&-E GWR (McIDAS Area)
Meteosat-7 & -9 (McIDAS Area)
MTSAT (McIDAS Area)
Ancillary Data for Product Generation NCEP GFS Model data (GRIB2 converted to McIDAS)
Global Terrain Maps (McIDAS Area)
Lookup Tables for Viewing Angle Corrections (McIDAS Area)
Ancillary Data for Product Validation Stage-IV Hourly Rainfall (netCDF)
CPC Daily Rainfall from gauge (GRIB2)April 6, 2012 GHE Operational Readiness Review
120
System Operational Readiness IT Architecture and Network Connection
April 6, 2012 GHE Operational Readiness Review
Note: CLASS is not in the picture since no archival is required
121
System Operational Readiness Products (1/2)
The global Hydro-Estimator rainfall estimate utilizes IR brightness temperatures to identify regions of rainfall and retrieve rainfall rate, then uses GFS model fields to adjust the rainfall rate for the effects of moisture availability, evaporation, orographic modulation, and thermodynamic profile effects.
The rainfall products include:Global: instantaneous rainfall rate and 1-hour rainfall
rate
CONUS: instantaneous rainfall rate and 1-hour, 3-hour, and 6-hour rainfall estimate, daily rainfall, 2-day, 3-day, 4-day, 5-day, 6-day and 7-day rainfall estimate.
April 6, 2012 GHE Operational Readiness Review
122
System Operational Readiness Products (2/2)
Detailed Product SpecificationsParameters Specifications
Environmental parameter Instantaneous rainfall rate , 1-hour, 3-hour, 6-hour, 24-hour and multi-day rainfall accumulations
Geographical Coverage Global from 60°S to 60°N
Horizontal Resolution/grid spacing
4 km
Mapping Uncertainty 4 km
Measurement Range 0 ~ 76 mm/h
Measurement Precision 9 mm/h at rates of 10 mm/h, with higher values at higher rates
Measurement Accuracy 6 mm/h at rates of 10 mm/h, with higher values at higher rates
Latency 20 mins
Refresh 20 mins
Formats McIDAS, netCDF4
April 6, 2012 GHE Operational Readiness Review
123
System Operational Readiness
Users of ProductsUser POCs Products Dissemination
NWS/OHD David Kitzmiller Hourly Rainfall Estimate ESPC Data Distribution Sever
NWS/AWIPS James Heil Hourly Rainfall Estimate ESPC Data Distribution Sever
NWS Centers, i.e. HPC
James Heil Hourly Rainfall Estimate NAWIPS
NWS/HRC Dan BeardsleyKonstantine GeorgakakosBob Jubach
Hourly Rainfall Estimate ESPC data Distribution Sever
NESDIS/SAB Sheldon Kusselson Instantaneous rain rate, 1-hour, 3-hour, 6-hour, 24-hour rainfall accumulation, and multi-day rainfall accumulations
ESPC McIDAS ADDE Server
eTRAP Liqun Ma Hourly Rainfall Estimate ESPC McIDAS ADDE Server
April 6, 2012 GHE Operational Readiness Review
124
System Operational ReadinessProduction
ESPC GOES Ingest Systems provides all GEO satellite input data
ESPC Model Server provides GFS model data
The global HE product system is hosted on GHE1/GHE2, which collects the satellite inputs and required ancillary data to run the HE algorithm
The products are generated in McIDAS area and then converted into netCDF4 for archive
April 6, 2012 GHE Operational Readiness Review
125
System Operational ReadinessDissemination
DDSHourly rainfall over CONUS in GRIB format
Hourly rainfall over global in netCDF4 format Pending for the distribution rules on DDS, which will be setup
after the SPSRB’s approval for operation
McIDAS ADDE on SATEPSDIST1All GHE products
Internet (Web Interface)GHE product images
Image animation loops
Test DataApril 6, 2012 GHE Operational Readiness Review
126
System Operational Readiness Monitoring (1/2)
Multi-level Monitoring ToolsA GUI monitor for operator to monitoring the
processing statusAutomated email alerts for product generation and
distribution anomaliesWeb-based tools for product quality, timeliness
and distribution status (http://www.ospo.ssd.nesdis.noaa.gov/Products/atmosphere/ghe)
Offline product quality validation against Radar and Gauge dataApril 6, 2012 GHE Operational Readiness Review
127
System Operational ReadinessMonitoring (2/2)
Monitoring ProceduresOverall quality check for input data are performed inside
of the global HE algorithm.The job performance, including processes status, input
and output data latency, and product distribution, will be monitored by the ESPC help desk through the GUI monitor
Email alerts will be generated and send to the related people when an error occurs
Offline statistic comparison with radar and gauge data will be generated for product quality validation
The Precipitation PAL and maintenance personnel at OSPO will monitor the product quality and coordinate with the STAR scientists for any product quality issues
April 6, 2012 GHE Operational Readiness Review
128
System Operational Readiness
GUI Monitor for Operator
April 6, 2012 GHE Operational Readiness Review
129
System Operational Readiness
Web for Product Monitoring
April 6, 2012 GHE Operational Readiness Review
130
System Operational Readiness
GHE 5-Day Rainfall Total
April 6, 2012 GHE Operational Readiness Review
131
System Operational Readiness
Maintenance (1/2)GHE will be supported under the ESPC operationThe production machines are maintained by the
ESPC IT team 24/7Operation Procedure and System Maintenance
Manual will be in place to support O&M needsThe primary and backup maintenance
personnel have been identified to cover normal maintenance needs
The ESPC CM and security procedures will be followed for any codes and documents changes
The monitoring tools and procedures are in place as discussed before
The PAL will work with STAR scientists for any science maintenance needs when identified
April 6, 2012 GHE Operational Readiness Review
132
System Operational Readiness
Maintenance (2/2)Emergency Recovery CapabilityGHE will replace the current HE at the CIP
(Critical Infrastructure Protection) facility after the GHE is operational to make use of the current IT resource at CIP.
Any promotions and changes in the ESPC operation will be being made in the CIP at the same time
GHE products can be continued in the event of an unexpected and sustained loss of service at the NSOF ESPC
April 6, 2012 GHE Operational Readiness Review
133
System Operational Readiness QA – Code Standards
The GHE operational team has been working with the development team to ensure that the GHE follows the ESPC operational requirements/guidanceDirectory structuresFile/directory naming conventionsOperational log file contentError tracking and handling
The GHE has passed through Code Review OSPO leads the Code Review for coding standards and
security, All the open items from code review have been closedResults have been documented in Code Review ReportThe code review report, as a ORR review artifact, can be found
at: ftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/ORR
April 6, 2012 GHE Operational Readiness Review
134
System Operational Readiness
QA – CM and IT security Product implementation Implementation on parallel test environment and transition to
operation are tasked and managed by Change Requests (CCRs/WRs) through the ESPC Request for Action Tracking System (RATS)
Software CM follows ESPC Software Configuration Management Process and Procedures Manual.
Codes will be checked into CVS
Security Procedures GHE processing passes the software security check and meets
NESDIS OSPO security standards GHE has being tested in a separate test environment before
installation in an operational environment SIA will be performed for GHE before the system declares
operational
Documents will be under the CM control at OSPO G:\Common\ESPC Library
April 6, 2012 GHE Operational Readiness Review
135
System Operational Readiness QA – Documentation
ESPC Operation Procedure has been developed for operators
Operation maintenance procedures have been developed to support O&M needs at OSPO, which include:Procedures for installation and buildRun procedures (includes normal and emergency
operations)Monitoring, diagnosis, and recovery proceduresProduct distribution proceduresInterpretation of error messagesSystem shutdown and startup procedures
SPSRB Required Docs Completed the draft User Manuals, System
Maintenance Manual, ATBDNeed be finalized before the GHE is operational
April 6, 2012 GHE Operational Readiness Review
136
System Operational ReadinessArchive
Appended for future revisitCurrent, no formal archive requirement is identified
in the user request for global HE productThe CONUS HE from STAR is archived voluntarily at
NCAR for the NAME projectThe IPT will take initiative to discuss with users and
CLASS the possibility of archiving the HE products with NCDC/CLASS An initial request to archive global Hydro-
Estimator Rainfall product has be submitted to NCDC/CLASS through its online Advanced Tracking and Resource Tool (ATRAC)
April 6, 2012 GHE Operational Readiness Review
137
System Operational ReadinessUser Readiness
Data AccessAll users have access to the test data that are
provided on the ESPC ftp siteftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/
NWS/HRC has been granted the access to DDS for the operational data, and will switch to pull data from STAR to ESPC DDS when the GHE declares operational.
NWS/AWIPS user has been receiving the HE/SPE data from DDS since 2002. The transition from GHE to HE is transparent to them.
NESDIS/SAB users have access to GHE McIDAS files through ADDE server
April 6, 2012 GHE Operational Readiness Review
138
System Operational ReadinessUser Readiness
Acceptance of ProductHRC user has verified its capability to ingest the
global HE data in netCDF4 format, and is ready to use it when it is operationally available.
NWS/AWIPS users will continue getting the CONUS HE data in GRIB1 format The data be provided from GHE instead of HE. The transition is transparent – no change in format,
data coverage User evaluation of the product quality is ongoing
NESDIS/SAB is provided the global products in McIDAS, and has flexibility to view only CONUS or any other interested region. Evaluation for the global products is ongoing
April 6, 2012 GHE Operational Readiness Review
139
System Operational ReadinessUser Readiness
TrainingUser manuals will be made available to all
usersHRC users
have used the experimental products from STAR for a long time, and no particular training is required at this point except the change of format
Test data has been provided to users, and feedbacks from users regarding the filename convention, and metadata have been addressed
SAB users Help to make changes to their scripts to use the GHE
files instead of HE files over CONUS.
April 6, 2012 GHE Operational Readiness Review
140
System Operational ReadinessUser Readiness
Training (cont)NWS/AWIPS (OHD) users
Test data is provided for checking out any potential issue in preparing the future transition from GRIB1 to GRIB2.
The E2E test for GRIB2 is pending for the AWIPS testing schedule.
ESPC Operator Operations Procedure has been submitted for review
by the ESPC help desk Training will be scheduled for all four Crews, and
completed by the time the GHE is declared operational
April 6, 2012 GHE Operational Readiness Review
System Operational ReadinessSummary
The system is ready for operations
The documentation will be complete by the time the GHE is officially declared operational (final touches need to be done to the documents)
The users are ready to receive and use the data
April 6, 2012 GHE Operational Readiness Review 141
142142
OutlineOutline Introduction Risks and Actions System Requirements System Description System Test System Operational Readiness Summary
142April 6, 2012 GHE Operational Readiness Review
SummarySummary Limin Zhao
NESDIS/OSPO
143April 6, 2012 143GHE Operational Readiness Review
144
SummarySummaryRisk and Actions have been reviewedRequirements and their Allocations have been
reviewedSystem Description and Test have been reviewedProducts Quality Readiness have been reviewedOperation Readiness has been reviewedUser Readiness has been reviewed
April 6, 2012 144GHE Operational Readiness Review
145
Next StepsNext Steps
Operational PhaseSPSRB Decision Briefing – April 18, 2012Operational Commencement – April 30, 2012
April 6, 2012 145GHE Operational Readiness Review
146
Open DiscussionOpen Discussion
The review is now open for free discussion
April 6, 2012 146GHE Operational Readiness Review
AppendixAppendix
147April 6, 2012 147GHE Operational Readiness Review
GHE Unit TestPeter Keehn
NESDIS/STAR
148April 6, 2012 148GHE Operational Readiness Review
GHE Unit TestTest Environment
The development and tests are performed on ghe2.nesdis.noaa.gov Linux 64-bit
The machine is located at OSPO2 quad core CPUs2.66 GHz8 GB memory200 GB additional disk spacegfortran version 4.1.2gcc version 4.1.2McIDAS version 2010.1
NetCDF and HDF5 were manually installedNetCDF version 4.1.3HDF5 version 1.8.6
April 6, 2012 149GHE Operational Readiness Review
GHE Unit TestTest Dataset
The system works off of the McIDAS data servers which provide real time data.GOES-E, GOES-W, METEOSAT, MTSAT,
INDOEX IR images (McIDAS format)GFS forecast models (McIDAS format)
April 6, 2012 150GHE Operational Readiness Review
GHE Unit TestTest Configuration
Define output locationsScripts/setup_ghe.shSrc/globalghe.incData/RESOLVE.SRV
Compile source codeRun ghe_build.sh in src/ directory and move
executables to bin/ directoryRun makefile in ghe_ncd_code/main directory
Load ghe_crontab into cron daemonApril 6, 2012 151GHE Operational Readiness Review
GHE Unit TestTest Items
The following are the main driver routines for the GHE systemsetupworld.sh (globalsetup.k)raingoesen.sh (goesen2011.k)raingoeses.sh (goeses2011.k)raingoeswn.sh (goeswn2011.k)raingoesws.sh (goesws2011.k)rainindia.sh (indoex2011.k)rainmeteo.sh (meteo2011.k)rainmtsat.sh (mtsat2011.k)globalmerge.shtransfergifs.shclean_up.sh
Create ancillary data files:precipitable waterrelative humidityorographic correctionequilibrium-level
adjustment
April 6, 2012 152GHE Operational Readiness Review
GHE Unit TestTest Items
The following are the main driver routines for the GHE systemsetupworld.sh (globalsetup.k)raingoesen.sh (goesen2011.k)raingoeses.sh (goeses2011.k)raingoeswn.sh (goeswn2011.k)raingoesws.sh (goesws2011.k)rainindia.sh (indoex2011.k)rainmeteo.sh (meteo2011.k)rainmtsat.sh (mtsat2011.k)globalmerge.shtransfergifs.shclean_up.sh
Get the most recent GOES IR image and calculate rain rates
April 6, 2012 153GHE Operational Readiness Review
GHE Unit TestTest Items
The following are the main driver routines for the GHE systemsetupworld.sh (globalsetup.k)raingoesen.sh (goesen2011.k)raingoeses.sh (goeses2011.k)raingoeswn.sh (goeswn2011.k)raingoesws.sh (goesws2011.k)rainindia.sh (indoex2011.k)rainmeteo.sh (meteo2011.k)rainmtsat.sh (mtsat2011.k)globalmerge.shtransfergifs.shclean_up.sh
Get the most recent INDOEX IR image and calculate rain rates
April 6, 2012 154GHE Operational Readiness Review
GHE Unit TestTest Items
The following are the main driver routines for the GHE systemsetupworld.sh (globalsetup.k)raingoesen.sh (goesen2011.k)raingoeses.sh (goeses2011.k)raingoeswn.sh (goeswn2011.k)raingoesws.sh (goesws2011.k)rainindia.sh (indoex2011.k)rainmeteo.sh (meteo2011.k)rainmtsat.sh (mtsat2011.k)globalmerge.shtransfergifs.shclean_up.sh
Get the most recent METEOSAT IR image and calculate rain rates
April 6, 2012 155GHE Operational Readiness Review
GHE Unit TestTest Items
The following are the main driver routines for the GHE systemsetupworld.sh (globalsetup.k)raingoesen.sh (goesen2011.k)raingoeses.sh (goeses2011.k)raingoeswn.sh (goeswn2011.k)raingoesws.sh (goesws2011.k)rainindia.sh (indoex2011.k)rainmeteo.sh (meteo2011.k)rainmtsat.sh (mtsat2011.k)globalmerge.shtransfergifs.shclean_up.sh
Get the most recent MTSAT IR image and calculate rain rates
April 6, 2012 156GHE Operational Readiness Review
GHE Unit TestTest Items
The following are the main driver routines for the GHE systemsetupworld.sh (globalsetup.k)raingoesen.sh (goesen2011.k)raingoeses.sh (goeses2011.k)raingoeswn.sh (goeswn2011.k)raingoesws.sh (goesws2011.k)rainindia.sh (indoex2011.k)rainmeteo.sh (meteo2011.k)rainmtsat.sh (mtsat2011.k)globalmerge.shtransfergifs.shclean_up.sh
Merge instantaneous rain rate images into a global image.
Generate global hourly (1, 3, 6) and daily (1-7) totals.
April 6, 2012 157GHE Operational Readiness Review
GHE Unit TestTest Items
The following are the main driver routines for the GHE systemsetupworld.sh (globalsetup.k)raingoesen.sh (goesen2011.k)raingoeses.sh (goeses2011.k)raingoeswn.sh (goeswn2011.k)raingoesws.sh (goesws2011.k)rainindia.sh (indoex2011.k)rainmeteo.sh (meteo2011.k)rainmtsat.sh (mtsat2011.k)globalmerge.shtransfergifs.shclean_up.sh
Generate GIF images and transfer to web server
April 6, 2012 158GHE Operational Readiness Review
GHE Unit TestTest Items
The following are the main driver routines for the GHE systemsetupworld.sh (globalsetup.k)raingoesen.sh (goesen2011.k)raingoeses.sh (goeses2011.k)raingoeswn.sh (goeswn2011.k)raingoesws.sh (goesws2011.k)rainindia.sh (indoex2011.k)rainmeteo.sh (meteo2011.k)rainmtsat.sh (mtsat2011.k)globalmerge.shtransfergifs.shclean_up.sh Remove old files that are
no longer needed
April 6, 2012 159GHE Operational Readiness Review
GHE Unit Test Test Description
Each test will follow this scenarioDescribe the test itemShow scheduled execution times (cron
schedule)Show predefined McIDAS area numbers used
for intermediate and final outputShow directory listing of output files indicating
the file creation time is consistent with the scheduled execution time
April 6, 2012 160GHE Operational Readiness Review
GHE Unit Test setupworld.sh
setupworld.shRuns once every hourExecutes globalsetup.k
Create global PW and RH data files. Create global orographic correction data files. Create global equilibrium-level adjustment files
(every 3 hours).
April 6, 2012 161GHE Operational Readiness Review
GHE Unit Test setupworld.sh
Cron schedule for setupworld.shRuns at 3 minutes past the hour (every hour)
# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh
April 6, 2012 162GHE Operational Readiness Review
GHE Unit Test setupworld.sh
AREA and GRID numbers used for PW and RH data files
C #############################################################CC PW,RH routinesCC ############################################################# INTEGER, PARAMETER :: PWRH_GRID = 110 INTEGER, PARAMETER :: PWRH_AREA = 25 INTEGER, PARAMETER :: GLOBAL_PW = 26 INTEGER, PARAMETER :: GLOBAL_RH = 27 INTEGER, PARAMETER :: DEFAULT_PW = 31 INTEGER, PARAMETER :: DEFAULT_RH = 32
April 6, 2012 163GHE Operational Readiness Review
GHE Unit Test setupworld.sh
Listing of PW and RH data filesFile creation time is 3 minutes past the hour
[Pprecip@ghe2 ~/GHE/mcidas/data]$ll GRID0110 AREA0025 AREA0026 AREA0027-rw-r--r-- 1 Pprecip precip 262724 Feb 16 16:03 AREA0025-rw-r--r-- 1 Pprecip precip 263316 Feb 16 16:03 AREA0026-rw-r--r-- 1 Pprecip precip 263316 Feb 16 16:03 AREA0027-rw-r--r-- 1 Pprecip precip 1570876 Feb 16 16:03 GRID0110
April 6, 2012 164GHE Operational Readiness Review
GHE Unit Test setupworld.sh
AREA and GRID numbers used for orographic data files INTEGER, PARAMETER :: GLOBAL_OROG_GE = 20 INTEGER, PARAMETER :: GLOBAL_OROG_GW = 21 INTEGER, PARAMETER :: GLOBAL_OROG_MSG = 22 INTEGER, PARAMETER :: GLOBAL_OROG_IND = 23 INTEGER, PARAMETER :: GLOBAL_OROG_MTS = 24
April 6, 2012 165GHE Operational Readiness Review
GHE Unit Test setupworld.sh
Listing of orographic data filesFile creation time is ~3 minutes past the hour
[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA002[0,1,2,3,4] GRID002[0,1,2,3,4]-rw-r--r-- 1 Pprecip precip 14400848 Feb 16 16:03 AREA0020-rw-r--r-- 1 Pprecip precip 14400848 Feb 16 16:03 AREA0021-rw-r--r-- 1 Pprecip precip 14400848 Feb 16 16:03 AREA0022-rw-r--r-- 1 Pprecip precip 14400848 Feb 16 16:03 AREA0023-rw-r--r-- 1 Pprecip precip 14400848 Feb 16 16:04 AREA0024-rw-r--r-- 1 Pprecip precip 522480 Feb 16 16:03 GRID0020-rw-r--r-- 1 Pprecip precip 522480 Feb 16 16:03 GRID0021-rw-r--r-- 1 Pprecip precip 522480 Feb 16 16:03 GRID0022-rw-r--r-- 1 Pprecip precip 522480 Feb 16 16:03 GRID0023-rw-r--r-- 1 Pprecip precip 522480 Feb 16 16:03 GRID0024
April 6, 2012 166GHE Operational Readiness Review
GHE Unit Test setupworld.sh
AREA, GRID, and MD numbers used for EQL data files
C #############################################################CC EQL routines (eqlgrdw.pgm, eqtry2011.pgm)CC ############################################################# CHARACTER*12, PARAMETER :: ELDATA = "gfsmodeldata" INTEGER, PARAMETER :: GRID_EQLEQLMOD = 29 INTEGER, PARAMETER :: MD_EQLIN = 29 INTEGER, PARAMETER :: MD_EQLOUT = 30
INTEGER, PARAMETER :: AREA_TEL = 80 INTEGER, PARAMETER :: AREA_EQLOUT = 81 INTEGER, PARAMETER :: AREA_TTROP1 = 82 INTEGER, PARAMETER :: AREA_TTROP2 = 83 INTEGER, PARAMETER :: AREA_TMERGE = 84 INTEGER, PARAMETER :: AREA_TFIX = 85 INTEGER, PARAMETER :: GLOBAL_EQL = 29
April 6, 2012 167GHE Operational Readiness Review
GHE Unit Test setupworld.sh
Listing of EQL data files
[Pprecip@ghe2 ~/GHE/mcidas/data]$ll ????0029 ????0030 AREA008[0,1,2,3,4,5]-rw-r--r-- 1 Pprecip precip 2536588 Feb 16 14:04 AREA0029-rw-r--r-- 1 Pprecip precip 2535404 Feb 16 14:04 AREA0080-rw-r--r-- 1 Pprecip precip 2536508 Feb 16 14:04 AREA0081-rw-r--r-- 1 Pprecip precip 3496236 Feb 16 14:04 AREA0082-rw-r--r-- 1 Pprecip precip 2535484 Feb 16 14:04 AREA0083-rw-r--r-- 1 Pprecip precip 2535404 Feb 16 14:04 AREA0084-rw-r--r-- 1 Pprecip precip 2535916 Feb 16 14:04 AREA0085-rw-r--r-- 1 Pprecip precip 24313848 Feb 16 14:04 GRID0029-rw-r--r-- 1 Pprecip precip 46872800 Feb 16 14:04 MDXX0029-rw-r--r-- 1 Pprecip precip 9920716 Feb 16 14:04 MDXX0030
April 6, 2012 168GHE Operational Readiness Review
GHE Unit Test raingoesen.sh
raingoesen.shRuns 4 times every hourExecutes goesen2011.k
Get most recent IR image. Remap to mercator projection Do zenith-angle and parallax corrections Get PW, RH, orography, and EQL for this sector Calculate rain rate Smooth rain image Save rain image
April 6, 2012 169GHE Operational Readiness Review
GHE Unit Test raingoesen.sh
Cron schedule for raingoesen.shRuns at 1,16,31,46 past the hour (every hour)
# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh
April 6, 2012 170GHE Operational Readiness Review
GHE Unit Test raingoesen.sh
AREA and GRID numbers used for GOES-E North data filesC #############################################################CC GOES-East North routine (goesen2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: GEN_IR = 100 INTEGER, PARAMETER :: GEN_ZEN = 101 INTEGER, PARAMETER :: GEN_PLAX = 102 INTEGER, PARAMETER :: GEN_PW = 103 INTEGER, PARAMETER :: GEN_RH = 104 INTEGER, PARAMETER :: GEN_EQL = 105 INTEGER, PARAMETER :: GEN_OROG = 106 INTEGER, PARAMETER :: GEN_RAIN = 107 INTEGER, PARAMETER :: GEN_SRAIN = 108
c stored global data INTEGER, PARAMETER :: GLOBAL_OROG_GE = 20
c grid file for parallax calculations INTEGER, PARAMETER :: GEN_GRID_PLAX = 103
c data directory CHARACTER*100, PARAMETER :: GOESEN_DIR = "/data/Pprecip/pkeehn/globalhe/goesen/"
April 6, 2012 171GHE Operational Readiness Review
GHE Unit Test raingoesen.sh
Listing of GOES-E North data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA010? GRID0103-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 18:46 AREA0100-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 18:46 AREA0101-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 18:46 AREA0102-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 18:46 AREA0103-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 18:46 AREA0104-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 18:46 AREA0105-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 18:46 AREA0106-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 18:46 AREA0107-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 18:46 AREA0108-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 18:46 GRID0103
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/goesen]$ll AREA8775-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 18:46 AREA8775
April 6, 2012 172GHE Operational Readiness Review
GHE Unit Test raingoeses.sh
raingoeses.shRuns 2 times every hourExecutes goeses2011.k
Get most recent IR image. Remap to mercator projection Do zenith-angle and parallax corrections Get PW, RH, orography, and EQL for this sector Calculate rain rate Smooth rain image Save rain image
April 6, 2012 173GHE Operational Readiness Review
GHE Unit Test raingoeses.sh
Cron schedule for raingoeses.shRuns at 19 and 49 past the hour (every hour)
# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh
April 6, 2012 174GHE Operational Readiness Review
GHE Unit Test raingoeses.sh
AREA and GRID numbers used for GOES-E South data filesC #############################################################CC GOES-East South routine (goeses2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: GES_IR = 150 INTEGER, PARAMETER :: GES_ZEN = 151 INTEGER, PARAMETER :: GES_PLAX = 152 INTEGER, PARAMETER :: GES_PW = 153 INTEGER, PARAMETER :: GES_RH = 154 INTEGER, PARAMETER :: GES_EQL = 155 INTEGER, PARAMETER :: GES_OROG = 156 INTEGER, PARAMETER :: GES_RAIN = 157 INTEGER, PARAMETER :: GES_SRAIN = 158
c grid file for parallax calculations INTEGER, PARAMETER :: GES_GRID_PLAX = 105
c data directory CHARACTER*100, PARAMETER :: GOESES_DIR = "/data/Pprecip/pkeehn/globalhe/goeses/"
April 6, 2012 175GHE Operational Readiness Review
GHE Unit Test raingoeses.sh
Listing of GOES-E South data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA015? GRID0105-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 11:49 AREA0150-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 11:49 AREA0151-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 11:49 AREA0152-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 11:49 AREA0153-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 11:49 AREA0154-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 11:49 AREA0155-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 11:49 AREA0156-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 11:49 AREA0157-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 11:49 AREA0158-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 11:49 GRID0105
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/goeses]$ll AREA8747-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 11:49 AREA8747
April 6, 2012 176GHE Operational Readiness Review
GHE Unit Test raingoeswn.sh
raingoeswn.shRuns 4 times every hourExecutes goeswn2011.k
Get most recent IR image. Remap to mercator projection Do zenith-angle and parallax corrections Get PW, RH, orography, and EQL for this sector Calculate rain rate Smooth rain image Save rain image
April 6, 2012 177GHE Operational Readiness Review
GHE Unit Test raingoeswn.sh
Cron schedule for raingoeswn.shRuns at 2, 17, 32, 47 past the hour (every hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh
April 6, 2012 178GHE Operational Readiness Review
GHE Unit Test raingoeswn.sh
AREA and GRID numbers used for GOES-W North data filesC #############################################################CC GOES-West North routine (goeswn2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: GWN_IR = 110 INTEGER, PARAMETER :: GWN_ZEN = 111 INTEGER, PARAMETER :: GWN_PLAX = 112 INTEGER, PARAMETER :: GWN_PW = 113 INTEGER, PARAMETER :: GWN_RH = 114 INTEGER, PARAMETER :: GWN_EQL = 115 INTEGER, PARAMETER :: GWN_OROG = 116 INTEGER, PARAMETER :: GWN_RAIN = 117 INTEGER, PARAMETER :: GWN_SRAIN = 118
c stored global data INTEGER, PARAMETER :: GLOBAL_OROG_GW = 21
c grid file for parallax calculations INTEGER, PARAMETER :: GWN_GRID_PLAX = 104
c data directory CHARACTER*100, PARAMETER :: GOESWN_DIR = "/data/Pprecip/pkeehn/globalhe/goeswn/"
April 6, 2012 179GHE Operational Readiness Review
GHE Unit Test raingoeswn.sh
Listing of GOES-W North data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA011? GRID0104-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:02 AREA0110-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:02 AREA0111-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:02 AREA0112-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:02 AREA0113-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:02 AREA0114-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 19:02 AREA0115-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 19:02 AREA0116-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:03 AREA0117-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:03 AREA0118-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 19:02 GRID0104
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/goeswn]$ll AREA8776-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:03 AREA8776
April 6, 2012 180GHE Operational Readiness Review
GHE Unit Test raingoesws.sh
raingoesws.shRuns 2 times every hourExecutes goesws2011.k
Get most recent IR image. Remap to mercator projection Do zenith-angle and parallax corrections Get PW, RH, orography, and EQL for this sector Calculate rain rate Smooth rain image Save rain image
April 6, 2012 181GHE Operational Readiness Review
GHE Unit Test raingoesws.sh
Cron schedule for raingoesws.shRuns at 3 and 33 past the hour (every hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh
April 6, 2012 182GHE Operational Readiness Review
GHE Unit Test raingoesws.sh
AREA and GRID numbers used for GOES-W South data filesC #############################################################CC GOES-west South routine (goesws2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: GWS_IR = 160 INTEGER, PARAMETER :: GWS_ZEN = 161 INTEGER, PARAMETER :: GWS_PLAX = 162 INTEGER, PARAMETER :: GWS_PW = 163 INTEGER, PARAMETER :: GWS_RH = 164 INTEGER, PARAMETER :: GWS_EQL = 165 INTEGER, PARAMETER :: GWS_OROG = 166 INTEGER, PARAMETER :: GWS_RAIN = 167 INTEGER, PARAMETER :: GWS_SRAIN = 168
c grid file for parallax calculations INTEGER, PARAMETER :: GWS_GRID_PLAX = 106
c data directory CHARACTER*100, PARAMETER :: GOESWS_DIR = "/data/Pprecip/pkeehn/globalhe/goesws/"
April 6, 2012 183GHE Operational Readiness Review
GHE Unit Test raingoesws.sh
Listing of GOES-W South data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA016? GRID0106-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:03 AREA0160-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:03 AREA0161-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:03 AREA0162-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:03 AREA0163-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:03 AREA0164-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 19:03 AREA0165-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 19:03 AREA0166-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:03 AREA0167-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:03 AREA0168-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 19:03 GRID0106
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/goesws]$ll AREA8776-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:03 AREA8776
April 6, 2012 184GHE Operational Readiness Review
GHE Unit Testrainindia.sh
rainindia.shRuns 2 times every hourExecutes indoex2011.k
Get most recent IR image. Remap to mercator projection Do zenith-angle and parallax corrections Get PW, RH, orography, and EQL for this sector Calculate rain rate Smooth rain image Save rain image
April 6, 2012 185GHE Operational Readiness Review
GHE Unit Testrainindia.sh
Cron schedule for rainindia.shRuns at 14 and 44 past the hour (every hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh
April 6, 2012 186GHE Operational Readiness Review
GHE Unit Testrainindia.sh
AREA and GRID numbers used for INDOEX data filesC #############################################################CC Meteosat-7 routine (indoex2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: IND_IR = 130 INTEGER, PARAMETER :: IND_ZEN = 131 INTEGER, PARAMETER :: IND_PLAX = 132 INTEGER, PARAMETER :: IND_PW = 133 INTEGER, PARAMETER :: IND_RH = 134 INTEGER, PARAMETER :: IND_EQL = 135 INTEGER, PARAMETER :: IND_OROG = 136 INTEGER, PARAMETER :: IND_RAIN = 137 INTEGER, PARAMETER :: IND_SRAIN = 138
c stored global data INTEGER, PARAMETER :: GLOBAL_OROG_IND = 23
c grid file for parallax calculations INTEGER, PARAMETER :: IND_GRID_PLAX = 100
c data directory CHARACTER*100, PARAMETER :: INDOEX_DIR = "/data/Pprecip/pkeehn/globalhe/india/"
April 6, 2012 187GHE Operational Readiness Review
GHE Unit Testrainindia.sh
Listing of INDOEX data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA013? GRID0100-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 18:44 AREA0130-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 18:44 AREA0131-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 18:44 AREA0132-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 18:44 AREA0133-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 18:44 AREA0134-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 18:44 AREA0135-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 18:44 AREA0136-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 18:47 AREA0137-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 18:47 AREA0138-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 18:44 GRID0100
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/india]$ll AREA8775-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 18:47 AREA8775
April 6, 2012 188GHE Operational Readiness Review
GHE Unit Testrainmeteo.sh
rainmeteo.shRuns 4 times every hourExecutes meteo2011.k
Get most recent IR image. Remap to mercator projection Do zenith-angle and parallax corrections Get PW, RH, orography, and EQL for this sector Calculate rain rate Smooth rain image Save rain image
April 6, 2012 189GHE Operational Readiness Review
GHE Unit Test rainmeteo.sh
Cron schedule for rainmeteo.shRuns at 11, 26, 41, 56 past the hour (every
hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh
April 6, 2012 190GHE Operational Readiness Review
GHE Unit Test rainmeteo.sh
AREA and GRID numbers used for METEOSAT data filesC #############################################################CC Meteosat-9 routine (meteo2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: MSG_IR = 120 INTEGER, PARAMETER :: MSG_ZEN = 121 INTEGER, PARAMETER :: MSG_PLAX = 122 INTEGER, PARAMETER :: MSG_PW = 123 INTEGER, PARAMETER :: MSG_RH = 124 INTEGER, PARAMETER :: MSG_EQL = 125 INTEGER, PARAMETER :: MSG_OROG = 126 INTEGER, PARAMETER :: MSG_RAIN = 127 INTEGER, PARAMETER :: MSG_SRAIN = 128
c stored global data INTEGER, PARAMETER :: GLOBAL_OROG_MSG = 22
c grid file for parallax calculations INTEGER, PARAMETER :: MSG_GRID_PLAX = 101
c data directory CHARACTER*100, PARAMETER :: METEO_DIR = "/data/Pprecip/pkeehn/globalhe/meteo/"
April 6, 2012 191GHE Operational Readiness Review
GHE Unit Test rainmeteo.sh
Listing of METEOSAT data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA012? GRID0101-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:11 AREA0120-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:11 AREA0121-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:11 AREA0122-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:11 AREA0123-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:11 AREA0124-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 19:11 AREA0125-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 19:11 AREA0126-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:13 AREA0127-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:13 AREA0128-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 19:11 GRID0101
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/meteo]$ll AREA8776-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:13 AREA8776
April 6, 2012 192GHE Operational Readiness Review
GHE Unit Testrainmtsat.sh
rainmtsat.shRuns 2 times every hourExecutes mtsat2011.k
Get most recent IR image. Remap to mercator projection Do zenith-angle and parallax corrections Get PW, RH, orography, and EQL for this sector Calculate rain rate Smooth rain image Save rain image
April 6, 2012 193GHE Operational Readiness Review
GHE Unit Testrainmtsat.sh
Cron schedule for rainmtsat.shRuns at 5 and 35 past the hour (every hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh
April 6, 2012 194GHE Operational Readiness Review
GHE Unit Testrainmtsat.sh
AREA and GRID numbers used for MTSAT data filesC #############################################################CC MTSAT routine (mtsat2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: MTS_IR = 140 INTEGER, PARAMETER :: MTS_ZEN = 141 INTEGER, PARAMETER :: MTS_PLAX = 142 INTEGER, PARAMETER :: MTS_PW = 143 INTEGER, PARAMETER :: MTS_RH = 144 INTEGER, PARAMETER :: MTS_EQL = 145 INTEGER, PARAMETER :: MTS_OROG = 146 INTEGER, PARAMETER :: MTS_RAIN = 147 INTEGER, PARAMETER :: MTS_SRAIN = 148
c stored global data INTEGER, PARAMETER :: GLOBAL_OROG_MTS = 24
c grid file for parallax calculations INTEGER, PARAMETER :: MTS_GRID_PLAX = 102
c data directory CHARACTER*100, PARAMETER :: MTSAT_DIR = "/data/Pprecip/pkeehn/globalhe/mtsat/"
April 6, 2012 195GHE Operational Readiness Review
GHE Unit Testrainmtsat.sh
Listing of MTSAT data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA014? GRID0102-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:05 AREA0140-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:05 AREA0141-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:05 AREA0142-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:05 AREA0143-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:05 AREA0144-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 19:05 AREA0145-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 19:05 AREA0146-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:08 AREA0147-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:08 AREA0148-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 19:05 GRID0102
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/mtsat]$ll AREA8775-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:08 AREA8775
April 6, 2012 196GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
globalmerge.shRuns 4 times every hourMerges instantaneous rain rate images into a
global image for each previous ¼ hourCreate 1-hour rain totalCreate 1-hour rain total in NetCDF at top of hourCreate 3 and 6 hour rain totals at top of the hourCreate 1, 2, 3, 4, 5, 6, and 7 day rain totals at
1300Compress older image files
April 6, 2012 197GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
Cron schedule for globalmerge.shRuns at 4, 19, 34, 49 past the hour (every hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh
April 6, 2012 198GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
Listing of instantaneous rain rate data files
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world]$ll AREA182{1..8}-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 06:04 AREA1821-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 06:20 AREA1822-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 06:35 AREA1823-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 06:50 AREA1824-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 07:04 AREA1825-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 07:20 AREA1826-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 07:35 AREA1827-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 07:50 AREA1828
April 6, 2012 199GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
Listing of 1-hour rain total data files
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/1hour]$ll AREA182{1..8}-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 06:05 AREA1821-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 06:20 AREA1822-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 06:35 AREA1823-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 06:50 AREA1824-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 07:05 AREA1825-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 07:20 AREA1826-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 07:35 AREA1827-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 07:50 AREA1828
April 6, 2012 200GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
Listing of 1-hour rain total NetCDf data files
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/1hour]$ll *.nc-rw-r--r-- 1 Pprecip precip 576000728 Mar 9 06:05 NPR.GEO.GHE.v1.S20120690400.E20120690500.nc-rw-r--r-- 1 Pprecip precip 576000728 Mar 9 07:05 NPR.GEO.GHE.v1.S20120690500.E20120690600.nc-rw-r--r-- 1 Pprecip precip 576000728 Mar 9 08:05 NPR.GEO.GHE.v1.S20120690600.E20120690700.nc-rw-r--r-- 1 Pprecip precip 576000728 Mar 9 09:05 NPR.GEO.GHE.v1.S20120690700.E20120690800.nc-rw-r--r-- 1 Pprecip precip 576000728 Mar 9 10:05 NPR.GEO.GHE.v1.S20120690800.E20120690900.nc-rw-r--r-- 1 Pprecip precip 576000728 Mar 9 11:05 NPR.GEO.GHE.v1.S20120690900.E20120691000.nc
April 6, 2012 201GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
Listing of 3-hour rain total data files
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/3hour]$ll AREA182{1..8}ls: AREA1822: No such file or directoryls: AREA1823: No such file or directoryls: AREA1824: No such file or directoryls: AREA1826: No such file or directoryls: AREA1827: No such file or directoryls: AREA1828: No such file or directory-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 06:05 AREA1821-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 07:05 AREA1825
April 6, 2012 202GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
Listing of 6-hour rain total data files
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/6hour]$ll AREA182{1..8}ls: AREA1822: No such file or directoryls: AREA1823: No such file or directoryls: AREA1824: No such file or directoryls: AREA1826: No such file or directoryls: AREA1827: No such file or directoryls: AREA1828: No such file or directory-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 06:06 AREA1821-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 07:05 AREA1825
April 6, 2012 203GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
Listing of 1-day rain total data files
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/24hour]$ll *-rw-r--r-- 1 Pprecip precip 48001680 Feb 9 14:06 AREA3040-rw-r--r-- 1 Pprecip precip 48001680 Feb 10 14:06 AREA3041-rw-r--r-- 1 Pprecip precip 48001680 Feb 11 14:06 AREA3042-rw-r--r-- 1 Pprecip precip 48001680 Feb 12 14:06 AREA3043-rw-r--r-- 1 Pprecip precip 48001680 Feb 13 14:06 AREA3044-rw-r--r-- 1 Pprecip precip 48001680 Feb 14 14:06 AREA3045-rw-r--r-- 1 Pprecip precip 48001680 Feb 15 14:06 AREA3046-rw-r--r-- 1 Pprecip precip 48001680 Feb 16 14:06 AREA3047-rw-r--r-- 1 Pprecip precip 48001680 Feb 17 14:06 AREA3048
April 6, 2012 204GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
Listing of 2-day rain total data files
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/2day]$ll *-rw-r--r-- 1 Pprecip precip 48001680 Feb 9 14:06 AREA3040-rw-r--r-- 1 Pprecip precip 48001680 Feb 10 14:06 AREA3041-rw-r--r-- 1 Pprecip precip 48001680 Feb 11 14:06 AREA3042-rw-r--r-- 1 Pprecip precip 48001680 Feb 12 14:06 AREA3043-rw-r--r-- 1 Pprecip precip 48001680 Feb 13 14:06 AREA3044-rw-r--r-- 1 Pprecip precip 48001680 Feb 14 14:06 AREA3045-rw-r--r-- 1 Pprecip precip 48001680 Feb 15 14:06 AREA3046-rw-r--r-- 1 Pprecip precip 48001680 Feb 16 14:06 AREA3047-rw-r--r-- 1 Pprecip precip 48001680 Feb 17 14:06 AREA3048
April 6, 2012 205GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
Listing of 3-day rain total data files
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/3day]$ll *-rw-r--r-- 1 Pprecip precip 48001680 Feb 9 14:06 AREA3040-rw-r--r-- 1 Pprecip precip 48001680 Feb 10 14:06 AREA3041-rw-r--r-- 1 Pprecip precip 48001680 Feb 11 14:06 AREA3042-rw-r--r-- 1 Pprecip precip 48001680 Feb 12 14:06 AREA3043-rw-r--r-- 1 Pprecip precip 48001680 Feb 13 14:06 AREA3044-rw-r--r-- 1 Pprecip precip 48001680 Feb 14 14:06 AREA3045-rw-r--r-- 1 Pprecip precip 48001680 Feb 15 14:06 AREA3046-rw-r--r-- 1 Pprecip precip 48001680 Feb 16 14:06 AREA3047-rw-r--r-- 1 Pprecip precip 48001680 Feb 17 14:06 AREA3048
April 6, 2012 206GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
Listing of 4-day rain total data files
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/4day]$ll *-rw-r--r-- 1 Pprecip precip 48001680 Feb 9 14:06 AREA3040-rw-r--r-- 1 Pprecip precip 48001680 Feb 10 14:06 AREA3041-rw-r--r-- 1 Pprecip precip 48001680 Feb 11 14:06 AREA3042-rw-r--r-- 1 Pprecip precip 48001680 Feb 12 14:06 AREA3043-rw-r--r-- 1 Pprecip precip 48001680 Feb 13 14:06 AREA3044-rw-r--r-- 1 Pprecip precip 48001680 Feb 14 14:06 AREA3045-rw-r--r-- 1 Pprecip precip 48001680 Feb 15 14:06 AREA3046-rw-r--r-- 1 Pprecip precip 48001680 Feb 16 14:06 AREA3047-rw-r--r-- 1 Pprecip precip 48001680 Feb 17 14:06 AREA3048
April 6, 2012 207GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
Listing of 5-day rain total data files
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/5day]$ll *-rw-r--r-- 1 Pprecip precip 48001680 Feb 9 14:06 AREA3040-rw-r--r-- 1 Pprecip precip 48001680 Feb 10 14:06 AREA3041-rw-r--r-- 1 Pprecip precip 48001680 Feb 11 14:06 AREA3042-rw-r--r-- 1 Pprecip precip 48001680 Feb 12 14:06 AREA3043-rw-r--r-- 1 Pprecip precip 48001680 Feb 13 14:06 AREA3044-rw-r--r-- 1 Pprecip precip 48001680 Feb 14 14:06 AREA3045-rw-r--r-- 1 Pprecip precip 48001680 Feb 15 14:06 AREA3046-rw-r--r-- 1 Pprecip precip 48001680 Feb 16 14:06 AREA3047-rw-r--r-- 1 Pprecip precip 48001680 Feb 17 14:06 AREA3048
April 6, 2012 208GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
Listing of 6-day rain total data files
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/6day]$ll *-rw-r--r-- 1 Pprecip precip 48001680 Feb 9 14:06 AREA3040-rw-r--r-- 1 Pprecip precip 48001680 Feb 10 14:06 AREA3041-rw-r--r-- 1 Pprecip precip 48001680 Feb 11 14:06 AREA3042-rw-r--r-- 1 Pprecip precip 48001680 Feb 12 14:06 AREA3043-rw-r--r-- 1 Pprecip precip 48001680 Feb 13 14:06 AREA3044-rw-r--r-- 1 Pprecip precip 48001680 Feb 14 14:06 AREA3045-rw-r--r-- 1 Pprecip precip 48001680 Feb 15 14:06 AREA3046-rw-r--r-- 1 Pprecip precip 48001680 Feb 16 14:06 AREA3047-rw-r--r-- 1 Pprecip precip 48001680 Feb 17 14:06 AREA3048
April 6, 2012 209GHE Operational Readiness Review
GHE Unit Testglobalmerge.sh
Listing of 7-day rain total data files
[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/7day]$ll *-rw-r--r-- 1 Pprecip precip 48001680 Feb 9 14:06 AREA3040-rw-r--r-- 1 Pprecip precip 48001680 Feb 10 14:06 AREA3041-rw-r--r-- 1 Pprecip precip 48001680 Feb 11 14:06 AREA3042-rw-r--r-- 1 Pprecip precip 48001680 Feb 12 14:06 AREA3043-rw-r--r-- 1 Pprecip precip 48001680 Feb 13 14:06 AREA3044-rw-r--r-- 1 Pprecip precip 48001680 Feb 14 14:06 AREA3045-rw-r--r-- 1 Pprecip precip 48001680 Feb 15 14:06 AREA3046-rw-r--r-- 1 Pprecip precip 48001680 Feb 16 14:06 AREA3047-rw-r--r-- 1 Pprecip precip 48001680 Feb 17 14:06 AREA3048
April 6, 2012 210GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
transfergifs.shRuns once every hourExecutes makeheworldgifs.shExecutes makehenamgifs.shTransfers GIF images to web page
Not implemented on test machine
April 6, 2012 211GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Cron schedule for transfergifs.shRuns at 20 minutes past the hour (every hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh
April 6, 2012 212GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of instantaneous world GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_INST_2012047_*-rw-r--r-- 1 Pprecip precip 28118 Feb 17 00:20 GHE_INST_2012047_231500.GIF-rw-r--r-- 1 Pprecip precip 30011 Feb 17 00:20 GHE_INST_2012047_233000.GIF-rw-r--r-- 1 Pprecip precip 20289 Feb 17 00:20 GHE_INST_2012047_234500.GIF-rw-r--r-- 1 Pprecip precip 28386 Feb 16 23:20 GHE_INST_2012047_221500.GIF-rw-r--r-- 1 Pprecip precip 30454 Feb 16 23:20 GHE_INST_2012047_223000.GIF-rw-r--r-- 1 Pprecip precip 23173 Feb 16 23:20 GHE_INST_2012047_224500.GIF-rw-r--r-- 1 Pprecip precip 28236 Feb 16 23:20 GHE_INST_2012047_230000.GIF-rw-r--r-- 1 Pprecip precip 26079 Feb 16 22:20 GHE_INST_2012047_211500.GIF-rw-r--r-- 1 Pprecip precip 27416 Feb 16 22:20 GHE_INST_2012047_213000.GIF-rw-r--r-- 1 Pprecip precip 23161 Feb 16 22:20 GHE_INST_2012047_214500.GIF-rw-r--r-- 1 Pprecip precip 28265 Feb 16 22:20 GHE_INST_2012047_220000.GIF-rw-r--r-- 1 Pprecip precip 28138 Feb 16 21:20 GHE_INST_2012047_201500.GIF-rw-r--r-- 1 Pprecip precip 27145 Feb 16 21:20 GHE_INST_2012047_203000.GIF-rw-r--r-- 1 Pprecip precip 15167 Feb 16 21:20 GHE_INST_2012047_204500.GIF-rw-r--r-- 1 Pprecip precip 15155 Feb 16 21:20 GHE_INST_2012047_210000.GIF
April 6, 2012 213GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 1-hour world GIF images[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_1HOUR_2012047_*-rw-r--r-- 1 Pprecip precip 32811 Feb 16 23:20 GHE_1HOUR_2012047_230000.GIF-rw-r--r-- 1 Pprecip precip 33577 Feb 16 22:20 GHE_1HOUR_2012047_220000.GIF-rw-r--r-- 1 Pprecip precip 29872 Feb 16 21:20 GHE_1HOUR_2012047_210000.GIF-rw-r--r-- 1 Pprecip precip 32142 Feb 16 20:20 GHE_1HOUR_2012047_200000.GIF-rw-r--r-- 1 Pprecip precip 34265 Feb 16 19:20 GHE_1HOUR_2012047_190000.GIF-rw-r--r-- 1 Pprecip precip 32357 Feb 16 18:20 GHE_1HOUR_2012047_180000.GIF-rw-r--r-- 1 Pprecip precip 32531 Feb 16 17:20 GHE_1HOUR_2012047_170000.GIF-rw-r--r-- 1 Pprecip precip 33538 Feb 16 16:20 GHE_1HOUR_2012047_160000.GIF-rw-r--r-- 1 Pprecip precip 31906 Feb 16 15:20 GHE_1HOUR_2012047_150000.GIF-rw-r--r-- 1 Pprecip precip 32218 Feb 16 14:20 GHE_1HOUR_2012047_140000.GIF-rw-r--r-- 1 Pprecip precip 34012 Feb 16 13:20 GHE_1HOUR_2012047_130000.GIF-rw-r--r-- 1 Pprecip precip 32424 Feb 16 12:20 GHE_1HOUR_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 32475 Feb 16 11:20 GHE_1HOUR_2012047_110000.GIF-rw-r--r-- 1 Pprecip precip 32174 Feb 16 10:20 GHE_1HOUR_2012047_100000.GIF-rw-r--r-- 1 Pprecip precip 31895 Feb 16 09:20 GHE_1HOUR_2012047_90000.GIF-rw-r--r-- 1 Pprecip precip 32294 Feb 16 08:20 GHE_1HOUR_2012047_80000.GIF-rw-r--r-- 1 Pprecip precip 33940 Feb 16 07:20 GHE_1HOUR_2012047_70000.GIF-rw-r--r-- 1 Pprecip precip 32402 Feb 16 06:20 GHE_1HOUR_2012047_60000.GIF-rw-r--r-- 1 Pprecip precip 32913 Feb 16 05:20 GHE_1HOUR_2012047_50000.GIF-rw-r--r-- 1 Pprecip precip 33957 Feb 16 04:20 GHE_1HOUR_2012047_40000.GIF-rw-r--r-- 1 Pprecip precip 32829 Feb 16 03:20 GHE_1HOUR_2012047_30000.GIF-rw-r--r-- 1 Pprecip precip 33460 Feb 16 02:20 GHE_1HOUR_2012047_20000.GIF-rw-r--r-- 1 Pprecip precip 35446 Feb 16 01:20 GHE_1HOUR_2012047_10000.GIF-rw-r--r-- 1 Pprecip precip 33820 Feb 16 00:20 GHE_1HOUR_2012047_0.GIFApril 6, 2012 214GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 3-hour world GIF images[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_3HOUR_2012047_*-rw-r--r-- 1 Pprecip precip 25164 Feb 16 23:20 GHE_3HOUR_2012047_230000.GIF-rw-r--r-- 1 Pprecip precip 25372 Feb 16 22:20 GHE_3HOUR_2012047_220000.GIF-rw-r--r-- 1 Pprecip precip 25682 Feb 16 21:20 GHE_3HOUR_2012047_210000.GIF-rw-r--r-- 1 Pprecip precip 25559 Feb 16 20:20 GHE_3HOUR_2012047_200000.GIF-rw-r--r-- 1 Pprecip precip 25558 Feb 16 19:20 GHE_3HOUR_2012047_190000.GIF-rw-r--r-- 1 Pprecip precip 26033 Feb 16 18:20 GHE_3HOUR_2012047_180000.GIF-rw-r--r-- 1 Pprecip precip 25197 Feb 16 17:20 GHE_3HOUR_2012047_170000.GIF-rw-r--r-- 1 Pprecip precip 25128 Feb 16 16:20 GHE_3HOUR_2012047_160000.GIF-rw-r--r-- 1 Pprecip precip 25600 Feb 16 15:20 GHE_3HOUR_2012047_150000.GIF-rw-r--r-- 1 Pprecip precip 24880 Feb 16 14:20 GHE_3HOUR_2012047_140000.GIF-rw-r--r-- 1 Pprecip precip 25116 Feb 16 13:20 GHE_3HOUR_2012047_130000.GIF-rw-r--r-- 1 Pprecip precip 25314 Feb 16 12:20 GHE_3HOUR_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 25142 Feb 16 11:20 GHE_3HOUR_2012047_110000.GIF-rw-r--r-- 1 Pprecip precip 25226 Feb 16 10:20 GHE_3HOUR_2012047_100000.GIF-rw-r--r-- 1 Pprecip precip 25326 Feb 16 09:20 GHE_3HOUR_2012047_90000.GIF-rw-r--r-- 1 Pprecip precip 25211 Feb 16 08:20 GHE_3HOUR_2012047_80000.GIF-rw-r--r-- 1 Pprecip precip 25477 Feb 16 07:20 GHE_3HOUR_2012047_70000.GIF-rw-r--r-- 1 Pprecip precip 25637 Feb 16 06:20 GHE_3HOUR_2012047_60000.GIF-rw-r--r-- 1 Pprecip precip 25586 Feb 16 05:20 GHE_3HOUR_2012047_50000.GIF-rw-r--r-- 1 Pprecip precip 25857 Feb 16 04:20 GHE_3HOUR_2012047_40000.GIF-rw-r--r-- 1 Pprecip precip 26100 Feb 16 03:20 GHE_3HOUR_2012047_30000.GIF-rw-r--r-- 1 Pprecip precip 26194 Feb 16 02:20 GHE_3HOUR_2012047_20000.GIF-rw-r--r-- 1 Pprecip precip 26595 Feb 16 01:20 GHE_3HOUR_2012047_10000.GIF-rw-r--r-- 1 Pprecip precip 26693 Feb 16 00:20 GHE_3HOUR_2012047_0.GIFApril 6, 2012 215GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 6-hour world GIF images[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_6HOUR_2012047_*-rw-r--r-- 1 Pprecip precip 32854 Feb 17 00:20 GHE_6HOUR_2012047_230000.GIF-rw-r--r-- 1 Pprecip precip 32758 Feb 16 23:20 GHE_6HOUR_2012047_220000.GIF-rw-r--r-- 1 Pprecip precip 32683 Feb 16 22:20 GHE_6HOUR_2012047_210000.GIF-rw-r--r-- 1 Pprecip precip 32604 Feb 16 21:20 GHE_6HOUR_2012047_200000.GIF-rw-r--r-- 1 Pprecip precip 32368 Feb 16 20:20 GHE_6HOUR_2012047_190000.GIF-rw-r--r-- 1 Pprecip precip 32462 Feb 16 19:20 GHE_6HOUR_2012047_180000.GIF-rw-r--r-- 1 Pprecip precip 32118 Feb 16 18:20 GHE_6HOUR_2012047_170000.GIF-rw-r--r-- 1 Pprecip precip 32200 Feb 16 17:20 GHE_6HOUR_2012047_160000.GIF-rw-r--r-- 1 Pprecip precip 32070 Feb 16 16:20 GHE_6HOUR_2012047_150000.GIF-rw-r--r-- 1 Pprecip precip 31902 Feb 16 15:20 GHE_6HOUR_2012047_140000.GIF-rw-r--r-- 1 Pprecip precip 31980 Feb 16 14:20 GHE_6HOUR_2012047_130000.GIF-rw-r--r-- 1 Pprecip precip 32097 Feb 16 13:20 GHE_6HOUR_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 32002 Feb 16 12:20 GHE_6HOUR_2012047_110000.GIF-rw-r--r-- 1 Pprecip precip 32131 Feb 16 11:20 GHE_6HOUR_2012047_100000.GIF-rw-r--r-- 1 Pprecip precip 32402 Feb 16 10:20 GHE_6HOUR_2012047_90000.GIF-rw-r--r-- 1 Pprecip precip 32564 Feb 16 09:20 GHE_6HOUR_2012047_80000.GIF-rw-r--r-- 1 Pprecip precip 32782 Feb 16 08:20 GHE_6HOUR_2012047_70000.GIF-rw-r--r-- 1 Pprecip precip 33056 Feb 16 07:20 GHE_6HOUR_2012047_60000.GIF-rw-r--r-- 1 Pprecip precip 33020 Feb 16 06:20 GHE_6HOUR_2012047_50000.GIF-rw-r--r-- 1 Pprecip precip 33399 Feb 16 05:20 GHE_6HOUR_2012047_40000.GIF-rw-r--r-- 1 Pprecip precip 33738 Feb 16 04:20 GHE_6HOUR_2012047_30000.GIF-rw-r--r-- 1 Pprecip precip 33636 Feb 16 03:20 GHE_6HOUR_2012047_20000.GIF-rw-r--r-- 1 Pprecip precip 33878 Feb 16 02:20 GHE_6HOUR_2012047_10000.GIF-rw-r--r-- 1 Pprecip precip 33886 Feb 16 01:20 GHE_6HOUR_2012047_0.GIFApril 6, 2012 216GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 1-day world GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_1DAY_*-rw-r--r-- 1 Pprecip precip 59469 Feb 17 14:20 GHE_1DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 59866 Feb 17 13:20 GHE_1DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 56836 Feb 16 13:20 GHE_1DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 58012 Feb 15 13:20 GHE_1DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 58324 Feb 14 13:20 GHE_1DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 59896 Feb 13 13:20 GHE_1DAY_2012043_120000.GIF
April 6, 2012 217GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 2-day world GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_2DAY_*-rw-r--r-- 1 Pprecip precip 81716 Feb 17 14:20 GHE_2DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 80216 Feb 17 13:20 GHE_2DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 78811 Feb 16 13:20 GHE_2DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 79244 Feb 15 13:20 GHE_2DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 80996 Feb 14 13:20 GHE_2DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 81638 Feb 13 13:20 GHE_2DAY_2012043_120000.GIF
April 6, 2012 218GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 3-day world GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_3DAY_*-rw-r--r-- 1 Pprecip precip 95105 Feb 17 14:20 GHE_3DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 94373 Feb 17 13:20 GHE_3DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 93831 Feb 16 13:20 GHE_3DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 94754 Feb 15 13:20 GHE_3DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 95512 Feb 14 13:20 GHE_3DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 95725 Feb 13 13:20 GHE_3DAY_2012043_120000.GIF
April 6, 2012 219GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 4-day world GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_4DAY_*-rw-r--r-- 1 Pprecip precip 105800 Feb 17 14:20 GHE_4DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 104706 Feb 17 13:20 GHE_4DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 104946 Feb 16 13:20 GHE_4DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 104711 Feb 15 13:20 GHE_4DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 105158 Feb 14 13:20 GHE_4DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 106515 Feb 13 13:20 GHE_4DAY_2012043_120000.GIF
April 6, 2012 220GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 5-day world GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_5DAY_*-rw-r--r-- 1 Pprecip precip 113533 Feb 17 14:20 GHE_5DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 113457 Feb 17 13:20 GHE_5DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 112972 Feb 16 13:20 GHE_5DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 113017 Feb 15 13:20 GHE_5DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 113605 Feb 14 13:20 GHE_5DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 114342 Feb 13 13:20 GHE_5DAY_2012043_120000.GIF
April 6, 2012 221GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 6-day world GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_6DAY_*-rw-r--r-- 1 Pprecip precip 120342 Feb 17 14:20 GHE_6DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 119253 Feb 17 13:20 GHE_6DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 119150 Feb 16 13:20 GHE_6DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 119445 Feb 15 13:20 GHE_6DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 119851 Feb 14 13:20 GHE_6DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 119210 Feb 13 13:20 GHE_6DAY_2012043_120000.GIF
April 6, 2012 222GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 7-day world GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_7DAY_*-rw-r--r-- 1 Pprecip precip 125109 Feb 17 14:20 GHE_7DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 124497 Feb 17 13:20 GHE_7DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 124850 Feb 16 13:20 GHE_7DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 124689 Feb 15 13:20 GHE_7DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 123584 Feb 14 13:20 GHE_7DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 123603 Feb 13 13:20 GHE_7DAY_2012043_120000.GIF
April 6, 2012 223GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of instantaneous N. Amer. GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_INST_2012047_*-rw-r--r-- 1 Pprecip precip 25788 Feb 17 00:20 NAMHE_INST_2012047_234500.GIF-rw-r--r-- 1 Pprecip precip 31537 Feb 16 23:20 NAMHE_INST_2012047_224500.GIF-rw-r--r-- 1 Pprecip precip 31338 Feb 16 23:20 NAMHE_INST_2012047_230000.GIF-rw-r--r-- 1 Pprecip precip 31068 Feb 16 22:20 NAMHE_INST_2012047_214500.GIF-rw-r--r-- 1 Pprecip precip 31432 Feb 16 22:20 NAMHE_INST_2012047_220000.GIF-rw-r--r-- 1 Pprecip precip 16797 Feb 16 21:20 NAMHE_INST_2012047_204500.GIF-rw-r--r-- 1 Pprecip precip 16791 Feb 16 21:20 NAMHE_INST_2012047_210000.GIF-rw-r--r-- 1 Pprecip precip 30207 Feb 16 20:20 NAMHE_INST_2012047_194500.GIF-rw-r--r-- 1 Pprecip precip 32676 Feb 16 20:20 NAMHE_INST_2012047_200000.GIF-rw-r--r-- 1 Pprecip precip 29514 Feb 16 19:20 NAMHE_INST_2012047_184500.GIF-rw-r--r-- 1 Pprecip precip 29904 Feb 16 19:20 NAMHE_INST_2012047_190000.GIF
April 6, 2012 224GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 1-hour N. Amer. GIF images[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_1HOUR_2012047_*-rw-r--r-- 1 Pprecip precip 31999 Feb 16 23:20 NAMHE_1HOUR_2012047_230000.GIF-rw-r--r-- 1 Pprecip precip 31737 Feb 16 22:20 NAMHE_1HOUR_2012047_220000.GIF-rw-r--r-- 1 Pprecip precip 31392 Feb 16 21:20 NAMHE_1HOUR_2012047_210000.GIF-rw-r--r-- 1 Pprecip precip 30610 Feb 16 20:20 NAMHE_1HOUR_2012047_200000.GIF-rw-r--r-- 1 Pprecip precip 30154 Feb 16 19:20 NAMHE_1HOUR_2012047_190000.GIF-rw-r--r-- 1 Pprecip precip 28691 Feb 16 18:20 NAMHE_1HOUR_2012047_180000.GIF-rw-r--r-- 1 Pprecip precip 28141 Feb 16 17:20 NAMHE_1HOUR_2012047_170000.GIF-rw-r--r-- 1 Pprecip precip 28992 Feb 16 16:20 NAMHE_1HOUR_2012047_160000.GIF-rw-r--r-- 1 Pprecip precip 27461 Feb 16 15:20 NAMHE_1HOUR_2012047_150000.GIF-rw-r--r-- 1 Pprecip precip 28398 Feb 16 14:20 NAMHE_1HOUR_2012047_140000.GIF-rw-r--r-- 1 Pprecip precip 29672 Feb 16 13:20 NAMHE_1HOUR_2012047_130000.GIF-rw-r--r-- 1 Pprecip precip 28200 Feb 16 12:20 NAMHE_1HOUR_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 28667 Feb 16 11:20 NAMHE_1HOUR_2012047_110000.GIF-rw-r--r-- 1 Pprecip precip 29772 Feb 16 10:20 NAMHE_1HOUR_2012047_100000.GIF-rw-r--r-- 1 Pprecip precip 27730 Feb 16 09:20 NAMHE_1HOUR_2012047_90000.GIF-rw-r--r-- 1 Pprecip precip 28204 Feb 16 08:20 NAMHE_1HOUR_2012047_80000.GIF-rw-r--r-- 1 Pprecip precip 28537 Feb 16 07:20 NAMHE_1HOUR_2012047_70000.GIF-rw-r--r-- 1 Pprecip precip 26832 Feb 16 06:20 NAMHE_1HOUR_2012047_60000.GIF-rw-r--r-- 1 Pprecip precip 26801 Feb 16 05:20 NAMHE_1HOUR_2012047_50000.GIF-rw-r--r-- 1 Pprecip precip 26744 Feb 16 04:20 NAMHE_1HOUR_2012047_40000.GIF-rw-r--r-- 1 Pprecip precip 25476 Feb 16 03:20 NAMHE_1HOUR_2012047_30000.GIF-rw-r--r-- 1 Pprecip precip 24787 Feb 16 02:20 NAMHE_1HOUR_2012047_20000.GIF-rw-r--r-- 1 Pprecip precip 25067 Feb 16 01:20 NAMHE_1HOUR_2012047_10000.GIF-rw-r--r-- 1 Pprecip precip 23789 Feb 16 00:20 NAMHE_1HOUR_2012047_0.GIFApril 6, 2012 225GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 3-hour N. Amer. GIF images[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_3HOUR_2012047_*-rw-r--r-- 1 Pprecip precip 23174 Feb 16 23:20 NAMHE_3HOUR_2012047_230000.GIF-rw-r--r-- 1 Pprecip precip 23048 Feb 16 22:20 NAMHE_3HOUR_2012047_220000.GIF-rw-r--r-- 1 Pprecip precip 23130 Feb 16 21:20 NAMHE_3HOUR_2012047_210000.GIF-rw-r--r-- 1 Pprecip precip 22608 Feb 16 20:20 NAMHE_3HOUR_2012047_200000.GIF-rw-r--r-- 1 Pprecip precip 22220 Feb 16 19:20 NAMHE_3HOUR_2012047_190000.GIF-rw-r--r-- 1 Pprecip precip 22512 Feb 16 18:20 NAMHE_3HOUR_2012047_180000.GIF-rw-r--r-- 1 Pprecip precip 22045 Feb 16 17:20 NAMHE_3HOUR_2012047_170000.GIF-rw-r--r-- 1 Pprecip precip 22235 Feb 16 16:20 NAMHE_3HOUR_2012047_160000.GIF-rw-r--r-- 1 Pprecip precip 22556 Feb 16 15:20 NAMHE_3HOUR_2012047_150000.GIF-rw-r--r-- 1 Pprecip precip 22548 Feb 16 14:20 NAMHE_3HOUR_2012047_140000.GIF-rw-r--r-- 1 Pprecip precip 22945 Feb 16 13:20 NAMHE_3HOUR_2012047_130000.GIF-rw-r--r-- 1 Pprecip precip 23150 Feb 16 12:20 NAMHE_3HOUR_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 23196 Feb 16 11:20 NAMHE_3HOUR_2012047_110000.GIF-rw-r--r-- 1 Pprecip precip 23074 Feb 16 10:20 NAMHE_3HOUR_2012047_100000.GIF-rw-r--r-- 1 Pprecip precip 22983 Feb 16 09:20 NAMHE_3HOUR_2012047_90000.GIF-rw-r--r-- 1 Pprecip precip 22328 Feb 16 08:20 NAMHE_3HOUR_2012047_80000.GIF-rw-r--r-- 1 Pprecip precip 21959 Feb 16 07:20 NAMHE_3HOUR_2012047_70000.GIF-rw-r--r-- 1 Pprecip precip 21592 Feb 16 06:20 NAMHE_3HOUR_2012047_60000.GIF-rw-r--r-- 1 Pprecip precip 21415 Feb 16 05:20 NAMHE_3HOUR_2012047_50000.GIF-rw-r--r-- 1 Pprecip precip 20866 Feb 16 04:20 NAMHE_3HOUR_2012047_40000.GIF-rw-r--r-- 1 Pprecip precip 20276 Feb 16 03:20 NAMHE_3HOUR_2012047_30000.GIF-rw-r--r-- 1 Pprecip precip 19903 Feb 16 02:20 NAMHE_3HOUR_2012047_20000.GIF-rw-r--r-- 1 Pprecip precip 19908 Feb 16 01:20 NAMHE_3HOUR_2012047_10000.GIF-rw-r--r-- 1 Pprecip precip 19858 Feb 16 00:20 NAMHE_3HOUR_2012047_0.GIFApril 6, 2012 226GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 6-hour N. Amer. GIF images[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_6HOUR_2012047_*-rw-r--r-- 1 Pprecip precip 28166 Feb 17 00:20 NAMHE_6HOUR_2012047_230000.GIF-rw-r--r-- 1 Pprecip precip 27694 Feb 16 23:20 NAMHE_6HOUR_2012047_220000.GIF-rw-r--r-- 1 Pprecip precip 27464 Feb 16 22:20 NAMHE_6HOUR_2012047_210000.GIF-rw-r--r-- 1 Pprecip precip 27127 Feb 16 21:20 NAMHE_6HOUR_2012047_200000.GIF-rw-r--r-- 1 Pprecip precip 26792 Feb 16 20:20 NAMHE_6HOUR_2012047_190000.GIF-rw-r--r-- 1 Pprecip precip 26765 Feb 16 19:20 NAMHE_6HOUR_2012047_180000.GIF-rw-r--r-- 1 Pprecip precip 26818 Feb 16 18:20 NAMHE_6HOUR_2012047_170000.GIF-rw-r--r-- 1 Pprecip precip 27039 Feb 16 17:20 NAMHE_6HOUR_2012047_160000.GIF-rw-r--r-- 1 Pprecip precip 27477 Feb 16 16:20 NAMHE_6HOUR_2012047_150000.GIF-rw-r--r-- 1 Pprecip precip 27525 Feb 16 15:20 NAMHE_6HOUR_2012047_140000.GIF-rw-r--r-- 1 Pprecip precip 27479 Feb 16 14:20 NAMHE_6HOUR_2012047_130000.GIF-rw-r--r-- 1 Pprecip precip 27321 Feb 16 13:20 NAMHE_6HOUR_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 26688 Feb 16 12:20 NAMHE_6HOUR_2012047_110000.GIF-rw-r--r-- 1 Pprecip precip 26347 Feb 16 11:20 NAMHE_6HOUR_2012047_100000.GIF-rw-r--r-- 1 Pprecip precip 25600 Feb 16 10:20 NAMHE_6HOUR_2012047_90000.GIF-rw-r--r-- 1 Pprecip precip 24974 Feb 16 09:20 NAMHE_6HOUR_2012047_80000.GIF-rw-r--r-- 1 Pprecip precip 24753 Feb 16 08:20 NAMHE_6HOUR_2012047_70000.GIF-rw-r--r-- 1 Pprecip precip 24210 Feb 16 07:20 NAMHE_6HOUR_2012047_60000.GIF-rw-r--r-- 1 Pprecip precip 23855 Feb 16 06:20 NAMHE_6HOUR_2012047_50000.GIF-rw-r--r-- 1 Pprecip precip 23251 Feb 16 05:20 NAMHE_6HOUR_2012047_40000.GIF-rw-r--r-- 1 Pprecip precip 22879 Feb 16 04:20 NAMHE_6HOUR_2012047_30000.GIF-rw-r--r-- 1 Pprecip precip 22817 Feb 16 03:20 NAMHE_6HOUR_2012047_20000.GIF-rw-r--r-- 1 Pprecip precip 22759 Feb 16 02:20 NAMHE_6HOUR_2012047_10000.GIF-rw-r--r-- 1 Pprecip precip 22379 Feb 16 01:20 NAMHE_6HOUR_2012047_0.GIFApril 6, 2012 227GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 1-day N. Amer. GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_1DAY_*-rw-r--r-- 1 Pprecip precip 50131 Feb 17 14:20 NAMHE_1DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 39105 Feb 17 13:20 NAMHE_1DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 31013 Feb 16 13:20 NAMHE_1DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 31486 Feb 15 13:20 NAMHE_1DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 36092 Feb 14 13:20 NAMHE_1DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 39398 Feb 13 13:20 NAMHE_1DAY_2012043_120000.GIF
April 6, 2012 228GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 2-day N. Amer. GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_2DAY_*-rw-r--r-- 1 Pprecip precip 63552 Feb 17 14:20 NAMHE_2DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 47889 Feb 17 13:20 NAMHE_2DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 43130 Feb 16 13:20 NAMHE_2DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 47248 Feb 15 13:20 NAMHE_2DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 53863 Feb 14 13:20 NAMHE_2DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 67951 Feb 13 13:20 NAMHE_2DAY_2012043_120000.GIF
April 6, 2012 229GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 3-day N. Amer. GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_3DAY_*-rw-r--r-- 1 Pprecip precip 67009 Feb 17 14:20 NAMHE_3DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 54335 Feb 17 13:20 NAMHE_3DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 56818 Feb 16 13:20 NAMHE_3DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 64750 Feb 15 13:20 NAMHE_3DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 77218 Feb 14 13:20 NAMHE_3DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 76126 Feb 13 13:20 NAMHE_3DAY_2012043_120000.GIF
April 6, 2012 230GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 4-day N. Amer. GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_4DAY_*-rw-r--r-- 1 Pprecip precip 73299 Feb 17 14:20 NAMHE_4DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 64749 Feb 17 13:20 NAMHE_4DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 69338 Feb 16 13:20 NAMHE_4DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 81303 Feb 15 13:20 NAMHE_4DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 83255 Feb 14 13:20 NAMHE_4DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 84891 Feb 13 13:20 NAMHE_4DAY_2012043_120000.GIF
April 6, 2012 231GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 5-day N. Amer. GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_5DAY_*-rw-r--r-- 1 Pprecip precip 82661 Feb 17 14:20 NAMHE_5DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 75065 Feb 17 13:20 NAMHE_5DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 83599 Feb 16 13:20 NAMHE_5DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 87283 Feb 15 13:20 NAMHE_5DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 91764 Feb 14 13:20 NAMHE_5DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 95804 Feb 13 13:20 NAMHE_5DAY_2012043_120000.GIF
April 6, 2012 232GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 6-day N. Amer. GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_6DAY_*-rw-r--r-- 1 Pprecip precip 90478 Feb 17 14:20 NAMHE_6DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 87539 Feb 17 13:20 NAMHE_6DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 89380 Feb 16 13:20 NAMHE_6DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 95574 Feb 15 13:20 NAMHE_6DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 100743 Feb 14 13:20 NAMHE_6DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 100534 Feb 13 13:20 NAMHE_6DAY_2012043_120000.GIF
April 6, 2012 233GHE Operational Readiness Review
GHE Unit Testtransfergifs.sh
Listing of 7-day N. Amer. GIF images
[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_7DAY_*-rw-r--r-- 1 Pprecip precip 95997 Feb 17 14:20 NAMHE_7DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 92881 Feb 17 13:20 NAMHE_7DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 97589 Feb 16 13:20 NAMHE_7DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 103647 Feb 15 13:20 NAMHE_7DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 104996 Feb 14 13:20 NAMHE_7DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 103529 Feb 13 13:20 NAMHE_7DAY_2012043_120000.GIF
April 6, 2012 234GHE Operational Readiness Review
GHE Unit Testclean_up.sh
clean_up.shRuns once every dayRemoves old log filesRemoves old AREA filesRemoves old NetCDF filesTrims the monitoring tools status files
April 6, 2012 235GHE Operational Readiness Review
GHE Unit Testclean_up.sh
Cron schedule for clean_up.shRuns at 23:55 every day
# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh
April 6, 2012 236GHE Operational Readiness Review
GHE Unit Testclean_up.sh
log file directory size and listing of files older than 8 days (note: no files older than 8 days)[Pprecip@ghe2 ~/GHE/mcidas]$du -s --si logs/; find logs/ -mtime +8119M logs/[Pprecip@ghe2 ~/GHE/mcidas]$
April 6, 2012 237GHE Operational Readiness Review
GHE Unit Testclean_up.sh
data file directory size and listing of files older than 8 days (note: no files older than 8 days)[Pprecip@ghe2 ~/GHE/mcidas]$du -s --si /data/Pprecip/pkeehn/globalhe/; find /data/Pprecip/pkeehn/globalhe/ -mtime +847G /data/Pprecip/pkeehn/globalhe//data/Pprecip/pkeehn/globalhe/[Pprecip@ghe2 ~/GHE/mcidas]$
April 6, 2012 238GHE Operational Readiness Review
GHE Unit Testclean_up.sh
Sample status file showing first 3 (oldest) and last 3 (newest) lines of text (note: first and last line of file show a date range of 8 days – 2012-02-09 to 2012-02-17)
[Pprecip@ghe2 ~/GHE/mcidas/monitoring]$date;\> head -3 raingoesen.status;\> echo " - - - - - ";\> tail -3 raingoesen.statusFri Feb 17 15:34:57 UTC 201220120209000101 20120209001512 S /home/Pprecip/GHE/mcidas/logs/raingoesen_20120209_000101.log successful completion20120209001601 20120209001602 W /home/Pprecip/GHE/mcidas/logs/raingoesen_20120209_001601.log detected warning msg. in log file20120209003101 20120209003317 S /home/Pprecip/GHE/mcidas/logs/raingoesen_20120209_003101.log successful completion - - - - -20120217150101 20120217151348 S /home/Pprecip/GHE/mcidas/logs/raingoesen_20120217_150101.log successful completion20120217151601 20120217151602 W /home/Pprecip/GHE/mcidas/logs/raingoesen_20120217_151601.log detected warning msg. in log file20120217153101 20120217153237 S /home/Pprecip/GHE/mcidas/logs/raingoesen_20120217_153101.log successful completion
April 6, 2012 239GHE Operational Readiness Review
GHE Unit TestTiming Information
Average run timesetupworld.sh 1:08s (n=141)raingoesen.sh 3:04s (n=741)raingoeses.sh 0:34s (n=299)raingoeswn.sh 3:03s (n=739)raingoesws.sh 0:45s (n=332)rainindia.sh 3:20s (n=380)rainmeteo.sh 2:22s (n=801)rainmtsat.sh 2:53s (n=416)globalmerge.sh 2:30s (n=837)transfergifs.sh 0:05s (n=210)clean_up.sh 0:19s (n=8)
April 6, 2012 240GHE Operational Readiness Review