when weather means business managing the collection and dissemination of non-homogenous data from...
TRANSCRIPT
when weather means business
Managing the collection and dissemination of non-homogenous
data from numerous, diverse, geographically scattered sources
Jim Block
Chief Meteorologist
Meteorlogix
when weather means business
when weather means business
Basic Principals
More data is a good thing.Forecasters need specific observations for good warnings and forecasts
No meteorologist ever has too much data
Local! Local! Local!
Atmospheric information has a Forensic value, as well as Meteorological and Climatological value
when weather means business
Basic Principals
The commercial value of observations decreases over time.
The closer to “real-time” observations are, the more potential uses it has
The commercial value never goes to zero.Weather data does have a Forensic and Risk Management value even years later
when weather means business
Basic Principals
The value of atmospheric information is maximized when it is available to commercial entities.
There is no need for special systems or programs to distribute this additional atmospheric information
Standardization increases the value
Non-Proprietary
when weather means business
Basic Principals
Privately funded atmospheric information systems need to protect their investment.
Intrinsic value of the data to the owner
Competitive issues need to be respected
when weather means business
Data Management
Non-homogeneity of data
Metadata
Timeliness
Format
Reliability
when weather means business
Data Management
Non-homogeneity of data from diverse sourcesSiteing
Often chosen for convenience, not representativenessMay present systematic errorsNeeds to be understood and captured
Quality of InstrumentsCalibration
How often?Who does it?
when weather means business
Data Management
Metadata is crucial for the effective use of non-homogenous data
Who collects and manages the Metadata?
Who double checks the accuracy?
How is the Metadata maintained?
Who will be responsible?
when weather means business
Data Management Timeliness
Frequency. At what observational frequency is value maximized?Many instruments are capable of reporting nearly continuously
Availability. How frequently should observations be available?ASOS has the ability to report observations every minuteThere is a trade-off between frequency and communications bandwidth (cost)
Latency. How soon should observations be available?Whatever the frequency, reports need to be available within 10-20% of the time between observations (e.g. Hourly METAR observations are taken within 6-12 minutes of the top of each hour, and available via the FOS within 6-12 minutes of observation)
when weather means business
Data Management
FormatStandardization of formats is desirable
Inclusion of all available parameters Parameters crucial to one user may be unimportant to others
Has to be able to deal with observations at different intervals, and different ages
when weather means business
Data Management
ReliabilitySporadic or inconsistent reports decrease value dramatically
Quality Control. Has the data been checked for:Reasonableness?
Temporal consistency?
Spatial consistency?
Will users know that QC is (or is not) being done?
when weather means business
Conclusion
Clear definition of the roles and responsibilities in the management of non-homogenous data is crucial.A few standards and formats are better than many.The closer to real-time data is available, the higher the value of that data.The higher the value of data, the more ALL aspects of the meteorological community, government, research, and commercial, benefit.
when weather means business
Contact Information
Jim Block
Meteorlogix
(952) 890-0609