don’t solve problems, copy success - ecmwf · don’t solve problems, copy success leveraging...

12
Don’t solve problems, copy success Leveraging standards and conventions to improve interoperability Kevin O’Brien Science Data Integration Group University of Washington/JISAO NOAA/Pacific Marine Environmental Laboratory

Upload: others

Post on 15-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Don’t solve problems, copy success - ECMWF · Don’t solve problems, copy success Leveraging standards and conventions to improve interoperability Kevin O’Brien Science Data

Don’t solve problems, copy success

Leveraging standards and conventions to improve interoperability

Kevin O’BrienScience Data Integration GroupUniversity of Washington/JISAONOAA/Pacific Marine Environmental Laboratory

Page 2: Don’t solve problems, copy success - ECMWF · Don’t solve problems, copy success Leveraging standards and conventions to improve interoperability Kevin O’Brien Science Data

Don’t solve problems, copy success

"Switch: How to Change Things When Change Is hard"- Chip Heath, 2010

Page 3: Don’t solve problems, copy success - ECMWF · Don’t solve problems, copy success Leveraging standards and conventions to improve interoperability Kevin O’Brien Science Data

Don’t solve problems, copy success

Page 4: Don’t solve problems, copy success - ECMWF · Don’t solve problems, copy success Leveraging standards and conventions to improve interoperability Kevin O’Brien Science Data

• Projects: (too many to name)

Data

formats:netCDF GRIB HDF

Applications: Matlab ArcGIS Ferret

GrADS Google Earth IDV LAS ERDDAP …

Users: (too many to name)

CSV …

NetCDF – OPeNDAP-CF-THREDDS-WMSService

Stack:

Page 5: Don’t solve problems, copy success - ECMWF · Don’t solve problems, copy success Leveraging standards and conventions to improve interoperability Kevin O’Brien Science Data

An example: The real time data stream

Page 6: Don’t solve problems, copy success - ECMWF · Don’t solve problems, copy success Leveraging standards and conventions to improve interoperability Kevin O’Brien Science Data

How can users access real time observations?

– Data has maximum societal value

– Forecast models could utilize to improve their forecasts

– QC’d data can take months to become available

– Can be difficult to obtain (GTS)

An example: The real time data stream

Page 7: Don’t solve problems, copy success - ECMWF · Don’t solve problems, copy success Leveraging standards and conventions to improve interoperability Kevin O’Brien Science Data

Solution:Leverage netCDF, DAP and CF conventions

Create Oracle ViewsThat map onto CF 1.6 Discrete Sampling Geometries ERDDAP Server

RESTful URL’s then connect a

multitude of clients to data

GTSData

An example: The real time data stream

Page 8: Don’t solve problems, copy success - ECMWF · Don’t solve problems, copy success Leveraging standards and conventions to improve interoperability Kevin O’Brien Science Data

• SOOP XBT/CTD, Argo floats, NDBC buoys on GTS [OSMC ERDDAP]

Work flow for real-time ESPreSSO ROMS 4DVar

John WilkinRutgers Ocean Modeling GroupMARACOOS

http://osmc.noaa.gov/erddap/tabledap/OSMC_flattened.nc?

time,longitude,latitude,ztmp

&time>=now-3hours&time<=now

An example: The real time data stream

Page 9: Don’t solve problems, copy success - ECMWF · Don’t solve problems, copy success Leveraging standards and conventions to improve interoperability Kevin O’Brien Science Data

An example: The real time data stream

http://osmc.noaa.gov/erddap/tabledap/OSMC_flattened.csv?

time,longitude,latitude,ztmp

&time>=now-3hours&time<=now

http://osmc.noaa.gov/erddap/tabledap/OSMC_flattened.kml?

time,longitude,latitude,ztmp

&time>=now-3hours&time<=now

http://osmc.noaa.gov/erddap/tabledap/OSMC_flattened.nc?

time,longitude,latitude,ztmp

&time>=now-3hours&time<=now

http://osmc.noaa.gov/erddap/tabledap/OSMC_flattened?

time,longitude,latitude,ztmp

&time>=now-3hours&time<=now

Page 10: Don’t solve problems, copy success - ECMWF · Don’t solve problems, copy success Leveraging standards and conventions to improve interoperability Kevin O’Brien Science Data
Page 11: Don’t solve problems, copy success - ECMWF · Don’t solve problems, copy success Leveraging standards and conventions to improve interoperability Kevin O’Brien Science Data

In Summary…..

Leveraging widely-used standards improves

interoperability on a budget

Multiple/Overlapping standards pose compliance

challenges

Uniting netCDF/GRIB would greatly ease efforts

of developers and users

Page 12: Don’t solve problems, copy success - ECMWF · Don’t solve problems, copy success Leveraging standards and conventions to improve interoperability Kevin O’Brien Science Data

Kevin O’Brien

Kevin.M.O’[email protected]

Thank you!