Jeff de La Beaujardière, PhD

NOAA

Sr System Architect, IOOS Program Office

DAARWG Meeting

Silver Spring, 2010-12-09

Integrated Ocean Observing System (IOOS)Data Management Activities

• Interagency effort– Recent legislation: ICOOS Act– NOAA lead - program office– NSF, USACE, Navy collaborations most active

• 11 Regional Associations (RAs), 1 sensor V&V partner– US non-federal partners– Funding from NOAA

2

IOOS Program Overview

IOOS Data Types(available or in progress as of 2010)

Buoys Shore StationsCoastal HF Radar

Gliders Model Outputs

Diver Surveys

Satellite Ocean Color

IOOS Data Providers(available or in progress as of 2010)

MODIS

CoastWatchNOAA Natl. Satellite Data & Info. Svc.

NWLON PORTS

CO-OPSNOAA Ctr. for Oper. Oceanographic. Prods & Svcs

Wx TAO DART HF Radar

NDBCNOAA/NWS Natl. Data Buoy Ctr.

8

5

6

11

2

4

10

3

7

9

1

12

IOOS RAsRegional Associations

Water Levels

USACEArmy Corps - Mobile District

Water Quality

FIUFlorida Intl. U.

modeloutputs

Coastal radarsatellite

observations

Goal: Enable Integration via Standards

established 2008-2010 as part of Data Integration Framework pilot

OGC SOS(Sensor Observation Service)

satellite

griddedmodeloutputs

HF radar

In situ Observations + Metadata

Points, Profiles,Collections,Trajectories

Structured Grids(+ unstructured grids)

DAP (Data Access Protocol) and

OGC WCS (Web Coverage Service)

OGC WMS(Web Map Service)

Map Images(of all data types)

*OGC = Open Geospatial Consortium

Formats: PNG, GeoTIFF, JPEG, ...

Formats: XML, ASCII, KML, + CF/NetCDF

Format: CF/NetCDF

IOOS Data Request Services

Metadata: SensorML

7

DIF* Pilot Project & Beyond

NDBCSOS DAP WMS

Harmful Algal Blooms Hurricane Intensity

CO-OPS

SOS

IOOS RAs

SOS DAP WMS

CoastWatch

DAP

Public Internet

Future Providers:USACE (WL),

PacIOOS (Bio),Florida Intl U (WQ), ...

Google Oceans

SOSCoastal Inundation

SOS

Tsunami Event DB

SOS

FutureCustomers:

Espresso ROMS,CO-OPS,

Ocean Acidification?,

Ocean Energy?

Integrated Ecosystem Assessments

DAPSOS

*DIF = Data Integration Framework

DAPDAP

Public Internet

SOS DAP WMS

SOS DAP WMSSOS DAP WMS

Public Internet

8

IOOS Catalog

Metadata Harvester

ServiceRegistry

Web Interface

SOS DAP WMS

SOS DAP WMS

FormatConversion

Visualization

Data Integration

Additional Services

Archive

IOOS Catalog – v1.0

ORRAP Ocean Observing Sub-Panel – Washington, DC – December 7, 2010 10

11

ServiceRegistry

List of servers,summarymetadata

Register(+verify

compliance)

Data Catalog

Detailed spatial& temporal extents

US geodata.gov,GEOSS CSR

Service Metadata(ISO 19119)

PostgreSQL/PostGISGeoNetwork

Harvest(+verify

continuedoperation)

IOOS Data Servers

NOAA/NOS

CO-OPS

SOS

NOAA/NESDIS

CoastWatch

DAP

IOOS RASOS DAP WMS

NOAA/NWS

NDBC

SOS DAP WMS

IOOS RASOS DAP WMS

Dataset Metadata(ISO 19115)

IOOS Catalog Concept of Operations

DMACData

Managementand

Communications

Data Management

Modeling &Analysis

WebPortal

ClientLibraries

AnalysisTools

SystemMonitor

Models

ObservingSystems

MooredBuoys

FixedStations

SamplesMovingPlatforms

Radar Satellite

DataAssemblyCenters

PhysicalObs

BiologicalObs

ArchivesModelOutputs

UtilityServices Visualization

Conversion DataIntegration

Catalog

Registry

Computational Viewpoint from Reference Model for Open Distributed Processing (RM-ODP)

Component Types Needed for IOOS

DataAccessServices

SubscriptionPullIndividualFeatures

StructuredGrids

UnstructuredGrids

UnderseaImagery

…

…

…

…

…

ServiceGateway

Maps &Images

Workflows

Notification

Surveys

GIS

FrameworkData

StartingWorking Examples Not Startedw/NSF OOI-CILegend:

IOOSCatalog

13

IOOS/NSF OOI-CI Collaboration

NDBCWx

NDBCHFR

CO-OPSWL

IOOS Data Sources Non-IOOS Sources

SOS TDS SOS

Espresso ROMS

other models

IOOSRAs

SOS

IOOS as data source for OOI-CI & models

OOI-CI

ServiceTranslation

FormatConversion

NotificationFeeds/

Subscriptions

External Observatory Integration (EOI)

• Lack of complete metadata– IOOS helping fund improvements

• General standards that are too broad– IOOS is coordinating, implementing, documenting

• Needs of local RA stakeholders vs. greater good– IOOS published Guidance paper for FFO

• Getting all data archived– IOOS helping with Wx, HFR, RA, glider

• Long-term support for observing assets– ?

Challenges