ed armstrong – pi luca cinquini chris mattmann nasa jet propulsion laboratory frank o’brien zach...

14
Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012 ESIP Summer 2012 Madison, WI Overview and demo of the Coastal Marine Discovery Service (NASA ACCESS 2009)

Upload: solomon-henry

Post on 17-Jan-2016

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

Ed Armstrong – PI

Luca Cinquini

Chris Mattmann

NASA Jet Propulsion Laboratory

Frank O’Brien

Zach Siegrist

System Science Applications, Inc.

18 July 2012

ESIP Summer 2012

Madison, WI

Overview and demo of the Coastal Marine Discovery Service (NASA

ACCESS 2009)

Page 2: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

Overview . . . • AKA “Coastal Marine Discovery Service” (CMDS)– 1: a discovery portal for remote coastal datasets

including satellite, in situ, ocean model, GIS layers.• No data stored in CMDS; only harvested metadata and

URLs• http://cmds.jpl.nasa.gov

– 2: a visualization and data interrogation system for datasets in the CMDS repository• “on the fly” visualization and georeferencing• Dataset overlay and download• Client web interface. No software necessary to download.

Page 3: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

Overview • CMDS blends proven software technologies of

open source Solr/Lucene database and search interface with OODT and EASy GIS Netviewer from System Science Applications (SSA, see http://runeasy.com)– Discovery through a faceted and free text search

interface– OODT is used extensively (profile servers, profile

handlers) to parse and ingest the remote datasets– OODT harvests Catalog.xml from THREDDS servers

– Visualization and interrogation via EASy Netviewer• Web client• Interacts directly with search results from CMDS (URLs) to

access and download data

Page 4: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

CMDS accessible data

• Satellite: Level 2,3 and 4 products for SST, Chl A, Turbidity, Wind, SSH, Salinity•Ocean Models: 3D Salinity, Depth, Temperature and Currents•Currents: Coastal HF Radar•In situ data: Ship, buoy, and glider observations of SST, Wind and Currents•Historical: CalCOFI reports, fish surveys, scientific cruises•GIS coverages and other point data: Bathymetry, marine sanctuary boundaries, socio-economic

Page 5: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

Architecture (from proposal)

Page 6: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

Metadata harvesting/ingestion pipeline

Page 7: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

CMDS web site (public)

Page 8: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

CMDS search interfaceFacet/free text driven to over 160 data sets

• To date focused on coastal datasets from CoastWatch, NOAA ERDDAP, NASA PO.DAAC, NOAA NODC, NVODS, US NAVY on THREDDS (OPeNDAP) servers

Interface built on the earth system grid federation software

Page 9: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

Visualization and data interrogation – the EASy NetViewer client

• Reads and displays any OPeNDAP URL from CMDS catalog• Data interrogation of pixel values• ROI statistics• GIS like queries (filtering, stats) between multiple layers

• Hardwired shapefile layers• Data export to netCDF3

Page 10: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

IntegrationFuture deployment at PO.DAAC “labs” site

Aug 2012:Site for exposure of new tools and servicesBased on user feedback will be elevated to a

standard PO.DAAC service

Page 11: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

Acknowledgements

The work described was performed at the Jet Propulsion Laboratory, California Institute of Technology, under contract to the National Aeronautics and Space Administration for ROSES ACCESS 2009.

Page 12: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

Current architecture

Page 13: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

IssuesLatency to periodically recrawl previously

indexed data repositoriesMany THREDDS repositories have extremely

limited granule metadataFree text search interface suffers

Page 14: Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012

Example of a NVODS dataset with limited metadata