data management in nacp

Data Management in NACP

Robert CookEnvironmental Sciences Division

Oak Ridge National Laboratory

and the SSG’s Data Task ForceSupport from

NACP Investigator Meeting 2007

2

Topics

Data in NACP NACP Data Policy NACP’s Modeling and Synthesis Thematic

Data Center (MAST-DC) Challenges and Actions: what you can do….

NACP Approach: Data and Modeling Intensive

Observations & Experiments Science Results Estimates-Uncertainties

Predictive Models

Experiments

Diagnostic Models

Model-Data Fusion

Dynamic Maps

Decision Support

Observations

Source: Bill Emanuel, NASA


4

NACP Data Management Planning Activities (Thornton and Cook, Co-chairs) January 2005 Workshop

Multi-agency, international workshop to define NACP data system

Report available on www.nacarbon.org

NACP Data Systems Task Force (formed May 2005)

Subgroup of Science Steering Group Formed to describe the requirements for an NACP Data

System and develop an NACP Data Policy

http://www.nacarbon.org/


5

Data Task Force• Steve Aulenbach, NCAR

• Tom Boden, ORNL

• Scott Doney, Woods Hole Oceanographic Institute

• John Dwyer, USGS, EROS

• Dave Hollinger, USDA–FS

• Tom Maiersperger, USGS, LP-DAAC

• Jeff Morisette, NASA GSFC

• Dennis Ojima, Colorado State University

• Elizabeth Pattey, Agriculture and Agrifoods, Canada

• Mac Post, ORNL

• Mohan Ramamurthy, UCAR

• Greg Reams, USDA–FS

• Pieter Tans, NOAA–CMDL

• Sharon Waltman, USDA–NRCS

• Thomas White, Pacific Forestry Centre, Canada

• Bob Cook, ORNL (Co-Chair)• Peter Thornton, NCAR (Co-

Chair)


6

Background: NACP Data Policy

Recommendation from NACP Data Workshop Report (January 2005)

NACP should develop a data policy CCIWG and SSG should develop effective means for

implementing the data policy NACP Data Policy

Based on international and national data policies, e.g., IGBP Climate Change Science Program Large-Scale Biosphere Atmosphere Experiment in Amazonia AmeriFlux

For US Investigations


7

NACP Data Policy: Key Elements1. Definition of NACP Data2. Data Sharing

Integrating data for NACP requires a data policy that provides open access to data in a timely manner

3. Giving Credit to Data Collectors4. Protecting the Rights of Students5. Data Management based on standard metadata and

open source software6. Data Archive7. Sharing and archiving models (source code)

8. Acknowledging NACP9. Resolving Conflicts


8

NACP Data Policy: Next Steps Status: NACP Data Policy approved by SSG

and CCIWG as a draft for review by NACP Investigators

Provide feedback / comments to Peter Thornton and Bob Cook by February 9

Review version is available on NACP Web Site on the “Documents” page:

http://www.nacarbon.org/nacp/documents/NACP_Data_Policy_200611_ssg.pdf

http://www.nacarbon.org/nacp/documents/NACP_Data_Policy_200611_ssg.pdf


9

NACP: Data System Components “Data Central” not funded Project Profiles and links to data at NACP

Web Site (www.nacarbon.org) NASA solicited for “Thematic Data Center for

Modeling and Synthesis” Modeling and Synthesis Thematic Data Center

(MAST-DC) was selected Bob Cook, Mac Post, Bruce Wilson (ORNL), and Peter

Thornton (NCAR) (investigators)


10

Goals Of MAST-DC Provide data management services to NACP

investigators and agencies performing modeling and synthesis activities

Free modelers and those doing the synthesis and integration from having to perform data management functions. Based on NACP requirements established, MAST-DC

will provide data products and services in a central location, in consistent and uniform grids, with common and co-registered spatial projection, in easily converted formats.


11

MAST-DC Tasks1. Establish specific data management needs of

NACP modelers and synthesis groups and coordinate with other thematic data centers;

2. Prepare and distribute model input data; 3. Provide data management support for model

outputs; 4. Provide tools for accessing, subsetting and

visualization; 5. Provide observation data packages to

evaluate model output; and 6. Support synthesis activities, including data

support for workshops

Other Thematic Data Centers

Digital Elevation Model SRTM

Nitrogen – Dentener

LAI / fPARMODIS4NACP

Weather / Climate -DAYMET

Historical Land Use LEDAPS

Land Cover – MODIS

Soils –CONUS+

Services

•Data Access•Subsetting •WMS/WCS

MAST-DC Web Page

•Link to NACP Project•Link to Thematic Centers•Index of MAST-DC Data (Mercury)•OPeNDAP access to MAST-DC Data

NACP User Community

(and others)

Metadata Registry

Bottom-up Model Output

Top-Down Model Output

Observation Data Packagesto evaluate model results

Re

mo

te S

en

sin

g

Atm

os.

Mea

sure

men

ts

Reg

ion

al I

nte

nsi

ves

Co

as

tal

Oc

ea

n

Ext

ensi

ve In

ven

tori

es

Flu

x T

ow

er N

etw

ork

s

Inv

es

tig

ato

r D

ata

Framework

MAST-DC Data and Services


13

Current services from MAST-DC Provided jointly with NASA’s ORNL DAAC (Distributed Active

Archive Center)

Survey on spatial data requirements (ends on Feb. 1) Clearinghouse of background data for NACP WebGIS with background layers and links to field data Subsetting tool for remote sensing products (MODIS Land

Products) Links to existing data products and thematic data centers

Web Site: nacp.ornl.gov/mast-dc/

http://www.nacp.ornl.gov/MAST-DC/

http://www.nacp.ornl.gov/MAST-DC/


14

MAST-DC User Groupprovide guidance to MAST-DC in establishing specific data management needs of NACP modelers and synthesis groups Arlyn Andrews

Atmos. Concentrations Steve Aulenbach

Data Systems Rich Birdsey

Forest Inventories and Biology Lisa Dilling Decision Support Scott Denning Top Down Richard Houghton

Carbon Budget Modeling

Gregg Marland Anthropogenic Emissions & Modeling

Jeff Masek Remote Sensing Observations

Rama Nemani Integrative Modeling

Stephen Ogle Agricultural Data and Modeling

Dennis Ojima Bottom Up

Members selected with input from NASA and NACP SSG


15

NACP Data Management:Concluding thoughts (1 of 2)

Leverage as much as possible from thematic data centers (action: CCIWG and SSG)

NACP needs to improve coordination with existing thematic data centers

Data sharing strategies to facilitate the exchange of data / information from many data sources (action: Investigators)

Creative solutions from investigators

Challenge: Providing effective data management to meet NACP goals in the absence of Data Central


16

NACP Data Management:Concluding thoughts (2 of 2)

Coordinate data needs of a highly diverse collection of investigations (action: Investigators)

Identify data you will produce and share Identify data you expect others to provide Identify data gaps (data you need to complete your analysis) Identify data products required for synthesis and modeling

Key actions for each of the breakout groups

By February 9… Provide comments / feedback on the NACP Data

Policy to Peter Thornton and Bob Cook

Image courtesy of NASA/GSFC

Thank you


18

Ocean Data Management Activities OCCC and OCB data served by Woods Hole Carbon biogeochemistry data (primarily

pCO2) served by ORNL

Buoy / mooring dataData from ships of opportunity (Underway data)

Photos from Alex Kozyr, ORNL


19

Data Central: High priority functions Coordinate with NACP-related thematic data centers Define metadata standards Establish and maintain a metadata index of NACP-

relevant data holdings across multiple Thematic Data Centers, including index of data held locally by projects/PIs

Coordinate with NACP Office to link the dataset metadata index with the project metadata index generated and maintained by the NACP Office

Provide metadata entry tools for investigators who are not working directly with a thematic data center


20

Data Central: High priority functions Functions originally envisioned for Data

Central that might be met by the thematic data centers

Data versioning system, with subscription and update services

PI-managed access control (following NACP Data Policy) to versions of data

Machine access to data holdings (OpenDAP servers)

Subsetting and GIS data services


21

Data Coordination

NACP is an ambitious highly integrated interdisciplinary research program, designed to use observations on land, sea, air, and from space with models to understand carbon cycle

Data will come from a wide array of sources and be used for a large number of purposes Extensive coordination between those making the

observations and modelers is critical


22

CMDLCMDL OCOOCO COBRACOBRA

Atmospheric Transport ModelsAtmospheric Transport Models

Satellite, Inventory, Ecology DataSatellite, Inventory, Ecology Data

BGC / C Accounting ModelsBGC / C Accounting ModelsProcess Studies

Process Studies

SynthesisSynthesisFlux towersFlux towers

Land/Atmos C Flux

Land/Atmos C Flux

“Top Down”

“Bottom Up”

NACP Framework

Source: Jeff Masek, NASA

data management in nacp

Documents

nacp data policyrecommendation

data collectorsprotecting

data products

nacp data workshop report

data policy cciwg

data management functions

nacp requirements

nacp approach