the hierarchical data format (hdf) a foundation for sustainable data and software

December 16, 2013

The Hierarchical Data Format (HDF): A Foundation for Sustainable Data and Software

Ted Habermann, Mike Folk, The HDF Group

1

ServicesFo

rmat

sC

on

ventio

ns

Tools

AGU, Fall 2013

Crossing the Chasm

December 16, 2013 2American Geophysical Union, Fall 2014

Conventions

(Standards)

Training &

Support

Additional

Software

Tools

System

Integration

Adoption

Processes ?

Core

Product

Crossing the Chasm

December 16, 2013 3American Geophysical Union, Fall 2014

The

Whole

Product

Crossing Geoffrey Moore’s chasm

requires a whole product.

Conventions

(Standards)

Training &

Support

Additional

Software

Tools

System

Integration

Adoption

Processes ?

Core

Product

Crossing the Chasm

December 16, 2013 4American Geophysical Union, Fall 2014

The

Whole

Product

Crossing Geoffrey Moore’s chasm

requires a whole product.

Creating the whole product

requires partners.

Conventions

(Standards)

Training &

Support

Additional

Software

Tools

System

Integration

Adoption

Processes ?

Core

Product

Crossing the Chasm

December 16, 2013 5American Geophysical Union, Fall 2014

The

Whole

Product

Crossing Geoffrey Moore’s chasm

requires a whole product.

Creating the whole product

requires partners.

Whole Product Partners

December 16, 2013 6American Geophysical Union, Fall 2014

IMPACT

Whole Product Partners

December 16, 2013 7American Geophysical Union, Fall 2014

IMPACT

Whole Product Partners

December 16, 2013 8American Geophysical Union, Fall 2014

IMPACT

Whole Product Partners

December 16, 2013 9American Geophysical Union, Fall 2014

The Common Data Model

December 16, 2013 10American Geophysical Union, Fall 2014

The Common Data Model

developed at Unidata to bring

together important common

features of many data types.

The netCDF4 library implements

the Common Data Model in

HDF5.

Grouping Data and Metadata (HDF-EOS)

11AGU, Fall 2013

Grids

Grid_1 Grid_N

Data Fields Attributes

Data Field.1

Data Field.2

Swaths

Swath_1 Swath_N

Data Fields

Data Field.1

Data Field.2

Profile FieldsGeolocation

Fields

Latitude

Longitude

Time

Colatitude

Profile Field.1

Profile Field.2

HDF File with HDF-EOS Conventions

Zonal Averages

Points

December 12, 2013

IHO Standard Bathemetric Attributed Grid

December 16, 2013 12American Geophysical Union, Fall 2014

IHO Standard Bathemetric Attributed Grid

December 16, 2013 13American Geophysical Union, Fall 2014

IHO Standard Bathemetric Attributed Grid

December 16, 2013 14American Geophysical Union, Fall 2014

Tools

December 16, 2013 15American Geophysical Union, Fall 2014

Tools

December 16, 2013 16American Geophysical Union, Fall 2014

Tools

December 16, 2013 17American Geophysical Union, Fall 2014

Community

18AGU, Fall 2013December 12, 2013

Community

19AGU, Fall 2013December 12, 2013

Using HDF to share data?

Tweet #HDFInside