the new iagos data portal · •new software (mongodb) •better performances •better for...

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

The new IAGOS data portal

Damien Boulanger

CNRS – Observatoire Midi-Pyrénées

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

IAGOS data workflow

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

New database

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

• New software (MongoDB)• Better performances

• Better for heterogeneous data management

• Simplified database management (backup, etc.)

• Data processing• A lot of processes : validation, formatting, merging, added-value products

• Use of the tool Apache Camel (rule-based routing and mediation engine)

• Better management of the data flow

• Content• IAGOS-MOZAIC and IAGOS-CORE data

• IAGOS-CARIBIC (Aerosols and cloud data on going)

• BCP data on going

• Flags and uncertainties (on going for CARIBIC)

• Added-value products: PV, tropopause height, CO representation error, etc.

Live demo

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

http://iagos.sedoo.fr

Future improvements

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

• Data download• Save user requests

• Generation of a single file containing only the observations matching the request

• Download any levels of data for the IAGOS team

• Web service for scripts

• Data plotting• Plot two parameters at a time for comparison

• Tools for the PIs• Manage instruments

• Manage comparisons

• Data• New parameters : Boundary layer height, potential temperature, etc.

• Metadata• Available through AERIS portal, GAW and ENVRI+ metadata portals

• Implementation of DOI (common work with AERIS)

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

Released next week.

http://www.iagos-data.fr

Any comments are welcome!

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

Screenshots

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

Home

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

Registration

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

Data status

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

Metadata

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

Search and download

IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th

Administration