the new iagos data portal · •new software (mongodb) •better performances •better for...
TRANSCRIPT
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
The new IAGOS data portal
Damien Boulanger
CNRS – Observatoire Midi-Pyrénées
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
IAGOS data workflow
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
New database
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
• New software (MongoDB)• Better performances
• Better for heterogeneous data management
• Simplified database management (backup, etc.)
• Data processing• A lot of processes : validation, formatting, merging, added-value products
• Use of the tool Apache Camel (rule-based routing and mediation engine)
• Better management of the data flow
• Content• IAGOS-MOZAIC and IAGOS-CORE data
• IAGOS-CARIBIC (Aerosols and cloud data on going)
• BCP data on going
• Flags and uncertainties (on going for CARIBIC)
• Added-value products: PV, tropopause height, CO representation error, etc.
Live demo
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
http://iagos.sedoo.fr
Future improvements
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
• Data download• Save user requests
• Generation of a single file containing only the observations matching the request
• Download any levels of data for the IAGOS team
• Web service for scripts
• Data plotting• Plot two parameters at a time for comparison
• Tools for the PIs• Manage instruments
• Manage comparisons
• Data• New parameters : Boundary layer height, potential temperature, etc.
• Metadata• Available through AERIS portal, GAW and ENVRI+ metadata portals
• Implementation of DOI (common work with AERIS)
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
Released next week.
http://www.iagos-data.fr
Any comments are welcome!
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
Screenshots
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
Home
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
Registration
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
Data status
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
Metadata
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
Search and download
IAGOS Scientific Symposium on Atmospheric Composition, Manchester - October 19th
Administration