fp7.oeaw.ac.at observatory tools within the fp7 project ...virtual observatory tools within the ......

http://impex‐fp7.oeaw.ac.at

REA Grant agreement no. 262863

Virtual Observatory Tools within the FP7‐Project IMPEx and Beyond

1

M. Khodachenko1, E. Kallio2,5, T. Al-Ubaidi1 , V. Génot3, M. Gangloff3, W. Schmidt2, R. Modolo3, I. Alexeev4,

M. Scherf1, F. Topf1, S. Hess3 , N. André3, E. Belenkaya4

1) Space Research Institute, Austrian Academy of Sciences, Austria (IWF-OeAW)2) Finnish Meteorological Institute, Finland (FMI)3) Centre National de la Recherche Scientifique, France (CESR-CDPP/LATMOS) 4) Institute of Nuclear Physics, Moscow State University, Russia (SINP/MSU)5) Aalto University, School of Electrical Engineering, Helsinki, Finland

A common standard for the analysis of simulated and observational space plasma physics data



262863

IMPEx - Integrated Medium for Planetary Exploration

FP7-SPACE-2010-1

SPA.2010.2.1-03

Exploitation of space science and exploration data

Collaborative Project

1,998,719.03 Mio. €

December 06, 2009

June 1, 2011

4 years (ended in May 2015 , Approved in Nov 2015)

Project number

Project title

Call (part)

Identifier

Theme

Funding Scheme

Budget

Submitted

Official Start

Duration

Basic Figures


1. Institut für Weltraumforschung, Österreichische Akademie der Wissenschaften, Austria (IWF-OeAW)

2. Finnish Meteorological Institute, Finland(FMI)

3. Centre National de la Recherche Scientifique, France (CNRS):

i. Laboratoire Atmosphères, Milieux et Observations Spatiales (LATMOS)

ii. Centre de Données de la Physique des Plasma, Institut de Recherche en Astrophysique et Planétologie (IRAP-CDPP).

4. Skobeltsyn Institute of Nuclear Physics, Moscow State Univ., Russia (SINP)

Participants

Third Parties linked to CNRS• Université de Versailles Saint-

Quentin-En-Yvelines• Université de Paul Sabatier -

Toulouse 3

Consortium



simulate planetary phenomena and interpret measurement data test models versus experimental data fill gaps in measurements with data from appropriate modelling runs perform preparation of mission operations and solve technological tasks

Goal: creation of an interactive framework where data from planetary missions can be easily related to numerical models providing a possibility to…

Target audience:• planetary science community (basic researchers) • data analysts• mission and instrument designers

IMPEx provides access to a variety of space missions data products and world leading computing models, as well as advanced visualization tools.

Goals and Objectives


Scientific focus of IMPEx: plasma and magnetic environments of…• Mercury (BepiColombo) • Venus (VenusExpress) • Earth (Cluster, Themis) • Mars (MarsExpress) • Jupiter and Ganymede (Galileo, JGO) • Saturn and Titan (Cassini) • Comet 67P (Rosetta)

• Selection, downloading, visualization and analysis of data• Searching matching modelling runs and request of specific runs• Superimposing modelling data with the spacecraft measurements (visual) • Support for preparation and operation of space missions (virtual spacecraft)

IMPEx enables

Goals and Objectives


REA Grant agreement no. 262863 6

Basic principles

Mandatory features of the IMPEx infrastructure

• Extendibility (easily adding new models, databases and analysis tools)

• In-line with worldwide trends and standards(e.g. IVOA)

• Generality of approaches and interoperabilitywith existing tools

• Web-based applications in a service-orientedenvironment

Can be seen as a prototype for a general infrastructure capable of operating a broad spectrum of data and models.



The IMPEx Tool‐Set

AMDA ‐ http://cdpp‐amda.cesr.fr/

CLWeb ‐ http://clweb.cesr.fr/ SINP ‐ http://smdc.sinp.msu.ru/

HWA ‐ http://hwa.fmi.fi/

3DView ‐ http://3dview.cesr.fr/

Portal ‐ http://impex‐portal.oeaw.ac.at



wwwwww

8

Database structures exposed via xml(IMPEx Data Model)

Web Service interface(SOAP/REST based)

IMPEx enabled tools

Central administration via IMPEx configuration

Central Access to SMDB’s via IMPEx Portal

SAMP Hubs for client side communication

IMPEx Topology & Architecture

SMDB I SMDB II ObsArch

SOAP/HTTP

REST

SAMP

IMPEx Portal

IMPEx enabled tools (3DView, AMDA)

SOAP

/HTTP

SOAP

/HTTP

User Access (Browser)

IMPEx Resources

SOAP

SOAP

SOAP



9

A common metadata standard was developed for the description of simulation models and archived datasets.

The IMPEx Data Model is based on SPASE (xml) that originated from the Heliospheric community.

The IMPEx Data Model

SPASE (Space Physics Archive Search and Extract) was developed for the description of observational data

Ideal basis to add ability to describe respective simulation data on top and use it as a unified Data Model in the context of IMPEx

for further details on the SPASE 2.2.3 simulation extension see: spase-group.org/data/reference/spase-sim-1_0_0/



10

IMPEx Protocol

Central configuration file for access to methods and data

The IMPEx configuration file (impexconf.xml) contains basic access information for every tool and every SMDB

The configuration file is existing only once for the whole system, the caching policy is part of the definition (see Technical Documentation on website)

Also includes basic information about all services and the technical protocol to use for access of tools and SMDBs.

Access via the IMPEx Portal (xml or json)

All data is accessible via (static) tree.xml files. All data in the trees is stored compliant with IMPEx Data Model

All available functionalities and methods are accessible as a web service as defined in the methods.wsdl file

IMPEx configuration <xml>…</xml>

Tool/SMDB tree.xml<xml>…</xml>

Tool/SMDB methods.wsdl<xml>…</xml>



IMPEx Protocol

Common set of web services for SMDB and Tools access

The common webs service interface to Simulation Databases (SMDBs) and web based analysis tools is fully implemented since March 2015.

2

FMI3

SINP 14

LATMOS1

4

AMDA2

There are 30 methods defined in total, 2 are shared between all SMDBs and 4 between AMDA and ClWeb

• getDataPointValue - Generic method to return data from 0D(given point) up to 3D (volume)

• getSurface - 3DView integration - generates a meshgrid and computes interpolations for one or several parameters

SINP provides 16 web services mainly dedicated to “run on request” execution

AMDA and ClWeb provide further methods for data exchange (i.e. virtual workspace)

ClWeb4



The IMPEx Portal was developed and finalized in Nov. 2014.

Central overview and access to all IMPEx data and methods provided by SMDBs and tools.

GUI also usable via mobile devices and phones Access to IMPEx Configuration

REST interface for all IMPExmethods

Ability to store temporary data in browser for later use withoutnew authentication.

IMPEx Portalhttp://impex‐portal.oeaw.ac.at/



https://www.youtube.com/watch?v=3u09TNKY2nU



IMPEx Webpagehttp://impex-fp7.oeaw.ac.at

Developed by IWF-Team in Graz based on Typo3 CMS.

Information about Technical Documentation Video Tutorials Modelling Demonstrators Access to IMPEx Portal Project activities and news Publications and talks Project science news Collaborations with other projects Podcast


Achievements

What has been achieved…• IMPEx Data Model v1.0.3 has become an official part of SPASE 2.2.3,

see spase-group.org/data/• Standard for exposing SMDB structures and content

- shared WS interface (REST/SOAP), DM, tree.xml• Central configuration and administration• IMPEx Portal for easy access to data and tools• Online access for SMDB• SINP Interactive Models and “run on demand”• Online material and (video-) tutorials for Public

Outreach, Education• Technical Documentation and User Feedback Form



42 publications in peer reviewed journals

118 dissemination activities, includingpresentations & talks at conferences, posters, videos, web tutorials, andinterviews

4 major public press releases

IMPEx Podcast (16 episodes)

Publications & Presentations



Sustainability of IMPEx Continuation of IMPEx Tools support

Continuation of IMPEx Services (SMDBs, Portal, modelling …)

Continuation of Provision of IMPEx information resources (web site, tutorials…)

Further development of tools, services, the IMPEx Protocol and the IMPEx Data Model

Exploitation of IMPEx solutions (engagement in further projects, consortia and missions)

In‐line with Grant Agreement, a spin‐off company ITVersum was founded in 2012; It has know‐how in the field of planetary science, software development(in particular web application), MLEs (Managed Learning Environments), and IT‐security; A sub‐contractor in EuroPlanet 2020 project



iSPHERE (H2020)integrated Scientific Platform for

HEterogeneous Research and Engineering

18

Maxim L.Khodachenko1, Tarek Al‐Ubaidi1, Manuel Scherf1, Esa J. Kallio2, Ari‐Matti Harri3, Igor I. Alexeev9, José Luis Vázquez‐Poletti4, Harry Enke5, Thierry Magin6, Martin Mair13, Stefaan Poedts7, Patrick De Causmaecker7, Daniel Heynderickx14, Pietro Congedo10, Ioana Manolescu10, Burkard Esser8, Stephen Webb11, Cristian Ruja12, Bidzina Shergelashvili7, Jochen Klar5, Zuheyr Alsalihi6

(1) Space Research Institute, ÖAW (Austria) (2) Aalto University (Finland)(3) Finnish Meteorological Institute (Finland) (4) Universidad Complutense de Madrid (Spain)(5) Leibniz‐Institut für Astrophysik Potsdam (Germany)(6) von Karman Institute for Fluid Dynamics (Belgium)(7) Katholieke Universiteit Leuven (Belgium)

Maxim L.Khodachenko1, Tarek Al‐Ubaidi1, Manuel Scherf1, Esa J. Kallio2, Ari‐Matti Harri3, Igor I. Alexeev9, José Luis Vázquez‐Poletti4, Harry Enke5, Thierry Magin6, Martin Mair13, Stefaan Poedts7, Patrick De Causmaecker7, Daniel Heynderickx14, Pietro Congedo10, Ioana Manolescu10, Burkard Esser8, Stephen Webb11, Cristian Ruja12, Bidzina Shergelashvili7, Jochen Klar5, Zuheyr Alsalihi6

(1) Space Research Institute, ÖAW (Austria) (2) Aalto University (Finland)(3) Finnish Meteorological Institute (Finland) (4) Universidad Complutense de Madrid (Spain)(5) Leibniz‐Institut für Astrophysik Potsdam (Germany)(6) von Karman Institute for Fluid Dynamics (Belgium)(7) Katholieke Universiteit Leuven (Belgium)

Project Community…

(8) Deutsches Zentrum für Luft‐ und Raumfahrt (Germany)(9) Skobeltsyn Institute of Nuclear Physics, MSU, (Russia)(10) INRIA (France)(11) RTDS GmbH (Austria) (12) GoSmart Solutions (Romania) (13) Martin Mair (Austria) (14) DH Consultancy (Belgium)

Project Major goal… Creation of a versatile platform for generation, storage, analysis and processing

of scientific data (observations, lab.experiment and num.simulation) Access to commercial cloud resources for the execution of modelling codes



19

• Scientists; • Engineers;• (post‐)graduate students; • Industry;• Education

Target users… Covered subject range…

Scientific & IT Challenges… Comparative study of experimental results, observational and simulation data;

Simulations of complex physical phenomena that are not covered by a single model and need complex simulation chains and/or extensive computing power.

Interdisciplinary research and universality of IT solutions

Operation/analysis of big data; advanced data mining, visualization & analysis

• Space Weather;• Planetary Atmospheres;• Entry Flows (experiment)• Material characterization

(experiment)





20

System Architecture

Project structureScore: 11.50 (as IMPEx)Next try: COMPET‐4(2016) H2020





HERMES (FFG IKT‐4)Hermian Magnetosphere Environment Study

21

introducing up‐to‐date neural networks and cloud technologies for providing advanced analysis and modelling tools in planetary physics.

Subject…

Prototyping with Mercury and related missions MESSENGER, BepiColombo.

Focous on…• prediction of solar wind

environment at Mercury, using 1) neural networks 2) s.w. propagation models

• Simulation of the Mercurian magnetosphere, using 1) advanced numerical models (MULT & PMM), and 2) neural networks trained with the model outputs.

• The (automated) search for specific features of interest in big sets of data.• Forecast of the Sun’s surface activity conditions (Solar weather). • A comparison between the numerical modeling and neural network results



HERMES (FFG IKT‐4)Hermian Magnetosphere Environment Study

Participants…(1) Space Research Institute, ÖAW (Austria) (2) TU Graz, Know‐Center (Austria)(3) Katholieke Universiteit Leuven (Belgium) (4) Aalto University (Finland)(5) Skobeltsyn Institute of Nuclear Physics, MSU, (Russia)

fp7.oeaw.ac.at observatory tools within the fp7 project ...virtual observatory tools within the ......

Documents