the cdpp centre de données de la physique des plasmas plasma physics data centre
TRANSCRIPT
The CDPP
Centre de Données de la Physique des Plasmas
Plasma Physics Data Centre
French national centre (CNRS-CNES) > 10 years
Hosted at CESR, Toulouse, France
Missions:-Archiving the data for long-term preservation-Valorisation of the data
Making data easy to useProviding tools and services
-Participation to Virtual Observatories
http://cdpp.cesr.fr
-HELIO
- EuroPLANET
The CDPP Team
CESRToulouse
CNESToulouse
LESIAMeudon
LPCEOrléans
CESRToulouseCETP
Paris
LPGGrenoble
AKKA
GFI
NOVELTIS
Associatedscientists/engineers
Industrial support
CDPP
Co-libri
The CDPP teamExecutive Director, Project Scientist: Christian Jacquey (CESR)
Project Manager: Dominique Heulet (CNES)
Science team (~3 EFT):
Vincent Génot, (CESR), Lead Scientist for Added Value Service development Baptiste Cecconi, (LESIA), Lead Scientist for Wave/Radio data and services Carine Briand, (LESIA), Lead Scientist for Wave Form data and services Nicolas André, (CESR), Lead Scientist for CDPP activities in planetogyChristian Jacquey, Particle data, Added Value Service development and VO activities
Associated scientists:Benoit Lavraud, (CESR), Heliophysics, Solar-Terrestrial relationshipChristian Mazelle, (CESR), GIOTTO, Cometary dataGérard Belmont, Patrick Robert, (CETP), Analysis toolsPhilippe Louarn, (CESR), magnetotail, shocksAurélie Marchaudon, (LPCE), Ground-Space observationsFrédéric Pitout, (LPG), EISCAT
Technical team (~7 EFT):
Dominique Heulet, (CNES), Lead engineer for Archive SystemFrançoise Dériot, (CNES), Lead Engineer for ArchivingMichel Gangloff, (CESR) Lead Engineer for Interoperability, Standards and VO activitiesMyriam Bouchemit, (CESR), Lead Engineer for servers and Added Value Service development
Industrial support:Eléna Budnik, (NOVELTIS), Added Value Service development, Data ingestionThomas Moreau, (GFI), THEMIS dataGFI, 3D-view multi-mission serviceAKKA, data archiving, CDPP data format
Associated Engineers:Etienne Pallier, (CESR), MAPSKP, EuroPLANETAndrei Fedorov, (CESR), AMDA system, ASPERA dataEmmanuel Penou, (CESR), THEMIS data, CL-AMDA connections
1 0 1 0 0 1 1 1 1 1 1 1 1 0 1 0 1 1 0 0 1 1 0 0 1 1 0 0 0 1 0 1 0 1 1 0 1 0 1 1 1 0 0 0 1 0 1 1 0 0 1 0 1 1 1 1 1 0 1 1 1 0 0 0 1 0 0 0 1 0 1 1 1 0 1 0 1 0 1 1 1 0 1 1 0 0 0 1 1 1 0 1 1 0 1 1 1 0 0 1 1 1 0 0 0 1 0 0 0 0 1 0 1 1 0 0 0 1 0 0 1 1 1 1 0 0 1 0 0 1 1 1 1 0 0 1 1 0 1 0 0 0 1 1 0 0 0 0 0 1 0 0 0 0 0 1 1 1 1 1 0 0 0 1 1 0 1 1 0 1 0 1 0 1 1 1 1 1 1 0 0 1 0 0 1 0 1 1 1 0 0 1 0 0 1 0 1 0 0 0 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 1 0 1 0 1 1 0 1 1 1 0 1 0 1 0 0 1 1 1 1 0 1 1 0 1 1 0 0 1 1 1 0 1 0 1 1 1 0 1 1 1 1 1 0 1 1 1 0 1 1 1 1 1 0 0 0 1 1 0 0 1 0 1 1 0 1 0 0 1 0 0 0 0 1 1 0 1 1 1 0 0 1 1 1 1 0 0 1 1 0 1 1 0 1 1 1 1 1 0 0 1 0 1 1 0 0 1 1 0 1 0 1 0 0 1 0 0 0 1 1 1 1 1 1 0 0 0 1 0 1 0 0 1 1 1 0 0 0 0 1 1 1 0 1 0 1 1 1 1 0 0 1 1 1 1 1 0 0 1 0 1 0 0 1 1 1 0 0 1 1 1 1 1 1 0 0 1 0 0 0 1 1 0 0 1 0 1 1 1 1 0 0 1 0 0 1 0 1 0 1 1 0 1 1 1 0 0 1 1 0 0 0 0 1 0 1 0 1 1 1 0 1 1 1 1 0 1 1 1 0 1 0 1 1 1 1 1 0 0 0 1 1 1 0 0 0 0 1 0 1 1 1 1 1 0 1 1 1 1 1 1 0 0 0 0 0 1 1 1 0 0 1 0 1 1 0 1 0 1 1 0 1 0 0 1 1 0 0 0 0 1 0 0 1 1 0 0 1 1 0 0 0 1 1 0 0 0 1 1 0 1 0 0 0 1 0 0 1 0 0 0 0 1 0 0 0 1 1 0 1 1 1 0 0 0 1 0 1 0 0 0 1 1 0 1 1 1 1 0 1 0 0 1 1 0 0 1 1 1 1 0 0 1 0 0 1 0 1 1 1 0 0 1 1 0 1 1 0 1 1 0 0 0 0 0 1 1 1 1 0 1 1 0 1 0 1 0 0 1 0 1 0 1 1 0 0 1 0 0 0 0 1 1 0 0 0 1 0 1 0 1 1 1 1 0 1 1 0 1 0 1 1 0 1 0 0 0 1 1 0 1 1 0 0 0 1 0 0 0 1 0 1 0 1 1 0 0 0 0 0 0 1 1 1 1 0 1 1 0 0 1 0 1 0 1 1 1 0 0 1 1 0 0 0 1 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 0 1 1 1 1 0 0 0 1 0 0 1 0 0 0 0 0 0 0 0 0 1 0 1 1 0 0 1 1 1 1 1 0 0 0 0 0 1 0 0 0 1 1 0 1 0 1 1 1 0 0 1 0 0 1 1 1 0 0 1 1 1 0 0 1 1 1 1 0 0 0 1 1 0 1 1 1 0 0 1 0 0 1 0 0 0 0 1 1 1 0 1 1 0 0 1 0 0 1 0 1 0 1 0 0 1 0 1 1 1 0 0 1 1 0 0 0 0 1 0 0 0 0 1 0 1 1 1 1 1 1 0 0 1 1 1 1 0 0 0 1 0 0 1 0 1 1 0 0 1 1 0 0 1 1 0 0 0 1 0 0 0 1 0 0 1 0 0 1 0 1 1 1 0 0 0 0 1 1 1 1 1 1 0 0 0 1 1 0 1 1 0 0 1 1 0 1 1 1 0 0 1 0 1 1 1 1 0 0 1 0 0 1 1 0 0 1 1 1 0 1 1 1 0 0 1 1 1 0 1 0 0 1 1 0 1 1 0 1 0 1 0 1 1 0 1 0 1 0 0 1 0 0 1 0 0 1 0 0 0 0 0 0 0 1 1 0 1 1 0 0 1 1 0 1 0 1 1 1 1 0 0 1 0 1 0 0 0 0 1 0 0 1 1 1 0 0 1 0 0 1 1 0 1 0 0 1 0 0 1 0 1 0 0 0 0 0 0 1 0 0 0 1 0 1 1 0 1 1 0 0 1 1 1 1 0 1 1 0 0 1 0 1 1 1 1 1 0 1 0 0 0 1 0 1 0 0 0 1 0 1 0 0 0 1 1 1 0 0 0 0 0 0 1 1 1 1 1 1 0 0 1 0 0 1 0 0 0 1 1 0 1 0 1 0 1 1 0 0 0 1 1 0 0 0 0 0 0 0 1 0 1 0 1 1 1 1 1 0 1 0 1 1 0 1 0 0 1 0 0 1 1 1 1 1 1 1 1 0 0 0 1 0 0 0 0 1 1 1 1 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 1 1 0 1 1 1 1 0 0 0 0 1 1 1 1 0 1 1 0 1 1 0 1 0 0 0 1 1 1 0 0 0 0 1 1 1 1 0 0 1 0 0 1 1 0 0 0 0 1 0 1 1 0 1 0 0 0 1 0 0 0 1 1 1 1 1 0 0 0 0 1 1 1 0 0 1 1 1 0 0 0 1 0 1 1 1 0 0 0 0 0 1 0 0 1 0 1 1 0 0 1 1 1 1 0 0 1 0 0 1 0 0 0 1 1 0 0 1 0 1 0 0 0 0 1 0 0 1 1 0 0 0 1 1 0 1 0 0 1 0 1 0 0 1 1 0 1 0 1 0 1 1 1 0 1 0 0 0 1 0 1 0 0 1 1 0 1 1 1 0
I. Data
Type de données
The time (measurement datation) is the first parameter for search and identification of the data:
Time span or event Search cone
Data:1. Images (referenced in time), movies 2. Time series, 1D, 2D, 3D, Nx3D3. Combined parameters4. Simulation data
Standard: SPASE : Structured Datamodel
Archives and databases at CDPP
Deep ArchiveCNES
CDPP portal
SIPADserver
CSDCESR
SiTOOLSserver
Mirror THEMISDatabase
CESR
THEMISserver
Local AMDADatabase
AMDAservice
Access to distantdatabases
CDAWebUSA
CASSINIMAPSKP
CESR
CASSINISKR
LESIA
VEX-MAGIWF
CSD: CDPP StandardisedDatabase
II. Services
Messenger
VEX MEX
Ulysses
STEREOA and B
Around the Earth: ACE, WINDTHEMIS, CLUSTER, GEOTAIL, …
shockCom
pressed solar w
ind
Energetic
particles
ejecta
August 15, 2007
Ex.: Prangé et al., Nature, 2004
AMDAAutomated Multi-Dataset Analysis
http://cdpp-amda.cesr.frhttp://cdpp.cesr.fr/downloads/publications/amda_caa_workshop.pdf
AMDA Automated Mutiple Dataset Analysis
Web based service
Transparent (automated) access to data the user plays with parameters, not with files
AMDA local database (CLUSTER, ACE, THEMIS, GEOTAIL, WIND, …, STEREO, VEX, MEX, …, IMP-8, ISEE, … geomagnetic indices)
External databases (CDAWeb, CASSINI: MAPSKP+SKR, VEX-MAG, THEMIS/CESR, …)
Produces and exploits time-tables and catalogues
Visualisation editor
Parameter editor
Download data
Conditional search
External data
Visual search
Time-Table manager
AMDA DOES NOT WORK FULLY WITH InternetExplorer and Safari
AMDA is public (registred or guess users, at http://cdpp-amda.cesr.fr)
!
VO: AMDA SPASE compliant
LocalDatabase
AMDA
System
CDAWeb
SKR
MAPSKP
Any databases including a SPASE based interoperability layer can be used by AMDA
VEX-MAG
THEMIS
III. Participation in Virtual Observatory and interoperability projects
The CDPP is a founder member of and an active participant to the SPASE consortium
The CDPP follows the IVOA development
A mini-VO: TTE, Time-Table Exchange
HELIO
EuroPLANET
SPASE (Space Physics Archive Search and Extract ) http://www.spase-group.org/
Spase[Rq]
Version[Rq]
Catalog[* of A]
Display Data[* of A]
Numerical Data[* of A]
Granule[* of A]
Instrument[* of A] Observatory[* of A] Person[* of A] Registry[* of A] Repository[* of A]
Service[* of A] Extension[* of A]
A datamodel (a way –standardised and structured- for describing data)
A dictionary for solar and space physics data
Tools (generator, editor, validator of descriptors, harvestor, parser, …)
AMDA-Automated search
-Visual search Time-Tables
CAAValidated high resolution
CLUSTER data
CL
QSAS
Standardisedsub-databases
Other?
CDAWeb
DARTS
CDPP/CESRTHEMIS database
SSLTHEMIS database
Other?
Time-Tables
A mini-VO based on Time-Table Exchange
Time-Tables
Data, parameters Data, parameters
User tools
Collaboration CDPP-CAA-CESR-UKCSC
HELIOThe Heliophysics Integrated Observatory
HELIO:The HELiophysics Integrated Observatory
FP7-Infrastructure (e-Infrastructure)
I3 proposal : Scientific Data Infrastructure
3 year project
Selected negociations
Objectives
Providing an integrated system for relying the sun-Earth-planet system from the exploitation of solar, heliospheric, magnetospheric and ionospheric data.
Providing a coordinated access to these data through data mining and analysis tools.
HELIOThe CDPP is mainly involved in:
Research (R1, R2, R3, R4)
a) Automated search toolsb) Tools for generating, managing et exploiting
the cataloguesc) Semantics, ontologiesd) Interfaces
Service (S2, S4, S5)Metadata services, workflows, Access interfaces
IDIS: Integrated Distributed Information System Goal: building a VO of planetology
Challenges of IDIS/plasma node:components of the problem
Study types:Case studiesStatistical/systematical studiesSimulationTheory
FieldsPlasmaComparative studiesHeliophysics studiesGlobal (inter-nodes) planetary studies
Type of ressources (data, services, tools, …):Plasmas, E-B fieldsNeutral (atmosphere, exosphere, other..)Dust, RingsSmall bodiesPlanetary surface, volcanism, …Solar observations…Models, simulation codesData analysis toolsData treatment tools …
Two levels:-Intra-node: only dealing with plasma ressources, BUT, interacting with other plasma Vos (HELIO, US-VOs)-Inter-nodes: exchanging ressources with nodes of different thematics
the Big Challenge…and a strong justification of a planetary VO
EuroPLANET/FP6
Co-leader (avec IWF, Graz) of Plasma Node of Europlanet/IDIS
Use Cases Analysis, definition/specifications of the future VO of planetology (User Requirements)
Searchable registry demonstrator based on SPASE
AMDA/IDIS: Scientific exploitation demonstrator using VO concepts and technics
3DView Multi-Mission: a tool for spacecraft location and attitude in the solar system and around the planets to be interoperable
EuroPLANET/FP7■ JRA-4: “Tools for Transforming IDIS into a Planetary Virtual Observatory”
• The CDPP is leader of task-2 “Interoperable Data Access”[commitment] : L1-datamodel, i.e., up to the dataset (“Measurement type”) level[commitment] : Prototypes of interfaces to external VOs (HELIO, IVOA)[Prospective] : L2-datamodel, i.e., up to the granule-parameter level in the goal to make the system usable by generic tools
• The CDPP participates to the task-3 “Added Value Services for Users”
■ SA-IDIS:
• The CDPP is co-leader (with IWF) of the Plasma Node of IDIS
A colateral goal: diffusion of the VO culture inside IDIS and the planetology community
Task-2Interoperable Data Access
Task-3Added Value Services
Task-4New DataBases