emodnet chemistry 2 service contract mare/2012/10 s12.656742 progress of the cdi service by dick...
TRANSCRIPT
EMODnet Chemistry 2
Service Contract MARE/2012/10 S12.656742
Progress of the CDI service
ByDick M.A. Schaap – Technical Coordinator
Istanbul – Turkey, 15 June 2015, 2nd Plenary Progress Meeting
CDI service for discovery and unified access of data
Already 105 data centres connected and more underway
CDI Data Discovery and Access Service
Based up ISO19115 content standard and ISO 19139 XML Schema, fully INSPIRE compliantDedicated tools and facilities for generating CDI entries, format associated data sets and populating the CDI serviceShopping basket mechanism for discovery, access request, and downloading of data sets from distributed data centres Downloading in harmonised SeaDataNet formats: SDN ODV ASCII, and soonSDN NetCDF (CF) Adopted in many projects and ongoing improvements Operational governance scheme
Chemistry CDI Data Discovery and Access Service
Dedicated CDI service for EMODNet Chemistry scope Three search interfaces for human users, upgraded as part of the project:
Quick Search with dynamic drilling down of search results;
Extended Search with more flexibility for combining search options, including free search;
Variables Vs Marine Regions with an interactive Matrix of variables in specific marine regions.
Chemistry CDI Data Discovery and Access Service
Chemistry CDI Data Discovery and Access Service
Chemistry CDI Service – filter
EMODNet Chemistry 2 project has a scope of chemical substances:Pesticidides and biocides Antifoulants PharmaceuticalsHeavy metalsHydrocarbonsRadionuclidesFertilisers Organic matter(e.g. from sewers or mariculture)ChlorophyllPartial pressures of dissolved gasesAcidity (from pH, pCO2, Total Inorganic Carbon, alkalinity)Others
Mapping between new EMODNet Chemistry 2 groups and P02 Vocabulary doneSets filter for virtual subset of SeaDataNet CDI to EMODNet Chemistry CDI collection
Chemistry CDI Service – present coverage (14 June 2015)
731109 CDI records and data sets (June 2014: 661095)
European waters (N80 W-30; N20 E45)651507 CDI records and data sets (June 2014: 587538)65 Data Centres (62)32 Countries (31)291 Originators (248)1868 – 2015 years84% unrestricted (82)16% to be negotiated (18)
Discovery and harvesting of data sets for regional product groups
EMODNet Chemistry 2 project is generating chemistry products per MSFD sea region
Discovery and harvesting of data sets per MSFD region for specific chemical parameters is done in an almost full automatic method by:
using a Robot harvester via the shopping mechanism to discover and retrieve specific data sets from distributed data centres to compile and maintain specific aggregate data sets as internal central data buffers that are transferred to regional groups for further processing and products generation.
Buffer CMS + Central User Interfacing
CDI User Interfaces
CDI Robot harvester
Specific data buffers
CDI User Interface + Shopper:
Access regulated via AAA
Agreed Settings
Dynamic Maintenance
Robot CMS to configure Robot harvesting profiles
MARIS master
RSM systemextended with
administering robot transactions and via
central interfaces
API
Central User Interface with logon (AAA service) following authorisation in buffer CMS profiles
logon
Overview of authorized buffersCentral buffer UI incl direct shopping
Request Status Manager (RSM) service extended with administering of Central buffer interfaces
Logon as user/provider/master
New functions for central buffer shopping
Discovery and harvesting of data sets for regional product groups – 1st year
Robot harvester had gathered circa 440.000 CDI records and data sets for nutrients in the given regions
These sets were transferred to the EMODNet regional groups per region
Processing of the 1st harvest by the Regional Coordinators revealed a lot of shortcomings of data sets
This was handled by a feedback loop to data providers for improvement
A second harvesting and delivery of regional data sets for nutrients took place in November 2014
Robot harvester gathered now circa 480.000 CDI records and data sets for nutrients in the given regions
Delivery took place via AWI of regional ODV collections of metadata enriched ODV files
See reports of Regional Coordinators for follow-up
Discovery and harvesting of data sets for regional product groups – repeated in November 2014
New buffer initiated with buffer-6 for contaminants in April 2015
All data centres requested to cooperate in case of ‘restricted’ data sets
Discovery and harvesting of data sets for regional product groups – contaminants
14 June 2015: 24015 CDIs harvested from 27 data centres from 20 countries; ca 10.000 remaining
www.emodnet-chemistry.eu