marine core service my ocean wp 15 thematic & assemby center for in situ
TRANSCRIPT
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Reminder -
Partnership
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
15.1
15.3
15.415.5
15.2
MyOcean in-situ TAC tasks
Define common distribution means: vocabularies, formats, organization, monitoring tools,…
Develop a reliable distributed architecture for in-situ data delivery to MFCs and MyOcean users
Converge on common real time quality control procedures and flag conventions Converge on Real –tIme QC methods for physical variables in coherence with international
standards Develop methods for Quality Control of biogeochemical data both in real time and delayed
mode and provide recommendations for acquisition of biogeochemical data from various platforms
Enhance the T&S basin scale assessment methods for global ocean and adapt them to regional scales, if possible
Turn to operations enhanced calibration/validation methods
Coordinate at European Level with EuroGOOS and SeaDataNet, and with JCOMM observing program(as Argo, OceanSites,Gosud, DBCP,..)
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
R&D : main achievements
Main achievements are The near real-time Quality control procedures developed for T&S,
sea level and current have been endorsed by EuroGoos and passed by SeaDataNet to IOC
Similar NRT QC procedure has been developed for Biogeochemical data ( mainly Chlorophyll/Fluorescence and Oxygen) and have been deployed in the INS TAC centers
Validation procedures have been defined at regional scale
Main difficulties Develop methods that can be extended to EuroGoos and
SeaDataNet
Remaining activities/objectives Develop KPI to monitor the INS TAC product quality for internal
and later external use
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Dev. & Maintenance
Objectives Define an set up a distributed but reliable architecture for in situ data integration for operational oceanography
Steps VO : 4 global products available from global component operated by
Coriolis V1: 6 regional + a global portals set up distributing 2+14 additional
Real-Time products V2 : Regional and Global portals enhanced with 7 scientifically
analyzed T&S product for reanalysis purposes (1990-2010)
V1 step up in 3 steps Stream1/Stream2 November 2009- April 2010 : Data integration and distribution set up March 2010- June 2010 /December 2010: Common real-time QC
procedures applied in Stream1/Stream2 regions September 2010-March 2011/ March-August 2011 : Scientific
product assessment performed in Stream1/Stream2 regions
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Dev. & Maint. : main achievements
Main achievements are The 12 PU and 7 DU have been set up and tested ( SIVP) The NRT QC procedures have been deployed in all regions The stream1 components has set up a first version of Validation/
Assessment of T&S product The Oceanotron software that replaces OPEnDAP for insitu has
been developed and deployed. Connection to MISGW is specified and should be available for V2 as well as WMS service for in situ
Main difficulties Ins-Tac is highly distributed The MyOcean tools need evolutions to handle in situ products
Remaining tasks Implement KPI
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Reminder - Objectives for Production
Objectives, Products, Difficulties, … Set up the regional , EU and global portals that would integrate , in
a sustained manner, enough data to significantly ease the MFC and MyOcean users activities and have a real added value for the regions
Be able to operate this distributed infrastructure in a coherent and reliable way
Be able to turn to operation the methods defined in R&D
1
2
6
4
75
3
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Production : main achievements
Main achievements are In all regions the link with data providers have been established and good
collaboration with EuroGOOS ROOSes set up the data are integrated in regional and global portals and used by some MFCs More providers are interested to contribute The service organization has been set up , and stream1 proved that the
escalation process described in SIOPM was efficient
Main difficulties In the Global component the DU was harder to set up than planned because
of the number of platforms and time needed to update the portal In NSW and Baltic regions the organization of the responsibilities has been
revisited to secure operations In some regions like Black sea there is very few real time observations
Remaining objectives Set up an efficient monitoring of the production and alert system Elaborate T&S re-analyzed product for reanalysis activities
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Monitoring platform availability per day
Global Component ≈ 2100 platforms per day:1250drifters , 30vessels, 300 floats,350 moorings ≈150 platforms from GTS
Integrates Global Networks and Regional observations acquired in the In situ Tac components
Jan
11
Mar
11
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Monitoring platform availability per day at PU level also
4 ferrybox lines acquired routinely by Niva PU and integrated in Global Du
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Monitoring platform availability per day
NWS Component ≈ 140 platforms per day: 70 moorings , 60 drifters, <10 profilers, 1
vessel , some GTS data
Baltic Component :≈ 90 platforms per day 90 moorings , 2 vessels
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Monitoring platform availability per day
Med Component :≈ 100 platforms per day 24 drifters , 35-50 moorings, up to 8 vessels,
≈10-15 floats,
Arctic Component :≈ 120 platforms per day80 drifters , 3-8 vessels, ≈10-15 floats, ≈10-20
platforms from GTS
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Monitoring platform availability per day
Black sea Component 1 mooring 1 float , sometimes one drifter and one vessel
IBI Component ≈ 250 platforms per day:100drifters , 5-9vessels, 15floats,120 moorings ,<10 platforms from GTS
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Service to Users
117 registered users for INS TAC ( 6 products in the catalogue)
378 product requested
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Service to Users
Increase in request for Global products Regional products start to be requested (Arctic, Med)
since V1 launch
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Production: T&S regional re-analysed products Covers 1990-2010
Best values of T&S data available to be used for assimilation and/or validation depending of the regions
Contains data that have been through Delay Mode scientific assessment plus real time data scientifically assessed ( flagged but not corrected) within the INS TAC– Exhaustivity in term of data ( more and not less than WOD09, should
include national cruises)– Better quality than WOD09– Scientific assessment documented– Provide Information on the accuracy of the data better with the data but
can be in the documentation
It's a Myocean product presently planned to be on the catalogue: – follow MyOcean data policy : freely available to registered users– Can be complemented by restricted access data for MyOcean MFCs only
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Production: Potential risk for T&S regional re-analysed product
SDN and MYO want to collaborate on building product for re-analysis but further work is needed to better specify the needs and speak the same language
The timing of the 2 projects doesn't fit : SDNI is finished, SDNII is in negotiation phase and KO is foreseen for end 2011, MYO-V2 is end 2011
The "Best product " from SDN to MyO described in the MoU has not been developed in SDNI.
– Presently the only regional aggregated T&S datasets that exist from SDN are the ones used for building the regional climatology but they are restricted access as they merge public data with restricted data. At the best they can provided as internal product for MFCs
What can be done for MYOI ?– Set up the mechanisms to be able to integrate the SDN products when available and Trace
the access to the datasets provided by SDN and provide feedback to SDN. This will be possible when the connection to MISGW is fully implemented for INS-TAC
– Provide the regional aggregated T&S datasets build for climatology by SDN to MyOcean MFCs ONLY if SDN agrees to provide them
– Start building prototype of regional T&S data for MYO users• A lot of T&S European data are presently available freely at US-NODC or ICES and
some of them are included in the V1 Global T&S Re-analyzed product
• Some INS-TAC partners , also involved in SDN, can provide their institution data to start building the MyOI products as a temporary solution waiting for SDNII
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Reminder - Objectives for Cal / Val
Objectives Assess scientifically the quality of the products using the methods
develop in R&D
Process different for real time products and re-analyzed products
Difficulties The amount of data available in an area to do perform consistency
checks at basin scale Based in most regions on Visual QC by an operator and test against
Climatology ( plan to rely on SeaDataNet form enhanced regional climatology in Europe)
Steps First work on T&S parameters as they are assimilated in MFCs Second on current, sea level and biogeochemical data used for
validation by MFCs
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Cal/Val : main achievements
Main achievements are T&S stream 1 products have been validated and system is in place for
quarterly assessment T&S global re-analyzed product assessment has been performed
using both statistical methods and visual assessment by a scientist Validation process has been defined for all the V1 products and
mainly rely on visual QC because data are to sparse
Main difficulties For some data such as sea level it's difficult to do better than provider.
INS-TAC is than essentially an integrator of observations For biogeochemical data biofouling is an issue that may sometimes
difficult to detect in RT. Consistency between parameters will be used whenever possible to
at list detect outliers. Remaining tasks
Finalize the Product Quality KPI that will provide a traffic light view of the INS-TAC product quality taking into account the amount of platform versus expected, the delay between the date of the data and first delivery by INS TAC, the amount of bad/suspicious data versus good ones
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Organizational Challenges– Converge from different history on data sharing to common practices– Convince outside & national data providers
Technical Challenges– Lack of on the shelves data model standards and OGC services for
sparse datasets
Operational Challenges– Guaranty operational services on a distributed architecture– Manage to elaborate re-analyzed T&S products for re-analysis at
Global and regional scale for internal AND external users in collaboration with SeaDataNet, EuroGOOS for European data resolving the data policy issues
Ultimate Challenges …– The quality of the in situ product will depend on the availability and
sustainability of the in-situ observing systems that presently are mostly funded on research funds
Main Challenges
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Past (event, work or tasks achieved) :– September 2009 : Start of monthly phone meetings to better steer the INS-TAC activities– October 2009 : in situ portal specifications approved and presented at EuroGOOS annual
meeting– December 2009-April 2010-April 2011: Plenary WP15 meetings– January 2010 : SeaDataNet-MyOcean MoU signed– February 2010: T&S real-time QC procedure approved and provided to SeaDataNet– March 2010-April 2010 : all INS-TAC portals are up and distributed products in prototype
mode– June 2010 : RTQC procedures implemented for Stream 1- Assessment procedure defined– Autumn 2010 : Assessment procedure implemented for Stream 1- RTQC procedures
implemented for stream2– October 2010 MyOcean RTQC procedures endorsed by EuroGOOS– Summer –Autumn 2010: Service organization defined for INS TAC, and mandatory ITIL
processes in place– December 2010 : Start of V1 service for stream1 products– March 2011 : RTQC procedures sent to IOC by SDN for proposal as a standard
Future :
– June 2011: Start of V1 service for stream2 products– Summer 2011: set up of quality KPI– Summer 2011: Elaboration of V2 products in partnership with SDN ( even if SDNI finished and
SDNII not started…)– December 2011: Start of V2 products
Calendar
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Some illustrations…
January 2010
Marine Core Service
MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma
Some illustrations…
Gliders
FerryBox
Moorings
April 2011