wp10 first release of aggregated dataset and future work plan · [email protected] –...

S.Simoncelli, M.Tonani

WP10First release of Aggregated dataset

and Future Work Plan

5th STCOM Lucca, 22 September 2013

S.Simoncelli, M.Tonani and WP10 Regional Coordinators

[email protected] – www.seadatanet.org

OUTLINE

• Introduction� last year actions

• Quality Control (QC) analysis by Regional Coordinators (RCs)

• Results

• Future Plans

• Statistical Products due next year

• Some answers for the Advisory Board

• Conclusions


RC Meeting

WEBEX on

AGGREGATION


• Jan: RCs (SDN WP10) received the TS collections

• Guidelines for a first basic QC analysis in ODV and acommon template for the QC report have been defined

• Feb: 1990-2012 sub sets of data have been extracted and

released to MyO In-situ TAC in order to collaborate on the QC

process

• Mar: reports on the entire data collection have been prepared and

presented to SDN StComm

• 10 Apr: RCs WEBEX Meeting on QUALITY ASSESSMENT

• 15 Apr: 2nd SDN-MyO Joint Meeting on data quality assessment

• May: MyO sent to SDN feedback on the quality of regional TS

collections

• 27 Jun: WEBEX on the AGGREGATION PROCEDURE

QC Process


QC analysis by RCs

QC analysis considered all Qflags in order to identify anomalies andpossible solutions and results were included in short reports

1.Data distribution and data density map

2.Histograms of annual and seasonal data distribution

3.TS scatter plots of the entire dataset� highlighted the necessity of applyinga gross range check

4.TS scatter plot after the range check

5.TS scatter plots of: Qflags=1(good),2(probably good) and Qflags=0(nocheck)

6.Statistics about Qflags

7.Visual control of scatter-plots to identify wrong profiles (outliers)

8.Visual check of spikes

9.Identification of stations falling on land, of wrong or missing data

Outliers have been saved in text files in order to report to both MyO andNODCs


SDN QC Results

Some data center probably inverted Qflag 1 and 0 � obs flagged as

good (1,2) presented values out of range while most of the obs

flagged 0 were reasonable! � we asked for checking

•RCs do not modify any data or Qflag

•RCs define procedures and priority actions to report on the quality to

data providers to facilitates the update process and the progressive

improvement of the overall quality of the infrastructure.

•STCOMM nominated a responsible person to coordinate the

comunication between NODC - RCs - MyO INSTAC� Christine

Coatanon (Ifremer)

•RCs decided to improve the strategy for future QC analysis through

specific sub-regional QC (areas & depth) and stability check on

density

•RCs will finalize with an harmonized approach the Reports on

Quality Assessment


Conclusions (1)

• RCs were all active and collaborative in QC

assessment and reporting (to MyO, to NODC, to

users next)

• WP10 acted fostering collaborations andcommunication between

1. partners (WEBEX conf)

2. WPs (WEBEX conf)

3. projects (2 Joint Meetings)

• WP10 will contribute and participate actively totraining activities on data next year


• Data aggregation and quality assessment procedurewas an extensive and fruitful exercise involving manypeople and institutions. It allowed to ameliorate andrefine each technical phase of the procedure, butmainly to highly improve the quality of SDNinfrastructure content.

• Collaboration between SDN and MyO was crucialduring the data quality assessment and allowed toidentify and correct lots of data anomalies

• Since the quality of historical data collections would behighly improved by an update before the officialrelease, we decided to repeat the aggregationprocedure and repeat the QC assessment

Conclusions (2)


Future Work

A new aggregation exercise would allow to

1.deliver the best aggregated data sets which mirror the true

infrastructure content (otherwise the TS collection would have a

lower quality than in reality)

2.retrieve also restricted data that have to be used for the

products computation ***

3.the future SDN products (climatologies, maps, profiles) based

on these data collections will be higher quality

*** we kindly ask data provider to allow restricted data retrivalapproving fast data requests� they will be use for internal use

ONLY!!!


CDICDI

TS aggregated datasetfree-acces, under SDN

licence, + restricted (new!)

TS aggregated datasetfree-acces, under SDN

licence, + restricted (new!)

Arctic

North Sea Baltic Sea Med Sea

Black Sea

1900-2012 COMPLETE

internal use for products

1990-2012SUB-SET MyOcean

1900-2012 UNRESTRICTED

for external release

Noth Atlantic

Future Work


Work PlanMyO2

Sept 2014Release of DATA PRODUCTSgridded fields, climatological profiles and relative stds

Feb2014 second QC feedback

3°°°°Joint Meeting SDN-MyO ?

END MyO (?)

V1 AGGREGATED DATASET Sept2013POSTPONED !!!!

1. reply to MyO alerts � Sept

2. second QC � Nov

3. second QC feedback to MyO � Dec

Apr 2014 Release of historical data (MyO V4)

Official Release of SDN-MyO Joint Product

second feedback to NODCs

Mar2014

Dec2013


Statistical Products due M36

OBJECTIVEs:1.to show and synthesize the SDN database content

2. to implement new common QC analysis in synergy with MyOcean INS TAC

based on the new computed climatologies, climatologycal profiles and relative

standard deviation

3.to deliver good quality products to the external users for both data analysis

and modeling purposes

�T and S monthly climatologies (corresponding error field) for allregional seas on the IODE standard vertical levels�Vertical resolution could be higher in some shallow regions

�Horizontal resolution at least equal to SDN1 climatology (refined if data

density allows it)

�Collections of Observations will be integrated with restricted data andexternal data sources

Other parameters could be taken into consideration later in the project

(nutrients, oxygen and chlorophyll) if the data density permits it


• We will refine our QC procedures

• We will strengthen the collaboration with MyO

in order to deliver them statistical products which

will improve their RT QC procedures, crucial for

modeling purposes (initialization, assimilation,

validation)

• We will deliver useful product to the scientific

community that will show SDN Infrastructure

content

• We need to define product format to meet at best

user requiriments

Conclusions (3)


VISION:

INTEGRATED MONITORING AND PREDICTION SYSTEM

REAL TIME OCEAN

ASSESSMENT(forecast)

LONG TERM ANALYSIS

(reanalysis)

initializationcalibrationvalidation


Reply to the AdvisoryBoard

SDN-MyO In situ TAC collaboration


Reply to the Advisory Board

SDN-MyO In situ TAC collaboration


SDN-MyO In situ TAC collaboration: data usage example

Reply to the Advisory Board

• Objective: historical data collections in MyO will serve MyO

WP18 dedicated to the REANALYS production


DATA USAGE EXAMPLES

• OBJECTIVE: historical data collections in MyO will serve MyO WP18dedicated to the REANALYSIS production

• SDN data will be used for data assimilation and reanalysis validation

• EXPAMPLE1: Mediterranean Reanalysis that will be released next yearis assimilating SDN data and used SDN data to compute the initialcondition (SDN climatology)� upcoming pubblication

• EXAMPLE2: upcoming pubblication S. Dobricic, I. Pujol, S. Simoncelli,N. Pinardi 2013 Geosat observations of sea level anomaly improvehistorical estimates of the ocean state in the second half of the eighties

• EXAMPLE3: collabotation with Ozgur Gurses (PhD student) and EminOzoy (METU) on the Maramara Sea model implementation� SDN datafor climatology computation

• EXAMPLE4: Karina VonSchuckmann (Ifremer) used Med climatology+collaboration to use SDN data and compute heat content in the Med


• SDN TS historical data collections will be delivered at the

end of the year and Quality Assessment Reports will be

finalized by RCs in order to help the users

• D10.2 � postponed from Sep to Dec13

• SDN-MyO Joint Product will be available hopefully in

May2014

• We have to advertise our activities and promote

collaborations on the external usage of SDN products

• We foresee publications for the next year: TS historical data

collections and products delivery will increase exponentially

SDN acknowledgments

• OUR Scientific Pubblication?

!!! web page with instructions for scientific publications

Conclusions (4)


Thanks to

C. Coatanoan (Ifremer), O. Bäck (SMHI), H. Sagen

(IMR), S. Scory (MUMM), Devrim Tezcan(METU),

Marina Tonani (INGV)

Sylvie Puliquen and all the IN situ TAC of

MyOcean

wp10 first release of aggregated dataset and future work plan · [email protected] –...

Documents