Global Model
NWPCs/ACsNCEP,JMAECPC,BoM UKMO,CMC
ECMWF CPTEC NCMWF
EPSON METGMAO GLDAS
Regional Model
Land Surface Model/LDAS
HAP
extreme
webs
aerosolisotope
cross-cutting
monsoon
cold
semi-arid
high-elevation
Reference Sites
River basins
NCAR/EOLWDC-CMPI-M
Satellite dataCEOSJAXANASAESA
NOAA EUMETSAT
WGISSWGCV
UT&JAXA
DATA INTEGRATION & ANALYSISDistributed System
WTF-CEOPCentralized System
U. Tokyo
GlobalDatasetProjects
Societal Benefits
A Project of P
rojects
Coordinated Enhanced Observing Period
Convergence of Observations A Prototype of the Global Water Cycle
Observation System of Systems
Three Unique Capabilities
Coordinated Enhanced Observing Period
Interoperability Arrangement A well organized collecting, processing, storing, and disseminating shared data, metadata and products
Data Integrating/Archiving
Center at University of Tokyo and JAXA of
Japan
Model Output Data Archiving Center at the World Data Center
for Climate, Max-Planck Institute for Meteorology of
Germany
In-Situ Data Archiving Center at NCAR (National
Center for Atmospheric Research) of USA
Three Unique Capabilities
Coordinated Enhanced Observing Period
Data Management Distributed- and Centralized- Data Integration Functions
In-situ
satellitesatellite
satellitesatellite
satellitesatellite
satellite
modelmodel
model
modelmodel
model
UCAR
MPI
UT/JAXA
In-situIn-situ
In-situ
In-situIn-situ
In-situ
Computing Power
Computing Power
DistributedIntegration
Services
GrADS/DODS
for Subsets
GrADS/DODS
for Subsets
GrADS/DDDS
for Subsets
Centralized Integration
Services
Three Unique Capabilities
http://jaxa.ceos.org/wtf_ceop/
http://monsoon.t.u-tokyo.ac.jp/ceop-dc/ceop-dc_top.htm
Hans-Jörg Isemer, International BALTEX Secretariat, [email protected]
CEOP Reference Sites Data Release Guidelines
Data exchange guidelines:
(3) Data users: No transfer to third parties. (4) Data release to data users: Turn-around period. Category 1 data: 6 months Category 2 data: 15 months
(2) CDA and data users: Commercial exploitation of CEOP data is prohibited.
(1) To comply with WMO Resolutions 40 (CG-XII) and 25 (CG-XIII) in particular: No financial implications.
(5) Acknowledgement and citation
(6) Co-Authorship for Reference Sites’ PIs recommended, collaboration base required if PI requests co-authorship (in particular for category 2 data) (7) CEOP Publication Library at CDA
© GEO Secretariat
DB
DB
0
50
100
150
200
250
300
350
A1:高度成長社会A2:多元化型B1:持続発展型B2:地域共存型
DB
DB
DB
DB
DB0
50
100
150
200
250
300
350
A1:高度成長社会A2:多元化型B1:持続発展型B2:地域共存型
DB
DB0
50
100
150
200
250
300
350
A1:高度成長社会A2:多元化型B1:持続発展型B2:地域共存型
DB
DB
DB
Meteorology
Ecosystem
Agriculture Hydrolog
y
Land Use
Climatology
Health
农业
เกษตรกรรม
농업
© GEO Secretariat
DB
DB
0
50
100
150
200
250
300
350
A1:高度成長社会A2:多元化型B1:持続発展型B2:地域共存型
DB
DB
DB
DB
DB0
50
100
150
200
250
300
350
A1:高度成長社会A2:多元化型B1:持続発展型B2:地域共存型
DB
DB0
50
100
150
200
250
300
350
A1:高度成長社会A2:多元化型B1:持続発展型B2:地域共存型
DB
DB
DB
Where is data?How to access?
Technical Terms among
Different Disciplines
Quality?Reliability?
农业
เกษตรกรรม
농업
Meteorology
Ecosystem
Agriculture Hydrolog
y
Land Use
Climatology
Health
http://www.eol.ucar.edu/ http://www.eol.ucar.edu/ projects/ceop/dm/projects/ceop/dm/
INTEGRATEDINTEGRATED
IN-SITUIN-SITU
SATELLITESATELLITE
MODELMODELEOL work supported by NOAA/CPO
CEOP REFERENCE CEOP REFERENCE SITE VIRTUAL SITE VIRTUAL
TOUR CDTOUR CD
http://www.eol.ucar.edu/projects/ceop/dm/insitu/tour
“Reference Sites, their surroundings, and the cultural aspects of the
region…”
What - does a dataset on a specific topic exist?Where - for a specific place?When - for a specific date or period?Who - a point of contact to learn more about or order the dataset?
MetadataElement
CoreElement(MD_Metadata)
ProfessionalElement OrganizationalElement
+professionalElement0..*0..*+coreElement+organizationalElement
0..*
CEOP dataset
satelliteimagery data
modelsimulation
datain-situdata
MPIUCARUT/JAXA
W3CXML
find
bindClient
Registry service
Service provider
Data instanceregistry
Service instanceregistry
Data servicesPortrayalservices
Processingservices
WSDLimplementation
WSDL interface
XML schema
publish
Encoding
service interface service interface service interface
service interfaceservice interface
import
import
Metadata conceptual model
ISO 19115 metadata
Application requirements
Metadata implementation model
Metadata standard development framework
Web service application
ISO19139Metadata-
implementationOGC
WFS,WCS,CTS
Data Source
Data/Doc Arrive at EOL
Visual Inspection of Data and Plots
Available On-Line
EOL Updates Status Table and Detailed Notes
Reference Site EOP-3/4 Data Flow
Apply Auto/Manual Data/Doc Consistency Checks
Format Verification
Gross Limit
Checks
Exact/Inexact Dup Records
Data/Flag/Doc Checks
Generate Flagging and Site Statistics
Merge Data
CSE Reference Site
EOP-3 EOP-4
BALTEX Cabauw
Lindenberg
Norunda
Sodankyla
CAMP Chao-Phraya River
Equatorial Island
Himalayas
Korean Haenam
Korean Peninsula
Mongolia
Northeast Thailand
Northern South China Sea
Siberia Taiga
Siberia Tundra
Tibet
Tongyu
Western Pacific Ocean
AMMA Niamey
Oueme
CSE Reference Site
EOP-3 EOP-4
GAPP Bondville
Ft. Peck
Mt. Bigelow
Oak Ridge
ARM SGP
LBA Brasilia
Caxiuana
Manaus
Pantanal
Rondonia
Santarem
MAGS BERMS
MDB Murrumbidgee
Tumbarumba
ARM North Slope of Alaska
Tropical Western Pacific
CEOP Phase I Reference Site Data Set Availability (as of 9 March)
Complete Partial
Data checking
CDC Server
ReferenceSite
Database
Data Plotting
CDA
Raw Data
Point out Error & Noise
Updated DatabaseUpdated Data
CAMP Data Center(CDC)CAMP Data Center(CDC)
Document
Unified Format
Research
CDC Man Power
Pre-checkingInput
Web Interface
Open Category 1 after 6 months Category 2 after 15 months
composite
Users
OtherData
Archives
• Locate Data• Visualize Data• Light Processing
UCAR Archive(In-situ)
MPI Archive (Model Output, MOLTS)
DODS
CSDIC Archive (Satellite, Model Output)
DODS
DODS
DODS
Live Access Server (LAS)
WTF-CEOP
Ferret
GrADS
IDL CDAT
Matlab
User client –Library of scriptsWeb Browser
User client – data download and analysis
WTF-CEOPDistributed Data Integration System
Centralized Data Integration Functions
HTTP ServerHTTP Server
Visualization EngineVisualization Engine
Storage Management SystemStorage Management System
Data Integration EngineData Integration Engine
HierarchicalStorageManagement
UserUser
Web Browser / Client ApplicationWeb Browser / Client Application
DBMSDBMS
Data Mining EngineData Mining Engine
Key Issues on Data
•Clearly Described Data Policy with Full Agreement
•Meta Data Design and Registration System
•Well Quality Checked and Unified Formatted Data
•Data Integration System