wmo information system : wis and a pilot project from...
TRANSCRIPT
![Page 1: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/1.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Meteorology eMeteorology e--Science Effort in KoreaScience Effort in Korea
WMO Information WMO Information SystemSystem : WIS: WIS
and and a Pilot Project from CAgM
Dec. 13, 2006
Dong-Il Lee & Byong-Lyol Lee
Korea Meteorological AdministrationKorea Meteorological Administration
Status & Perspectives
![Page 2: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/2.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
• Implementation Strategies– Metadata/Ontology– Web service/Grid service
• Current Implementations for WIS– CAgM/WIS– WIS/KMA
Key ContentsKey Contents
![Page 3: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/3.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
GEO Initiatives & Cyber Infrastructure
![Page 4: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/4.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
WIS implementationsWIS implementations(CAgM/WIS)(CAgM/WIS)
![Page 5: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/5.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
WIS/GISC infrastructure(WMO Information System)SIMDAT(EU)SIMDAT(EU)
![Page 6: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/6.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
CAgM MetaData Management
Prototypes of Extended WMO Metadata Core Profile Keywords
![Page 7: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/7.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMAHierarchy of weather elements RDF/OWL presentation
WAMIS
![Page 8: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/8.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Prototype of Ontology using extended Keywords
WAMIS
![Page 9: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/9.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Web & Workflow
![Page 10: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/10.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
• Dedicated (Virtual) DCPC/GISC to Agro-
/Applied Meteorology– To take care of non-conventional and extra-
disciplinary data/products(flux, vegetation, soil, forestry, water cycle, etc.)
– To establish a bridge toward GEOSS in information sharing
• Resource sharing technolgy– Servers for NWPs, application models, GIS tools, etc.– Computing GRID is being tested
Requirements from CAgMRequirements from CAgM
![Page 11: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/11.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
ImplementationsImplementations(WIS/KMA)(WIS/KMA)
![Page 12: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/12.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
KMA Efforts to OPENDAP with Grid (I)
agent
SAM File Pool
datasetdataset
![Page 13: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/13.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
KMA Efforts for WIS (II)
dataset
![Page 14: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/14.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
SIMDATPortal
AMBER
MM5
① Invoke Cluster Resources
By WorkFlow Model
② Call script to reportMeteo modeling
Storage
③ Save resultTo Report File(server side)
Meta catalog
VMCnode
View ReportsOGSA-DAIService
KMA Efforts for WIS (III)
![Page 15: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/15.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
agentSAN
CTL,IDX for Grib
MetadataExtractor
SIMDATData Repository
UNIDARTMetadataTimeseries/GTS
Ensemble /GDPSWAMIS
VMCNODE(GISC)
WEBPortal
Computing Service
WAMIS Workflow
GrADS Visualization Service
FTP PUSH Service
WorkflowEngineComputing
Resource
KMA Efforts for WIS (IV)
![Page 16: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/16.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Future KMA Efforts for WIS
GISC
DCPC
GDS & LASGDS & LASOPENDAP
Agent metadatametadata
metadata
Legacy dataset
Legacy dataset
GISC
Integrated PORTAL
![Page 17: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/17.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
DCPC
Synchronize#1
MySQLDB
MySQLDB
② New Service
③ Find New Services
④ Figure outNew Servicesinformation
① Scheduling for synchronize
periodically
⑥ Insert (update) recordsFor new services ⑤ Return
New serviceinformation
Implemented GISC Functions (1)
Portal GISC
DCPC Config XML Metadata
1. Synchronize between GISC and DCPC for new service
UNIDART UNIDART
![Page 18: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/18.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
2. Synchronize between GISC and DCPC for new metadata
DCPC
Synchronize#1
MySQLDB
MySQLDB
Portal GISC
DCPC Config XML Metadata
② New Metadata with new Service ID
③ Search FragmentOn metadata Directory
With Service ID ④ Read MetadataMatched with
Fragment
① Scheduling for synchronize
periodically
⑥ Insert (update) recordsFor new metadata contents
⑤ Return New Metadata
Implemented GISC Functions [2]
![Page 19: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/19.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Wee
Service
3. Harvesting using Wee Service - OAI
DCPC
MySQLDB
MySQLDB
Portal GISC
XML Metadata
② Make/Send Harvesting msg
③ Search FragmentWith Service ID
Save in DB④ Read Fragment
Metadata
① Scheduling for synchronize
periodically
⑥ Insert (update) recordsFor Fragment contents
⑤ Return Fragment Metadata
Implemented GISC Functions [3]
![Page 20: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/20.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Staging Directoryof Portal
Staging Directoryof Portal
OGSA-DAI
② Call OGSA-DAIWith Service class info
And Retrieve condition values
③ Make RequestXML Data
⑤ Return Data
① Request DataUsing conditionsdefined By client
①-1 Save Timestamp IDOn Hashmap List
⑥ SendStatus / Data
⑦ ReturnRequest Status /
Return Data
⑧ If Status is Completed, then
save Data returned by OGSA-DAI
④ Retrieve / MakeXML Data
Portal GISC
Data RepositoryActivity
Storage ForMeteo Data
4. Data Requesting OGSA-DAI service: Instant XML Result Service
Implemented GISC Functions [4]
![Page 21: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/21.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
5. Data Requesting using OGSA-DAI service: PUSH Service
OGSA-DAI
② Call OGSA-DAIWith Service class info
And Retrieve condition values
Data Transfer Service
③ Make RequestXML Data
⑤ CallbackStatus
① Request Enb/GDPS DataUsing conditionsdefined By client
①-1 Save Timestamp IDOn Hashmap List
⑥ SendStatus
StorageFor
Meteo Data
TargetFTP Server
⑦ ReturnRequest Status
④-1 Transferring XML fileto target FTP Server
④ RetrieveXML Data
Portal GISC
Implemented GISC Functions [5]
![Page 22: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/22.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
6. WAMIS Service Execution using WorkFlow GUI component
AMBER
MM5
① Invoke Cluster Resources
By WorkFlow Model
② Call script to reportMeteo modeling
Report File
③ Save resultTo Report File(server side)
Connect to serverBy samba service
Portal
Implemented GISC Functions – WAMIS
![Page 23: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/23.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
<KMA UNIDART>
OGSA-DAI WSRF
Globus Toolkit
Tomcat
ORACLE MetaDB
210.107.255.14
210.107.255.100
DB
<UNIDART Portal>
OC4J Server
<ECMWF SIMDAT Portal>PortalVMCDataRepositoryMySQL
<KMA Climate DB>
MySQL(SYKO60)
FilePool(GTS, Grib)
<KMA SIMDAT & Portal>
Portal
VMC
DataRepository(using UNIDART)
MySQL
<KMA WAMIS NODE>
MM5 operation
Grid model output Tool
<DWD UNIDART>
OGSA-DAI WSRF
Globus Toolkit
Tomcat
DMZ
Demonstration site
KMA DMZ
DWD
ECMWF
AMBER on Windows
Demo – System Architecture
![Page 24: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call](https://reader033.vdocuments.us/reader033/viewer/2022041819/5e5c9364dba2572436673388/html5/thumbnails/24.jpg)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Thank you!Thank you!