JMA's Status Report related to WIS

Tatsuya Noyori

JMA

ET-WISC 2-5 February 2010

Contents

WIS VPN Pilot Project in RAs II and V Metadata and Catalog Blog software and related technologies

Internet VPN

Internet VPN

JMA Test SystemJMA Test System

WIS VPN Pilot Project in RAs II WIS VPN Pilot Project in RAs II and Vand V

Internet

JMA Operational SystemJMA Operational System

RTH Tokyo

Met. Sat. Center

Supercomputer System for NWP

RSMCData SV.

VPN

Cloud-I

VPN Pilot Proj.

DMZ

MPLS (OBS)

Frame Relay (BT)

Etc.DDB SV.

Cloud-II(RMDCN)

CMA

BoM

Other PPParticipants

100Mbps(Best effort)

NAS

• Main purpose is to evaluate the availability of VPN

• 17 participants in total• Themes in Advanced Phase

1. NC Application (SATAID)2. Data input support

CMA has implemented Web Input and BUFR Encoding

JMA is evaluating them

Metadata and Catalog

Metadata and Catalog

Design of Catalog/Metadata

What human interface do we need for catalog and metadata?

What element do we need in metadata?

Let’s learn best practice from existing website.

Example: WDCGGJMA World Data Centre for Greenhouse Gases

http://gaw.kishou.go.jp/cgi-bin/wdcgg/catalogue.cgi

Catalog search, Form Search, Map search

WDC (Greenhouse Gasses) There are a lot of domain-specific elements

as metadata, such as parameter and contributor and etc.

The domain-specific elements are used as search key for search functions. Therefore, the use of domain-specific elements are important to search metadata effectively.

Design of Catalog/Metadata

learned lesson Usefulness of multiple search interfaces Usefulness of domain-specific search terms and i

nterface(e.g. "parameter", "station type" in WDCGG)

Do you think we need VolA/VolC-specific features?

Website of Metadata of VolA/VolC

http://www.shiken.kishou.go.jp/roller/tokyometadata/

Catalog search, Map search

Metadata for bulk data like GRIBs

Metadata for bulk data like GRIBs

http://www.ecmwf.int/products/additional/gts_headers_dcpc_essential.html

Website of Metadata of Volume C and A

The way of writing a file name list of a group in a page enable users to understand the relationship between the files of the group.

Therefore, writing a file name list of a group in a page is important.

Website of Metadata of VolA/VolC

http://www.shiken.kishou.go.jp/roller/tokyometadata/http://akira.inmet.gov.br/roller/brasilmetadata/

Feed Aggregator: http://en.wikipedia.org/wiki/Aggregator

Suggestion for Metadata

Atom is one of metadata. KML is also one of metadata. If WMO adopts KML and Atom as one of the

metadata, we could easily build the website that I have shown.

So, I would like to suggest that WMO adopts KML and Atom as metadata.

Website using ISO19139 Metadata

http://server.shiken.kishou.go.jp/testwar/search.jsp

70,000 metadata that are created per each static data files have been stored.

Full-text search, bounding box search, time range search

Website using ISO19139 Metadata

ISO19139 does not permit domain-specific elements and tabular listing.

So, I am not sure how I can use ISO19139 effectively.

But I will keep studying how we can built useful website on ISO19139.

Blog software and related technologies

Blog software and related technologies

Blog software and related technologies

Japan has been investigating blog software and related technologies in cooperation with Brazil and China, since 2008.

I have investigated Notification of priority messages using blog

post File synchronization like podcast

Customization of blog software for test

The blog software has been customized to reply minimized Atom feeds.

The customized blog software has been used for the investigation.

Test Results

Notification of priority messages

It was confirmed that the notification of test tsunami warnings generated on a routine schedule was completed within 20 seconds.

Test Results

File synchronization

The maximum transfer rate was 9Mbps. Messages (SYNOP, SHIP, BUOY, TEMP, TEMP

SHIP and PILOT) generated on a routine basis were synchronized within 60 seconds.

A product of numerical weather prediction (The total size is 70Mbytes, the number of files is 9116) was synchronized within 150 seconds.

A large file of 100Mbytes was synchronized within 150 seconds.

Conclusion

desirable usage scenes

Data providers provide users with data on a near-real-time basis over the Internet.

Data providers provide users with data at intervals over the Internet.

Data providers receive a priority message from the GTS, and then post the priority message to their blog server on the Internet

Suggestion

I would like to suggest using blog technologies in WIS Part B (the Internet)

Suggestion

Timely delivery service can also be implemented by “pull” mechanism using the file synchronization of blog technologies. Therefore, I would like to suggest that the sentence of WIS fundamental services is revised like ”Push or Pull”.

Other test I have done

Atom+KML metadata synchronization

http://www.shiken.kishou.go.jp/roller/tokyometadata/

http://akira.inmet.gov.br/roller/brasilmetadata/

Other test I have done

Decoded Data (HTML 5 Microdata) synchronization

http://www.shiken.kishou.go.jp/roller/tokyomicrodata/

http://akira.inmet.gov.br/roller/brasilmicrodata/

Future Plan

Investigate PubSubHubbub protocol conduct experiment of scalability