ogsa-dai related r&d activities in aist japan · satellite data in geo grid (as of 2009.02) in...
TRANSCRIPT
������������
1
OGSAOGSA--DAI related DAI related R&D Activities in AISTR&D Activities in AIST
JapanJapan
Isao KojimaIsao KojimaITRI/AISTITRI/AIST
JapanJapan
������������
2
AIST http://www.aist.go.jp/• National Research Institute of
Advanced Industrial Science & Technology JAPAN– Computer Science & Electronics– Bio/Life Sciences– Nanotechnology, Materials and Manufacturing – Geology & Geosciences– Environment & Energy– Metrology
• ~3000 Researchers + ~2000 Visiting Scientists – Main Campus Located at Tsukuba Science City – 7 Regional Institutes.
ITRI
������������
3
ITRI:Information Technology Research Institute
of AIST• ~90 Researchers + visitors
– Formerly Known as “Grid Technology Research Center”(~2007)– Expanding our vision to cover general IT issues. (2007~Now)
• Grid Service-ware Research Group– Upper layer of the Grid R&D
(Database, HPC applications, Security Framework, etc)
– Database Team <10 researchers ;-< http://www.dbgrid.org• Small team• In charge of R&D for database projects in AIST
– GEO Grid– AIST Research RepositoriesEtc.
������������
4
Our Contributions to OGSA-DAI
• Use OGSA-DAI for our research projects.– GEO Grid
• Enhance OGSA-DAI as our research projects– OGSA-WebDB– OGSA-DAI-RDF– OGSA-DQP with XML/WebDB
������������
5
GEO Grid: • e-Infrastructure for Geosciences
Functionalities provided in GEO Grid• Geospatial Database Federations• Distributed File Systems• Large Scale Grid/Computing Platform• Workflows• Web Interfaces/Portals• User Management• VO(Virtual Organization) Managementetc.
http://www.geogrid.org
OGSA-DAI
For Details, Please have a look our IEEE Systems Journal Paper “Design Principles and IT Overviews of the GEO Grid” Vol2. No.3, 2008.09 Special Issue for GEOSS
������������
6
GEO Grid Architecture
AIST: OGF Gold sponsor (a founding member)
AIST: OGC Associate member (since 2007)
Grid Infrastructure
Support OGCSpecs
Web2.0 basedInterface
������������
7
GEO Grid Application Example• Creating Hazard Maps
Digital Elevation Maps using Satellite
Images
AMEDAS Rain sensors
Landslide Simulation
Display Hazard MapsGeological Data
ASTER
GEOMET
DatabaseFederation
������������
8
The reasons of using OGSA-DAI
• Service-based Database Access – World-wide Database federation over the Internet
• Support of VO based Security Mechanism– VOMS/GSI
• Harmonize with other Grid Tools– GridFTP, GRAM,Gfarm etc.
• Programming Framework to support Applications– Activity workflows
������������
9
Data stored in our GEO GridData stored in our GEO Grid
Raster DATARaster DATA
Sensor DATASensor DATA Vector DATAVector DATA
•Geological maps•Roads,railways, etc
GML/WFS
•ASTER •MODIS•PALSAR
GeoTiff/WCS
•PENSensorML/SOS
GIS Data
Satellite Images
Sensor Net
Linked by:- Geolocation- Observation/creation time- Specific parameter
- Owned by institutions/organizations- Many of them are not free
Source: Shunske Kodama SC08 Presentation
������������
10
Query Metadata with OGSA-DAI to PostGIS -> Large Images are Transferred with GridFTP
ASTER Satellite = Japan(METI)-made optical sensor on NASA TERRA SatelliteArchive is stored at ERSDAC(Japan) (and AIST GEO Grid)Resolution =15m Time-Series Images from Prof. S.Yokoyama of rinzo.ma project(our GUI project)
(Detail of the images will be presented at DEIM 2009 forum in Japan
Image files are stored with Gfarm file system
������������
11
Satellite Data in GEO Grid (as of 2009.02)
In Service Category resolution Observation Period
Scenes Data Size Description Note
ASTER opt 15m 2000- ~1,300,000 ~200TB
MODIS opt 250m 2000- �10�000 Japan& surrounding area
Working for federating with MODIS@NASA
FORMOSAT2
opt 8m2m(PAN)
2004- - NSPO@TAIWANcatalog only
Temporally Unavailable
Work in Progress
Category resolution Observation Period
Scenes Data Size Description Note
PALSAR sar 10m 2006- 12000 4.5TB Southeast Asia
LANDSAT opt 80m(1) ~ 15m(7)
1978- 2~4PBIn total
Planning&Negotiating
Category resolution Observation Period
Scenes Data Size Description Note
PRISM opt 2.5m 2007(?)-
GOSAT atm 2009?
JERS-1 opt&sar 18m(sar)18mx24m(opt)
1992-
All databases are
stored & federatedusing
OGSA-DAI/w Gfarm file system
Hope to be aNational Data Archive
for Satellite Data
Thanks to: Y.Takeyama, K.Iwao and N.Yamamoto
������������
12
GEO Grid & OMII
Good Support provided by OMII group• Several our requests are realized
– PerformDoc based interface• To have the compatibility with old programs
– Extended SQLBag Function• RemoteResourceGroup to join several satellite databases
with same schema– ….,
• Helps, Advises and Codes– OGSA-DAI with VOMS/GLite
������������
13
AIST OGSAAIST OGSA--DAI extensionsDAI extensionsHeterogeneous Database Integration MiddlewareOGSA-WebDB
extends OGSA-DAI SQL access to Web DatabasesOGSA-DAI-RDF
extends OGSA-DAI to support RDF databases/SPARQLOGSA-DQP Extensions
extends DQP to support XML databases and WebDBOGSA-DQPOGSA-DQP
OGSA-DAIOGSA-DAI OGSA-DAI
Web DBXML DBRelational DB
client OGSA-DQPExtensions
OGSA-WebDB OGSA-DAI-RDF
RDF DB
OGSA-DQPExtensions
Working to provideheterogeneity
������������
14
The Web
GUI environmentGUI environment
OGSAOGSA--DAIDAI
OGSAOGSA--WebDBWebDB
Japanese Database of Japanese Database of Single Nucleotide Single Nucleotide Polymorphisms Polymorphisms
Online Mendelian Online Mendelian Inheritance in Man Inheritance in Man
Analyze relationships between Analyze relationships between diseases, drugs & Sidediseases, drugs & Side--Effects, Effects, SNPs etc. from many aspectsSNPs etc. from many aspects
Medical Medical Bibliographic/Bibliographic/Citation DatabaseCitation Database
Pharmacogenetics & Pharmacogenetics & Pharmacogenomics Pharmacogenomics Knowledge Base Knowledge Base
OGSA-WebDB Medical ApplicationSearch for Cancer PreventionSearch for Cancer Prevention
OGSA-DAI SQLJOIN
������������
15
OGSAOGSA--DAIDAI--RDFRDF: Service based Access to the: Service based Access to theSemantic Web(RDF) DatabasesSemantic Web(RDF) Databases
OGSAOGSA--DAI RDFDAI RDF
Apache/TomcatApache/TomcatGT4GT4��OMIIOMII
��OGSA-DAI
SQL ActivitiesSQL Activities
XMLDBXMLDB ActivitiesActivities
Data Transport ActivitiesData Transport Activities
Data Manipulation ActivitiesData Manipulation Activities
SPARQL/XML &RDF
RDBRDBXMLDBXMLDB
GridFTP/FTPGridFTP/FTP
XSLTXSLT
SesameOGSA-DAI-RDF
OGSAOGSA--DAIDAI--RDF ActivitiesRDF ActivitiesSPARQL
Ontology
Insert/Delete
ReasoningJenaOGSA-DAI-RDF
Extend OGSA-DAIto
RDF databases(Sesame, jena)
ComplyComplyOGF(Open Grid Forum)OGF(Open Grid Forum)
StandardStandardWSWS--DAIDAI
To appear the NEXT issue of “Concurrency and Computation” Journal
������������
16
��
GUIGUIGUI
Grid Resource Ontology
OGSA-DAI-RDF
���
(Jena)
Sesame
Detecting AnormallyUsing Rule Processing Real-Time
Resource MonitoringUsing Continual Queries
Jena
Data and Metadata ManagementUsing OGSA-DAI framework
SPARQL
Reasoning
Machmaking of Service Description
Semantic GridSemantic GridResource ManagementResource Management(Semantic(Semantic--MDS)MDS)
Semantic Web Semantic Web Service Service ManagementManagement(OWL(OWL--S)S)
S(Semantic)S(Semantic)--MDSMDS
�Discover• Register
Application of DAIApplication of DAI--RDF: AISTRDF: AIST--SOA Semantic RepositorySOA Semantic RepositoryIntegrated Management of Integrated Management of SemanticSemantic Grid Resources Grid Resources and and
SemanticSemantic Web ServicesWeb Services(prototype demonstrated 2008.03)(prototype demonstrated 2008.03)
�Service ontology�RDF)�Object��text, imagae�
��������
��Store• Query
Monitoring Info(Owl-S)
�
Distributed Environment
���
(Jena)
SesameRelational DB�Files
Boca
������������
17
OGSA-DQP Extension
• Integration of WebDB, relational, XML data
<authors><author><name>Steven Lynden</name> <field>Grid Computing</field>
</author><author><name>…</name> <field>…</field>
</author>…
</authors>
AUTHOR PUBLICATION CITESEER
XML Relational Databases Web databases
Detail is shown in our Grid2008 PaperS.Lynden et al.Service-based Data Integration using OGSA-DQP and OGSA-WebDB
������������
18
OpenXML
select xauthor.name, publication.title,citeseer.url, xauthor.field
from publication, citeseer,OpenXML(
author,'//author','//name/text() name, //field/text() field‘
) as xauthorwhere publication.title=citeseer.titleand xauthor.name=publication.author;
<authors><author><name>Steven Lynden</name> <field>Grid Computing</field>
</author><author><name>…</name> <field>…</field>
</author>…
</authors>
<author><name>Steven Lynden</name> <field>Grid Computing</field>
</author>
<author><name>…</name> <field>…</field>
</author>title url fieldname… … … …… … … … Detail is shown in our Grid2008 Paper
S.Lynden et al.Service-based Data Integration using OGSA-DQP and OGSA-WebDB