Chinese activity on inter-Grid test between SRB and SIG

Guoqing Li, RSGS/NRSCC & Carol Song, RCAC/Purdue UniversityPresented at WGISS-23, Hanoi23 May 2007

2

Contents

BackgroundCooperation archtiture from the view of Inter-GridExperiment and ResultPreliminary conclusion

3

Collaboration Mode

There are three modes on grid data resources collaboration.• Mode I:

•Making one resource node cooperated with another node

• Mode II•Making one node of Grid A as a node of Grid B

• Mode III•Making Grid A as a node of Grid B

4

Mode I

node node

Cooperation Mechanism

One of the mechanism is GridGrid

5

Mode II

Node

Node

Node

Node

GridRegister

Grid A

Node

resource

Node

Node

GridRegister

Grid B

This resource is not a special one. Both Grid A and Grid B cannot cooperate each other with the two nodes of this resource.

6

Mode III

Node

Node

Node

Node

GridRegister

Grid A

Node

resource

Node

Node

GridRegister

Grid B

This resource is a special one. Two Grids can cooperate with the service nodes on this resource. Broker mechanism is active.

broker

7

Background of SRB/SIG

Target of the research (Why Inter-Grid?)• To connect the EO data resources between two

independent grid systems.• To find the way of inter-grid operation.

Participants in this case• RCAC (Rosen Center for Advanced Computing) of Purdue

university

• RSGS/NRSCC

8

GIG

NCSA

TACC

UC

NCAR

SDSC ORNL

Purdue

PSC

IU

TeraGrid

RSGS

Tsinghua

CAF

SIG

InterGrid

9

RCAC Data services resource

10

11

SIG Data services resource

12

Data Nodes (resource)

SIG Container

Query Service(eWCS)

Access Service(eWFS)

WMS Service

Uniform interface

Uniform interface

Uniform interface

Adaptor Adaptor AdaptorDevelopTools

LANOperateSQL+API

Daemon

How does SIG organize its data resource?

13

Principles

Gird user of both sides can find and access the whole data resources.

Keeping the original resource organization structure. (Black Box)

For most data resources,• Need not to be registered into second Grid• Need not to add new service interface for second

Grid

14

Cooperation archtiture from the view of Inter-Grid

SIG SRB

SRB

SRB

SRB

SIG

SIG

SIG

MCATSIG DataRegister

SIG

SRB

SRB

SIG

InterGrid Broker

15

From SRB to SIG

SIGBroker

SRBData Source

SRBData Source

SIG Data Register

SIGData Source

MCAT

User

Portal

16

Service InterfaceService Interface

XML query sentenceXML query sentence

Adaptor

SRB database B

.propOf BMeta Query

Query Engine

Sql sentence

SIG Adapter ASRB Adapter B

SIG database A

Example: the implementation of SRB2SIG data query service

.propOf A

17

From SIG to SRB

SIGData Source

SRB

SIGData Source

SRB MCAT

SRBData Source

SIG data Register

SRB Client

18

The implementation of SRB data query service

SRB SERVER SRB SERVER

Adapter

sig database

MCATSRB core

SIG Adapter

File SystemsUnix, NT,Mac OSX

DatabasesDB2, Oracle

Sybase

ArchivesHPSS, ADSM,UniTree, DMF

SIGSIG

SRB ClientSRB Client

19

Experiment and Result

At present, we have implemented the broker from SRB to SIG service

• It means that with SIG Portal, the user can search and access the data stored in SRB data source.

• With the help of SRB MCAT mechanism, there is only one SRB2SIG broker service should be set within the certain SRB domain. All data in this domain will be available for SIG user.

•SRBSIG （ ok ）•SIGSRB （ under going ）

20

21

22

23

24

25

Following works

Negotiating with Purdue about the registering of SRB2SIG broker into Purdue’s SRB domain, with their experiment partner － certification control.

Working with Purdue’s SRB experts to implement SIG2SRB broker, which work needs the knowledge of SRB intramural technology.

Bringing out a web-service based framework of inter-grid broker mechanism. Applying them in the following project to check its adapting capability.

26

Other Works

The inter-grid between ESA G-POD and China SIG is ongoing. • This work is also located at the level of EUChinaGrid.• There steps (data level/ task level/ application level)

•Now at data level ……• A report will be given at WGISS-24

New Chinese EO Grid Plan• National wide EO data grid and processing grid• Not very clear• Also will be reported at next WGISS meeting

27

Thank you.