fp6−2004−infrastructures−6-ssa-026634 euchinagrid project giuseppe andronico technical...

http://www.euchinagrid.eu

FP6−2004−Infrastructures−6-SSA-026634

EUChinaGRID Project

Giuseppe AndronicoTechnical Manager EUChinaGRID Project

INFN Sez. CTTaipei 27.03.2007

2 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007

Outline

The project outline Activities and status

• Network planning• IPv6 compliance• Infrastructure & operations• gLite – GOS interoperability study• Applications• Dissemination

Summary & conclusions


Project Information

EUChinaGRID is a Specific Support Action (SSA) The project started on the 1 January 2006. 24 Months duration. 10 partners (6 from EU and 4 from China). Project budget 1,327,998 €. A total of 495 Person Months (325 Funded).


ParticipantsPartners Third Parties

INFN (Italy) CoordinatorUNIVERSITÀ DI ROMATRE –Dip. di Fisica – Rome (IT)

CERN – Geneva (CH)ACADEMIA SINICA GRID COMPUTING CENTRE (ASGC) - TAIPEI

Università di Roma Tre - Dip. di Biologia – Rome (IT)

Consortium GARR (IT)

GRNET (GR)

Jagiellonian University - MC - Cracow (PL)

Beihang University - Beijing (CN)

CNIC-CAS – Beijing (CN)

IHEP-CAS - Beijing (CN)

Peking University – Beijing (CN)


EUChinaGRID at a glance

Set-up and manage a Pilot Infrastructure

Train users and site administrators to use and operate an e-Infrastructure

Disseminate, both

“bottom-up” and “top-

down”, the e-Infrastruc-

ture paradigm for long

term sustainability of

e-Science

Attract new

communities in

learning, testing and

using pilot

infrastructure


EUChinaGRID Main Objectives

Support the Interconnection and Interoperability of Grids between Europe and China.

Main focus is on two specific infrastructures:• CNGRID in China• EGEE in Europe

Dissemination of advanced knowledge in Grid technology is also an important part of the activity.

Strengthening the collaboration between scientific groups in both regions, supporting existing and new Grid applications.


The “global” network


The “global” grid


The project Activities and status




Network planning A deliverable was produced

Status and perspectives of network connectivity to Asia

It describes the state of the art and the perspectives of network connectivity between Europe and Asia.

Partners are using both CERNET, directly connected to TEIN2/ORIENT, and CSTNET, the two main Research Networks in China.

EUChinaGRID is developing synergies with ORIENT/TEIN2 projects to improve the connectivity between China and Europe


2.5Gbps

TEIN2

and

ORIENT

connectivity

upgrade


IPv6 compliance

Investigated the compliance of gLite and GOS middleware

Implemented a tool to check the code Produced a guideline for developers Developed a useful collaboration with ETICS Gabriella Paolini will report later today on this same

argument in the session Grid Middleware & Interoperability III


Euchina Grid Pilot Infrastructure

map


Authorization and security Completed D3.1 and D3.2 We set up the CA infrastructure reaching the goal of

interoperable certificates on the pilot grid• CNIC Grid CA (http://ca.grid.cn/en)• Scientific DataGrid CA (http://ca.sdg.grid.cn/en)

Accredited by Asian-Pacific Grid Policy Management Authority


Infrastructure Services Installed, configured and currently maintained:

Type of nodeType of node WhereWhere FunctionalityFunctionality

RB/BDII/UI Italy (CNAF) Resource Broker and Catalog, User Interface

GridICE collector Italy (CNAF) Grid Monitoring Service

VOMS Italy (CNAF) Virtual Organization Management Service

Sec. VOMS China (CNIC) Virtual Organization Management Service

SAM China (IHEP) Service Availability Monitor

Gstat Taiwan (ASGC) Grid Information System stats


ROC website Regional Operations Center: http://roc.euchinagrid.org Any kind of information about EUChinaGrid infrastructure Starting point for operations activity

• Links to all useful EUChinaGrid monitoring pages Documentation for users and sites


Monitoring tools

BEIJING - PKU


Ticketing System Address: http://support.euchinagrid.org Powerful and flexible tool Successfully used for operation activity on the EUChinaGrid

pilot infrastructure• Preliminary shifts done to improve grid availability


CNGrid and EGEE interoperability

We have achieved basic batch job submission between GOS (CNGrid) and gLite (EGEE)

Studied and implemented plug-in to extend GOS batch service

Studied the extension to allow CE to forward batch jobs to GOS

Set up pilot testbed for interoperability test• Submission of batch jobs from GOS to GLite works by now

– Simple batch job with “simple” data transfers– Large data transfers foreseen for this year

Resource information of GOS can be published on BDII Extending LCG Job Manager to submit batch job to GOS

feasible


Pipeline-based gatewayPipeline-based gateway

GOS WMProxy

batch jobbatch job

ExtendedLCG-CE

batch job

GOS

batch job

Thread Pool

Scheduler

Thread Pool

Scheduler

Pipeline for GLite to GOS

Pipeline for GOS to GLite

Different colors in pipeline stand for different stages (StageIn, StageOut, … )

Each pipeline has corresponding thread pool and scheduler

Extended LCG-CE forwards batch jobs to gateway

Extended GOS forwards batch job to gateway

Idle thread pool used in scheduler

Scheduler executes stage in pipeline using idle thread from thread pool


Testbed

portal.ct.infn.it

gos.ct.infn.it

glite-gos.ct.infn.it

WMProxy

glite-rb2.ct.infn.it

OpenPBS

GridSAM4GLite

GridSAM4GOS

WMS/RB

edg glite-UIExtended LCG-CE

jakarta-tomcat-5.0.28

Portal or WS-Client

Command Line

CE CE CE

WN WN WN

JSDL

JSDL

JDL RSL

RSL

RSL

JDL

RSLRSL

JSDL

JSDL


Applications

EGEEATLAS and CMS

support

ARGO Data mover

MEDEA++

CorsikaNBP Application

Rosetta

Early/Late stage


The virtuous cycle of dissemination

Wider dissemination

Raises grid awareness and

attracts new potential users

Dissemination of advanced

knowledge Provides potential

users with grid expertise

Promoting new communitiesNew users can now use and deploy their applications and act as a dissemiation vehicle at a National level

JOININGTRAINING

DISSEMINATING


Some numbers 4 International Meetings, Workshops and Conferences organized

• 210 overall attendees

16 external events with EUChinaGRID presence

Dissemination and training materials produced

• >150 web pages

• 4 leaflets

• 3 press releases

5 tutorial events held

• 231 overall trained people

46 press cuttings collected in 9 different languages (including Chinese, English and Spanish) and 3 continents

48 questionnaires received from new potential users’ communities


http://www.euchinagrid.eu/

http://www.euchinagrid.cn/

Project’s website


Training events: participants at a glance

Tutorial participants

0,00

40,0080,00

120,00

160,00200,00

240,00

Date

Tota

l Nu

mb

er

SysAdmins

Users


Survey on new communities

To get a picture of new user communities adopting distributed and grid computing, in order to support their collaboration with EUChinaGRID activities.

Published on the website (in English and Chinese):

• http://www.euchinagrid.eu/new_communities_form.php

• http://www.euchinagrid.cn/questionnaire.php

Advertised by partners in their communities.


2nd EUChinaGRID Conference

Beijing April 24 — 25 Jointly with EchoGRID http://echogrid.ercim.org/content/view/11/18/

Networking EU & Chinese Grid Experiencesfor Innovation



The project just passed the first annual review Very noticeable technical results Great progresses towards developing a human

network collaborating to the creation of a common grid infrastructure for e-Science between Europe and China.

The activities foreseen for this second year will further improve the results obtained so far, both from the technical and human networking point of view.


Thank You for Your attention!

Questions

fp6−2004−infrastructures−6-ssa-026634 euchinagrid project giuseppe andronico technical...

Documents

andronico infn ct isgc

ct taipei

europe slide

global network slide

pilot infrastructure

global grid slide

project activities

project budget