jra1 – annual activity report

www.eu-eela.eu

E-science grid facility forEurope and Latin America

JRA1 – Annual Activity Report

Francisco Brasileiro

Universidade Federal de Campina Grande – UFCG (Brazil)

Diego Scardaci

Istituto Nazionale di Fisica Nucleare – INFN (Italy)

TB + EAC Meeting

Bogotá, 23.02.2009

www.eu-eela.eu


• TJRA 1.1: Coordination of the Activity– All tasks are followed closely by either the

activity manager or his deputy– Communication channels need to be improved

Skype meetings between manager and his deputy at least once per month

Fortnight e-mail summary reports from CIEMAT staff FB shall establish a permanent communication

channel with SA1 management DS shall do the same for NA3

Bogotá, EELA-2 TB+EAC Meeting, 23.02.2009 3

www.eu-eela.eu


• TJRA 1.2: Development of Infrastructure-oriented Additional Grid Services – TJRA1.2.1: Seed Resources Sharing

OurGrid 4.1.4 has just been released• Includes authentication and XMPP-based communication• Support for X.509 certificates• Support for privacy• Application level and resource level security specification• Available at http://www.ourgrid.org/ and

https://forge.eu-eela.eu/projects/ourgrid-eela/• First site already operational at UFCG

5Bogotá, EELA-2 TB+EAC Meeting, 23.02.2009

www.eu-eela.eu


• TJRA 1.2: Development of Infrastructure-oriented Additional Grid Services – TJRA1.2.2: Porting of gLite to Microsoft Windows

platforms Windows port of gLite UI and Computing Element is ready and

available at: https://forge.eu-eela.eu/projects/grid2win/


www.eu-eela.eu


• TJRA 1.2: Development of Infrastructure-oriented Additional Grid Services – TJRA1.2.3: Interoperability between gLite and

OurGrid We have moved from a “bridging” approach to a co-

existence one

• OurGrid provides a good interface to run bag-of-tasks

• gLite is appropriate to support the execution of tightly-coupled applications

• BoT jobs should be submitted to the best-effort grid, draining these jobsout from the cluster’s queue


www.eu-eela.eu


• TJRA 1.2: Development of Infrastructure-oriented Additional Grid Services – TJRA1.2.3: Interoperability between gLite and OurGrid

Guide available in the EOC site for helping administrators of gLite-based sites to install the OurGrid middleware in co-existence with gLite

Guide available to install standalone OurGrid-based sites Guide available to write OurGrid jobs Public portal available for testing OurGrid-enabled applications

without the need to install the software

• http://portal.ourgrid.org/– Status and statistics services for the best-effort

infrastructure yet to be deployed as a core service See http://status.ourgrid.org/


www.eu-eela.eu


• TJRA 1.2: Development of Infrastructure-oriented Additional Grid Services – TJRA1.2.4: Application and VO compliant execution

environments through virtualization CIEMAT staff allocated to this task had to concentrate on other

affairs during the last four months of 2008 Management expects to profit from a face-to-face meeting

during the 1st EELA-2 conference to get this activity moving at the CIEMAT side

– We took advantage of synergy that exists between TJRA1.2.3 and TJRA1.2.4 to reach our milestone OurGrid sites can run customized virtual machines that support

the software required by a given VO


www.eu-eela.eu


• TJRA 1.3: Development of Application-oriented Additional Grid Services

–Digital ArchivesGSAF is available in a stable version https://forge.eu-eela.eu/projects/gsaf/


www.eu-eela.eu


• TJRA 1.3: Development of Application-oriented Additional Grid Services– Secure Storage Service

Available in a stable version https://forge.eu-eela.eu/projects/securestorage/


www.eu-eela.eu


• TJRA 1.3: Development of Application-oriented Additional Grid Services– Cooperative workflows and tagging

Prototype available for tagging data of Environmental Science Applications

• This is a product of the SegHidro Project• Relies on a centralized database for tags• http://opendapmetafinder.lsd.ufcg.edu.br/

Working on a distributed version• JF’s MSc dissertation


www.eu-eela.eu


• TJRA 1.3: Development of Application-oriented Additional Grid Services– Additional application-driven grid services

GFAL Java API• The GFAL library presents a Posix interface for the I/O operations

gLibrary/DRI• gLibrary/DRI extends gLibrary, a system with a easy-to-use web front-end designed to save

and organize multimedia assets on Grid-based storage resources

SAGE: Storage Accounting• SAGE is a system to measure the usage of storage resources in a gLite based grid

infrastructure and make this data available to DGAS (the accounting system of gLite) to account the storage at higher levels

WatchDog• Watches the status of a running job when it runs on a working node

Utilities• A set of utilities that allow users to easily manage gLite Services


www.eu-eela.eu


• TJRA 1.3: Development of Application-oriented Additional Grid Services– Multiple Middleware Installation

Instruction to install on a single computer a "super" Grid User Interface having clients both for gLite and Globus Toolkit 4 (GT4): https://grid.ct.infn.it/twiki/bin/view/EELA2/SuperUserInterface

Instruction to install on the machines of a single cluster both a gLite Computing Element and a GT4 job allocation manager thus making a "super" Grid Computing Element: https://grid.ct.infn.it/twiki/bin/view/EELA2/SuperComputingElement

We will provide support to Site-Admins for multiple middleware installation

OurGrid co-existence is compatible with multiple middleware resource centres


www.eu-eela.eu


• TJRA 1.4: Middleware Repository– EELA-Forge Site:

Forge is available at https://forge.eu-eela.eu/ Customized for EELA-2 Two project categories

• Services for the Applications• Services for the Infrastructure


www.eu-eela.eu


• Status of forthcoming actions– Accomplishment of MJRA1.2: prototypes running in the

validation infrastructure Was delayed due to the unavailability of this infrastructure

– DJRA1.1: Annual Activity Report FB and DS have agreed on the template and on the division of

tasks; first version should be available in the first week of March

– MJRA1.4: Prototype of the gateway to transfer jobs from gLite to OurGrid and vice-versa This milestone has been affected by the change of focus from

interoperability to co-existence Running gLite BoT jobs in OurGrid should be straightforward

• We can develop a new OurGrid Broker that is able to parse gLite .jdf files

Running OurGrid jobs on gLite is less interesting,now that the OurGrid-based infrastructure is ableto use the gLite-based one in an opportunistic way


www.eu-eela.eu


• JRA1 Resources– JRA1 Section in EELA-2 web site

Contains a summary of the activity goals and points to the Wiki site

https://www.eu-eela.eu/

– JRA1 Wiki Site Contains descriptions and links for each JRA1 services https://grid.ct.infn.it/twiki/bin/view/EELA2/JRA1Services

– EELA-Forge Site All released software https://forge.eu-eela.eu/


jra1 – annual activity report

Documents