© 2008 by m. stümpert, a. garcia; made available under the epl v1.0 | 2007-03-18 access the power...

12
© 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute of Technology) Ariel Garcia (Karlsruhe Institute of Technology) March 18th, 2008 EclipseCon 2008 Santa Clara

Upload: katrina-james

Post on 11-Jan-2016

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute

© 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18

Access the power of Grids with Eclipse

Mathias Stümpert (Karlsruhe Institute of Technology)

Ariel Garcia (Karlsruhe Institute of Technology)

March 18th, 2008

EclipseCon 2008

Santa Clara

Page 2: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute

g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0

What is a Grid

• Original definition by I. Foster and C. Kesselman: “To solve together a scientific problem, the distributed

resources of scientists can be dynamically and coordinately connected by using fast networks to build a virtual computing center/organization”

• Nowadays definitions: Multiple independent computing clusters not located within a

single administrative domain Online computing/storage offered as a commercial service

(e.g. cloud computing) ...

Page 3: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute

g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0

Grids for e-Science

• Currently g-Eclipse provides support for Grid infrastructures dedicated to e-Science

• Such infrastructures are still emerging On national and international level Some examples are EGEE, D-Grid, TeraGrid, int.eu.grid ...

• These infrastructures are built to solve problems of many different domains

Physics Bio-Medical Engineering Financial ...

Page 4: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute

g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0

Grid middleware

• Connects resources (computing, storage...)at different sites to one Grid infrastructure

• Provides services to access an infrastructure• Many different middlewares are available:

gLite, Globus Toolkit, UNICORE, GRIA, ...

• Same basic functionalities of a middleware: Security layer for authentication and authorization Transfer protocols for accessing and managing data Brokers to distribute computing jobs on the infrastructure Higher level services (SLAs, accounting, ...) ...

Page 5: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute

g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0

g-Eclipse - The idea behind it• Many different middlewares are out there

Provide extensible middleware-independent framework for accessing Grids

• Accessing a Grid is difficult Provide a user-friendly UI for accessing Grids

• A user may play different roles in a Grid Perspective for Grid users Perspective for Grid operators Perspective for Grid application developers

• Currently supported middlewares: gLite - Batch system for the scientific user GRIA - Service-oriented infrastructure for

industry and commerce

Page 6: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute

g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0

g-Eclipse - Some facts

• Funded by the European Community• 14 Committers at Eclipse.org• Currently around 20 developers (committers

+ contributors) spread over 7 partners from 5 European countries

• Roughly 50 plug-ins, 2500 classes/interfaces and 300.000 LOC

• Monthly release cycle• Some first contacts to external contributors

established

Page 7: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute

g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0

Roles and use cases

• Support for Grid user:

Submit/Manage jobs Manage data

Grid operator: Administrate sites Administrate users

Grid application developer:

Compile/Debug applications

Deploy applications

Page 8: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute

g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0

The architecture

• Two layers: Abstraction layer (Grid model):

Authentication/Authorization Job management Data management Services ...

Implementation layer: Implements the model for specific

middlewares

• UI is based on abstraction layerUI looks the same for all middlewares

Page 9: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute

g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0

Grid model and project

Page 10: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute

g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0

The user interface

• Perspectives for Grid user, operator, application developer and data transfers

• Views for projects, auth tokens, connections, jobs, visualization and many more

• Wizards for auth tokens, connections, job descriptions, virtual organisations and many more

• Editors for job descriptions (JSDL, RSL), batch systems, VTK pipelines and more

• Everything based on middleware independent Grid model → fits all middlewares

Page 11: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute

g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0

Current project status

• g-Eclipse is an official Eclipse Technology Project• First release (0.5) available since September 2007• Currently working in 1.0 milestone phase (M3 available)• Final 1.0 release planned for October 2008

• Architecture and Grid model stable since mid of 2007• First middleware implementation stable since end of 2007• Second middleware implementation started in the

beginning of 2008

Page 12: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute

g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0

Plans for 1.0 release

• Finish second middleware implementationProof of middleware independent conception

• Implement some first industry relevant applications on top of g-Eclipse

BEA application for fluid dynamicsPharmaceutical application by NEC

• Provide an interface for Amazon's EC2 and/or S3Be not only middleware-independent but also Grid-

independentIntroduce the world of cloud computing in Eclipse