© 2008 by m. stümpert, a. garcia; made available under the epl v1.0 | 2007-03-18 access the power...
TRANSCRIPT
![Page 1: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute](https://reader036.vdocuments.us/reader036/viewer/2022070406/56649de75503460f94ae1704/html5/thumbnails/1.jpg)
© 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18
Access the power of Grids with Eclipse
Mathias Stümpert (Karlsruhe Institute of Technology)
Ariel Garcia (Karlsruhe Institute of Technology)
March 18th, 2008
EclipseCon 2008
Santa Clara
![Page 2: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute](https://reader036.vdocuments.us/reader036/viewer/2022070406/56649de75503460f94ae1704/html5/thumbnails/2.jpg)
g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0
What is a Grid
• Original definition by I. Foster and C. Kesselman: “To solve together a scientific problem, the distributed
resources of scientists can be dynamically and coordinately connected by using fast networks to build a virtual computing center/organization”
• Nowadays definitions: Multiple independent computing clusters not located within a
single administrative domain Online computing/storage offered as a commercial service
(e.g. cloud computing) ...
![Page 3: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute](https://reader036.vdocuments.us/reader036/viewer/2022070406/56649de75503460f94ae1704/html5/thumbnails/3.jpg)
g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0
Grids for e-Science
• Currently g-Eclipse provides support for Grid infrastructures dedicated to e-Science
• Such infrastructures are still emerging On national and international level Some examples are EGEE, D-Grid, TeraGrid, int.eu.grid ...
• These infrastructures are built to solve problems of many different domains
Physics Bio-Medical Engineering Financial ...
![Page 4: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute](https://reader036.vdocuments.us/reader036/viewer/2022070406/56649de75503460f94ae1704/html5/thumbnails/4.jpg)
g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0
Grid middleware
• Connects resources (computing, storage...)at different sites to one Grid infrastructure
• Provides services to access an infrastructure• Many different middlewares are available:
gLite, Globus Toolkit, UNICORE, GRIA, ...
• Same basic functionalities of a middleware: Security layer for authentication and authorization Transfer protocols for accessing and managing data Brokers to distribute computing jobs on the infrastructure Higher level services (SLAs, accounting, ...) ...
![Page 5: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute](https://reader036.vdocuments.us/reader036/viewer/2022070406/56649de75503460f94ae1704/html5/thumbnails/5.jpg)
g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0
g-Eclipse - The idea behind it• Many different middlewares are out there
Provide extensible middleware-independent framework for accessing Grids
• Accessing a Grid is difficult Provide a user-friendly UI for accessing Grids
• A user may play different roles in a Grid Perspective for Grid users Perspective for Grid operators Perspective for Grid application developers
• Currently supported middlewares: gLite - Batch system for the scientific user GRIA - Service-oriented infrastructure for
industry and commerce
![Page 6: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute](https://reader036.vdocuments.us/reader036/viewer/2022070406/56649de75503460f94ae1704/html5/thumbnails/6.jpg)
g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0
g-Eclipse - Some facts
• Funded by the European Community• 14 Committers at Eclipse.org• Currently around 20 developers (committers
+ contributors) spread over 7 partners from 5 European countries
• Roughly 50 plug-ins, 2500 classes/interfaces and 300.000 LOC
• Monthly release cycle• Some first contacts to external contributors
established
![Page 7: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute](https://reader036.vdocuments.us/reader036/viewer/2022070406/56649de75503460f94ae1704/html5/thumbnails/7.jpg)
g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0
Roles and use cases
• Support for Grid user:
Submit/Manage jobs Manage data
Grid operator: Administrate sites Administrate users
Grid application developer:
Compile/Debug applications
Deploy applications
![Page 8: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute](https://reader036.vdocuments.us/reader036/viewer/2022070406/56649de75503460f94ae1704/html5/thumbnails/8.jpg)
g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0
The architecture
• Two layers: Abstraction layer (Grid model):
Authentication/Authorization Job management Data management Services ...
Implementation layer: Implements the model for specific
middlewares
• UI is based on abstraction layerUI looks the same for all middlewares
![Page 9: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute](https://reader036.vdocuments.us/reader036/viewer/2022070406/56649de75503460f94ae1704/html5/thumbnails/9.jpg)
g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0
Grid model and project
![Page 10: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute](https://reader036.vdocuments.us/reader036/viewer/2022070406/56649de75503460f94ae1704/html5/thumbnails/10.jpg)
g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0
The user interface
• Perspectives for Grid user, operator, application developer and data transfers
• Views for projects, auth tokens, connections, jobs, visualization and many more
• Wizards for auth tokens, connections, job descriptions, virtual organisations and many more
• Editors for job descriptions (JSDL, RSL), batch systems, VTK pipelines and more
• Everything based on middleware independent Grid model → fits all middlewares
![Page 11: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute](https://reader036.vdocuments.us/reader036/viewer/2022070406/56649de75503460f94ae1704/html5/thumbnails/11.jpg)
g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0
Current project status
• g-Eclipse is an official Eclipse Technology Project• First release (0.5) available since September 2007• Currently working in 1.0 milestone phase (M3 available)• Final 1.0 release planned for October 2008
• Architecture and Grid model stable since mid of 2007• First middleware implementation stable since end of 2007• Second middleware implementation started in the
beginning of 2008
![Page 12: © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | 2007-03-18 Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute](https://reader036.vdocuments.us/reader036/viewer/2022070406/56649de75503460f94ae1704/html5/thumbnails/12.jpg)
g-Eclipse - Access the Power of Grids with Eclipse | © 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0
Plans for 1.0 release
• Finish second middleware implementationProof of middleware independent conception
• Implement some first industry relevant applications on top of g-Eclipse
BEA application for fluid dynamicsPharmaceutical application by NEC
• Provide an interface for Amazon's EC2 and/or S3Be not only middleware-independent but also Grid-
independentIntroduce the world of cloud computing in Eclipse