g eclipse @ eclipse summit europe 2008
DESCRIPTION
g-Eclipse talk slides from the EclipseSummit Europe 2008.TRANSCRIPT
© 2008 by Knauer/Kornmayer; made available under the EPL v1.0 | 19th of Nov. 2008
Integration of Amazon Cloud in g-Eclipse
From Grid to Cloud Computing
Markus Knauer (EclipseSource | Innoopract)
Harald Kornmayer (NEC Laboratories Europe)
2 From Grid to Cloud Computing | © 2008 by Knauer/Kornmayer; made available under the EPL v1.0
From Grid to Cloud ?
The “Grid Vision” is “To solve together a (scientific) problem, by connecting the
distributed resources (of scientists) within different administrative domains dynamically and coordinately with the help of fast networks to build a „virtual computing center/organization”
(According to Foster/Kesselman; end of last century)
The Cloud Vision is not so well defined!!
Many Grid slides showed the virtual computing center as a “Cloud”
3 From Grid to Cloud Computing | © 2008 by Knauer/Kornmayer; made available under the EPL v1.0
What makes the Cloud a hype?
Grid
IaaSUtility Computing
Virtualization
SaaS
SaaS – Software as a ServicePaaS – Platform as a ServiceIaaS – Infrastructure as a Service
Web2.0
PaaS
Pay-per-use
Business-like spoken “organisations are switching from company-owned hardware and
software assets to per-use service-based models“ (Gartner 2008)
transform CAPEX to OPEX
“people's applications and information are going to be accessible to them from anywhere because it will all be up there in the Cloud.” (Eric Schmidt/Google)
Green Computing
4 From Grid to Cloud Computing | © 2008 by Knauer/Kornmayer; made available under the EPL v1.0
Future Cloud systems blueprint
IaaS
SaaS
PaaS
Grid
VirtualizationPay-per-use
User front ends
Grid
Pay-per-use
Web 2.0
Utility computing
10000 foot view
Green Comp.
5 From Grid to Cloud Computing | © 2008 by Knauer/Kornmayer; made available under the EPL v1.0
The market
6 From Grid to Cloud Computing | © 2008 by Knauer/Kornmayer; made available under the EPL v1.0
The Cloud use cases
submit jobs
monitor jobs
organize workflow
replicate data
create/delete data
visualize data
check jobs
check resources
monitor resources
configure resources
benchmark resources
manage VO
build workflow
code application
monitor application
deploy application
debug/test application
g-Eclipse
user
developer
operator
Not different from the Grid use cases of g-Eclipse
Manage data
Manage computing infrastructure
Tooling for seamless access is required
7 From Grid to Cloud Computing | © 2008 by Knauer/Kornmayer; made available under the EPL v1.0
g-Eclipse and the Cloud
Provides a middleware/infrastructure independent model for Grid access
Including dedicated views and wizards
Support as of today two Grid middlewares gLite
Grid middleware of the LHC accelerator (CERN) GRIA
(service-oriented middleware to support B2B collaborations; based on WSRF)
Interesting question:
Can we integrate the infrastructure from Amazon Web Services (AWS) in the g-Eclipse framework??
Simple Storage Service (S3) Elastic Computing Cloud (EC2)
Eclipse Platform
g-Eclipse
Abstraction Layer
Core UI
Implementation Layer
(Middleware)
Eclipse Extension Point
8 From Grid to Cloud Computing | © 2008 by Knauer/Kornmayer; made available under the EPL v1.0
g-Eclipse – the project
www.geclipse.eu
Project funded by the European Commission (INFSO-32347)
8 partners
Until end of 2008
www.eclipse.org/geclipse
Technology project at the Eclipse Foundation
Release 1.0.0 with stable API scheduled for end of 2008
Including AWS support
Gathering community i.e. in different Grid projects worldwide
by collaborating with other Eclipse projects
9 From Grid to Cloud Computing | © 2008 by Knauer/Kornmayer; made available under the EPL v1.0
Prerequisites for the demo Amazon AWS Account
http://aws.amazon.com/
One of the available 3.4 Eclipse Downloads
g-Eclipse Framework http://download.eclipse.org/technology/geclipse/updates/1.0/
g-Eclipse Amazon Webservice Integration http://www.geclipse.eu/update/1.0/
We work on moving it to eclipse.org
Switch to the g-Eclipse User Perspective and start creating a new Grid Project
AMI with image ID: ami-2766824e (or ask for an updated one)
You can connect e.g. via ssh to user 'tomcat' with PW 'EclipseCon'
See README in /home/tomcat
10 From Grid to Cloud Computing | © 2008 by Knauer/Kornmayer; made available under the EPL v1.0
Demo mode
Create a Grid project for Amazon Web service Including the definition of a Virtual Organisation
Access data at S3 resources Based on EFS
Secure authorisation and interoperability
Start a Cloud computing instance at EC2 Open seamless connection
Start OSGi remotely
Deploy bundles into a running Tomcat with p2
Enjoy a simple RAP-based application
Screenshots and (movies)
11 From Grid to Cloud Computing | © 2008 by Knauer/Kornmayer; made available under the EPL v1.0
Summary
g-Eclipse is an extensible framework which enables intuitive and easy access for
various Grid actors relies on the Eclipse framework Provides Grid model to seamlessly integrate Grid and Cloud resources can be extended to support different Grid middleware systems.
gLite, GRIA, AWS are already available
Grid computing and Cloud computing are similar in many senses Grid + Cloud
Groud
g-Eclipse can contribute to the future Eclipse runtime framework supporting IaaS, SaaS, PaaS
12 From Grid to Cloud Computing | © 2008 by Knauer/Kornmayer; made available under the EPL v1.0
Outlook – Possible Eclipse Cloud stack
IaaS
SaaS
PaaS
Grid
VirtualizationPay-per-use
User front end
Grid Equinox
Pay-per-use
g-Eclipse
ECF
p2
RCPRAP
RT STP
Web 2.0
Utility computing
Green Comp.
RCP
From Grid to Cloud Computing | © 2008 by Knauer/Kornmayer; made available under the EPL v1.0
How to contribute
Use our tool and send us feedback! Webpage www.eclipse.org/geclipse or www.geclipse.eu
Developer mailing list https://dev.eclipse.org/mailman/listinfo/geclipse-dev
Bugzilla https://bugs.eclipse.org/bugs
Collaborate and provide patches for other middleware systems Contact {at} geclipse.eu
Acknowledgement Thanks to Scott Lewis for providing parts of the demo!