cloud computing and eclipse technology - how does it fit together?

© 2009 by Kornmayer, Knauer; made available under the EPL v1.0 | 29.10.2009

Cloud Computing and Eclipse

How does it fit together?

Markus Knauer (EclipseSource)Harald Kornmayer (NEC Laboratories Europe)

Cloud computing and Eclipse technology | © 2009 by Kornmayer, Knauer; made available under the EPL v1.0

Outline

• Cloud computing

• Jump on the Cloud – Demo: Orchestration of Cloud infrastructure

• Cloud providers – A ‘non-complete’ Overview

• Equinox on the Cloud– Demo: Provisioning of a Cloud application with Eclipse

• Summary


The Cloud

• Today: No announcement in IT without the cloud

The market

and manymore!!


Individual Cloud experience?!


Individual Cloud experience?!

• Cloud examples are Google mail accounts

Do you use it for your mails? Amazon Simple Storage

Service (S3) Did you know that you

downloaded Eclipse Galileo from S3?

Salesforce.com (CRM)

Amazon Elastic Cloud Computing (EC2)

Google AppEngine


Cloud Definition

• Many definition exists!!

• NIST definition

“Cloud computing is a model for enabling available, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction.”

(National Institute of Standards and Technology).

• Essential characteristics On-demand self service Ubiquitous network access Location independent resource

pooling Rapid elasticity Measured services

• Delivery Models IaaS PaaS SaaS

• Deployment models Private Community Public Hybrid


The cloud from 10000 ft

Infrastructure as a Service (IaaS)

Software as a Service (SaaS)

Platform as a Service (PaaS)

User front ends


Platform development in Eclipse

Embedded Mobile Desktop Server Cloud (?)


Cloud challenges

• What is common in all cloud systems?

• What are the basic requirements? - Choice- Flexibility - Speed and agility - Skills

• How can the Open Source community overcome the proprietary cloud systems?

• Can Eclipse contribute technology today?


Orchestrate a Cloud application with Eclipse

Botto

m u

p

g-Eclipse


• Eclipse Technology Project

• Intuitive and easy access for Grid users, Grid resource providers Grid application developers

• Extensible framework including a Grid model for seamless integration of Grid/Cloud resources

• Supports different Cloud/Grid middleware gLite, GRIA (middleware from EC projects) Amazon Web Service (AWS)

• Can run in headless mode as API


Cloud Demo – Infrastructure as a Service

• Prerequisites: AWS Account from aws.amazon.com

Access Key and Secret Key registered for EC2 and S3 A valid security group (preconfigured firewall)

• Use g-Eclipse to access AWS resources Create a Grid Project Access to S3 data

EFS Implementation for S3 protocol Start EC2 instances


The cloud from 10000 ft

Infrastructure as a Service (IaaS)

Software as a Service (SaaS)

Platform as a Service (PaaS)

User front ends


Amazon Web Services – an example in details

Infrastructure

Application

Servers

Clients

Infrastructure [ IaaS ]

Compute Storage

Application / Software [ SaaS ]

UserInterface MachineInterface

Servers

Clients

Platform [ PaaS ]

Components Services

NetworkSimple DB +Amazon RDSSimple DB +Amazon RDS

Simple Storage Service (S3)

Simple Storage Service (S3)Elastic Compute

Cloud (EC2)Elastic Compute

Cloud (EC2)

Cloud FrontCloud Front

Elastic MapReduce

Elastic MapReduce

Simple Queue Service (SQS)


Virtual Private Cloud


DevPayDevPayFlexible Payments Service (FPS)

Flexible Payments Service (FPS)

Alexa Top SitesAlexa Top Sites

DevPayDevPay

Alexa Web Information Serv.



Amazon Web Services – in a nutshell!?!

• Simple Storage Service (S3)– Simple file system accessible via the internet

• Elastic Compute Cloud (EC2)– Virtual computer accessible via SSH– Linux or Windows– Equinox can run on these resources!


Amazon Web Services – a common model?

NimbusScience Clouds

Simple DB +Amazon RDSSimple DB +Amazon RDS







DevPayDevPay

Alexa Top SitesAlexa Top Sites

DevPayDevPay

Elastic Compute Cloud (EC2)

Elastic Compute Cloud (EC2)

Cloud FrontCloud Front

Elastic MapReduce

Elastic MapReduce






Tooling for Amazon Web Services

• Amazon EC2 management perspective– Starts, stops EC2 instances– Connects to Elastic Block storage– Bundles EC2 images– No connection to S3

• Support for Web application deployment– Integration with WTP

• http://aws.amazon.com/eclipse


GoGrid.com – another example in details

Infrastructure

Application

Servers

Clients


Compute Storage



Servers

Clients

Platform [ PaaS ]

Components Services

NetworkCloud StorageCloud Storage

Cloud Server ImagesCloud Server Images Cloud ConnectCloud Connect

F5 BigIP Load Balancing

F5 BigIP Load Balancing


GoGrid.com – in a nutshell!?!

• Cloud Storage – Simple file system – NOT accessible via the internet!

• only from GoGrid Cloud Server Images

• Cloud Server Images– Virtual computer accessible via SSH– Linux or Windows– Equinox can run on these resources!


Google App Engine – Web apps on Google's infrastructure

Infrastructure

Application

Servers

Clients


Compute Storage



Servers

Clients

Platform [ PaaS ]

Components Services

Network

Memcache Memcache

Datastore / BigTable

Datastore / BigTable

Google App Engine PythonGoogle App

Engine Python

Google App Engine JVMGoogle App Engine JVM

Goggle DocsGoggle Docs


Google AppEngine – in a nutshell!?!

• Storage– GoogleDocs– Big Table / Datastore

• Google AppEngine– Run applications in a JVM with limited capabilities

• Cannot create new threads• Read-only access to file system• Only a subset of the classes from the JRE standard edition

– Equinox can NOT run currently!• Can this be changed?


Orchestrate a Cloud application with Eclipse (II)

Botto

m u

p

g-Eclipse

Equinox

P2


Equinox, p2 – the Eclipse “platform”

Equinox • is the core of Eclipse• is an implementation of the OSGi R4 core specifications• is a set of bundles that implement various OSGi services• used on server side already

Dynamic management of applications

p2• Provisioning of components • Compose complex applications


Cloud Demo – Platform as a ServiceEC2 Instance

Java VMTomcat App Server

Equinox Servlet Bridge

Equinox / OSGi

consoleconsole

p2p2

Everything built with Eclipse technology


Cloud Demo – Software provisioning

EC2 InstanceJava VM

Tomcat App ServerEquinox Servlet

BridgeEquinox / OSGi

consoleconsole

p2p2

RAP applicationRAP application

p2metadata repository

Application metadataApplication metadata

p2artifact repository

Application artifactsApplication artifacts


Orchestrate a Cloud application with Eclipse

Botto

m u

p

g-Eclipse

Equinox

P2

RAP

RT


Summary

• A full XaaS story on the cloud was demonstrated by combining results from different Eclipse projects

• Interoperability and vendor lock-in?• Amazon provides Eclipse Tools for AWS (EclipseCon 2009)• Microsoft announced Eclipse Tools for Azure (EclipseSummit 2009)• g-Eclipse provides a middleware/infrastructure independent framework

• enables interoperability, choice, flexibility, …

• Equinox and its related projects can support Cloud applications• p2, RAP and other RT projects• Equinox can become the Cloud Operating System • Eclipse offers an Open Source Eco System for Cloud computing today!

Eclipse on the Cloud has a bright future!


Resources

• http://www.eclipse.org/geclipse– http://wiki.eclipse.org/G-Eclipse/AWS_Cloud_Getting_Started– http://live.eclipse.org/node/820

• http://www.eclipse.org/equinox/

• http://www.eclipse.org/rap

• http://www.theserverside.com/blogs/thread.tss?thread_id=57194

cloud computing and eclipse technology - how does it fit together?

Technology

geclipse cloud computing

cloud application

cloud definition

api cloud computing

cloud computing jump

cloud examples

cloud challenges

epl v1