cloud computing - uva · 2017. 1. 9. · • cloud allows access to services without user technical...

36
UVA HPC & BIG DATA COURSE Cloud Computing Adam Belloum

Upload: others

Post on 26-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

UVA HPC & BIG DATA COURSE

Cloud ComputingAdam Belloum

Page 2: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

outline

•  Cloud computing: Approach and vision•  Resource Provisioning in Cloud systems: •  Cloud Systems: IaaS, PaaS, SaaS•  Using Cloud Systems in practice•  Cloud system providers •  Open source Cloud middleware

Page 3: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

What is Cloud Computing?

Page 4: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

What is the cloud

•  IT as a service •  Cloud allows access to services without user technical

knowledge or control of supporting infrastructure•  Best describe in terms of what happened to electrical power

over 100 years ago•  Now computers are simple devices connected to the leader

cloud

Data processing, storage and software application that used to run locally are now being supplied by big central computing

station, They are becoming in essence computing utilities

Page 5: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Traditional ways of provisioning resources

Page 6: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

ExpandyourInfrastructure!Buynewservers,increaseyourso0warecosts,provisionmore

datacentercapacity!!

Page 7: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Looktothecloud!Payforthebandwidthand

serverresourcesthatyouneed.Whenyourpushisdonethenturnthewholethingoff!

•  TheThreeReasonstoCloudCompute:h?p://www.youtube.com/watch?annotaCon_id=annotaCon_308603&feature=iv&src_vid=SgujaIzkwrE&v=OIbkMjrrdjQ

Page 8: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Style of computing & usage model

Page 9: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Elastic approach to resource provisioning

Page 10: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Utility based usage metric

Page 11: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Delivery Models

Page 12: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

outline

•  Cloud computing: Approach and vision•  Resource Provisioning in Cloud systems: •  Cloud Systems: IaaS, PaaS, SaaS•  Using Cloud Systems in practice

Page 13: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

A new consumption Model for IT

Page 14: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Enabling Cloud

Page 15: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Abstract Pool automate

Page 16: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Abstract Pool automate

Page 17: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between
Page 18: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Gridmiddleware

Page 19: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between
Page 20: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Everything-as-a-Service

Page 21: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Relation between IaaS, PaaS, SaaS

Cloud&SOA CloudIaaS 21

Page 22: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

outline

•  Cloud computing: Approach and vision•  Resource Provisioning in Cloud systems: •  Cloud Systems: IaaS, PaaS, SaaS•  Using Cloud Systems in practice•  Cloud system providers •  Open source Cloud middleware

Page 23: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Example of the elasticity and scalability (IaaS)

•  To test the possibilities and performance of Grid on Demand a Biomedical Application and a workflow manager are used

•  Biomedical Application: WAVE–  Parallel (MonteCarlo simulation) application

•  Workflow Manager–  A (graphical) tool to assist complex e-Science application creation–  Creates a series of jobsubmissions–  WS-VLAM created by UvA SNE Group–  Connects to Globus Grid Interface

Page 24: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Example of the elasticity and scalability (IaaS)

Page 25: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Example of the elasticity and scalability

Page 26: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Example of successful MSc project

00:00:00

00:15:00

00:30:00

00:45:00

01:00:00

01:15:00

01:30:00

01:45:00

02:00:00

02:15:00

02:30:00

02:45:00

0 10 20 30 40 50 60 70 80 90 100

Tim

e

Job#

Performance on DAS3 - 100 Jobs

Running timePending time

00:00:00

00:15:00

00:30:00

00:45:00

01:00:00

01:15:00

01:30:00

01:45:00

02:00:00

02:15:00

02:30:00

02:45:00

0 10 20 30 40 50 60 70 80 90 100

Tim

e

Job#

Performance on Grid on Demand - 100 Jobs

Running timePending time

Page 27: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

outline

•  Cloud computing: Approach and vision•  Resource Provisioning in Cloud systems: •  Cloud Systems: IaaS, PaaS, SaaS•  Using Cloud Systems in practice•  Cloud system providers •  Open source Cloud middleware

Page 28: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

SaaS,PaaS,andIaaS

Page 29: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Infrastructure as a Service (IaaS).

Amazon S3(Datastorage/filesystem),SimpleDB(non-relaConaldatabase)EC2(compuCngservers).

Rackspace CloudDrive(Datastorage/filesystem),CloudSites(websitehosCngoncloud)CloudServers(compuCngservers).

GoGrid CloudHosFng(websitehosCngoncloud)CloudStorage(Datastorage/filesystem).

IBM SmartBusinessStorageCloudCompuFngonDemand(CoD)

Page 30: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Platform as a Service (PaaS).

Googles AppEngineisadevelopmentpla_ormbaseduponPythonandJava

force.com Apexadevelopmentpla_ormbaseduponaproprietaryprogramminglanguage

Microso0 Azureprovidesadevelopmentpla_ormbasedupon.Net.

Page 31: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Software as a Service (SaaS)

Google GoogleDocs,GMail,GoogleCalendarandPicasa

IBM LotusLiveiNotes,awebbasedemailservicethatprovidesmessagingandcalendaringcapabiliCestobusinessusers

Zoho hasvastsuiteofonlineproductssimilartoMicroso0officesuite.

Page 32: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

Software as a Service (SaaS) applications processing

•  Photo editing software•  Online file storage•  Twitter related applications•  Digital Video•  Photo Album•  Editing documents, spreadsheets and powerpoints•  Navigation: google Maps, Yahoo maps, …•  e-commerce software•  …

Page 33: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

outline

•  Cloud computing: Approach and vision•  Resource Provisioning in Cloud systems: •  Cloud Systems: IaaS, PaaS, SaaS•  Using Cloud Systems in practice•  Cloud system providers •  Open source Cloud middleware

Page 34: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

OpenNebula

Page 35: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

OpenNebula

•  OpenNebula provides different interfaces to interact and manage physical and virtual resources.

Page 36: Cloud Computing - UvA · 2017. 1. 9. · • Cloud allows access to services without user technical ... Abstract Pool automate. Grid middleware Everything-as-a-Service. Relation between

OpenStack

•  The OpenStack Open Source Cloud Mission: “to produce the ubiquitous Open Source Cloud Computing platform that will meet the needs of public and private clouds regardless of size, by being simple to implement and massively scalable.�”

•  Originated by Rackspace and NASA In 2010