cloud computing workshop at iit bombay

56
IIT Tech Fest Cloud Workshop

Upload: nilesh-satpute

Post on 07-Jul-2015

897 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: Cloud computing workshop at IIT bombay

IIT Tech Fest Cloud Workshop

Page 2: Cloud computing workshop at IIT bombay

Trainer ProfileCo-founder and CEO at Applied Cloud ComputingMr. Nilesh is an experienced technology professional with hands on expertise on cloud technologies.

He is associated with IIT Bombay as an Independent Technology Advisor assisting them with their Virtualization journey. And Cloud Advisor with Wegilant University, an IIT startup.

•Mr. Nilesh Served IBM, HP, Wipro, Hexaware as a cloud expert in last 10 years. •Few of his clients are HCL, Tata Interactive Systems, IIT Bombay, Future Group, CITIBANK, Boehringer Ingelheim india.

AWS certified Solution ArchitectNetsuite Certified Implementation partnerPeoplesoft Certified Technical consultant

Qualification : BE Computer Science from VJTI: MBA form Jamnalal Bajaj Institute of management studies

Linkedin Profile:http://www.linkedin.com/profile/view?id=200500065

Nilesh Satpute

2www.appliedcloudcomputing.com

Page 3: Cloud computing workshop at IIT bombay

INTRODUCTION TO CLOUD COMPUTING

Session 1

3www.appliedcloudcomputing.com

Page 4: Cloud computing workshop at IIT bombay

History of cloud computing

• Need for Utility : (Electricity, Telecom) : Delivering computer resources over global network

1969 (ARPNET)

1970(mainframes)

1980(PC adoption)

1990-till date (internet economy)

1999 (salesforce.com)

2002(Amazon Web Services)

2004(Private Cloud)

2009(web 2.0)

Mainframe

Full virtualization

Paravirtualization

4www.appliedcloudcomputing.com

Page 5: Cloud computing workshop at IIT bombay

cloud

Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction.

• 5 characteristics• On demand self Service, Broad Network Access, Resource pooling, Rapid Elasticity and Measured services

• 3 Service Models•SaaS, PaaS, IaaS

•4 Deployment model•Private Cloud, Public Cloud, Community cloud, And Hybrid Cloud

5www.appliedcloudcomputing.com

Page 6: Cloud computing workshop at IIT bombay

How Cloud Computing works 1/2

• Using resource pools to share common resources

• Server Virtualization

• Network Virtualization

• Storage Virtualization

• Virtualization to cloud : IT –as-a-Service

• Data Centre transformation to shared Infrastructure

6www.appliedcloudcomputing.com

Page 7: Cloud computing workshop at IIT bombay

How Cloud Computing works 2/2

IT Service Management

Software as a Service

Platform as a service

Infrastructure as a service

Virtual Infrastructure Architecture

Virtual Infrastructure Management

System StorageBackup

and Recovery

Networks SecurityTraditional Roles still essential

New role emerging•Cloud Architect•Cloud Admin•Cloud Capacity Planner•IT automation engineer

New focus Area : Cloud services and operations management

Business and Financial management

7www.appliedcloudcomputing.com

Page 8: Cloud computing workshop at IIT bombay

Application for Business

• Application testing and staging

• Temporary processing and storage needs

• Data archiving

• Virtual Desktop Infrastructure (VDI)

• Supplier management

• Back-office optimization

• Sales force management

• Project management and collaboration

8www.appliedcloudcomputing.com

Page 9: Cloud computing workshop at IIT bombay

Infrastructure Cloud Services Provider

• AWS

• Microsoft Azure

• Google App engine

• Rackspace Cloud

9www.appliedcloudcomputing.com

Page 10: Cloud computing workshop at IIT bombay

Cloud Computing Architecture 1/4

10www.appliedcloudcomputing.com

Page 11: Cloud computing workshop at IIT bombay

Cloud Computing Architecture 2/4

11www.appliedcloudcomputing.com

Page 12: Cloud computing workshop at IIT bombay

Cloud Computing Architecture 3/4

12www.appliedcloudcomputing.com

Page 13: Cloud computing workshop at IIT bombay

Cloud Computing Architecture 4/4

13www.appliedcloudcomputing.com

Page 14: Cloud computing workshop at IIT bombay

Cloud Computing Terminologies

• Communication-as-a-Service (CaaS)

• Infrastructure-as-a-Service (IaaS)

• Monitoring-as-a-Service (MaaS)

• Software-as-a-Service (SaaS)

• Platform-as-a-Service (PaaS)

14www.appliedcloudcomputing.com

Page 15: Cloud computing workshop at IIT bombay

Cloud

Advantage

• Access

• Scalable

• Cross Platform

• No upfront cost

• Data Security

• Integration

Disadvantage

• Security

• Response Time

15www.appliedcloudcomputing.com

Page 16: Cloud computing workshop at IIT bombay

VIRTUALIZATIONSession 2

16www.appliedcloudcomputing.com

Page 17: Cloud computing workshop at IIT bombay

Virtualization Basics : Hypervisor Virtualization

Guest VM User Space

EmulationMM RM Scheduler

HypervisorHost VM

User Space

Hardware

Hypervisor

Drivers VM OS kernel

Drivers VM Space

Drivers Virtual Hardware

Guest VM User Space

Drivers VM Space

Drivers Virtual Hardware

17www.appliedcloudcomputing.com

Page 18: Cloud computing workshop at IIT bombay

Virtualization Basics : OS Virtualization

DriversUser API

MM RM Scheduler

OS Virtualisation

User Space(Container)

User Space(Container)

User Space(Container)

Hardware

OS Kernel

18www.appliedcloudcomputing.com

Page 19: Cloud computing workshop at IIT bombay

Virtualization Basics : Para Virtualization

DriversUser API

MM RM Scheduler

Para Virtualisation

User Space(Container)

User Space(Container)

User Space(Container)

Hardware

OS Kernel

Hypervisor

19www.appliedcloudcomputing.com

Page 20: Cloud computing workshop at IIT bombay

Benefits

• Hardware Abstraction• Ease of Migration• Encapsulation of storage• Snapshots• Ease of archiving• Ease of growth• Improved Monitoring and troubleshooting• Workload consolidation• Ease of environment segmentation• Improved Remote management

20www.appliedcloudcomputing.com

Page 21: Cloud computing workshop at IIT bombay

CLOUD NETWORK AND PRIVATE CLOUD

Session 3

21www.appliedcloudcomputing.com

Page 22: Cloud computing workshop at IIT bombay

22www.appliedcloudcomputing.com

Page 23: Cloud computing workshop at IIT bombay

23www.appliedcloudcomputing.com

Page 24: Cloud computing workshop at IIT bombay

24www.appliedcloudcomputing.com

Page 25: Cloud computing workshop at IIT bombay

25www.appliedcloudcomputing.com

Page 26: Cloud computing workshop at IIT bombay

www.appliedcloudcomputing.com 26

Page 27: Cloud computing workshop at IIT bombay

www.appliedcloudcomputing.com 27

Page 28: Cloud computing workshop at IIT bombay

www.appliedcloudcomputing.com 28

Page 29: Cloud computing workshop at IIT bombay

AMAZON WEB SERVICES CLOUDSession 4

29www.appliedcloudcomputing.com

Page 30: Cloud computing workshop at IIT bombay

Amazon Web Services (AWS) -robust, scalable and affordable

infrastructure for cloud computing.

This session is about:

30www.appliedcloudcomputing.com

Page 31: Cloud computing workshop at IIT bombay

5 Benefits of Using Amazon Web Services

Page 32: Cloud computing workshop at IIT bombay

1. Pay-per use model

You are only charged for disk space, CPU time and bandwidth that you use.

Page 33: Cloud computing workshop at IIT bombay

2. Instant scalability

Your Service automatically scales on AWS stack.

Page 34: Cloud computing workshop at IIT bombay

3. Reliable/Redundant/Secure

Infrequent outages (so far).Data is redundant in the cloud.

All services have built-in security.

* Soon will add Comprehensive to the list.

Page 35: Cloud computing workshop at IIT bombay

4. Most services accessed via simple REST/SOAP API

Libraries are available in all major languages.Minimal learning curve.

Page 36: Cloud computing workshop at IIT bombay

5. Amazon - Experience & Commitment

Amazon has been doing this for ~15 years. Company-wide commitment to AWS.

Page 37: Cloud computing workshop at IIT bombay

Amazon Web Services Stack

Page 38: Cloud computing workshop at IIT bombay

Simple DatabaseService (SimpleDB)

Elastic Cloud Service (EC2)

Simple StorageService (S3)

Simple QueueService (SQS)

38www.appliedcloudcomputing.com

Page 39: Cloud computing workshop at IIT bombay

Elastic Compute Cloud (EC2)

On-demand grid

Page 40: Cloud computing workshop at IIT bombay

EC2 in a Nutshell

QuickTime™ and a decompressor

are needed to see this picture.

QuickTime™ and a decompressor

are needed to see this picture.

QuickTime™ and a decompressor

are needed to see this picture.

MachineImage

(OS + Apps)

Usage:

• Create Machine Image• Deploy the image to S3• Start 1 or more instances• Use it as regular machine(s)

Main Options:

• Dynamic/Static IPS• Choose cores• Choose locations• Persistence via EBS

40www.appliedcloudcomputing.com

Page 41: Cloud computing workshop at IIT bombay

Sample EC2 Use Cases

Batch Processing

All instances are configured with the same code. Each instance operates on a subset of data. Partitions are specified in configuration file.

Web Service

All instances are configured with the same code. One or more instances are configured as load balancers

(HAProxy for example). DNS Server distributes requests between load balancers.

41www.appliedcloudcomputing.com

Page 42: Cloud computing workshop at IIT bombay

EC2 vs. Web Hosting Company

Good

Instantly add new instances

Full-control over the machines and choice of the environment

Likely cheaper (but depends on your exact situation)

Bad

Need to put the images together and manage instances

No dedicated technical support

(but there is premium support and RightScale solutions)

42www.appliedcloudcomputing.com

Page 43: Cloud computing workshop at IIT bombay

Simple Storage Service (S3)

Large media and everything else storage.

Page 44: Cloud computing workshop at IIT bombay

S3 in a Nutshell

Client

Idea:

Put/Get objects into bucketsbased on unique keys.

Main Features:

• Public/Private access.• Support for large objects.

Amazon S3

Bucket 1 Bucket N…

Put object Get object

44www.appliedcloudcomputing.com

Page 45: Cloud computing workshop at IIT bombay

Sample S3 Use Cases

Image/Video storage

Put your media once on S3 and then serve it up

Reads are 10 times cheaper than writes!

Serialize your Java Objects

Define unique key based on the object attributes

Write out binary serialized version to a stream

Write bytes to S3

Read them back when needed

45www.appliedcloudcomputing.com

Page 46: Cloud computing workshop at IIT bombay

Simple Database Service (SimpleDB)

Basic database and indexing service

Page 47: Cloud computing workshop at IIT bombay

Simple DB in a Nutshell

Client

Idea:

Create flat database with auto-indexed tables.

Main Features:

• Each attribute is indexed.• Record structure is flexible.• Basic operators in queries• Supports sorting.

Simple DB Domain

Record 1

Put record

Get recordQuery records

Key1 Attributes: A1,A2…

Record N

Key2 Attributes: A1,A2…

47www.appliedcloudcomputing.com

Page 48: Cloud computing workshop at IIT bombay

Sample SimpleDB Use Cases

Index Media files stored on S3

Use the same key as on S3

Write the record with each metadata element as attribute

Store flat objects

Use SimpleDB as a storage for non-nested data

48www.appliedcloudcomputing.com

Page 49: Cloud computing workshop at IIT bombay

Simple Queue Service (SQS)

Infinite Asynchronous Queue

Page 50: Cloud computing workshop at IIT bombay

SQS in a Nutshell

Writer

Idea:

Create an infinite asynchronous queue.

Main Features:

• Multiple queues• Upto 4K messages• Message Locking

SQS Queue

Message 1

SendMessage

ReceiveMessage

Message N

Reader

50www.appliedcloudcomputing.com

Page 51: Cloud computing workshop at IIT bombay

Sample SQS Use Cases

Twitter Friend Update

For each update generate a task to update friends

Process updates in order

Publish/Subscribe

Post messages to the queue to inform multiple subscribers

Process Pipeline

Use different queues to put, for example, and order through a pipeline.

51www.appliedcloudcomputing.com

Page 52: Cloud computing workshop at IIT bombay

52www.appliedcloudcomputing.com

Page 54: Cloud computing workshop at IIT bombay

PHOTOGRAPHS FROM IIT WORKSHOP

54www.appliedcloudcomputing.com

Page 55: Cloud computing workshop at IIT bombay

55www.appliedcloudcomputing.com

Page 56: Cloud computing workshop at IIT bombay

56www.appliedcloudcomputing.com