cos301 - inside windows azure, the cloud os

7/24/2019 COS301 - Inside Windows Azure, The Cloud OS

http://slidepdf.com/reader/full/cos301-inside-windows-azure-the-cloud-os 1/55

Inside Windows Azure:The Cloud Operating System

Mark RussinovihTehnial !ellowWindows Azure

COS"#$



Agenda

Introdution to Windows Azure

Windows Azure !undamentals!a%ri Controller Internals

&eploying a Servie

'pdating a Servie

(ost OS 'pgradesServie (ealth



What is a )Cloud*+

Cloud: on,demand- sala%le- multi,tenant- sel.,se

ompute resoures



Cloud !undamentals

In.rastruture as a Servie /IaaS0:

%asi ompute and storage resouresOn,demand servers

Amazon 1C2- 3MWare vCloud

4lat.orm as a Servie /4aaS0: loud appliation in.rastru

On,demand appliation,hosting environment

15g5 6oogle App1ngine- Sales.ore5om- Windows AzureSo.tware as a Servie /SaaS0: loud appliations

On,demand appliations

15g5 O..ie "78- 6Mail- Miroso.t O..ie We% Companions



Cloud: 1..iieny 3ersus Control

= Managed for You StandaloneServers

IaaS PaaS SaaS

Appliations

Runtimes

&ata%ase

Operating System

3irtualization

Server

Storage

9etworking

Windows Azure

Efficiency

Control



Windows Azure

Windows Azure is an OS .or the data enter

Model: Treat the data enter as a mahine

(andles resoure management- provisioning- and m

Manages appliation li.eyle

Allows developers to onentrate on %usiness logi

4rovides shared pool o. ompute- disk and netw

3irtualized storage- ompute and networkIllusion o. %oundless resoures

4rovides ommon %uilding %loks .or distri%uted

Relia%le ueuing- simple strutured storage- S;< st

Appliation servies like aess ontrol and onnet



Windows Azure Appliation 4hilosophy

&esign .or !ailure

Sale out .or apaitySale out .or redundany

Short time outs with retries

Idempotent operations

Stateless with dura%le e=ternal storage



Windows Azure Appliation Charateris

Automated- Consistent

Appliation 'pdates

'pdates to the appliation our in an automated

'pdates result in lean omponents .oring ons

<oal storage and OS are le.t untouhed Automated- Consistent

Con.iguration Changes

'pdates to the settings our in an automated w

'pdates result in lean settings

<oal storage and OS are le.t untouhed

Multi,Instane

Management

Idential instanes are deployed aross the serv

<arge sale,out servies are guaranteed to %e o

9o on.iguration dri.tSale,out Appliation sale,out an our automatially

(igh Availa%ility The appliation has no downtime- even in the .a

.ailures5


OS Serviing

The OS system hosting the appliation an %e up

most reent pathes in a oordinated and autom



Windows Azure Appliation Charateris

Single Instane4ersistent OS

Single InstaneStateless OS

Multi,InstanStateless O


Appliation 'pdates



Multi,Instane Management

Sale,out

(igh Availa%ility

Automated- Consistent OS

Serviing

Windows

Single Instane4ersistent OS

Single InstaneStateless OS

Multi,InstanStateless O


Appliation 'pdates



Multi,Instane Management

Sale,out

(igh Availa%ility

Automated- Consistent OS

Serviing



Windows Azure 4lat.orm >uilding >lok

Windows Azure Compute

Windows Azure Storage

><O>s

Ta%les

;ueues

Windows Azure C&9

S;< Azure App!a%ri 4aaS Middleware Servies

App!a%ri Cahing

App!a%ri Servie >us

App!a%ri Aess Control Server



Agenda



&eploying a Servie

'pdating a Servie




Modeling Cloud Appliations A loud appliation is typially made up o. di..ereomponents

!ront end: e5g5 load,%alaned stateless we% serversMiddle worker tier: e5g5 order proessing- enoding

>akend storage: e5g5 S;< ta%les or .iles

Multiple instanes o. eah .or sala%ility and availa%i

!ront,1nd

Mark?s Cloud Appliation

!ront,1nd

(TT4@(TT4S

W

S

S

<oad >alaner

Middle,

Tier



The Windows Azure Servie Model

A Windows Azure appliation is alled a )servie*

&e.inition in.ormationCon.iguration in.ormation

At least one )role*

Roles are like &<<s in the servie )proess*

Colletion o. ode with an entry point that runs in its omahine

Windows Azure ompute S<A reuires two instaneah role

58B .or onnetivity to two instanes

Ahieved with update and .ault domains



Availa%ility: 'pdate &omains

4urpose: 1nsure servie stays up whileupdating and Windows Azure OS

updatesSystem onsiders update domainswhen upgrading a servie

$@'pdate domains perent o. servie that

will %e o..line

&e.ault and ma= is 8- %ut you an override

with upgrade&omainCount servie de.inition

property

The Windows Azure S<A is %ased on atleast two update domains and two roleinstanes in eah role

!ront,

1nd,$

!ront,

1nd,2

'pdate

&omain $

'pdate

&omain

Middle

Tier,$

Middle

Tier,2

!ront,

1nd,2

!ront,

1nd,$



Availa%ility: !ault &omains

4urpose: Avoid single points o.

.ailuresSimilar onept to update domains

>ut you don?t ontrol the updates

'nit o. .ailure %ased on data entertopology

15g5 top,o.,rak swith on a rak o. mahines

Windows Azure onsiders .aultdomains when alloating servieroles

2 .ault domains per servie

Will try and spread roles out aross more

15g5 don?t put all roles in same rak

!ront,

1nd,$

!ault

&omain $

!au

&omai

!ron

1nd

Midd

Tier

Middle

Tier,$



Role Contents

&e.inition:

Role nameRole type

3M size /e5g5 small- medium- et50

9etwork endpoints

Code:

We%@Worker Role: (osted &<<and other e=euta%les

3M Role: 3(&

Con.iguration:

9um%er o. instanes

9um%er o. update and .ault domains

Mark’s Ser

Role: Front-End

efinition

Type: We%

3M Size: Small

1ndpoints: 1=ternal,$

Configuration

Instanes: 2

'pdate &omains: 2!ault &omains: 2

R

e

Ty

3M

1n

Co

In

'p

!a



Role Types

There are urrently three role types:

We% Role: IISD and AS4591T in Windows Azure,suppWorker Role: ar%itrary ode in Windows Azure,supplie

3M Role: uploaded 3(& with ustomer,supplied OS

3M Role: is it a 3M+

9o- %eause it is stateless6ood .or:

<ong install /8E minutes0

Manual [email protected]

!ragile [email protected]



Servie Model !iles

Servie de.inition is in

Servie&e.inition5sde. Servie on.iguration is inServieCon.iguration5s.g

CS4ak program Fipsservie %inaries andde.inition into serviepakage .ile/servie5s.g0



S

4ort

'S,9orth C

&eploying a Servie to the Cloud:

The $#-### .oot view

Servie pakage uploaded to portal

Windows Azure 4ortal Servie passes servie

pakage to )Red &og !ront 1nd* /R&!10

Azure servie

R&!1 onverts servie pakage to native )R&*

version

R&!1 sends servie to !a%ri Controller/!C0 %ased on target region

!C stores image in repository and deploysand ativates servie

S



The !a%ri Controller /!C0

The )kernel* o. the loud operating system

Manages dataenter hardware

Manages Windows Azure servies

!our main responsi%ilities:

&ataenter resoure alloation

&ataenter resoure

provisioning

Servie li.eyle management

Servie health management

Inputs:

&esription o. the hardware and network resoures it will on

Servie model and %inaries .or loud appliations

Server

Gernel

4roess

Windows Gernel

Server

WordS;<

Server

1



Side%ar: What?s with all these )!a%ris

The Windows Azure !a%ri Controller is totally-ompletely- unrelated to App!a%ri

App!a%ri is a %rand that enompasses:

Windows Server App!a%ri: a set o. omponents .or

%uilding omposite appliations %ased on Windows

Communiation !oundation and Windows Work.low

Windows Azure App!a%ri: Cloud servies .or onneloud and on,premise appliations

App!a%ri Aess Control Server

App!a%ri Servie >us

App!a%ri Cahe

>uilt as Windows Azure servies



&ataenter Arhiteture

TOR

<> <>"gg

4&'

<> <>"gg

<> <>"gg

<> <>"gg

<> <>"gg

Raks

&ataenter

Routers

Aggregation

Routers and

<oad >alaners

TOR

4&'

TOR

4&'

TOR

4&'

TOR

4&'

TOR

4&'

TOR

4&'

TOR

4&'

TOR

4&'

TOR

4&'

TOR

4&'

TOR

4&'

HHH H

Top o. RakSwithes

4ower &istri%ution

'nits

H N o d e s

N o d e s

N o d e s

N o d e s

N o d e s

N o d e s

N o d e s

N o d e s

N o d e s

N o d e s

N o d e s

N o d e s



Windows Azure &ataenters

(i h < l !C A hit t



(igh,<evel !C Arhiteture!C is a distri%uted- state.ul appliation running on nodes /%ladespread aross .ault domains

Installed %y )'tility* !a%ri Controller

One ats as the primary and all others keep view o. world in synSupports rolling upgrade- and servies ontinue to run even i. !C .ails en

!#R

FC

$

% %

!#R

FC

&

% %

!#R

FC

'

% %

FC

'

!#R

FC

(

% %

!#R

FC

)

% %

*+

*+ ",, *+*+ *+

9odes

Rak

4 i i i 9 d



4rovisioning a 9ode

4ower on node

41,%oot Maintenane

OS Agent .ormats disk anddownloads (ost OS

(ost OS %oots- runsSysprep @speialize-

re%oots!C onnets with the)(ost Agent*

!a%ri Controller

Role

Image

Role

Images

Role

Images

Role

Images

Image Repository

Maintenane

OS

4arent

OS

9ode

Maintenane

OS

Windows Azure

OS

Windows

Azure

OS

!C

(ost

Agent

Windows Azure (ypervis



Inside a 9ode

!a%ri Controller /4rimary0

!C (ost Agent/trusted0

(ost 4artition

6uest

4artition

6uest

Agent

6uest

4artition

6uest

Agent

6uest

4artition

6uest

Agent

6uest

4artition

6uest

Agent

4hysial 9ode

!a%ri Controller /Replia0 !a%ri Controller /RepH

Role

Instane

Role

Instane

Role

Instane

Role

Instane

!rust oundar

A d



Agenda



&eploying a Servie

'pdating a Servie


S i & l t St



Servie &eployment Steps4roess servie model .iles

&etermine resoure reuirements

Create role images

Alloate ompute and network resoures

4repare nodes

4lae role images on nodes

Create virtual mahines

Start virtual mahines and roles

Con.igure networking

&ynami I4 addresses /&I4s0 assigned to %lades

3irtual I4 addresses /3I4s0 E ports alloated and mapped to

4rograms load %alaners to allow tra..i

S i R All ti



Servie Resoure Alloation

6oal: alloate servie omponents to availa%le resoures while sahard onstraints

(W reuirements: C4'- Memory- Storage- 9et

!ault domains

Seondary goal: Satis.y so.t onstraints

4re.er alloations whih will simpli.y serviing the host OS@hypervisor: pik

already have instanes .rom the same update domain

Optimize network pro=imity: pak nodes

Servie alloation produes the goal state .or the resoures assigservie omponents

9ode and 3M on.iguration /OS- hosting environment0

Images and on.iguration .iles to deploy

4roesses to start

Servie alloation also alloates network resoures suh as <> a

1=ample Servie Alloation



1=ample Servie AlloationRole >Count: 2

'pdate &omains: 2

!ault &omains: 2

Size: Medium

Role ACount: "

'pdate &omains: 2

!ault &omains: 2

Size: <arge

!ault &omain $ !ault &omain 2 !ault &omain "

<oad

>alaner

$#5$##5#5"7

$#5$##5#5$22

$#5$##5#5$J8

www5myloudapp5net

www5myloudapp5net

4rovisioning a Role Instane

http://www.mycloudapp.net/






4rovisioning a Role Instane

!C pushes role .iles and on.iguration in.ormation to tanode host agent

(ost agent reates three 3(&s:&i..erening 3(& .or OS image /&:K0

(ost agent inLets !C guest agent into 3(& .or We%@Worker roles

Resoure 3(& .or temporary .iles /C:K0

Role 3(& .or role .iles /.irst availa%le drive letter e5g5 1:K- !:K0

(ost agent reates 3M- attahes 3(&s- and starts 3M6uest agent starts role host- whih alls role entry poin

Starts health heart%eat to and gets ommands .rom host age

<oad %alaner only routes to e=ternal endpoint when itresponds to simple (TT4 61T /<> pro%e0

Inside a Role 3M



Inside a Role 3M

Resource .olu/e

#S .olu/e

Role .olu/e

,uest "gent

Role 0ost

Role Entry Point

4rovisioning 3M Role Instanes



4rovisioning 3M Role Instanes3M Role %ase and di..erening 3(& are stored in WindStorage %lo%s

Shadow versions are made when the originals are uploaded

3(& reads all go through a 3(& ahing servie

Reads ome on,demand .rom the ahe

Writes go to a seondary di..erening 3(&

)Reimage* simply deletes it and re%oots

Windows Azure >lo% StorageOriginal >ase

3(&

Original &i..erening

3(&Shadow >ase

3(&

Shadow &i..erening

3(&

R&!13(& Cahing

ServieS

S

Agenda



Agenda



&eploying a Servie

'pdating a Servie


'pdate Types



'pdate TypesThere are two update types:

In,plae

3I4 swapIn,plae update:

Role instanes upgraded one update

domain at a time

Two modes: automati and manual

3I4 swap update:9ew version o. servie deployed-

e=ternal 3I4@&I4 mapping swapped

with old

Role A

'& $

Role

'&

Role >

'& $

Role

'&

Role A

'& $

Role >

'& $

Role

'&

Role

'&

Role A

'& $

Role A

'& 2

Role >

'& $

Role >

'& 2

<>

In,4lae 'pd

3I4 Swap 'pd

'pdate Type Charateristis



'pdate Type Charateristis

Su11orted C2anges In-1lace .IP S3a1 elete an

Operating system version es es

591T trust level es es

3irtual mahine size Soon es

<oal storage settings es

/inrease only0

es

9um%er o. roles Soon es

9um%er o. role instanes es es

9um%er or type o. endpoints Soon 9o

9ames and values o. on.iguration settings Soon es

3alues /%ut not names0 o. on.iguration settings es es

Add new erti.iates Soon es

Change e=isting erti.iates es es

&eploy new ode es es

In,4lae 'pdate &etail



In,4lae 'pdate &etail

!C deploys updated role .iles and on.iguration to all nparallel

4repares new role instanes:!C host agent reates new role 3(&

Attahes and mounts new role 3(&

Stops old role instane:

!C instruts guest agent to stop role instane

&ismounts and detahes old role 3(&Starts new role instanes:

Calls new role ode entry point

Considers role instane update suess.ul when role ode re

9ote that resoure volume is preserved updates o. role

Agenda



Agenda



&eploying a Servie

'pdating a Servie


'pdating the (ost OS



'pdating the (ost OSInitiated %y the Windows Azure team

Typially no more than one per month

6oal: update all mahines as uikly as possi%le

Constraint: must not violate servie S<A

Servie needs at least two update domains and role instane

Can?t allow more than one update domain o. any servie to %

time

9ote: your role instane keeps the same 3M and 3(&preserving ahed data in the resoure volume

1ssentially a graph oloring pro%lem

1dges e=ist %etween verties /nodes0 i. the two nodes host in

the same servie role in di..erent update domains

9odes that don?t have edges %etween them an update in pa

1=ample Alloations



1=ample AlloationsN >oth alloations are

valid .rom the

servies point o. viewN Alloation $ allows .or

2 nodes re%ooting

simultaneously

N Alloation 2 allows

only one node to %e

down at any time

N (ost OS upgrade

rollout is 2= .aster

with alloation $

Alloation $

Alloation 2

Servie A

Role A,$

'& $

Servie >

Role A,$

'& $

Servie ARole >,$

'& $

Servie >Role >,$

'& $

Servie A

Role A,$

'& 2

Servie ARole >,2

'& 2

Servie A

Role A,$

'& $

Servie A

Role >,$

'& $

Servie >

Role >,$

'& $

Servie

Role A,

'& 2

Servie

Role >,2

'& 2

Servie >

Role A,$'& 2

Agenda



Agenda



&eploying a Servie

'pdating a Servie


<oad >alaner Operation



<oad >alaner Operation

!C programs load %alaners /<>0 to )pro%e* gues

/6A0 every $8 seondsI. the guest misses two pro%es- the <> stops .orwardi

The role an report )%usy* status to the 6A

6A stops responding to pro%es

<> keeps an idle onnetion open .or "#s

'se keep,alive ommands i. the onnetion needs to

longer

9ode (ealth Inde=



9ode (ealth Inde=Timeouts vary depending on node state andoperation

>ased on heart%eats- whih are typially $8

seonds'sed .or status and reovery

(ealth state sampler resets the inde= on suess.ul poll

One the inde= .alls %elow zero- !C attempts to heal

node

!or e=ample- host agent timeout is $# minutes

Worst,ase reation time is timeout interval Eheart%eat interval

Missed

(eart%eats

(eart%eat

Interval

Missed

(eart%eatReovery

Initiated

(eart%eat

Timeout

(ealthTimeout

(ealthy

9ode and Role (ealth Maintenane



9ode and Role (ealth Maintenane

!C maintains servie availa%ility %y monitoring tso.tware and hardware health

>ased primarily on heart%eats

Automatially )heals* a..eted roles

Problem How Detected Fabric ResponseRole instance crashes FC guest agent monitors role

termination

FC restarts role

Guest VM or agentcrashes

FC host agent notices missingguest agent heartbeats

FC restarts VM arole

Host OS or agentcrashes

FC notices missing host agentheartbeat

Tries to recoer FC reallocates roother nodes

Detected nodehardware issue

Host agent in!orms FC FC migrates rolenodesMar"s node #ou

repair$

6uest Agent and Role Instane (eart%eats



6uest Agent and Role Instane (eart%eats

Timeouts

28 min

6uest

Agent

Connet

Timeout

6uest Agent

(eart%eat

8s

Role

Instane<aunh

Inde.inite

Role

Instane

Start

Role

Instane

Ready

/.or updates only0

$8 min

Role Instane

(eart%eat$8s

6uest Agent

(eart%eat Timeout

$# min

Role Instane

)'nresponsive* Timeout

"#s

<oad >alaner

(eart%eat

$8s

6uest Agent

Role Instane

Moving a Role Instane /Servie (eali



Moving a Role Instane /Servie (eali

Moving a role instane is similar to a servie up

On soure node:Role instanes stopped

3Ms stopped

9ode reprovisioned

On destination node:

Same steps as initial role instane deployment

Warning: Resoure 3(& is not moved

Conlusion



4lat.orm as a Servie is all a%out reduing manaand operations overhead

The Windows Azure !a%ri Controller is the .ouWindows Azure?s 4aaS

4rovisions mahines

&eploys servies

Con.igures hardware .or servies

Monitors servie and hardware health

The !a%ri Controller ontinues to evolve

>ook Signing and My <ast Session



g g y

>ook signing Tehed %ookstore: $2:"#,$:"#

Case o. the 'ne=plained 2:P8

Trak Resoures



&on?t .orget to visit the Cloud 4ower area within the T<C />lue Setion0 to see produspeak with e=perts a%out the Server Q Cloud 4lat.orm solutions that help drive your %

ou an also .ind the latest in.ormation a%out our produts at the .ollowing links:

Windows Azure , http:@@www5miroso.t5om@windowsazure@

Miroso.t System Center , http:@@www5miroso.t5om@systementer@

Miroso.t !ore.ront , http:@@[email protected]@

Windows Server , http:@@www5miroso.t5om@windowsserver@

Cloud 4ower , http:@@www5miroso.t5om@loud@

4rivate Cloud , http:@@www5miroso.t5om@privateloud@

Resoures

http://www.microsoft.com/windowsazure/

http://www.microsoft.com/systemcenter/

http://www.microsoft.com/forefront/

http://www.microsoft.com/windowsserver/

http://www.microsoft.com/cloud/






















www5miroso.t5om@tehed

Sessions On,&emand Q Community Miroso.t Certi.iation Q Traini

Resoures .or IT 4ro.essionals Resoures .or &evelo

www5miroso.t5om@le

http://microsoft.com/technet http:@@miroso.t5om@

Leag

http:@@northameria5mstehed5om

Connet5 Share5 &isuss5

http://www.microsoft.com/teched

http://www.microsoft.com/learning

http://microsoft.com/technet

http://microsoft.com/msdn

http://northamerica.msteched.com/

http://northamerica.msteched.com/

http://microsoft.com/msdn

http://microsoft.com/technet

http://www.microsoft.com/learning

http://www.microsoft.com/teched



Complete anevaluation onCommNet andenter to win!

Scan t2e !ag

t l t thi



to evaluate this

session now

on /y!ec24Ed

Moile



© 2011 icrosoft Corporation. ll rights reserved. icrosoft" #indows" #indows $ista and other product names are or ma% &e registered trademar's and/or trademar's in the (.). and/ *he information herein is for informational purposes onl% and represents the current view of icrosoft Corporation as of the date of this presentation. +ecause icrosoft must respond to changing mar'et c

&e a commitmenton the part of icrosoft" and icrosoft cannot guarantee the accurac% of an% information provided after the date of this presentation. ,C-)* ) N #--N*,)" 3-))" ,3L,4 - )**(*

3-)N**,N.

cos301 - inside windows azure, the cloud os

Documents