building scalable cloud applications david aiken windows azure technical specialist microsoft...

Building Scalable Cloud Applications

David AikenWindows Azure Technical SpecialistMicrosoft Corporation

If the number of users/tasks in increases, can your application handle that?

1 Scale out

Web ServerCapability: 1000 requests/sec

Web ServerCapability: 1000 requests/sec

Load Balancer

State

Scaling Out with Windows Azure

demo

Web ServerCapability: 1000 requests/sec

Web ServerCapability: 1000 requests/sec

Load Balancer

State

1 Instance versus 5 Instances

Load Test 1000 Users1 Instance

• Max User Load 600 • Tests/Sec 1.69 • Tests Failed 371• Avg. Test Time (sec) 90.9 • Pages/Sec 5.43 • Avg. Page Time (sec) 34.3 • Requests/Sec 33.8 • Requests Failed 583 • Avg. Response Time (sec)

5.57

5 Instances

• Max User Load 600• Tests/Sec 13.9• Tests Failed 0• Avg. Test Time (sec) 21.1• Pages/Sec 43.5• Avg. Page Time (sec) 1.61• Requests/Sec 246• Requests Failed 0• Avg. Response Time (sec)

0.32

1

2

Scale out

Decouple tasks

Blob Storage

Web Role

Q

Worker Role

Blob Storage

Web Role

Scaling Out with Worker Roles

demo

Q

Worker Role

Blob Storage

Web Role

1000 runs

1 Instance 5 Instance 5 Instance Worker

Max User Load 600 600 600Test/Sec 1.69 13.9 15.2Tests Failed 371 0 0Avg. Test Time (sec) 90.9 21.1 19.5Pages/Sec 5.43 43.5 47.2Avg. Page Time (sec) 34.3 1.61 1.06Requests/Sec 33.8 246 262Requests Failed 538 0 0Avg. Response Time (sec) 5.57 0.32 0.22

1

2

3

Scale out

Decouple tasks

Cache static content

* We don’t actually have endpoints in these places.

Serve Content from the Edge24 global locations with 99.95% availability

CDN now works for web apps, not just for public blobs

CDN Blob StorageClosest Point of Presence

Possibly many hops or poor links

Few hops

Scaling Out with the CDN

demo

1

2

3

4

Scale out

Decouple tasks

Cache static content

Scale across data centers

Windows Azure Traffic Manager

Policies Monitoring

www.foo.net

DNS response

1.2.3.4

Scaling Out with Traffic Manager

demo

Summary1

2

3

4

5

Scale out – Tell us how many, we do the rest!

Use Workers and Queues to decouple expensive tasks

Use the CDN to cache static content

Use Traffic Manager to scale out across datacenters

Use Data Sync to synchronize data between datacenters

© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to

be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.