building scalable cloud applications david aiken windows azure technical specialist microsoft...
TRANSCRIPT
Building Scalable Cloud Applications
David AikenWindows Azure Technical SpecialistMicrosoft Corporation
If the number of users/tasks in increases, can your application handle that?
1 Scale out
Web ServerCapability: 1000 requests/sec
Web ServerCapability: 1000 requests/sec
Load Balancer
State
Scaling Out with Windows Azure
demo
Web ServerCapability: 1000 requests/sec
Web ServerCapability: 1000 requests/sec
Load Balancer
State
1 Instance versus 5 Instances
Load Test 1000 Users1 Instance
• Max User Load 600 • Tests/Sec 1.69 • Tests Failed 371• Avg. Test Time (sec) 90.9 • Pages/Sec 5.43 • Avg. Page Time (sec) 34.3 • Requests/Sec 33.8 • Requests Failed 583 • Avg. Response Time (sec)
5.57
5 Instances
• Max User Load 600• Tests/Sec 13.9• Tests Failed 0• Avg. Test Time (sec) 21.1• Pages/Sec 43.5• Avg. Page Time (sec) 1.61• Requests/Sec 246• Requests Failed 0• Avg. Response Time (sec)
0.32
1
2
Scale out
Decouple tasks
Blob Storage
Web Role
Q
Worker Role
Blob Storage
Web Role
Scaling Out with Worker Roles
demo
Q
Worker Role
Blob Storage
Web Role
1000 runs
1 Instance 5 Instance 5 Instance Worker
Max User Load 600 600 600Test/Sec 1.69 13.9 15.2Tests Failed 371 0 0Avg. Test Time (sec) 90.9 21.1 19.5Pages/Sec 5.43 43.5 47.2Avg. Page Time (sec) 34.3 1.61 1.06Requests/Sec 33.8 246 262Requests Failed 538 0 0Avg. Response Time (sec) 5.57 0.32 0.22
1
2
3
Scale out
Decouple tasks
Cache static content
* We don’t actually have endpoints in these places.
Serve Content from the Edge24 global locations with 99.95% availability
CDN now works for web apps, not just for public blobs
CDN Blob StorageClosest Point of Presence
Possibly many hops or poor links
Few hops
Scaling Out with the CDN
demo
1
2
3
4
Scale out
Decouple tasks
Cache static content
Scale across data centers
Windows Azure Traffic Manager
Policies Monitoring
www.foo.net
DNS response
1.2.3.4
Scaling Out with Traffic Manager
demo
Summary1
2
3
4
5
Scale out – Tell us how many, we do the rest!
Use Workers and Queues to decouple expensive tasks
Use the CDN to cache static content
Use Traffic Manager to scale out across datacenters
Use Data Sync to synchronize data between datacenters
© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to
be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.