grid computing with 256 windows azure worker roles & kinect alan smith march 2013

42
Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Upload: piers-chapman

Post on 27-Dec-2015

215 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Grid Computing with 256 Windows Azure Worker Roles & KinectAlan Smith March 2013

Page 2: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Alan Smith

@alansmithDeveloper, Trainer, Mentor, EvangelistWindws Azure MVPWindows Azure InsiderFrom the UK, Living in StockholmPassionate about ”The Cloud” and the dev community.

Page 3: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 4: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 5: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Render Times

Film Render Hours

Madagascar: Escape 2 Africa

• 30,000,000• 3,400 years

Monsters vs. Aliens • 40,000,000• 5,500 years

Some of the frames required for Devastator in Transformers 2 took up to 72 hours.

Page 6: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 7: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

viewpoint{ from <4.000, -1.000, 1.000> at <0.000, 0.000, 0.000> up <0, 1, 0> angle 60 resolution 640, 480 aspect 1.6 image_format 0}

light <-10, 30, 20>light <-10, 30, -20>

object { disc <0, -2, 0>, <0, 1, 0>, 30 wooden }object { sphere <0.000, 0.000, 0.000>, 1.00 chrome }object { cylinder <0.000, 0.000, 0.000>, <0.000, 0.000, -4.000>, 0.50 chrome }

Page 8: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 9: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 10: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 11: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 12: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Depth Range

KinectSensor

Page 13: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 14: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 15: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 16: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

267 seconds * 2000 frames = 6 days 4 hours

Page 17: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

On-Premise Computing Costs

Nodes Cost1 $50010 $5,000100 $50,0001000 $500,00010,000 $5,000,000

Assuming a cost of $500 per node

Page 18: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Cloud Computing Costs

Nodes Hours Cost

1 10,000 $1,200

10 1,000 $1,200

100 100 $1,200

1,000 10 $1,200

Theoretical compute cost for a 10,000 hour render job

Page 19: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 20: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Technologies Used

• Windows Azure Worker Roles• Windows Azure Storage

• Blobs, Queue, Tables• Windows Azure Media Services• Windows Azure Websites

Page 21: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Windows Azure

Compute – Worker RolesAzure StorageJob Queue

Blob Storage

Frame Queue

On-Premise

Animation Creator Process Monitor

Encode Queue

Depth Images

Scene Files

Frames

Websites Media Services

Table Storage

Job Stas

WorkerRole

Stasts

Page 22: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Worker RoleKinect App

Animation Job Processing

Windows Azure Storage

Viewpoint 10,6,0Light 10,6,7Light 10,8,-4Sphere 0,0,0Cylinder 0,1,0

Windows Azure Storage

Viewpoint 10,6,0Light 10,6,7Light 10,8,-4Sphere 0,0,0Cylinder 0,1,0

Viewpoint 10,6,0Light 10,6,7Light 10,8,-4Sphere 0,0,0Cylinder 0,1,0

Viewpoint 10,6,0Light 10,6,7Light 10,8,-4Sphere 0,0,0Cylinder 0,1,0

Viewpoint 10,6,0Light 10,6,7Light 10,8,-4Sphere 0,0,0Cylinder 0,1,0

Page 23: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Worker Role

Render Job Processing

Windows Azure Storage

Windows Azure Storage

Local Storage

Viewpoint 10,6,0Light 10,6,7Light 10,8,-4Sphere 0,0,0Cylinder 0,1,0

PolyRay.exe

Page 24: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Worker Role

Encode Job Processing

Windows Azure Storage

Windows Azure Storage

Local Storage

VirtualDub.exe

Windows Azure Media Services

Windows Azure Websites

Page 25: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Windows AzureCompute – Worker Roles Windows Azure Storage

Event Queue

Role Lifecycle Table

On-Premise

Process Monitor

Event Viewer

RoleId Status Frames Time

192938Runnin

g34

2:08:23

192939Runnin

g30

2:07:03

192940Runnin

g35

2:03:28

192941Runnin

g31

2:00:56

192942Runnin

g29

1:58:17

Monitoring 256 Worker Roles

Page 26: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Global Windows Azure Bootcamp – April 27th

Page 27: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 28: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentations. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Thank youAlan SmithDeveloper, Trainer, Mentor, EvangeistWindows Azure MVP, Windows Azure [email protected]

Page 29: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Click to add title

Page 30: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Use this as an alternative slide when title type is longer than one line.

Page 31: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Use this as an alternative slide when title type is longer than one line.

Page 32: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 33: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 34: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 35: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013
Page 36: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Use this slide as a transition.

Page 37: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Use this slide for charts or large images where a color bar at the top is distracting.

Category 1 Category 2 Category 3 Category 40

1

2

3

4

5

6

Page 38: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Title Slide

Page 39: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

t

Title Slide

Page 40: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

Alan [email protected]

Grid Computng with 256 Windows Azure Worker Roles & Kinect

Page 41: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

RégisLaurentDirector of Operations, Global KnowledgeCompetencies include:Gold LearningSilver System Management

Page 42: Grid Computing with 256 Windows Azure Worker Roles & Kinect Alan Smith March 2013

RégisLaurentDirector of Operations, Global KnowledgeCompetencies include:Gold LearningSilver System Management

Use this slide as a title or transition.