intro to nvidia gpus in azure · 2016-10-12 · top score. 15 visualization ... remote desktop...

SEOUL | Oct.7, 2016

In Kee Paek, 10/07/2016

Cloud Data Solution Architect

Microsoft

INTRO TO NVIDIA GPUS IN AZURE

2

GPU VIRTUALIZATION VISION

Deliver accelerated graphics & compute capabilities in Azure infrastructure

High end performance

Not “Swiss-army knife” offering

Helps achieve true “HPC in the Cloud”

Close partnership with NVIDIA

3

FINANCE FX Options

Risk Management

Fixed Income Analytics

Market data analysis

Hedge Fund management

4

MANUFACTURING OIL & GAS

Dynamic manipulation of Engineering

models and parts

Realistic material creation

Reservoir modelling and seismic

processing

Automotive engineering

5

MEDIA Stream high fidelity video games

Encoding and transcoding

Image processing

Social media sentiment analysis

6

RENDERING Visual Effects (VFX)

Ray-Tracing rendering

Advertising & Marketing

CAD Applications in Architecture

Simulations

7

TECHNOLOGY

DDA – Discrete Device Assignment

Introduced in Windows Server 2016 as part of Hyper-V

Pass-through PCIe devices directly to a Guest VM

Allows for close to bare-metal performance

8

DDA (DISCREET DEVICE ASSIGNMENT)

Entire device is mapped into the VM just as it would be running on bare metal

Allows for full access to capabilities of that device as well as allowing the device’s native driver to be used

Each device may be mapped to a single VM (1 device to 1 VM), but multiple devices can be mapped into the same VM (1 VM to many devices)

9

10

ARCHITECTURE

11

COMPUTE VIRTUAL MACHINES

12

TESLA K80 – “IT’S FAST…”

0x

5x

10x

15x

K80 CPU

Quantum Chemistry

Molecular Dynamics

PhysicsBenchmarks

13

RATE OF IMPROVEMENT

72%74%

84%

88%

93%

96%

65%

70%

75%

80%

85%

90%

95%

100%

2010 2011 2012 2013 2014 2015

GPU

65%

70%

75%

80%

85%

90%

95%

100%

8-2013 12-2014 5-2016

Accuracy

39%

45%

55%

62%66%

72%75%

79%83%

86%87.5%

30%

40%

50%

60%

70%

80%

90%

100%

Top Score

15

VISUALIZATION VIRTUAL MACHINES

16

REMOTE DESKTOP SERVICES

Graphics performance improvements through DDA

Enhanced support for OpenGL and OpenCL

Connection Broker capabilities to handle massive concurrent connections

Edge support

Pen support

Windows 10 and Mac preview available

17

NV VM DEMO

18

COLLABORATION WITH CNTK

First class citizen

Scalability – multi-GPU-multi-VM

Performance

Internal use-cases across various Microsoft properties and products

(DSVM) Data Science VM by Azure Machine Learning

N-Series and CNTK works really well together

19

CNTK PERFORMANCE ON DDA

2670

10560

18755

27575

35750

0

5000

10000

15000

20000

25000

30000

35000

40000

CPU 1 GPU 2 GPUs 3 GPUs 4 GPUs

Sam

ple

s p

er S

eco

nd

Resource

Avg. Samples/Sec Linear (Avg. Samples/Sec)

20

SUMMARY

High end platform

Support OpenGL and DirectX

Support OpenCL and CUDA

Support existing libraries and tools

Can utilize Azure higher-level services on top of GPU

Fulfill both Compute and Visualization use-cases

21

RESOURCES

http://blogs.technet.com/b/virtualization/archive/2015/11/23/discrete-device-assignment-gpus.aspx

https://azure.microsoft.com/en-us/blog/azure-n-series-preview-availability/

https://channel9.msdn.com/Shows/Tuesdays-With-Corey/Tuesdays-with-Corey-Azure-N-Series-GPU-Acceleration-in-the-public-cloud

SEOUL | Oct.7, 2016

THANK YOU