djinn and tonic: dnn as a service and its implications for future … · 2017-04-09 · djinn and...

3
DjiNN and Tonic: DNN as a Service and Its Implications for Future Warehouse Scale Computers Johann Hauswald, Yiping Kang, Michael A. Laurenzano, Quan Chen, Cheng Li, Trevor Mudge, Ronald G. Dreslinski, Jason Mars, Lingjia Tang University of Michigan — Ann Arbor, MI

Upload: others

Post on 16-Mar-2020

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: DjiNN and Tonic: DNN as a Service and Its Implications for Future … · 2017-04-09 · DjiNN and Tonic: DNN as a Service and Its Implications for Future Warehouse Scale Computers

DjiNN and Tonic: DNN as a Service and Its Implications for Future Warehouse Scale Computers

Johann Hauswald, Yiping Kang, Michael A. Laurenzano, Quan Chen, Cheng Li, Trevor Mudge, Ronald G. Dreslinski, Jason Mars, Lingjia Tang

University of Michigan — Ann Arbor, MI

Page 2: DjiNN and Tonic: DNN as a Service and Its Implications for Future … · 2017-04-09 · DjiNN and Tonic: DNN as a Service and Its Implications for Future Warehouse Scale Computers

1. DNN ExtractionImage Classification

Digit Recognition

Facial Recognition

Speech Recognition

Natural Language Processing

3. Server Design

Deep Neural Networks (DNN) as a Service

Integrated GPU

djinn.clarity-lab.org

CPU-Only

2. High Throughput

DisaggregatedGPU

Page 3: DjiNN and Tonic: DNN as a Service and Its Implications for Future … · 2017-04-09 · DjiNN and Tonic: DNN as a Service and Its Implications for Future Warehouse Scale Computers

133x 771xReal System

4-20xTCO Improvement

First session right now

djinn.clarity-lab.org