lecture 17 case study: diannao (part 2) · case study: diannao (part 2) class project teams •...

13
Xuan ‘Silvia’ Zhang Washington University in St. Louis http:// classes.engineering.wustl.edu /ese566/ Lecture 17 Case Study: DianNao (Part 2)

Upload: others

Post on 21-May-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Lecture 17 Case Study: DianNao (Part 2) · Case Study: DianNao (Part 2) Class Project Teams • Team 1 – Andrew Ellison, Shixuan Zhang ... – artificial neural network (ANN) –

Xuan ‘Silvia’ Zhang Washington University in St. Louis

http://classes.engineering.wustl.edu/ese566/

Lecture 17 Case Study: DianNao (Part 2)

Page 2: Lecture 17 Case Study: DianNao (Part 2) · Case Study: DianNao (Part 2) Class Project Teams • Team 1 – Andrew Ellison, Shixuan Zhang ... – artificial neural network (ANN) –

Class Project Teams

•  Team 1 –  Andrew Ellison, Shixuan Zhang

•  Team 2 –  Brett Gilpin, Matthew Wedrewer, Nestor Gonzalez

•  Team 3 –  Weidong Cao, Liu Ke, Xinyao Li

•  Team 4 –  Meizhi Wang, Longzhen Zhang, An Zou

•  Team 5 –  Yuyang Li, Yu Liu, Qilan Ding

•  Team 6 –  Chenxi Yin, Yuyao Hu

•  Team 7 –  Wenmei Bo, Jizhou Huang, Bojun Li

2

Page 3: Lecture 17 Case Study: DianNao (Part 2) · Case Study: DianNao (Part 2) Class Project Teams • Team 1 – Andrew Ellison, Shixuan Zhang ... – artificial neural network (ANN) –

DianNao (ASPLOS 2014)

•  ASPLOS –  ACM International Conference on Architectural Support

for Programming Languages and Operating Systems –  other examples: ISCA, MICRO, HPCA, ISSCC, JSSC, DAC

•  Ubiquitous Machine Learning –  artificial neural network (ANN) –  convolutional neural network (CNN) –  deep neural network (DNN)

•  High-Throughput –  large-scale neural network –  impact of memory

3

Page 4: Lecture 17 Case Study: DianNao (Part 2) · Case Study: DianNao (Part 2) Class Project Teams • Team 1 – Andrew Ellison, Shixuan Zhang ... – artificial neural network (ANN) –

Neural Network Hierarchy

4

Page 5: Lecture 17 Case Study: DianNao (Part 2) · Case Study: DianNao (Part 2) Class Project Teams • Team 1 – Andrew Ellison, Shixuan Zhang ... – artificial neural network (ANN) –

5

Page 6: Lecture 17 Case Study: DianNao (Part 2) · Case Study: DianNao (Part 2) Class Project Teams • Team 1 – Andrew Ellison, Shixuan Zhang ... – artificial neural network (ANN) –

6

Page 7: Lecture 17 Case Study: DianNao (Part 2) · Case Study: DianNao (Part 2) Class Project Teams • Team 1 – Andrew Ellison, Shixuan Zhang ... – artificial neural network (ANN) –

7

Page 8: Lecture 17 Case Study: DianNao (Part 2) · Case Study: DianNao (Part 2) Class Project Teams • Team 1 – Andrew Ellison, Shixuan Zhang ... – artificial neural network (ANN) –

Hardware Implementation for Small NN

8

Page 9: Lecture 17 Case Study: DianNao (Part 2) · Case Study: DianNao (Part 2) Class Project Teams • Team 1 – Andrew Ellison, Shixuan Zhang ... – artificial neural network (ANN) –

Neural Functional Unit (NFU)

9

Page 10: Lecture 17 Case Study: DianNao (Part 2) · Case Study: DianNao (Part 2) Class Project Teams • Team 1 – Andrew Ellison, Shixuan Zhang ... – artificial neural network (ANN) –

Local Transpose in NBin

10

Page 11: Lecture 17 Case Study: DianNao (Part 2) · Case Study: DianNao (Part 2) Class Project Teams • Team 1 – Andrew Ellison, Shixuan Zhang ... – artificial neural network (ANN) –

Layer Code

11

Page 12: Lecture 17 Case Study: DianNao (Part 2) · Case Study: DianNao (Part 2) Class Project Teams • Team 1 – Andrew Ellison, Shixuan Zhang ... – artificial neural network (ANN) –

Area and Power Breakdown

12

Page 13: Lecture 17 Case Study: DianNao (Part 2) · Case Study: DianNao (Part 2) Class Project Teams • Team 1 – Andrew Ellison, Shixuan Zhang ... – artificial neural network (ANN) –

Questions?

Comments?

Discussion?

13