speech recognition powered by xilinx fpga for virtual
TRANSCRIPT
![Page 1: Speech Recognition Powered by Xilinx FPGA for Virtual](https://reader030.vdocuments.us/reader030/viewer/2022020916/61ab065257046d38c370f37c/html5/thumbnails/1.jpg)
Minwook Ahn
Module Leading Developer
2018.10.02
Speech Recognition powered by Xilinx FPGA
for Virtual Personal Assistant, NUGUPresented By
![Page 2: Speech Recognition Powered by Xilinx FPGA for Virtual](https://reader030.vdocuments.us/reader030/viewer/2022020916/61ab065257046d38c370f37c/html5/thumbnails/2.jpg)
XILINX CONFIDENTIAL
Contents
˃ Introduction: SK Group & SK Telecom
˃ NUGU: Virtual Personal Assistant
˃ SKT AIX: Neural Network Accelerator for NUGU on Xilinx FPGA
˃ Technical Roadmap
![Page 3: Speech Recognition Powered by Xilinx FPGA for Virtual](https://reader030.vdocuments.us/reader030/viewer/2022020916/61ab065257046d38c370f37c/html5/thumbnails/3.jpg)
XILINX CONFIDENTIAL
Introduction: SK Group & SK Telecom
NUGU AI Speaker
Navigation withNUGU HD Map Self-driving Car
Surveillance CloudMedia ServicesSK Telecom
SK Hynix
SK C&C
SK planet
No.1 Mobile Comm. in Korean
No.2 Memory Semiconductor Manufacturer in Global Market
Total IT Service Provider
Platform Provider
![Page 4: Speech Recognition Powered by Xilinx FPGA for Virtual](https://reader030.vdocuments.us/reader030/viewer/2022020916/61ab065257046d38c370f37c/html5/thumbnails/4.jpg)
XILINX CONFIDENTIAL
NUGU: Virtual Personal Assistant
![Page 5: Speech Recognition Powered by Xilinx FPGA for Virtual](https://reader030.vdocuments.us/reader030/viewer/2022020916/61ab065257046d38c370f37c/html5/thumbnails/5.jpg)
XILINX CONFIDENTIAL
NUGU: Virtual Personal Assistant
![Page 6: Speech Recognition Powered by Xilinx FPGA for Virtual](https://reader030.vdocuments.us/reader030/viewer/2022020916/61ab065257046d38c370f37c/html5/thumbnails/6.jpg)
XILINX CONFIDENTIAL
SKT AIX: Neural Network Accelerator for NUGU on Xilinx FPGA
![Page 7: Speech Recognition Powered by Xilinx FPGA for Virtual](https://reader030.vdocuments.us/reader030/viewer/2022020916/61ab065257046d38c370f37c/html5/thumbnails/7.jpg)
XILINX CONFIDENTIAL
FPGA Resource Utilization for SKT AIX
LUT as logicLUT as
memoryFlipFlop BRAM DSP
Available 663360 293760 1326720 2160 5520
Used 292781 24910 491916 1002 5212
Utilization 44.14% 8.48% 37.08% 46.39% 94.42%
![Page 8: Speech Recognition Powered by Xilinx FPGA for Virtual](https://reader030.vdocuments.us/reader030/viewer/2022020916/61ab065257046d38c370f37c/html5/thumbnails/8.jpg)
XILINX CONFIDENTIAL
SW stack for NUGU
![Page 9: Speech Recognition Powered by Xilinx FPGA for Virtual](https://reader030.vdocuments.us/reader030/viewer/2022020916/61ab065257046d38c370f37c/html5/thumbnails/9.jpg)
XILINX CONFIDENTIAL
SDK for SKT AIX
Neural Network designed by Caffe, Tensorflow, or MxNet
Compression (Quantization/Factorization)
Acceleration Op Creator
Neural Network Execution Engine
Accelerator opsCPU opsGPU ops
SKTAIX
DL Framework
SK AI Inference
SDK
SK AI Inference
Accelerator
![Page 10: Speech Recognition Powered by Xilinx FPGA for Virtual](https://reader030.vdocuments.us/reader030/viewer/2022020916/61ab065257046d38c370f37c/html5/thumbnails/10.jpg)
XILINX CONFIDENTIAL
SKT AIX performance
5x Performance16x Performance-Per-Watt
compared to GPU
0
5,000
10,000
15,000
20,000
25,000
0 20 40 100 120 140
fram
es/s
ec
60 80
# of channels
CPU-28Core GPU-TitanX AIX-FPGA
0.00
100.00
200.00
300.00
400.00
500.00
0 20 40 100 120 140
ms/
bat
ch
60 80
# of channels
CPU-28Core GPU-TitanX AIX-FPGA
Throughput according tonumber of concurrent channels
Latency according tonumber of concurrent channels
Environment: 28-Core CPU, 8-Batch
Power Consumption
CPU-28Core
GPU-TitanX
AIX-FPGA
150W
250 W
75 W 100 200
![Page 11: Speech Recognition Powered by Xilinx FPGA for Virtual](https://reader030.vdocuments.us/reader030/viewer/2022020916/61ab065257046d38c370f37c/html5/thumbnails/11.jpg)
XILINX CONFIDENTIAL
Technical Roadmap
3
![Page 12: Speech Recognition Powered by Xilinx FPGA for Virtual](https://reader030.vdocuments.us/reader030/viewer/2022020916/61ab065257046d38c370f37c/html5/thumbnails/12.jpg)
XILINX CONFIDENTIAL