revolutionizing the user experience through secure neural network acceleration at the...

REVOLUTIONIZING THE USER EXPERIENCE THROUGH SECURE

NEURAL NETWORK ACCELERATION AT THE EDGE

Huibert Verhoeven – SVP & GM IoT Division

© 2019 Synaptics Incorporated 2

NEURALNETWORKS

1986 - Synaptics was founded to commercialize analog neural network

chips for ultra-low power pattern matching

Action potential

Pre-synaptic(“sending”) cell

SYNAPSE

Post-synaptic(“receiving”) cell


Advanced Underlying Technologies

Far-field Voice and

Speech Capture

Acoustics and Audio

Output Processing

Video and Image

Processing

Optical Imaging

Display Driver and

Integrated Sensing

Capacitive Sensing Machine Learning


What is Synaptics’ HMI Vision?

Human machine interface so ubiquitous, intuitive and natural

that we lose conscious awareness of our interactions


Global Adoption of Voice UI – What are the Pain Points?

3%

6%

8%

10

%

64

%

2018 GLOBAL SMART SPEAKER INSTALLED BASE

US

Source: Canalys estimates and forecasts, Smart Speaker Analysis, May 2018

CONSUMER CONCERNS WITH VOICE UI

CHINA UK GERMANY SOUTH KOREA

41% 40% 46%

Privacy Security Data Control

Source: Accenture global survey, Reshape to Relevance, January 2019

CONSUMER EXPECTATIONS IN USABILITY

Home Security

Home Automation

Paying Bills

Virtual Medical Advice

61%

59%

55%

52%


Secure Inferencing at the Edge Addresses Consumer Concerns

• User identifiable data stays

on device while only

abstracted data sent to the

cloud

• Multimodal interface where

audio and video streams are

not sent to the cloud

• Functions handled locally –

Home control and security

functions performed with

lower latency

• Contextual awareness

anticipates user intent

• Functions handled locally –

available even in case of an

outage

• Out of the box voice UI

experience for appliances

etc.

PRIVACY LATENCY ROBUSTNESS


Evolution of the Voice Interface

Voice primarily for calling• Home phones

• Mobile devices

• PCs

Voice enhanced for far-field• Focus on speech recognition

• Enabled with cloud intelligence

Superior voice experience

through local intelligence• Personalized

• Better privacy

• Increased accuracy

• Multimodal

Voice 1.0 Voice 2.0 Voice 3.0


SoC

CPUAI

Typical Voice 2.0 Architecture

SoC

CPUDSP

Remote Attack

AI

Non-secure Mic-to-cloud


Remote Attack

How Do We Implement Voice 3.0?

SoC

Neural Network

Engine

CPU

Secure Processor

TEE

Secure Processor

Secure Mic-to-cloud

AI


Voice 3.0 – Smart Edge Case Study

Morning That would be

great, thanks!

Hi, Steve. Would you like

your usual morning latte?


Voice 3.0 – Smart Edge Case Study

Afternoon Yes, that’s exactly

what I need right now

You look tired, Steve. Should

I make your afternoon

double espresso?


Smart Home Multi Modal Applications


Synaptics has Differentiated Technologies for next-gen HMI

• Far-field Voice & Smart

Trigger Technology

• Analog / Mixed Signal

Solutions

• Flexible & Purpose-built

Audio Processors

• High-Performance,

Multi-Standard, Multi-

Stream Video Codecs

• Leading Edge PQ

Enhancement Engine

• Memory Bandwidth

Efficient Video and

Display Engines

Voice / Audio Video / Display AI Security / Privacy

• Secure Multimedia Paths

through the SoC

• Carrier-Grade Security

• Designed to Withstand

Side-Channel Attacks

• Security Frameworks

Apply to Android TV,

Android Open Source,

& Linux

• Video/Audio/Voice

Analytics

• Adaptive UX through

Contextual Awareness

• Local ASR & NLP

Accelerators


SyNAP™ Hardware Capabilities

<1 TOPS (GPU) 1 TOPS (Dedicated NPU) >4 TOPS (Dedicated NPU)

STBsSpeakers, Soundbars, Wi-Fi Mesh,

AppliancesSTBs, Smart Displays

Video Analytics AIVoice and Sensor

Real-Time AI

Voice, Video, Imaging

Real-Time AI

CPU GPU CPU NPU CPU NPU GPU


Why We Selected SOI

Our HMI vision requires low power, significant

computation, and dedicated neural network

hardware


22nm SOI is a Goldilocks IoT Process Node

0

0,5

1

1,5

2

2,5

3

3,5

28nm 22nm SOI 12/14nm

Active Power Unit Cost Investment

© 2019 Synaptics Incorporated

Synaptics, the Synaptics logo, TouchPad, ClickPad, SecurePad, ClearPad, ClearView, Synaptics TouchView, Natural ID, ClearForce,

SentryPoint, AudioSmart, VideoSmart, ImagingSmart, SyNAP, Design Studio, Image Studio and SafeSense are trademarks or

registered trademarks of Synaptics Incorporated or its affiliates in the United States and/or other countries. All other brands and

names may be trademarks of their respective owners.

revolutionizing the user experience through secure neural network acceleration at the...

Documents