scaling 5g and ai for the next generation of robotics › media › documents › files › ... ·...

17
Dev Singh, Senior Director Head of Robotics, Drones and Intelligent Machines Qualcomm Technologies, Inc. June 2020 @DevSingh_QCOM Scaling 5G and AI for the Next Generation of Robotics

Upload: others

Post on 25-Jun-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

Dev Singh, Senior Director

Head of Robotics, Drones and Intelligent Machines

Qualcomm Technologies, Inc.

June 2020 @DevSingh_QCOM

Scaling 5G and AI for the Next Generation of Robotics

Page 2: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

22

Manufacturing Retail Energy Smart citiesRobotics

Asset management

Logistics / warehousing

Security and surveillance

HealthcareSmart displays and collaboration

Driving digital transformation of business and enterprise11,000+ customers across multiple segments

Page 3: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

33

Qualcomm Technologies areaddressing diverse robotic challenges

Delivery Companion

Entertainment First responder andpublic safety

Warehouse/logistic Factory

Retail Agriculture Home care

Page 4: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

44

Robotic opportunities we are focused on

Ind

ustr

ial

Co

mm

erc

ial

Co

nsu

me

rLogistics Manufacturing Construction Agriculture Forklifts Drones

Commercialfloor cleaning

Hospital Security Packagedelivery

Retail Commercialmowers

Drones

Consumerfloor care

Lawncare

Poolcleaning

Toy Technicaleducation

Personalassistants

Drones

Page 5: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

55

Intuition Robotics

CerevoAWS Robomaker Brain Corp CloudMinds

Ecovacs

Clearpath

iRobotHitachi

AttaboticsAlibaba

JPL

FLIR JD.com

LGKinova Robotics

Gotting

Misty Robotics NuroNaverNASA Nilfisk

Nuwa RoboticsNXT Panasonic Phoenix Contact

Preferred Networks

Parrot

Rexroth

Orion

Robotis Roborock Sharp

Softbank Robotics

Siemens

Skydio

Samsung

Sony

Siasun

Weidmüller

ZEROTECH

ZeroZeroYasikawaUBTech

Numerous robotics products launched

Page 6: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

66

Memorysubsystem & IOs

Video engine

Location

CPUs

GPU

Display engine

DSPCamera ISPModemLTE

ComprehensiveQualcomm

Technologies for Robotics

ConnectivityWi-Fi, LTE/5G, CBRS

SecurityAuthentication and execution

CameraComputer vision

On-boardintelligenceHard real-time control for autonomous navigation

High-fidelity sensorprocessing

Precise localization

HLOSLinux, ROS

AI / Machine learningDetection, classification,navigation and engagement

High performance /integrated SOC

Optimized heterogeneouscomputing platform, at low power

and small form-factors

Page 7: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

7Source: 1ABI Research, 2019; 2Strategy Analytics, 2019; 3Allied Market Research May 2020

17M homecleaning robots

in 20201

5Min 20252

1M professional service robots in

20202

1.5M drones

sold in 20201

4Min 20251

60M robots (& drones)

deployed in 2020 –

doubled by 20251

Robotics technologyindustry size to reach

$170 billionby 20273

Roboticsindustry

37Min 20251

Page 8: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

8Qualcomm SDA/SDM845 and Qualcomm Robotics RB3 Platform are products of Qualcomm Technologies, Inc. and/or its subsidiaries.

Launched a dedicated platformto build smart, power-efficientand cost-effective large industrialand enterprise robots to smallbattery-operated one’s withchallenging power and thermaldissipation requirements

Linux, ROS,AWS RoboMaker

Vault-like hardware-based security

Commercializationchoices: dev kit,SOM, chip-on-board

Wi-Fi and cellularconnectivity(4G/LTE, CBRSand support for 5G)

Artificial intelligence(AI) engine for on-device machine learning

Multimedia Multiple cameras& sensors

Computer vision

High performance, heterogenous computing

on Qualcomm® SDA/SDM845

Memorysubsystem & IOs

Video engine

Location

CPUs

GPU

Display engine

DSPCamera ISPModemLTE

Page 9: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

9

Local value

Efficiency

Privacy

Security

New experiences

Autonomy

Personalization

Immediacy

The age of

5G and AIBillions of connected things

Massive amounts of data

Powering new services at the wireless edge

Page 10: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

1010

On-device processingand sensing

Single 5Gnetwork

Edge services anddata privacy

Flexibility with wireless Ethernet

Scalable capacity and reliability

CV and AI for autonomous machines

Industry 1.0Mechanization

Industry 2.0Electrification

Industry 3.0Digitalization

Industry 4.0

5G takes Industry 4.0 and Roboticsto the next level

Connectivity Compute| Security |

5GConnectivity

Page 11: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

11Qualcomm Robotics RB5 Platform is a product of Qualcomm Technologies, Inc. and/or its subsidiaries.

World’s first5G and AI-enabled robotics platform

Page 12: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

12

Scaling5G andAI for next generation robotics High-tier

LaunchPremium tierExpand

20202019

Page 13: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

1313

Robotic opportunities andQualcomm Robotics RB5 platform target segments

Ind

ustr

ial

Co

mm

erc

ial

Co

nsu

me

r

Logistics Manufacturing Construction Agriculture Forklifts Drones

Commercialfloor cleaning

Hospital Security Packagedelivery

Retail Commercialmowers

Drones

Consumerfloor care

Lawncare

Poolcleaning

Toy Technicaleducation

Personalassistants

Drones

Targetsegments

Page 14: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

1414

Qualcomm QRB5165, Qualcomm AI Engine, Qualcomm Hexagon Tensor Accelerator, Qualcomm Spectra 480, Qualcomm Neural Processing SDK.,

Qualcomm Fast CV Computer Vision SDK, Qualcomm Robotics Vision SDK are products of Qualcomm Technologies, Inc. and/or its subsidiaries.

QRB5165 – Integrated premium tier robotics SoC

High-performance heterogeneous computing (15 TOPS) at ultra-low power consumption

5th generation Qualcomm ® Artificial Intelligence (AI) Engine for on-device machine learning

Dedicated Qualcomm® Hexagon™ Tensor Accelerator delivering 8 TOPS for accurate edge inferencing

8K video, 4K HDR, 200MP photo, & 7-camera concurrency enable fully autonomous robots

Qualcomm ® Spectra™ 480 CV-ISP featuring 2-Gigapixel/sec ISPs & visual analytics hardware engine enables computer vision apps

From crypto to DRM, the secure processing unit helps to secure robots at every level

Cellular (LTE / 5G / CBRS) and Wi-Fi for ubiquitous connectivity

AI, CV and Software

Qualcomm® Neural Processing SDK for advanced on-device AI

Qualcomm® FastCV Computer Vision SDK offers rich vision processing functionality

Qualcomm® Robotics Vision SDK provides localization, feature recognition and obstacle detection

Linux, Ubuntu, ROS 2, AWS RoboMaker round out end-to-end robotic application development

Industrial Grade

Operates in harsh industrial conditions & temperature range of -30°C to 105°C TJ, and has long lifecycle support

Communicates via industrial protocols such as EtherCAT & TSN

Flexible commercialization choices: System-on-Module, chip-on-board, package-on-package (POP)/non-POP packages

QRB5165

5G

PMIC

Linux

Robotics vision SDK

CV AI

ROS 25G

PMIC

Wi-Fi /BT

Charging

Page 15: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

1515

Purpose built robotics development kit

Motor Control MezzanineBrushed DC control driverBrushless DC control driverDynamixel smart motor driverStepper motor driverServo motor driverI/O expansion

5G MezzanineSub6, Quectel RM500Q-GLSub6 + mmWave, Quectel RM510Q-GL

Sensor MezzanineSingle and Dual IMU

MagnetometerPressure sensor

Temperature sensorChirp sensor

Digital PDM micMotor drivers

Dynamixel motors

Industrial MezzanineEtherCAT

EtherNet/IPModbus-TCP

PROFINET

SoftwareUbuntu, LinuxRobot Operating System 2 (ROS 2)AWS RoboMakerQualcomm Neural Processing SDKQualcomm Robotics Vision SDK Qualcomm FastCV Computer VisionSDK

Vision Mezzanine12MP Main camera, IMX577

Tracking camera, OV9282Depth camera, Intel RealSense D435i

TOF camera, Panasonic V4TGMSL2 camera, LI-AR0231

IMU, compass, pressure

Page 16: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

16

BuildingBetterRobots,Drones &Intelligent Machines

Collaboration withmultiple ODM/CM,technology, andplatform companies

Prototype and commercialize robots quickly with fewerresource restraints

QualcommRobotics RB5 Platform

QualcommRobotics RB3 Platform

QualcommFlight™ Pro

Chipsets Software/Tools

Hardware/Platforms

Ecosystem &support

Qualcomm Neural Processing Enginefor AI/ML

OpenCL andQualcomm®

Computer Vision SDK

OpenCV and Open GL

Machine Vison SDK

Purpose builtsilicon roadmapfor Robotics

AWS RoboMaker

Linux

ROS 2

Altek

ModalAI

TDK Invensense

Thundercomm

16Qualcomm QCS605, Qualcomm QCS603, Qualcomm QCS405, Qualcomm QCS403, Qualcomm Computer Vision SDK, Qualcomm Flight Pro are products of Qualcomm Technologies, Inc. and/or its subsidiaries.

QCS405QCS404

Good

QCS605QCS603

Better

Best SDA845QRB5165

Page 17: Scaling 5G and AI for the Next Generation of Robotics › media › documents › files › ... · analytics hardware engine enables (EVA) computer vision apps, VIO, SLAM, DFS Qualcomm®

Follow us on:

For more information, visit us at:

www.qualcomm.com & www.qualcomm.com/blog

Thank you

Nothing in these materials is an offer to sell any of the

components or devices referenced herein.

©2018-2020 Qualcomm Technologies, Inc. and/or its

affiliated companies. All Rights Reserved.

Qualcomm an Hexagon are trademarks of Qualcomm

Incorporated, registered in the United States and other

countries. Other products and brand names may be

trademarks or registered trademarks of their respective

owners.

References in this presentation to “Qualcomm” may mean Qualcomm

Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries

or business units within the Qualcomm corporate structure, as

applicable. Qualcomm Incorporated includes Qualcomm’s licensing

business, QTL, and the vast majority of its patent portfolio. Qualcomm

Technologies, Inc.,

a wholly-owned subsidiary of Qualcomm Incorporated, operates, along

with its subsidiaries, substantially all of Qualcomm’s engineering,

research and development functions, and substantially all of its product

and services businesses, including its semiconductor business, QCT.