the 5g era: consumer devices of the future...42 tracking/inputs encoded data on-device adjustment to...

18
The 5G Era: Consumer Devices of the Future Tuesday, 22 October 2019 13:00 – 15:00

Upload: others

Post on 08-Apr-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

The 5G Era: Consumer Devices of the Future

Tuesday, 22 October 201913:00 – 15:00

Page 2: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

Director of Product ManagementQualcomm

Said Bakadir

Page 3: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

5G + AI + XR – Transforming the Mobile Industry for the Next Generation of Immersive ComputeSaid Bakadir

Director of XR Product ManagementQualcomm Technologies, Inc.

@qualcommOct 22, 2019

Page 4: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

31

XR is the next mobile computing platformEverything we’ve learned for smartphones will be used for XR

Laptop Smartphone XR glasses

Page 5: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

32

Connectingvirtually everything

Powering anXR world

Driving smarterexperiences

Healthcare

Transportation

Training

Construction

Utilities

Productivity

Emergency response

EntertainmentGaming

Education

Travel

Healthcare

Virtual world exploration

Retail

Social

Factory

The age of

5G, AI and XRConsumer Enterprise

Page 6: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

33

What does AI mean for XR?

AI improvesXR experienceson device

AI Agent

Virtual Assistant: Alexa-like avatar

Game agents

Contextual Awareness

Environment

Scene recognition

Always-on AI powered camera

When to show notifications

Object detection

Perception

AI based SLAM

Hand tracking

Body tracking

Eye tracking

Facial expression

Common Illumination

Multimedia

Illumination

Occlusion

Shader

Voice

Speech synthesis: text to speech or vice versa

Live translation

Page 7: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

34

AI Agent for guided XR instruction

Holographic AI Agent

Hand tracking

World trackingand registration foraugmented objects

Predictiveintelligence

Low latency motion tracking

Ultra reliable,low-latency wirelessconnection

Page 8: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

35

Transforming industries

Connecting virtually everythingat the wireless edge

Redefined computing

Desktop tosmartphones

Digitized mobile communications

Analogto digital

Evolution of mobile innovation…

Transforming how the world connects, computes and communicates

Page 9: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

3636Based on ITU vision for IMT-2020 compared to IMT-advanced; URLLC: Ultra Reliable Low Latency Communications; IAB: Integrated Access & Backhaul

Designing a unified, more capable 5G air interface

10xConnection density

3xSpectrumefficiency

10xDecrease inend-to-end latency

10xExperienced throughput

100xTrafficcapacity

100xNetwork efficiency

Enhanced mobilebroadband

Diversedeployments

Mid-bands1 GHz to 6 GHz

High-bandsAbove 24 GHz (mmWave)

Low-bandsBelow 1 GHz

Diversespectrum

Licensed/shared/unlicensed

Page 10: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

37

20+Operatorsannounced

20+OEMsannounced

5G rollout happening faster than 4G

4Operatorslaunched

3OEMslaunched

Source: IHS Report Jan ’19, Qualcomm Technologies data

Year 1 announcements underscore tremendous momentum with 5G

Page 11: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

38

1990sDigital voiceSMS

2000sMobile dataMMS and video calling

1980sAnalog voiceVoice call

2010sMobile broadbandEnhanced Video calling

2019+Enhanced Mobile BroadbandHolographic telepresence

Evolution of social communications buildingon decades of breakthrough technologies

Page 12: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

39

HolographicTelepresence

Real time social interaction

Spatialcomputing

39

Page 13: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

40

Page 14: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

41

Building the vision of converged XR

AR

VR

Existing Processing

Standalone Processing

Distributed Processing

(Wireless Proximity)

DistributedProcessing

(Mobile Edge Computing)Converged XR

(Mobile Edge Computing)

USB3-DP

Distributed Processing

(Cabled Proximity)

60 ghZ 5G 5G

Page 15: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

42

Tracking/Inputs

Encoded data On-device adjustment to latest pose1

XR headset

Deeperin network

On-premise, e.g. venue

with rendering

Cloud

Boundless XR over 5G – Distributed IntelligenceThe public or private 5G edge will augment on-device processing

1. Asynchronous time warp reduces Motion to Photon (MTP) latency by using on-device processing based on the latest available pose. MTP below 20 ms generally avoids discomfort — has to be processed on the device

Edge Cloud

Partial rendering offload possible with 5G’s low latency, capacity and quality of service

Power-efficient, latency sensitive on-device rendering and tracking

Today’s latency is unpredictable

Less latency sensitive content (e.g. recorded streaming video)

with on-device processing

Page 16: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

43

ODMs, OEMs

Platforms, Technology

Platform Content

Collaboration within the XR

ecosystem

OperatorsEnd

Users

consumer

enterprise

Page 17: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

44

The path to convergence

ComputeSystems:

Entertainment:

Telecomm:

Mainframecomputer

Workstation DesktopPC

Laptop Tablet Smartphone

Theater Movies Home Television

Home Phone Large CellularPublic Phone Feature Phone

Laptop Tablet Smartphone

Smartphone

Page 18: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering

Nothing in these materials is an offer to sell any of the components or devices referenced herein.

©2018-2019 Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved.

Qualcomm is a trademark of Qualcomm Incorporated, registered in the United States and other countries. Other

products and brand names may be trademarks or registered trademarks of their respective owners.

References in this presentation to “Qualcomm” may mean Qualcomm Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate structure, as applicable. Qualcomm Incorporated includes Qualcomm’s licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm

Incorporated, operates, along with its subsidiaries, all of Qualcomm’s engineering, research and development functions, and all of its product and services businesses, including its semiconductor business, QCT.

Follow us on:

For more information, visit us at:

www.qualcomm.com & www.qualcomm.com/blog

Thank you

@BakadirS