the 5g era: consumer devices of the future...42 tracking/inputs encoded data on-device adjustment to...
TRANSCRIPT
The 5G Era: Consumer Devices of the Future
Tuesday, 22 October 201913:00 – 15:00
Director of Product ManagementQualcomm
Said Bakadir
5G + AI + XR – Transforming the Mobile Industry for the Next Generation of Immersive ComputeSaid Bakadir
Director of XR Product ManagementQualcomm Technologies, Inc.
@qualcommOct 22, 2019
31
XR is the next mobile computing platformEverything we’ve learned for smartphones will be used for XR
Laptop Smartphone XR glasses
32
Connectingvirtually everything
Powering anXR world
Driving smarterexperiences
Healthcare
Transportation
Training
Construction
Utilities
Productivity
Emergency response
EntertainmentGaming
Education
Travel
Healthcare
Virtual world exploration
Retail
Social
Factory
The age of
5G, AI and XRConsumer Enterprise
33
What does AI mean for XR?
AI improvesXR experienceson device
AI Agent
Virtual Assistant: Alexa-like avatar
Game agents
Contextual Awareness
Environment
Scene recognition
Always-on AI powered camera
When to show notifications
Object detection
Perception
AI based SLAM
Hand tracking
Body tracking
Eye tracking
Facial expression
Common Illumination
Multimedia
Illumination
Occlusion
Shader
Voice
Speech synthesis: text to speech or vice versa
Live translation
34
AI Agent for guided XR instruction
Holographic AI Agent
Hand tracking
World trackingand registration foraugmented objects
Predictiveintelligence
Low latency motion tracking
Ultra reliable,low-latency wirelessconnection
35
Transforming industries
Connecting virtually everythingat the wireless edge
Redefined computing
Desktop tosmartphones
Digitized mobile communications
Analogto digital
Evolution of mobile innovation…
Transforming how the world connects, computes and communicates
3636Based on ITU vision for IMT-2020 compared to IMT-advanced; URLLC: Ultra Reliable Low Latency Communications; IAB: Integrated Access & Backhaul
Designing a unified, more capable 5G air interface
10xConnection density
3xSpectrumefficiency
10xDecrease inend-to-end latency
10xExperienced throughput
100xTrafficcapacity
100xNetwork efficiency
Enhanced mobilebroadband
Diversedeployments
Mid-bands1 GHz to 6 GHz
High-bandsAbove 24 GHz (mmWave)
Low-bandsBelow 1 GHz
Diversespectrum
Licensed/shared/unlicensed
37
20+Operatorsannounced
20+OEMsannounced
5G rollout happening faster than 4G
4Operatorslaunched
3OEMslaunched
Source: IHS Report Jan ’19, Qualcomm Technologies data
Year 1 announcements underscore tremendous momentum with 5G
38
1990sDigital voiceSMS
2000sMobile dataMMS and video calling
1980sAnalog voiceVoice call
2010sMobile broadbandEnhanced Video calling
2019+Enhanced Mobile BroadbandHolographic telepresence
Evolution of social communications buildingon decades of breakthrough technologies
39
HolographicTelepresence
Real time social interaction
Spatialcomputing
39
40
41
Building the vision of converged XR
AR
VR
Existing Processing
Standalone Processing
Distributed Processing
(Wireless Proximity)
DistributedProcessing
(Mobile Edge Computing)Converged XR
(Mobile Edge Computing)
USB3-DP
Distributed Processing
(Cabled Proximity)
60 ghZ 5G 5G
42
Tracking/Inputs
Encoded data On-device adjustment to latest pose1
XR headset
Deeperin network
On-premise, e.g. venue
with rendering
Cloud
Boundless XR over 5G – Distributed IntelligenceThe public or private 5G edge will augment on-device processing
1. Asynchronous time warp reduces Motion to Photon (MTP) latency by using on-device processing based on the latest available pose. MTP below 20 ms generally avoids discomfort — has to be processed on the device
Edge Cloud
Partial rendering offload possible with 5G’s low latency, capacity and quality of service
Power-efficient, latency sensitive on-device rendering and tracking
Today’s latency is unpredictable
Less latency sensitive content (e.g. recorded streaming video)
with on-device processing
43
ODMs, OEMs
Platforms, Technology
Platform Content
Collaboration within the XR
ecosystem
OperatorsEnd
Users
consumer
enterprise
44
The path to convergence
ComputeSystems:
Entertainment:
Telecomm:
Mainframecomputer
Workstation DesktopPC
Laptop Tablet Smartphone
Theater Movies Home Television
Home Phone Large CellularPublic Phone Feature Phone
Laptop Tablet Smartphone
Smartphone
Nothing in these materials is an offer to sell any of the components or devices referenced herein.
©2018-2019 Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved.
Qualcomm is a trademark of Qualcomm Incorporated, registered in the United States and other countries. Other
products and brand names may be trademarks or registered trademarks of their respective owners.
References in this presentation to “Qualcomm” may mean Qualcomm Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate structure, as applicable. Qualcomm Incorporated includes Qualcomm’s licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm
Incorporated, operates, along with its subsidiaries, all of Qualcomm’s engineering, research and development functions, and all of its product and services businesses, including its semiconductor business, QCT.
Follow us on:
For more information, visit us at:
www.qualcomm.com & www.qualcomm.com/blog
Thank you
@BakadirS