the reality of augmented reality mark billinghurst
TRANSCRIPT
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
1/67
The Reality of Augmented Reality
Mark [email protected]
The HIT Lab NZ, University of Canterbury
December 2011
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
2/67
Falling in Love
1989
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
3/67
Virtual Reality Was COOL!
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
4/67
Joining the HIT Lab in Seattle
Only $250K for 1500 polygons/sec!
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
5/67
My VR Predictions
I knew everyone would use VR when:
HMDs were cheap (
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
6/67
Cheap HMDs
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
7/67
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
8/67
Gartner Hype Cycle
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
9/67
1990-95
1995-2000
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
10/67
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
11/67
April 2007 Computer World VR Voted 7th on list of 21 biggest technology
flops- MS Bob Winner
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
12/67
Back to Reality
1999 Fred BrooksWhats Real about VirtualReality
In 1994 VR barely works
In 1999 VR is now really real
3 stages of application maturity: Demonstration
Pilot
Production
There are successful VR application domains
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
13/67
VR Business Today
> $3-5 Billion VR business (+ > $150 Billion GraphicsIndustry) Visualization, simulation, gaming, CAD/CAE, multimedia, graphics
arts
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
14/67
> $3-5 Billion
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
15/67
Lessons learned
Dont believe the hype
Many factors determine technologyacceptance
- Design for users
Need to move from Demo to Production
- Profitable niche markets
Follow the money
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
16/67
Whats Real About
Augmented Reality?
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
17/67
Key Questions
Where is AR technology today?
What are the key opportunities?
What are research obstacles? Where will the technology be in 5-10
years?
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
18/67
AR History
1960s 80s: EarlyExperiments
1980s 90s: Basic
Research Tracking, displays
1995 2005:Tools/Applications Interaction, usability, theory
2005 - : CommercialApplications Games, Medical, Industry
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
19/67
2007 - AR Reaches Mainstream
MIT Technology Review
March 2007
list of the 10 most
exciting technologies Economist
Dec 6th 2007
Reality, only better
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
20/67
Google Searches for AR
2009 Key crossover point More people interested in AR than VR
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
21/67
Gartners top 10 disruptive technologies 2008-2012: Multicore and hybrid processors
Virtualisation and fabric computing
Social networks and social software
Cloud computing and cloud/Web platforms
Web mashups
User Interface
Ubiquitous computing
Contextual computing
Augmented reality
Semantics
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
22/67
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
23/67
AR Technology Today
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
24/67
1977 Star Wars
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
25/67
Key Features Classic Augmented Reality (Azuma 97)
Combines Real and Virtual Images- Display technology
Interactive in Real-Time
- Real time graphics
Content Registered in 3D- Viewpoint tracking
Other Features Shared 3D viewing
- Individual views
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
26/67
HMD, HMD, HMD...
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
27/67
Tracking, Tracking, Tracking
ContoursFeature Points
Surfaces
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
28/67
1999 - HIT Lab US Shared
Space
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
29/67
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
30/67
AR Conferencing
Moves conferencing from thedesktop to the workspace
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
31/67
Virtual Viewpoint Generation
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
32/67
3D Live System
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
33/67
2008 - CNN
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
34/67
The Red Planet (2000)
Outdoor AR
Flexible Lens Surface Bimanual interaction
Digital paper analogy
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
35/67
AR FlexiLens
Real handles/controllers with flexible AR lens
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
36/67
2008: Location Aware Phones
Nokia NavigatorMotorola Droid
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
37/67
HIT Lab NZ Outdoor AR Platform
Cross platform
Android, iPhone
3D onsite visualization
Intuitive user interface
Positions content in space
Camera, GPS, compass
Client/Server software architecture
Targeting museum guide/outdoor site
applications
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
38/67
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
39/67
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
40/67
Earthquake Reconstruction
See past, present and future building designs
Earthquake survivor stories shown on mapview
Collect user comments
Android platform
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
41/67
IronMan2
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
42/67
Natural Hand Interaction (2011)
Using bare hands to interact with AR
content MS Kinect depth sensing
Real time hand tracking
Physics based simulation model
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
43/67
AR Today Key Technologies Available
- Robust tracking (Computer Vision,GPS/sensors)
- Display (Handheld HMDs)- Input Devices (Kinect, etc)
- Developer tools (Qualcomm, Metaio, ARTW)
Commercial Business Growing- Gaming, GPS/Mobile, Online Advertisement
>$5 Billion USD by 2016 (MarketsandMarkets)
>$1.5 Billion USD in Mobile AR by 2014 (Juniper Research)
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
44/67
AR Business Today
Marketing Web-based, mobile
Mobile AR
Geo-located information and service Driving demand for high end phones
Gaming
Mobile, Physical input (Kinect, PS Move) Upcoming areas
Manufacturing, Medical, Military
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
45/67
Research Directions
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
46/67
Important Research Directions
Fundamental Technologies
Unobtrusive displays
Ubiquitous tracking
Improving the user experience
Interaction, Information management
Social networking + AR
Standards (Content, interaction)
Integrating with related technologies
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
47/67
AR User Experience
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
48/67
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
49/67
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
50/67
Future Displays
Always on, unobtrusive
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
51/67
Contact Lens Display
Babak Parviz University Washington
MEMS components Transparent elements Micro-sensors
Challenges
Miniaturization Assembly
Eye-safe
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
52/67
Contact Lens Prototype
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
53/67
Information Presentation
Public and private annotations
Aid recognition, extended memory
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
54/67
Wikitude www.mobilizy.com
Blah
Blah
BlahBlah
Blah
BlahBlah
Blah
BlahBlah
Blah
BlahBlah
Blah
BlahBlah
Blah
BlahBlah
Blah
BlahBlah
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
55/67
Information Filtering
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
56/67
Information Filtering Information Filtering (Julier et al. 00)
Remove clutter by goal- and distance based filteringUsers task is route finding: Sniper and relevant buildings aredisplayed; objects, which are determined to be unnecessary,removed
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
57/67
Metaverse
Neal Stephensons SnowCrash
The Metaverse is the convergence of:
1) virtually enhanced physical reality
2) physically persistent virtual space
Metaverse Roadmap
http://metaverseroadmap.org/
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
58/67
Metaverse Dimensions
Augmentationtechnologies that layer informationonto our perception of the physical environment.
Simulationrefers to technologies that model
reality Intimatetechnologies are focused inwardly, on
the identity and actions of the individual orobject;
Externaltechnologies are focused outwardly,towards the world at large;
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
59/67
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
60/67
Mirror Worlds
Mirror worlds are informationally-enhancedvirtual models or reflections of the physical
world.
Google Earth, MS Street View, Google Maps
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
61/67
LifeLogging
Technologies record and report theintimate states and life histories of objectsand users
Nokia LifeBlog, Nike+
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
62/67
Ubiquitous AR (GIST, Korea)
How does your AR device work with other devices?
How is content delivered?
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
63/67
ubiHome @ GIST
ubiHome
What/When/How
Where/When
Media services
Who/What/When/How
ubiKey
Couch SensorPDA
Tag-it
Door Sensor
ubiTrack
When/HowWhen/HowWho/What/When/How
Light service MR window
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
64/67
CAMAR GIST
(Context-Aware Mobile Augmented Reality)
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
65/67
Conclusions
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
66/67
Conclusions
AR is becoming a real industry
Key areas of everyday use include
Location Based, Gaming
Web-based, Mobile AR
Important research for the future
Tracking, Interaction, Displays, User experience
-
8/3/2019 The Reality of Augmented Reality Mark Billinghurst
67/67
More Information
Mark Billinghurst [email protected]
Website
http://www.hitlabnz.org/