seeing through augmented reality - qualcomm
TRANSCRIPT
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
1
Seeing Through Augmented Reality
Steven FeinerComputer Graphics & User Interfaces LabDepartment of Computer ScienceColumbia University New York, NY 10027
Supported in part by NSF, ONR, Raytheon, USMC, and gifts fromMicrosoft, Nokia, VTT, Vuzix, Canon
Qualcomm Augmented Reality Lecture SeriesTU Wien, Vienna, Austria, August 22, 2013
2
AR Restaurant Guide, 2001
Outdoor Mobile AR
S. Feiner et al., 1996–
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
3
Outdoor Mobile AR
S. Feiner et al., 1996–
4
S. White & S. Feiner, CHI 2009
Situated Visualization
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
5
O. Oda & M. Sukan, 2011
Games: FarmAR
6
S. Henderson & S. Feiner, ISMAR 2009
Task Assistance
Multiple Viewpoints
Multiple Displays
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
7
1991–1993 1996–1997
2007–2008 2008–2009
Task Assistance
8
ARMAR (Augmented Reality for Maintenance and Repair)
S. Henderson & S. Feiner, ISMAR 2009
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
9
ARMAR: Workpiece TaskAssistance
S. Henderson & S. Feiner, ISMAR 2011
10
ARMAR: Workpiece Task Assistance
S. Henderson & S. Feiner, IEEE ISMAR 2011
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
11
ARMAR: Workpiece Task Assistance
S. Henderson & S. Feiner, IEEE ISMAR 2011
12
ARMAR: Workpiece Task Assistance Study
Is AR better than conventional (computer)documentation?
Assemble aircraft engine combustion chamberSelect bottom and top, align correctly, pin
+ =
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
13
ARMAR: Workpiece Task Assistance Study
AR Condition LCD Condition
Within-subjectCounterbalanced start condition: AR, LCDRandomized chamber bottom/top, pairs of holes
14
ARMAR: Workpiece Task Assistance Study: AR Condition
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
15
ARMAR: Workpiece Task Assistance Study: AR Condition
Source/destination bin highlights Motion paths
16
ARMAR: Workpiece Task Assistance Study: AR Condition
Prescriptive 3D arrowsBillboarded labels
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
17
ARMAR: Workpiece Task Assistance Study: AR Condition
Alignment highlights
18
ARMAR: Workpiece Task Assistance Study: AR Condition
OpticalSee-Through HWD
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
19
ARMAR: Workpiece Task Assistance Study: LCD Condition
20
ARMAR: Workpiece Task Assistance Study: Experiment Design
Formal study(22 participants, 6 female,ages 18–44 [avg 26.3],CU affiliates)Introduction + stereo vision test + 2 conditions × (instructional video + practice block + 14 trials) + post hoc questionnaire
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
21
ARMAR: Workpiece Task Assistance Study: Results (α = .05)
H1: AR faster foralignment/pinning(24.2s vs. 45.5s)H2: AR more accurate [aligned within .5 hole width] (95% vs. 62%)H3: AR preferred [ranked higher in questionnaire] (20 of 22)H4: AR more intuitive [ranked higher in questionnaire] (19 of 22)
22
O. Oda, M. Sukan, S. Feiner, and B. Tversky, 3DUI 2013
Remote Localization and Referencing in Collaborative AR
Remote SMELocal Technician
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
23
Collaborative MainRemote Localization and Referencing in Collaborative AR
O. Oda, M. Sukan, S. Feiner, and B. Tversky, 3DUI 2013
Remote SME View
Local Technician View
24
Remote Localization and Referencing in Collaborative AR
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
25
M. Sukan, S. Feiner, B. Tversky, and S. Energin, ISMAR 2012
Multiple Viewpoints: SnapAR
26
M. Sukan, S. Feiner, B. Tversky, and S. Energin, ISMAR 2012
Multiple Viewpoints: SnapAR
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
27
M. Sukan, S. Feiner, B. Tversky, and S. Energin, ISMAR 2012
Multiple Viewpoints: SnapAR
28
M. Sukan, S. Feiner, B. Tversky, and S. Energin, ISMAR 2012
Multiple Viewpoints: SnapAR
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
29
M. Sukan, S. Feiner, B. Tversky, and S. Energin, ISMAR 2012
Multiple Viewpoints: SnapAR
Store multiple viewpoints
Select a viewpoint v to revisit
View and manipulate virtualobjects from viewpoint v
30
User Study Backstory
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
31
User Study Backstory
32
User Study Backstory
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
33
User Study Backstory
34
User Study Backstory
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
35
User Study Setup
36
User Study Setup
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
37
38
User Study Design
Travel condition: SNAP, WALKTask difficulty: ORTHO, OBLIQUE21 participants (CU affiliates, 8 female, age 19–40, X̅ = 23.6)Within-subject
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
39
User Study Results
SNAP significantly faster overall, esp. for OBLIQUE (# revisits higher)
40
User Study Results
tCapture ≈ 54 secs for 5 snapshotstWalk − tSwitch ≈ 30 secs for OBLIQUE, so faster after second OBLIQUE trialTime savings scale with usage/walking time
Capturerevisits
Walk Switch
tn
t t>
−
( )Capture Walk Switch revisitst t t n< − ×Saved time
Time saved overall
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
41
User Study Results
SNAP significantly more accurate overall, esp. for OBLIQUE (more difficult)
WALK WALK SNAP SNAP
0.41
0.70
0.38
0.55
0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0
ORTHO OBLIQUE
Inches
Mean Alignment Error (with 95% confidence interval)
42
User Study Results
Questionnaire19 of 21 preferred SNAP over WALK17 of 21 rated SNAP less demanding than WALK
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
43
Multiple Displays: Hybrid UIs
Combining a shared tabletop display with personal head-tracked see-through displays and phones
N. Dedual, C. Elvezio, and S. Feiner
44
Multiple Displays: Hybrid UIs
Data about POIs from Yelp, Foursquare, Instagram, CityMaps, NYC 311
Displayed in summary grids of pictograms
N. Dedual, C. Elvezio, and S. Feiner
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
45
Multiple Displays: Hybrid UIs
N. Dedual, C. Elvezio, and S. Feiner
46
S. Henderson & S. Feiner, ISMAR 2009
Task Assistance
Multiple Viewpoints
Multiple Displays
Steven Feiner, Seeing Through Augmented RealityQualcomm Augmented Reality Lecture Series, TU Wien, Vienna, Austria, August 22, 2013
47
Acknowledgments
Nick DedualCarmine ElvezioSteve HendersonOhan OdaMengu SukanBarbara TverskyLauren Wilcox
USMC personnel at Marine Corps Logistics Base: Mike Shellem, Curtis Williams, Andrew Mitchell, Alan ButterworthUSMC cadre and students at Aberdeen Proving GroundSupported in part by NSF, ONR, Raytheon, USMC, and gifts from, Microsoft, Nokia, VTT, Vuzix, Canon
Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation
See you at ISMAR 2013, Oct 1–4, 2013Adelaide, Australia http://ismar.vgtc.org