acm nordichi 2012: exploring the design of hybrid interfaces for

32
Exploring the Design of Hybrid Interfaces for Augmented Posters in Public Spaces Jens Grubert, Raphaël Grasset, Gerhard Reitmayr Institute for Computer Graphics and Vision, Graz University of Technology

Upload: jens-grubert

Post on 09-May-2015

187 views

Category:

Technology


0 download

DESCRIPTION

Jens Grubert recently presented "Exploring the Design of Hybrid Interfaces for Augmented Posters in Public Spaces" at the the 7th Nordic Conference on Human-Computer Interaction (NordiCHI 2012). October 14-17, 2012, Copenhagen, Denmark. Abstract: The use of Augmented Reality for overlaying visual information on print media like street posters has become widespread over the last few years. While this user interface metaphor represents an instance of cross-media information spaces the specific context of its use has not yet been carefully studied, resulting in productions generally relying on trial-and-error approaches. In this paper, we explicitly consider mobile contexts in the consumption of augmented print media. We explore the design space of hybrid user interfaces for augmented posters and describe different case studies to validate our approach. Outcomes of this work inform the design of future interfaces for publicly accessible augmented print media in mobile contexts.

TRANSCRIPT

Page 1: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Exploring the Design of Hybrid Interfaces for Augmented Posters in Public Spaces

Jens Grubert, Raphaël Grasset, Gerhard Reitmayr

Institute for Computer Graphics and Vision, Graz University of Technology

Page 2: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for
Page 3: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for
Page 4: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

[Lemmelä et al. 2008], [Tamminen et al. 2004]

Page 5: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

How to support a continuous user experience initiated at an augmented poster

in public space?

Page 6: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Augmented Reality

interaction with

digital information registered in a

physical frame of reference

Page 7: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

physical frame of reference

Augmented Reality

Page 8: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Augmented Reality

spatial navigation

Page 9: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for
Page 10: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Augmented Reality

interaction with

digital information embedded in a

physical frame of reference

Page 11: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Augmented Reality

interaction with

digital information embedded in a

physical frame of reference

Page 12: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Augmented Reality

interaction with

digital information embedded in a

physical frame of reference

Page 13: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Augmented Reality

interaction with

digital information embedded in a

physical frame of reference

Page 14: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Augmented Reality

interaction with

digital information embedded in a

physical frame of reference

Page 15: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Hybrid Interfaces

interaction with

digital information embedded in

multiple representations of thephysical frame of reference

Page 16: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Hybrid Interfaces

How to preserve the frame of reference?

How to navigate in multiple representations?

How to transit between representations?

Page 17: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

How to preserve the frame of reference?

Page 18: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

How to preserve the frame of reference?

Page 19: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

How to preserve the frame of reference?

Page 20: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

How to preserve the frame of reference?

Page 21: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

How to navigate in multiple representations?

6 DOF6 DOF 3 DOF3 DOF

Page 22: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Favor ease of navigation over complete navigability

[Hürst & Helder, 2011] [Lethinen et al. 2012]

How to navigate in multiple representations?

Page 23: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

How to transit between representations?

Page 24: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Case Studies: Event Poster

Page 25: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Case Studies: Gaming Poster

[Grubert et al., 2012]

Page 26: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Findings

Diverse combinations of interfaces

Discrete transition sufficient

More in [Grubert et al., 2012], [Mulloni et al. 2012] 

Page 27: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

How to support a continuous user experience initiated at an augmented poster

in public space?

Summary

Page 28: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Summary

Combine augmented reality and alternative interfaces

Favor ease of navigation over complete navigability

Minimize cognitive effort when transitioning between interfaces

Page 29: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Future Challenges When are more abstract interfaces (e.g., mobile websites) sufficient?

How will users combine the individual interfaces in various mobile contexts?

How to preserve the frame of referencein complex spatial environments?

How to support view transition in those complex environments?

Page 30: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

References[Grubert et al. 2012]  Grubert, J., Morisson, A., Munz., H and Reitmayr, G.: Playing it Real: Magic Lens and Static Peephole Interfaces for Games in a Public Space. In Proc. MobileHCI2012. ACM (2012), 231‐240

[Hürst & Helder, 2011]  Hürst, W. & Helder, M. Mobile 3D graphics and virtual reality interaction. In Proc. ACE 2011, ACM (2011), 28:1‐28:8

[Lemmelä et al. 2008] Lemmelä, S., Vetek, A., Mäkela, K. and Trendafilov, D. Designing and evaluating multimodal interaction for mobile contexts. In Proc. ICMI  2008, ACM (2008), 265‐272.

[Lethinen et al. 2012] Lethinen, V., Nurminen, A., and Oulasvirta, A. Integrating spatial sensing to an interactive mobile 3D map. In Proc. 3DUI 2012, IEEE (2012), 11‐14 

[Mulloni et al. 2012] Mulloni, A., Grubert, J., Seichter, H., Langlotz, T., Grasset, R., Reitmayr, G. and Schmalstieg, D. Experiences with the Impact of Tracking Technology in Mobile Augmented Reality Evaluations. In MobileHCI 2012 Workshop MobiVis, ACM (2012) 

[Tamminen et al. 2004] Tamminen, S., Oulasvirta, A., Toiskallio, K. and Kankainen, A. Understanding mobile contexts. In Personal Ubiquitous Computing, 8, Springer (2004), 135‐143.

Page 31: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

References[Grubert et al. 2012]  Grubert, J., Morisson, A., Munz., H and Reitmayr, G.: Playing it Real: Magic Lens and Static Peephole Interfaces for Games in a Public Space. In Proc. MobileHCI 2012. ACM (2012), 231‐240

[Hürst & Helder, 2011]  Hürst, W. & Helder, M. Mobile 3D graphics and virtual reality interaction. In Proc. ACE 2011, ACM (2011), 28:1‐28:8

[Lethinen et al. 2012]  Lethinen, V., Nurminen, A., and Oulasvirta, A. Integrating spatial sensing to an interactive mobile 3D map. In Proc. 3DUI 2012, IEEE (2012), 11‐14 

[Mulloni et al. 2012] Mulloni, A., Grubert, J., Seichter, H., Langlotz, T., Grasset, R., Reitmayr, G. and Schmalstieg, D. Experiences with the Impact of Tracking Technology in Mobile Augmented Reality Evaluations. In MobileHCI 2012 Workshop MobiVis, ACM (2012) 

Page 32: ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for

Thank you

Questions?

This work was supported by the Austrian NationalResearch Funding Agency (FFG) in the SmartReality project.