![Page 1: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/1.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
Gamification-supported Exploration of Natural User Interfaces
Stefan Diewald1, Andreas Möller1, Luis Roalter1, Matthias Kranz2
1Technische Universität München, Germany 2Luleå University of Technology, Department of Computer Science,
Electrical and Space Engineering, Luleå, Sweden
October 17, 2012 2nd Workshop on Automotive Natural User Interfaces (AutoNUI) at the 4th International Conference on
Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI), Portsmouth, NH, USA
![Page 2: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/2.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
Starting Situation: Complex Automotive User Interfaces
17.10.2012 Stefan Diewald 2
Image sources: Wikimedia Commons; http://www.e31.net/pics/Bordcomputer.jpg; http://www.auto123.com/ArtImages/102556/BMW_I_drive_i2.jpg;
Finding a desired functionality can be very time and attention-consuming.
![Page 3: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/3.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
Countermeasure: Natural User Interfaces
17.10.2012 Stefan Diewald 3
Image sources: http://www.autoguru.at/wp-content/uploads/2012/03/audi_multitouch_11.jpg; http://www.bmw.com/com/en/insights/technology/technology_guide/articles/_shared/img/voice_control_system.jpg
Natural User Interfaces: § Multi-touch § Gestures § Voice dialogs § … Less distraction and better user experience?
![Page 4: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/4.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
“Natural user interfaces are not natural”
17.10.2012 Stefan Diewald 4
“Speech utterances will have to be learned and gestures carefully developed and standardized through time.”
“None of these systems is inherently more natural than the others.”
Donald A. Norman. 2010. Natural user interfaces are not natural. interactions 17, 3 (May 2010), 6-10.
![Page 5: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/5.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
DriveAssist – Driver Assistance and Awareness System
17.10.2012 Stefan Diewald 5
§ Runs on mobile devices (Android smartphones and tablet PCs) § Multi-touch for interacting with the map view
![Page 6: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/6.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
DriveAssist – Driver Assistance and Awareness System
17.10.2012 Stefan Diewald 6
![Page 7: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/7.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
Interaction problems with DriveAssist
First test: § difficulties in exploring touch menus § unaware of gestures: e.g. “pinch-to-zoom” & rotation
17.10.2012 Stefan Diewald 7
![Page 8: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/8.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
“Did you know?”-hints for DriveAssist
17.10.2012 Stefan Diewald 8
12 participants
45 minutes
only 7 did notice the hint
and only 1 found the hint useful
![Page 9: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/9.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
The Challenge
Create a strong motivation for exploring natural user interfaces in the automotive domain:
§ Uncover hidden functions
§ Make usage more comfortable
17.10.2012 Stefan Diewald 9
![Page 10: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/10.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
The Idea: 1 - Gamification
17.10.2012 Stefan Diewald 10
… the use of game design elements in non-game contexts.
Sebastian Deterding et al. 2011. From game design elements to gamefulness: defining "gamification". In Proceedings of the 15th International Academic MindTrek Conference. ACM, New York, NY, USA, 9-15.
![Page 11: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/11.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
Gamification Example
17.10.2012 Stefan Diewald 11
Image sources: http://aboutfoursquare.com/wp-content/uploads/2011/03/photo-11.png; http://cdn3.techworld.com/cmsdata/reviews/3210966/foursquare_badges_360.jpg;
![Page 12: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/12.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
The Idea: 2 - Share and Compare
17.10.2012 Stefan Diewald 12
Image sources: http://www.uplaude.com/blog/; Wikimedia Commons; Nike+
![Page 13: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/13.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
Gamification in the Automotive Domain
17.10.2012 Stefan Diewald 13
MyFord – collect badges online. Chevy Volt – dashboard gamification for efficient driving.
![Page 14: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/14.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
Gamification-supported Exploration of NUIs
17.10.2012 Stefan Diewald 14
One-time badges For more common functions.
Experience Levels For less known and less
accessed functions.
![Page 15: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/15.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
What can be gained?
17.10.2012 Stefan Diewald 15
…
Open the windows through voice control.
Enter a navigation target via handwriting recognition.
Change the chassis configuration via voice control.
…
x1
![Page 16: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/16.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
When to award a Badge or Level-up?
17.10.2012 Stefan Diewald 16
![Page 17: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/17.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
How to award a Badge or Level-up?
17.10.2012 Stefan Diewald 17
Congratulations, you have just unlocked the “navigation target badge” by entering your destination via voice control.
![Page 18: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/18.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
“Share and Compare”
17.10.2012 Stefan Diewald 18
Image sources: http://2.bp.blogspot.com/-77IL5MZo1mQ/UDIpMenIf2I/AAAAAAAAPLg/szq3N3Iyj1Y/s1600/Tank.jpg
Share new badges and experience level-ups directly with friends in real time.
![Page 19: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/19.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
The Goal
Create a strong motivation for exploring natural user interfaces in the automotive domain,
… that is at least maintained until the user is used to the system.
17.10.2012 Stefan Diewald 19
![Page 20: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/20.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
Future Work
17.10.2012 Stefan Diewald 20
![Page 21: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/21.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
Thank you for your attention! Questions?
? ? Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 21
[email protected] www.vmi.ei.tum.de/team/stefan-diewald.html
![Page 22: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/22.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
Paper Reference
• Please find the associated paper at: https://vmi.lmt.ei.tum.de/publications/2012/GamificationNUI_preprint.pdf
• Please cite this work as follows: • Stefan Diewald, Andreas Möller, Luis Roalter, Matthias Kranz. 2012.
Gamification-supported Exploration of Natural User Interfaces In: Adjunct Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI2012), pp. 47-48, Portsmouth NH, USA, October 2012
Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 22
![Page 23: Gamification-supported Exploration of Natural User Interfaces](https://reader033.vdocuments.us/reader033/viewer/2022052907/5590c3bb1a28ab4d558b4656/html5/thumbnails/23.jpg)
Technische Universität München Distributed Multimodal Information Processing Group
If you use BibTex, please use the following entry to cite this work:
Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 23
@INPROCEEDINGS{NUIGamification2012, author = {Stefan Diewald and Andreas M\"{o}ller and Luis Roalter and Matthias Kranz}, title = {{Gamification-supported Exploration of Natural User Interfaces}}, booktitle = {{Adjunct Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2012)}}, year = {2012}, month = oct, pages = {47--48}, location = {Portsmouth NH, USA}, }