AugMenuAn Augmented Reality Ordering System for Restaurant

Motivation

Jim enters a Chinese RestaurantWhat is Ants Climbing Tree!?

Our idea:

AR + Menu

Sometimes, you need suggestions

You must be curious about how to cook it?

And, why on earth it has such a name?

Related Work

• No directly related work in ACM library• But tons of indirectly related work

Designing Augmented Reality Interfaces

Related Work

• Designing Augmented Reality Interfaces– Billinghurst, M., Grasset, R., and Looser, J

• What we get from this paper?• It explains principles of tangible augmented reality, and

these principles guide us to compliment easy user interaction design.

• The goal of augmented reality interface design is using an appropriate interaction metaphor to support users input and computer output

Related Work

• User expectations for mobile mixed reality services: an initial user study

– Thomas,Olsson, Pirita Ihamäki, Else Lagerstam, Leena Ventä-Olkkonen, KaisaV.Mattila.

• What we get from this paper?• They investigated the early impressions and expectations

of MMR(Mobile Mixed Reality) as a technology by evaluating various usage scenarios. Based on this initial study, we found relevance issues (what information to receive, how and when) and the reliability of MMR information to be the most salient elements that were anticipated to affect the overall user experience.

Methodology

• User Analysis

• No or little knowledge about the restraurants• With basic idea of using handheld devices

• Be Curious!!!

Methodology

• Environment Analysis

• Ordinary paper and text based menu• Waiters are familiar with handheld devices

• Be Exotic!!!

Methodology

• Hierarchical Task Analysis 0 View augmented information 0.1 Get the menu0.2 Get the device0.3 Launch the AugMenu Application0.4 Adjust the position between menu and handhold device

0.4.1 Adjust the angle 0.4.2 Adjust the position0.4.3 Adjust the distance

0.5 view information0.5.1 move the device0.5.2 operate the device to control the displayed information

0 View augmented information

0.1 Get the menu

0.2 Get the device

0.3 Launch the AugMenu Application

0.4 Adjust the position

0.4.1Adjust the angle

0.4.2Adjust the position

0.4.3Adjust the angle

0.5 view information

0.5.1move the device

0.5.2operate the device

• Observation– Observe the process of a customer ordering – Taking notes about what he does while viewing

the menu and what questions he asks.– Carefully capture the details of user’s non-verbal

motions– Video record this process(Permission)

Methodology

• Interview: semi-structured interviewthe customer

1. Focus on what problem they met2. What kind of menu they want to use

waiters1. How many customers feel confused about the

menu?2. What is their typical explanation for this kind of questions.3. How to improve the menu?

Methodology

• Predictive Analytic Evaluation– Heuristic Evaluation» In formative phase, check the low-fi prototype

according to design criteria.– Cognitive WalkThourgh» Walk through each interaction steps and

answer questions to avoid design flaws.

Methodology

Technical Specification

• A mobile device with camera• Sets of markers • AR toolkit to fulfill marker tracking and

information overlay

• FL Manager + Flex + AIR

Outcome

• A brand new menu design• An integrated ordering system design• Achieve core functionalities• A Paper

Thank you!

18 seconds left to answer questions