Characteristics ofHand Gesture Navigation:A case study using a wearable device (MYO)

Tobias Mulling | Mithileysh Sathiyanarayanan

With the development of devices capable of identifying the movement of hands and arms to interact with a graphical in-terface, such as MYO armband, the understanding of ergo-nomic, social and cognitive characteristics is needed in order to design applications for this wearable device. In this study, some characteristics of MYO armband gestures and approach (sensors to capture the movement of the hand) are explained, and a case study about how this armband can be used as gesture recognition in map navigation using Apple Maps Connector is discussed.

Introduction

A questionnaire (20 questions) was created with the objective of understanding how users interact with the MYO in Apple Maps software, through a Connector app. Users were asked to perform common tasks for navigating interactive maps such as Zoom, Panning, Focusing, among other commands using the predefined MYO commands (spread fingers, wave left, wave right, fist, rotation). The content of the questions was associated with acceptance of MYO as a data input device, easy to learn, use, stress and other ergonomics; for each question, there is a common 1-5 rating (5-point Likert scale: Strongly disagree = 1 and Strongly agree = 5).

Method

Results and Discussion

Contact Information

Initially, participants were asked if the MYO device requires prior training to be used. Of the total participants (n=23), 20 users (83%) understand that a learning process is necessary to perform the main gestures of the device (which are still very limited). Moreover, 70% of participants believe that the device has a great potential to be exploited in various appli-cations. The following are results on the ergonomic criteria addressed in this study:Social Acceptability: even as a wearable device, most users do not feel shame (mode = 1, mean = 1.60) when using and seen (mode = 1, mean = 1.59) while performing MYO gestures .

Ease of use and learning: users had considered that the device is difficult to learn (mode = 1, mean = 1.78) and hard to use (mode = 1, mean = 1.69). Part of this result may be linked to the fact that Apple Maps interface does not provide tips on every gesture to be executed.

Comfort and ability to perform gestures: the study showed that most users feel comfortable when using the device (mode = 5, mean = 4.39). Moreover, it was found that MYO did not improve the ability to perform related actions (mode = 1, mean = 1.26). Perhaps because the control interfaces from the movement of hands and arms is still not widely used in applications that are not games.

Stress/Effort: It was detected a high level of effort / stress associated with interaction with the MYO. Each specific gesture was analysed, Wave Left (mode=4, mean=3.73), Wave Right (mode=4, mean=4.04), Spread Fingers (mode=4, mean=4.08), Fist (mode=4, mean=4.08) and Pan (mode=4, mean=3.95). The analysis of general movements detected that the navigation gestures generated a certain stress to users (mode = 4, mean = 3.82).

1 2 3 4 5

If someone was watching you perform the gestures proposed in the map software. would you feel embarassed?Strongly disagree = 1Strongly agree = 5

1 2 3 4 5

Do you think MYO gestures on map application are easy to use?

Strongly disagree = 1Strongly agree = 5

1 2 3 4 5

Did you feel comfortable using the MYO device?

Strongly disagree = 1Strongly agree = 5

1 2 3 4 5

How do you define the general stress (effort) generated by gestures performed on MYO(armband)?No effort = 1Painful/Stressing = 5

School of Computing, Enginnering and Mathematics (CEM) - University of Brighton

E-mail: t.mulling@brighton.ac.uk

AcknowledgmentsThis work was undertaken with support from

CAPES, Brazil, grant Doutorado Pleno no Exterior–Proc. BEX BEX 13430/13-0.

Thanks to Dr. Derek Covill and Dr. Lyn Pemberton for their support and guidance.

MYO could prevent the occlusion,

because it uses a different

approachThe armband

avoids the prob-lem of “live mic”,

because it is enabled by a

gesture

Repetition of certain gestures might

cause fatigue on users and also frus-tration due to misin-

terpretedmovements.