ui concepts for gesture interaction
TRANSCRIPT
2Oliver Schreck2015-10-20
Pros:• Extension of current
paradigm
• Uses only 2D
• Constant feedback to user
Cons:• Leads to fatigue• Accuracy• Standard UI
difficult to operate
Hand/finger becomes the mouse cursor
3Oliver Schreck2015-10-20
Pros:• No issues of
accuracy
• Fewer false selection due to big buttons
Cons:• Chang in the
interface design
• No constant feedback to user
As hand moves over objects they are highlighted
4Oliver Schreck2015-10-20
Pros:• Very detail
feedback
• Virtual reality feeling
• Immersive world
Cons:• “Uncanny valley”, create a hand
that user wants to use• Very sensitive to tracking• Requires certain amount of
control• High sensitivity to the
perspective of the interface
Animated 3D model that reaches into the screen
5Oliver Schreck2015-10-20
Pros:• Intuitive• Constant feedback• Use of all 3 dimensions• No pointer required, the
hand is the pointer
Cons:• Re-design of UI and
interaction• Unclear definition of
selector• Obscuring of elements
A augmented Hand is overlaid onto the UI
6Oliver Schreck2015-10-20
7Oliver Schreck2015-10-20
Old interfaces are designed for mouseThe finger is not a mouseGesture adds value, without replacing the keyboard and mouse
8Oliver Schreck2015-10-20
9Oliver Schreck2015-10-20
Avoid actions that require your user to lift their hand above the height of their shoulder
10Oliver Schreck2015-10-20
11Oliver Schreck2015-10-20
Clear differentiation between left and right hand neededDetection/Discrimination of multiple hands
12Oliver Schreck2015-10-20
13Oliver Schreck2015-10-20
• Avoid frustration of user, if selection does not work
• Signalize the user when he is leaving the “Effective Interaction Zone”
14Oliver Schreck2015-10-20
15Oliver Schreck2015-10-20
16Oliver Schreck2015-10-20
17Oliver Schreck2015-10-20
Feedback needed, so that user knows if he is in the Effective Interaction Space
18Oliver Schreck2015-10-20
19Oliver Schreck2015-10-20
20Oliver Schreck2015-10-20
21Oliver Schreck2015-10-20
22Oliver Schreck2015-10-20
23Oliver Schreck2015-10-20
24Oliver Schreck2015-10-20
Simulate a touchscreen in the air- Provide visual feedback to the user- No haptic feedback- Separates action from selection
- Selection before wall- Action after wall
25Oliver Schreck2015-10-20
Corel Painter interaction with Leapmotion- Hover zone for selection- Painting zone for action
Color selector- Select color- Stay on one color for a certain time
circle will fill
26Oliver Schreck2015-10-20
Key Tap
Screen TapCircle
Swipe
27Oliver Schreck2015-10-20
Pros:• Easy to select
• Good feedback due to AR hand
• Clear how to interact
Cons:• High fatigue• Hand would obscure the
menus on the screen• Right handed difficult to
select left menu
28Oliver Schreck2015-10-20
Natural hand movementwhen resting elbow Leads to UI definition
29Oliver Schreck2015-10-20
30Oliver Schreck2015-10-20