Download - Mark Hancock, University of Waterloo
![Page 1: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/1.jpg)
mark hancock
university of waterloo
leveraging physical actions to interact with digital surfaces
![Page 2: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/2.jpg)
downhill back-country (telemark)
![Page 3: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/3.jpg)
downhill bindings attached at rear
telemark bindings detatched at rear
![Page 4: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/4.jpg)
falling over is a good thing!
![Page 5: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/5.jpg)
providing rich multi-touch manipulation together with the appropriate visual feedback can enable virtual objects to be used in a meaningful way, as tools
we can use these virtual tools to leverage physical actions to interact with digital surfaces
![Page 6: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/6.jpg)
multi-touch manipulation visual feedback virtual tools + =
part i part ii part iii
embodied interaction
part iv
![Page 7: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/7.jpg)
part i: multi-touch manipulation
![Page 8: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/8.jpg)
![Page 9: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/9.jpg)
how do I
how do I use them like real objects?
interact with these objects? pick them up? turn them over?
![Page 10: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/10.jpg)
technique one: one-finger interaction
![Page 11: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/11.jpg)
![Page 12: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/12.jpg)
one finger = two DOF input
dedicated areas
can use on any one-touch display
![Page 13: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/13.jpg)
technique two: two-finger interaction
![Page 14: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/14.jpg)
![Page 15: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/15.jpg)
two fingers = four DOF input
dedicated translate area
separate and simultaneous actions
![Page 16: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/16.jpg)
technique three: three-finger interaction
![Page 17: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/17.jpg)
![Page 18: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/18.jpg)
three fingers = six DOF input
dedicated fingers
![Page 19: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/19.jpg)
comparative study
![Page 20: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/20.jpg)
twelve participants six male, six female
three tasks passing, docking, puzzle
![Page 21: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/21.jpg)
![Page 22: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/22.jpg)
results
![Page 23: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/23.jpg)
people are faster with more touches
![Page 24: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/24.jpg)
0
5
10
15
20
25
one-finger two-finger three-finger
Task
Co
mp
letio
n T
ime
(s) passing
docking
![Page 25: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/25.jpg)
people prefer more touches
![Page 26: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/26.jpg)
1
2
3
4
5
6
7D
isa
gre
e
Ag
ree
I found the
technique easy
to use
the object
reacted as I
expected it to
I could easily move
an object to where
I wanted
1
2
3
4
5
6
7
Dis
ag
ree
Ag
ree
one-finger two-finger three-finger
I found the
technique
difficult to control
I found it difficult
to turn objects in
the plane
I found it difficult to
roll objects over
![Page 27: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/27.jpg)
1
2
3
4
5
6
7
Dis
ag
ree
Ag
ree
one-finger two-finger three-finger
I found the
technique
difficult to control
I found it difficult
to turn objects in
the plane
I found it difficult to
roll objects over
1
2
3
4
5
6
7D
isa
gre
e
Ag
ree
I found the
technique
difficult to control
I found it difficult
to turn objects in
the plane
I found it difficult to
roll objects over
![Page 28: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/28.jpg)
people perform many simultaneous actions
![Page 29: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/29.jpg)
0
2
4
6
8
10
12
one-finger two-finger three-finger
Tim
e S
pe
nt
Tou
ch
ing
(s)
![Page 30: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/30.jpg)
0
2
4
6
8
10
12
one-finger two-finger three-finger
Tim
e S
pe
nt
Tou
ch
ing
(s)
![Page 31: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/31.jpg)
0
2
4
6
8
10
12
one-finger two-finger three-finger
Tim
e S
pe
nt
Tou
ch
ing
(s) passing
docking
![Page 32: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/32.jpg)
0
2
4
6
8
10
12
one-finger two-finger three-finger
Tim
e S
pe
nt
Tou
ch
ing
(s)
translations
planar rotations
spatial rotations
![Page 33: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/33.jpg)
people are faster with more touches
people prefer more touches
people perform many simultaneous actions
![Page 34: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/34.jpg)
![Page 35: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/35.jpg)
observation: “why is the object turning when I just move it?”
![Page 36: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/36.jpg)
part ii: perception
![Page 37: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/37.jpg)
![Page 38: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/38.jpg)
![Page 39: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/39.jpg)
center of projection (COP)
rays picture plane
perspective projection
![Page 40: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/40.jpg)
![Page 41: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/41.jpg)
center of projection
point of view
![Page 42: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/42.jpg)
![Page 43: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/43.jpg)
perception study
![Page 44: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/44.jpg)
factor: POV-COP discrepancy
no discrepancy medium discrepancy large discrepancy
![Page 45: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/45.jpg)
factor: projection type
perspective
parallel
![Page 46: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/46.jpg)
factor: motion parallax
![Page 47: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/47.jpg)
factor: motion parallax
no parallax parallax
![Page 48: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/48.jpg)
task
![Page 49: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/49.jpg)
![Page 50: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/50.jpg)
results
![Page 51: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/51.jpg)
0
10
20
30
40
50
60
70
80M
ean
Err
or
(°)
motion parallax
discrepancy none med large none med large
parallel perspective
![Page 52: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/52.jpg)
![Page 53: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/53.jpg)
mean error up to 60°
![Page 54: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/54.jpg)
![Page 55: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/55.jpg)
part iii: virtual tools
![Page 56: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/56.jpg)
![Page 57: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/57.jpg)
the dawn of digital tables
![Page 58: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/58.jpg)
application: sandtray therapy
![Page 59: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/59.jpg)
cooperative design
face-to-face meetings
iterative design via distance collaboration
face-to-face feedback session interviews & mock therapy
![Page 60: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/60.jpg)
design considerations
narrative potential
associative medium
digital extensions
facilitate interpretation
![Page 61: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/61.jpg)
![Page 62: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/62.jpg)
feedback
construction
storytelling
actions
arrangement
![Page 63: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/63.jpg)
![Page 64: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/64.jpg)
research in the Touchlab (and other labs)
part iv: embodied interaction
![Page 65: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/65.jpg)
Urp (Underkoffler & Ishii, 1998)
![Page 66: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/66.jpg)
stephanie mikulecky (ucalgary)
miguel nacenta (st. andrews, scotland)
sheelagh carpendale (ucalgary)
measuring embodiment
![Page 67: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/67.jpg)
![Page 68: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/68.jpg)
kimberly mikulecky (ucalgary)
john brosz (ucalgary)
sheelagh carpendale (ucalgary)
cloth interaction
![Page 69: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/69.jpg)
![Page 70: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/70.jpg)
joseph shum (uwaterloo)
collaborative multi-touch navigation
![Page 71: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/71.jpg)
![Page 72: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/72.jpg)
call of duty black ops lego star wars
![Page 73: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/73.jpg)
Shear Shear
![Page 74: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/74.jpg)
Ripple Ripple
![Page 75: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/75.jpg)
dmitry pyryeskin (uwaterloo)
jesse hoey (uwaterloo)
above the surface
![Page 76: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/76.jpg)
![Page 77: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/77.jpg)
betty chang (uwaterloo)
stacey scott (uwaterloo)
understanding automation
![Page 78: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/78.jpg)
![Page 79: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/79.jpg)
![Page 80: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/80.jpg)
adam bradley (uwaterloo)
sheelagh carpendale (ucalgary)
playing with data
![Page 81: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/81.jpg)
![Page 82: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/82.jpg)
![Page 83: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/83.jpg)
downhill back-country (telemark)
![Page 84: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/84.jpg)
with a better understanding of human perception together with interaction that uses our hands and bodies, we can leverage physical actions to better interact with digital surfaces
![Page 85: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/85.jpg)
students: adam bradley
betty chang
arezoo irannejad
rebecca langer
dmitry pyryeskin
joseph shum
kimberly mikulecky (ucalgary)
stephanie mikulecky (ucalgary)
acknowledgements: NSERC
Games Institute
SurfNet
GRAND NCE
![Page 86: Mark Hancock, University of Waterloo](https://reader031.vdocuments.us/reader031/viewer/2022020309/568c34091a28ab02358eeabd/html5/thumbnails/86.jpg)
thank you [email protected]