understanding & modeling input devices. questions 1. how do common input devices work? 2. how...
TRANSCRIPT
![Page 1: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/1.jpg)
Understanding & Modeling
Input Devices
![Page 2: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/2.jpg)
Questions
1. How do common input devices work?2. How can we think about the larger
space of all possible input devices?3. Can we predict human input
performance?4. What about uncommon input
devices (multitouch, tangible interfaces, …)?
5. Will this be on the exam? Yes.
![Page 3: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/3.jpg)
Today’s lecture in graphic form
![Page 4: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/4.jpg)
I think my keyboard is broken. Whenever I have a few keys
pressed down, some keys suddenly don’t work anymore; at other times ‘phantom’ characters appear.
What’s going on?
![Page 5: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/5.jpg)
Keyboard
![Page 6: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/6.jpg)
![Page 7: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/7.jpg)
![Page 8: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/8.jpg)
![Page 9: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/9.jpg)
Microprocessor and Controller
![Page 10: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/10.jpg)
Row/Column Scanning
9 lines and 20 keys
http://v.youku.com/v_show/id_XMTI5NjE0OTQ4.html
![Page 11: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/11.jpg)
Closeup
![Page 12: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/12.jpg)
One key down
![Page 13: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/13.jpg)
![Page 14: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/14.jpg)
3 Keys Down
![Page 15: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/15.jpg)
Encoding keyboard: Keys conflict
C1-R1-C2-R2 3 or 4 keys Q,W,A,S
http://www.upsdn.net/html/2006-10/760.html
![Page 16: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/16.jpg)
A Layered Framework
From: Hartmann, Follmer, Klemmer: Input Devices are like Onions
![Page 17: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/17.jpg)
Mouse
Mouse. Engelbart and English ~1964
![Page 18: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/18.jpg)
![Page 19: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/19.jpg)
![Page 20: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/20.jpg)
Encoder wheel for scrollingLeft button
Right button
![Page 21: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/21.jpg)
IR emitter IR detector
slotted wheel (between emitter & detector)
![Page 22: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/22.jpg)
Sensing: Rotary Encoder
![Page 23: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/23.jpg)
Sensing: Fwd rotation
![Page 24: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/24.jpg)
Sensing: Backwd Rotation
![Page 25: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/25.jpg)
Solutions: Use two Out-of-Phase Detectors
![Page 26: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/26.jpg)
Sensing: Rotary Encoder
![Page 27: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/27.jpg)
![Page 28: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/28.jpg)
Transformation
cxt = max(0, min( sw, cxt-1+dx*cd )) cyt = … cxt: cursor x (horizontal) position in
screen coordinates at time t dx: mouse x movement delta in
mouse coordinates sw: screen width cd: control-display ratio
![Page 29: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/29.jpg)
Device Abstraction
Click, DoubleClick, MouseUp, MouseDown, MouseMove …
![Page 30: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/30.jpg)
What about optical mice?
Source: http://spritesmods.com/?art=mouseeye
![Page 31: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/31.jpg)
Source: http://spritesmods.com/?art=mouseeye
![Page 32: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/32.jpg)
Trackball, Trackpad
![Page 33: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/33.jpg)
Trackpoint
Indirect, force sensing, velocity control
Nonlinear transfer function
![Page 34: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/34.jpg)
Joystick
![Page 35: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/35.jpg)
A design space of input devices…
Card, S. K., Mackinlay, J. D., and Robertson, G. G. 1991.A morphological analysis of the design space of input devices. ACM TOIS 9, 2 (Apr. 1991), 99-122.
![Page 36: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/36.jpg)
![Page 37: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/37.jpg)
![Page 38: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/38.jpg)
Which is faster?
![Page 39: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/39.jpg)
Which is faster?
Engelbart
![Page 40: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/40.jpg)
Experiment: Mice are fastest!
![Page 41: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/41.jpg)
Fitts’s law
Time Tpos to move the hand to target (size S) which is distance D away is given by:Tpos = a + b log2 (D/S + 1)
Index of Difficulty (ID) Only relative precision
matters
Exam Question Material!
Source: Landay, James. “Human Abilities”. CS160 UC Berkeley.
![Page 42: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/42.jpg)
![Page 43: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/43.jpg)
Tpos = a + b log2 (D/S + 1)
Device Characteristics(bandwidth of human muscle group & of
device)a: start/stop time (intercept) b: speed (slope)
![Page 44: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/44.jpg)
Bandwidth of Human Muscle Groups
![Page 45: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/45.jpg)
Why is mouse fastest? Why these results? Time to position mouse
proportional to Fitts’s Index of Difficulty ID.
[i.e. how well can the muscles direct the input device]
Therefore speed limit is in the eye-hand system, not the mouse.
Therefore, mouse is a near optimal device.
![Page 46: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/46.jpg)
Fitts’s law example
Which will be faster on average? pie menu (bigger targets & less distance)
![Page 47: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/47.jpg)
Fitts’s law in Windows &Mac OS
The Apple menu inMac OS X v10.4 Tiger.
Windows 95: Missed by a pixelWindows XP: Good to the last drop
![Page 48: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/48.jpg)
In office 2007
Larger, labeled controls can beclicked more quickly
Magic Corner: Office Button in theupper-left corner
Mini Toolbar: Close to the cursor
Source: Jensen Harris, An Office User Interface Blog : Giving You Fitts. Microsoft, 2007.
![Page 49: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/49.jpg)
Uncommon Input Devices
Assumptions so far: Single user, working in front of a
desktop PC Main tasks are typing and pointing Efficiency rules
What if we change these assumptions? Design for enjoyment / engagement Design for multi-user scenarios
![Page 50: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/50.jpg)
Position+Orientation: Nitendo Wii
![Page 51: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/51.jpg)
Camera based input: IO Brush
Source: Kimiko Ryokai, http://web.media.mit.edu/~kimiko/iobrush/
![Page 52: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/52.jpg)
Multi-touch
Jeff Han, Perceptive Pixel
http://www.tudou.com/programs/view/LfwscZ1iUXc/
![Page 53: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/53.jpg)
Hybrids: Devices on Tables
Hartmann, Björn, Morris, M.R., Benko, H., and Wilson, A.Augmenting Interactive Tables with Mice & Keyboards. In Proceedings of UIST 2009.
![Page 54: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/54.jpg)
http://www.vid3o.net/view/v_AvkV286mI/uist09-augmenting-interactive-tables-with-mice-keyboards.html
![Page 55: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/55.jpg)
Hybrids: Multi-touch on Mice
Mouse 2.0: Multi-touch Meets the MouseNicolas Villar, Shahram Izadi, Dan Rosenfeld, Hrvoje Benko, John Helmes, Jonathan Westhues, Steve Hodges,Eyal Ofek, Alex Butler, Xiang Cao and Billy Chen. Proceedings of UIST 2009.
http://www.disclose.tv/action/viewvideo/31170/Mouse_2_0_from_Microsoft/
![Page 56: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input](https://reader036.vdocuments.us/reader036/viewer/2022062409/56649ead5503460f94bb4f27/html5/thumbnails/56.jpg)
Links
http://bjoern.org http://research.microsoft.com/apps/vi
deo/default.aspx?id=144849