hover widgets: using the tracking state to extend the capabilities of pen-operated devices
DESCRIPTION
Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices. Tovi Grossman Ken Hinckley Patrick Baudisch Maneesh Agrawala Ravin Balakrishnan. Dynamic Graphics Project Dept of Computer Science University of Toronto www.dgp.toronto.edu. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/1.jpg)
Hover Widgets: Using the Tracking State to Extend the Capabilities of
Pen-Operated Devices
Adaptive Systems and Interaction Research Group Microsoft Research www.research.microsoft.com
Tovi GrossmanKen Hinckley
Patrick BaudischManeesh AgrawalaRavin Balakrishnan
Dynamic Graphics Project Dept of Computer Science University of Toronto www.dgp.toronto.edu
![Page 2: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/2.jpg)
Pen-Based Interfaces• Great for notes, sketches• Lack of shortcuts problematic
![Page 3: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/3.jpg)
Pen-Based Interfaces• Great for notes, sketches• Lack of shortcuts problematic• Round trip problem
![Page 4: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/4.jpg)
Localized User Interfaces• Gesture Interaction
• Tivoli (Moran, Chiu, Melle. UIST ’97)• SKETCH (Zeleznik, Herndon & Hughes. SIGGRAPH ’96)• DENIM (Newman, Lin, Hong & Landay. HCI ’03)
• Menu Interaction• Marking Menu (Kurtenbach & Buxton. CHI ’93)• Flow Menu (Guimbretière & Winograd. UIST ’03)• Scroll ring (Smith & schraefel. Moscovich & Hughes. UIST ’04)
• Hybrid• Scriboli (Hinckley, Baudisch, Ramos, & Guimbretière. CHI ’05)
![Page 5: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/5.jpg)
Localized User Interfaces• Gesture Interaction
• Ink confused with gesture• Explicitly switch with button
• Menu Interaction• Activated with button
![Page 7: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/7.jpg)
Localized User Interfaces
![Page 8: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/8.jpg)
Localized User Interfaces
![Page 9: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/9.jpg)
Design Challenge1. Localized user interface2. Clearly distinct from ink input3. No button required
![Page 10: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/10.jpg)
Tracking menus
Fitzmaurice G., Khan A., Pieke R., Buxton B., Kurtenbach G. UIST 2003
![Page 11: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/11.jpg)
Hover Widgets• Gesture in tracking state• Widget fades in• Click on widget
![Page 12: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/12.jpg)
Hover Widgets
![Page 18: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/18.jpg)
Independent Variables• Technique (Hover Widget, Icon)• GridN (4, 8, 12)• Distance (300, 600, 900, 1200)
![Page 21: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/21.jpg)
Summary• New distinct command layer• Button free • Localized UI
• Reduce time• Minimal shift of attention
![Page 22: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/22.jpg)
Future Work• Customize & adapt
![Page 23: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/23.jpg)
Future Work• Customize & adapt• Large displays
![Page 24: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/24.jpg)
Acknowledgements• Members of The Microsoft Research
Adaptive Systems & Interaction group• Members of the Microsoft Research
Visualization and Interaction Group• Members of the University of Toronto
Dynamic Graphics Lab • David Thiel• Study Participants
![Page 25: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/25.jpg)
Questions?
![Page 27: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/27.jpg)
Using the Tracking State• Tool tips• Input panel gesture
![Page 30: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/30.jpg)
Visualization
![Page 31: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices](https://reader036.vdocuments.us/reader036/viewer/2022062811/568160f4550346895dd02e43/html5/thumbnails/31.jpg)
Learning