longitudinal study of people learning to use continuous ... · pdf file2009 april longitudinal...

13
Longitudinal Study of People Learning to Use Continuous Voice-Based Cursor Control Author: Susumu Harada Jacob O. Wobbrock Jonathan Malkin Jeff A. Bilmes , James A. Landay

Upload: danghuong

Post on 22-Mar-2018

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Longitudinal Study of People Learning to Use Continuous ... · PDF file2009 April Longitudinal study of People learning to use continuous voice based Cursor control More than 10 paper

Longitudinal Study of People Learning to Use

Continuous Voice-Based Cursor Control

Author: Susumu Harada Jacob O. Wobbrock Jonathan Malkin Jeff A. Bilmes, James A. Landay

Page 2: Longitudinal Study of People Learning to Use Continuous ... · PDF file2009 April Longitudinal study of People learning to use continuous voice based Cursor control More than 10 paper

Idea

● Introduce a new analog voice input method

● Discuss method of the evaluation of input system

● Discuss the outcome

● Discuss the improvement areas

Page 3: Longitudinal Study of People Learning to Use Continuous ... · PDF file2009 April Longitudinal study of People learning to use continuous voice based Cursor control More than 10 paper

Timeline

2004 OcT - Pitch Tracking

2005 Sep - Maximum Margin Learning & vowel classification

2005 Mar - Format Tracking

2005 Oct - Voice-Based Human-Computer Interface

2009 April Longitudinal study of People learning to use continuous voice based Cursor control

More than 10 paper between 2005 and 2009

Page 4: Longitudinal Study of People Learning to Use Continuous ... · PDF file2009 April Longitudinal study of People learning to use continuous voice based Cursor control More than 10 paper

Voice Control

Page 5: Longitudinal Study of People Learning to Use Continuous ... · PDF file2009 April Longitudinal study of People learning to use continuous voice based Cursor control More than 10 paper

Video Demonstration

Page 6: Longitudinal Study of People Learning to Use Continuous ... · PDF file2009 April Longitudinal study of People learning to use continuous voice based Cursor control More than 10 paper

Alternate Input Devices

Nurosky Emotiv

Eyetech

OpenEyesInput Switch

Page 7: Longitudinal Study of People Learning to Use Continuous ... · PDF file2009 April Longitudinal study of People learning to use continuous voice based Cursor control More than 10 paper

Some More ...... Ease of Access Center Sticky Keys

Magnifier Mouse Keys

On-Screen Keyboard Filter Keys

Narrator Visual Notifications

Speech Recognition Personalization

Change text size Touch

Page 8: Longitudinal Study of People Learning to Use Continuous ... · PDF file2009 April Longitudinal study of People learning to use continuous voice based Cursor control More than 10 paper

openEyes: a low-cost head-mounted eye-tracking solution

Dongheng Li, Jason Babcock, and Derrick J. Parkhurst

Page 9: Longitudinal Study of People Learning to Use Continuous ... · PDF file2009 April Longitudinal study of People learning to use continuous voice based Cursor control More than 10 paper

● Significant intrusivenessspecial contact lenses, elec-trodes, chin rests, bite bars or other components that must be physically attached to the user

● Lack of Robustness

● Low availability

● High price of eye-tracking technology.○ Toby cost around 10,000$

Challenges

Page 11: Longitudinal Study of People Learning to Use Continuous ... · PDF file2009 April Longitudinal study of People learning to use continuous voice based Cursor control More than 10 paper

The goal of the algorithm is to extract the lo-cations of the pupil center and the corneal reflection so as to relate the vector difference between these location to coordinates in thescene image

Software - Starburst algorithm

Page 12: Longitudinal Study of People Learning to Use Continuous ... · PDF file2009 April Longitudinal study of People learning to use continuous voice based Cursor control More than 10 paper

Validation Study

Generation 3 Wide 1.16 1.38 1.71Generation 4 Wide 0.68 1.11 1.37Generation 4 Narrow 0.60 1.03 1.04

Accuracy is measured as the distance between the estimated point ofgaze and the actual location of the calibration marks in the scene image averaged over all nine calibration points

Page 13: Longitudinal Study of People Learning to Use Continuous ... · PDF file2009 April Longitudinal study of People learning to use continuous voice based Cursor control More than 10 paper

Demonstrationhttps://vpn.umbc.edu/10.1145/1120000/1117350/,DanaInfo=delivery.acm.org+p95-li.pdf?ip=130.85.16.118&acc=ACTIVE%20SERVICE&CFID=188028412&CFTOKEN=96465139&__acm__=1351547475_4045d83fc147bd43966fc9f76ed5988e

http://thirtysixthspan.com/openEyes/videos.html