practical gaze tracking peter elliott cs 498 spring 2009
Post on 20-Dec-2015
220 views
TRANSCRIPT
![Page 1: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/1.jpg)
Practical Gaze Tracking
Peter Elliott
CS 498
Spring 2009
![Page 2: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/2.jpg)
Outline
• What is gaze tracking
• Methods
• How does it work
• Current problems
• Applications
• Questions
![Page 3: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/3.jpg)
Gaze Tracking
• Determine what a person is looking at
• Human-computer interaction
• Practical?– Need unobtrusive hardware– Don’t overload the eyes
![Page 4: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/4.jpg)
Sclera Coil
• Contact lens with Copper wire
• Uses changes in magnetic field
http://www.skalar.nl/graphics/fig1.jpg
![Page 5: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/5.jpg)
Sclera Coil
http://mvl.mit.edu/Neurovestibular/Pictures/Shelhamer/EyeCoilNear.jpg
![Page 6: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/6.jpg)
Electro-oculographic Potential
• Electrodes placed on face
• Measures electric charge of the eye
http://www.sciencedaily.com/images/2008/04/080428083418.jpg
![Page 7: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/7.jpg)
Fixed Head Position
• Similar to current technique
• Requires headrest
http://upload.wikimedia.org/wikipedia/en/f/f4/SMI_HiSpeed_EyeTracker.jpg
![Page 8: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/8.jpg)
Finding Gaze Position
• Requires special hardware– Camera and two point light sources (IR)
• Reflections of light stay stationary on the eye
![Page 9: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/9.jpg)
Glints
http://www.innerhealthandbeauty.net/images/Mixed_Iris.JPG
![Page 10: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/10.jpg)
Finding Gaze Position
• Use image processing to extract ellipses of pupil and glints
• Determine 3D position of the eye
• Use geometry to map to screen coordinates
• Calibration
![Page 11: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/11.jpg)
Problems
• Special hardware
• Eye movements
• Accuracy
• Natural feel
![Page 12: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/12.jpg)
Hardware
http://www.tobii.com/Images/contentimages/Produktbilder/tobii-t60-eye-tracker-perspective.jpg
http://www.ecse.rpi.edu/~cvrl/zhiwei/gazetracking/SystemView.jpg
![Page 13: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/13.jpg)
Eye Movements
• Not smooth
• Fixations and saccades
• Eye jitters
http://upload.wikimedia.org/wikipedia/en/b/b9/ReadingFixationsSaccades.jpg
![Page 14: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/14.jpg)
Accuracy
• 16-33 pixels• ~30ms response
time
![Page 15: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/15.jpg)
Natural Feel
• Don’t want to overload eyes
• Sensors, not used for motor control
• Must feel “natural”
• Users must feel free
• Hardware can only go so far, need software
![Page 16: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/16.jpg)
Applications
• Market research
• Surgeons/Doctors
• Disabled users
• Able-bodied users– Future method of human-computer
interaction?
![Page 17: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/17.jpg)
Marketing Application – Heat Maps
http://www.tobii.com/Images/contentimages/pageImages/Mag_spread_Heat_map.jpg
![Page 18: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/18.jpg)
Summary
• How gaze position is found
• New form of human-computer interaction
• Current solutions relatively unobtrusive
• Not without problems– Cost– Accuracy
![Page 19: Practical Gaze Tracking Peter Elliott CS 498 Spring 2009](https://reader034.vdocuments.us/reader034/viewer/2022051619/56649d445503460f94a2124e/html5/thumbnails/19.jpg)
Questions?