eyemouse: an interaction device for severely motor-disabled people carlo colombo, massimiliano...
TRANSCRIPT
![Page 1: EyeMouse: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University](https://reader036.vdocuments.us/reader036/viewer/2022081602/5513c1f65503463a298b49ee/html5/thumbnails/1.jpg)
“EyeMouse”: An interaction device for severely motor-
disabled people
Carlo Colombo, Massimiliano Corsini
Media Integration and Communication CenterUniversity of Florence
![Page 2: EyeMouse: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University](https://reader036.vdocuments.us/reader036/viewer/2022081602/5513c1f65503463a298b49ee/html5/thumbnails/2.jpg)
• Human-machine interaction system replacing the mouse with eye movements
EyeMouse
• Designed to exploit the residual mobility of severely motor-disabled people (e.g. multiple sclerosis)
![Page 3: EyeMouse: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University](https://reader036.vdocuments.us/reader036/viewer/2022081602/5513c1f65503463a298b49ee/html5/thumbnails/3.jpg)
Interaction
User
CVInterpreter
Screen
Live camera images
Interface commands
feedback
action
• User eye movements are captured through computer vision…
• …and then transformed into commands for the on-screen PC interface
![Page 4: EyeMouse: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University](https://reader036.vdocuments.us/reader036/viewer/2022081602/5513c1f65503463a298b49ee/html5/thumbnails/4.jpg)
• External eye and iris are captured by elastic template matching (snakes)
Eye capture
Snake template
Iris (circle)external eye
(ellipse)
![Page 5: EyeMouse: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University](https://reader036.vdocuments.us/reader036/viewer/2022081602/5513c1f65503463a298b49ee/html5/thumbnails/5.jpg)
Eye remapping
Image plane Screen plane
• The iris position in the image is remapped onto the screen plane
• The image-to-screen map is calibrated at startup
![Page 6: EyeMouse: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University](https://reader036.vdocuments.us/reader036/viewer/2022081602/5513c1f65503463a298b49ee/html5/thumbnails/6.jpg)
• Navigation: eye movements
• Selection: eye persistence, eye blinks
Mouse functionalities
• Interface feedback compensates for slight remapping errors
![Page 7: EyeMouse: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University](https://reader036.vdocuments.us/reader036/viewer/2022081602/5513c1f65503463a298b49ee/html5/thumbnails/7.jpg)
![Page 8: EyeMouse: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University](https://reader036.vdocuments.us/reader036/viewer/2022081602/5513c1f65503463a298b49ee/html5/thumbnails/8.jpg)
![Page 9: EyeMouse: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University](https://reader036.vdocuments.us/reader036/viewer/2022081602/5513c1f65503463a298b49ee/html5/thumbnails/9.jpg)
“X” movement
![Page 10: EyeMouse: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University](https://reader036.vdocuments.us/reader036/viewer/2022081602/5513c1f65503463a298b49ee/html5/thumbnails/10.jpg)
“O” movement
![Page 11: EyeMouse: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University](https://reader036.vdocuments.us/reader036/viewer/2022081602/5513c1f65503463a298b49ee/html5/thumbnails/11.jpg)
Current work
• Accommodation of head motion
• Automatic recovery of tracking errors for prolongated interaction
![Page 12: EyeMouse: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University](https://reader036.vdocuments.us/reader036/viewer/2022081602/5513c1f65503463a298b49ee/html5/thumbnails/12.jpg)
Contacts
Prof. Carlo Colombo
Dipartimento Sistemi e Informatica Via S. Marta 3 – Firenze
Centro di Eccellenza MIUR per la Comunicazione e Integrazione dei Media
Sede RAI, Largo A. de Gasperi 1 - Firenze
www.dsi.unifi.it/users/[email protected]