1
EyeMouse An interaction device for severely
motor-disabled people

• Carlo Colombo, Massimiliano Corsini
• Media Integration and Communication Center
• University of Florence

2

EyeMouse

• Human-machine interaction system replacing the
  mouse with eye movements

• Designed to exploit the residual mobility of
  severely motor-disabled people (e.g. multiple
  sclerosis)

3

Interaction

• User eye movements are captured through computer
  vision
• and then transformed into commands for the
  on-screen PC interface

CVInterpreter
Interface commands
Live camera images
User
Screen
action
feedback
4

Eye capture

• External eye and iris are captured by elastic
  template matching (snakes)
  

Snake template
Iris (circle)
external eye (ellipse)
5

Eye remapping
Image plane
Screen plane

• The iris position in the image is remapped onto
  the screen plane
  

• The image-to-screen map is calibrated at startup
  

6

Mouse functionalities

• Navigation eye movements
• Selection eye persistence, eye blinks

• Interface feedback compensates for slight
  remapping errors

7

8

9

X movement
10

O movement
11
Current work

• Accommodation of head motion
• Automatic recovery of tracking errors for
  prolongated interaction

12
Contacts

• Prof. Carlo Colombo
• Dipartimento Sistemi e Informatica
  
  Via S. Marta 3 Firenze
• Centro di Eccellenza MIUR per la Comunicazione
  e Integrazione dei Media
• Sede RAI, Largo A. de Gasperi 1 - Firenze
• www.dsi.unifi.it/users/colombo
• colombo_at_dsi.unifi.it