Assistive Technology Computer Mouse Control for Quadriplegics

1
Assistive TechnologyComputer Mouse Control for
Quadriplegics
May 6, 2004
Senior Engineers Joseph Jinho Lee
(COEN) Jarrod Tsukada (ELEN) Advisors Dr.
Shoba Krishnan Dr. Neil Quinn
2
Introduction

• Why are we here today?
• Computer Engineering components
• Electrical Engineering components
• Demonstration
• Closing Remarks

3
Why are we here today?

• Assistive Technology
• Quadriplegics
• To make a difference

4
Brainstorm

• Several Designs were considered
• Eye tracking
• Cheek, tongue or face movement for control
• Touch-screen style monitors (but with use of
  lasers)
• Sensors along the outside of the screen
• Physical devices for clicking

5
Existing Technology

• Gyroscope technology
• Infrared technology
• Camera Eye tracking technology
• Mechanical sensory
• Touch-pads, trackballs and alternate hand clickers

6
Motivations

• Innovative Senior Design
• Create a reliable, cost effective, accurate
  system that is easy to control
• Community
• Logitech multi-million dollar contract

7
Chosen Design

• A combination of ideas
• Laser and camera used together to control mouse
  cursor
• Webcamera tracks laser pointer controlled by
  users head.
• Mouse click controlled by eye blink.
• Phototransistor used to detect blink

8
Overview Technical Spec
9
Computer Engineering

• Communication with Webcamera
• Image Pixel Data
• Movement and Image Filtering
• Parallel Port Image Processing

10
Electrical Engineering
11
Electrical Engineering
12
Electrical Engineering
13
Demonstration

• Involuntary blink filter

14
Integration
Figure 3 Mouse Board
15
Integration
16
Demonstration

• Fully Functional Demo

17
Complete and Utter Failures

• Initial designs
• Xilinx reproduction of mouse signals
• PS/2 mouse output to driver
• Parallel Port

18
For the Future

• Developing a calibrating function
• Make the device battery powered
• Constructing an interface device
• Compacting code into interface device

19
Thank You

• Dr. Krishnan Dr. Quinn
• Yohannes
• Santa Clara University
• Google
• Budweiser

20
Questions Answers