Senior Capstone Project Gaze Tracking System

1
Senior Capstone ProjectGaze Tracking System

• Proposal Presentation
• IRALAR
• Breanna Heidenburg -- Michael Lenisa --
  Daniel Wentzel
• Advisor Dr. Malinowski

2
Presentation Outline

• Project Overview
• System Design
• Functionality
• Progress
• Demonstration
• Future Plans

3
Project Overview

• Summary,
• Applications,
• Previous Work

4
Project OverviewSummary

• Track a users eye
• Use input to control computer
• Mouse/Tablet Functionality
• Create user interface
• Augmented/Mixed Reality
• Heads Up Display (HUD)

5
Project OverviewApplications

• Biomedical
• Allow control for patients who would otherwise
  not be able to control a computer.
• Marketing
• To see how people read documents
• Important for use when companies create new
  advertisements

6
Project OverviewPrevious Work

• Patents
• Research work
• Oculog
• OpenEyes
• OpenCV
• Commercially available solutions

7
Project OverviewPrevious Work Patents

• Eye tracking
• Visible Spectrum
• Infrared Spectrum
• Controlling a cursor on a screen
• At a distance
• Head mounted
• Augmented reality
• Proposed for use in medical scenarios

8
Project OverviewPrevious Work Research

• Oculog
• Infrared spectrum
• Similar mounting
• Controlled MIDI devices
• OpenEyes
• Visible spectrum
• Starburst algorithm
• OpenCV
• Masters Thesis
• Very similar Problems -gt Solutions

9
Project OverviewPrevious Work OpenCV

• Developed by Intel in 2002
• Library for Open Source Computer Vision
• Written in C
• Provides functions for image manipulation and
  calculations

10
Project OverviewPrevious Work Commercial
Solutions

• Tobii
• Non-intrusive
• Mounted below desktop monitor
• faceLAB
• Multiple eye tracking
• Detects fatigue
• Driver State System
• Measures driver fatigue
• EyeLink
• Uses HMD
• 3 cameras

11
System Design

• Goals,
• Block Diagram,
• Software Flow

12
System DesignGoals

• Build upon previous designs
• Replicate/Improve results
• Methods
• Visible spectrum imaging
• Logitech Webcam
• OpenCV
• Multiple positioning algorithms will be used
• Move cursor
• Built into Windows
• User Interface
• Generated using SVG (Scalable Vector Graphics)

13
System DesignBlock Diagram
14
System DesignSoftware Flow
15
Functionality

• Requirements Specifications

16
FunctionalityRequirements

• Can be carried by one person
• At least one image capture device
• Stationary display
• Ability to initiate an action
• Mouse Click
• Method to test accuracy of system

17
FunctionalitySpecifications

• Resolution
• Horizontal 12.8 Pixels
• Vertical 9.6 Pixels
• VGA resolution 2
• Frame Rate
• Minimum 2 fps (500 mS)
• Maximum 30 fps ( 33 mS)
• Best Case 10 fps (100 mS)
• Maximum determined by camera refresh rate

18
Progress

• Software Progress,
• Demonstration,
• Time Entered

19
ProgressSoftware Progress

• Eye Tracking Application
• Cursor Movement
• Test UI

20
Progress Software Progress Eye Tracking

• Software can recognize eye
• Programmatically displays calculated results
• Algorithm
• Edge detection
• Shape recognition
• Problems
• Poor performance
• Lighting
• Eye color
• Reflections

21
Progress Software Progress Cursor Movement

• Cursor Movement functions properly
• Function call to
• Move cursor to given coordinates
• Perform action
• Left Click
• Right Click

22
Progress Software Progress Test UI

• Test UI complete
• Scalable Vector Graphics (SVG)
• Automatic Generation (scripted)
• Resolution
• Percentage Specification
• Detects cursor position
• Changes sector color

23
Progress Software Progress Test UI
24
Progress Software Progress Test UI
25
ProgressDemonstration
26
ProgressTime entered

• Total Hours Entered
• 206 Hours

27
Future Plans

• Required Parts,
• Project Division,
• Timeline,
• Competition

28
Future PlansRequired Parts

• Head Mounting Unit
• Camera (Logitech Quick Cam for Notebooks)
• Lighting system (LEDs)
• Polarizing Filter
• Mobile Computer
• ASUS EeePC
• Head Mounted Display
• Vuzix m920
• LitEye-500

29
Future PlansProject Division
30
Future PlansTimeline
31
Future PlansCompetition

• RESNA
• Biomedical Design Competition
• Entry due May 5th, 2008
• Older entries
• Topics vary from year to year
• 1998 submission
• eye tracking systems for alternative input

32
Questions