Intro

1
Introduction

• Intro
• Background
• Work Completed
• Present Work
• Future Plans
• Schedule
• Conclusion

2
CSIDC 2005- Envirosense- Goals
Introduction
3
- Computer Society International Design
Competition- Theme Going Beyond the
Boundaries- Ingenuity and Originality
Introduction
CSIDC 2005
4
- device to assist a hearing impaired person to
have a better sense of his/her surroundings
Introduction
Envirosense
5
computer based prototype- future use of a PDA
in conjunction with a vibrating motor, etc- to
create a portable device to assist people with
hearing impairments
Introduction
Goals
6
Background

• Spectrum Analysis
• Fourier Series representation of f(t)
• Fast Fourier Transform (FFT)

7
Background
We can use a Fourier Series to represent a time
domain waveform as follows
                                               (5)
8
Spectrum analysis Time domain plot of incoming
sound
Sum of 6 pure sinusoids at f 2, 4, 6, 8, 10 and
12 Hz
9
Spectrum Analysis Frequency domain plot of
incoming sound
Here we see the 6 frequency components
10
Spectrum Analysis Frequency domain plot of Lego
Robotics sounds
It is difficult to tell which frequencies are
present by looking at plot
11
Background

• Parametric vs. Non-Parametric
• pyulear vs. pwelch functions in MATLAB

Parametric(x,y)
Non-Parametric
pyulear
pwelch
12
pyulear plot of phone ringing pyulear plot of
fire alarm
pwelch plot of phone ringing pwelch plot of fire
alarm
13
Work Completed
Brainstorming

• 30 ideas that we considered
• Divided into 4 categories
• Environmental
• Medical
• Poverty
• Crime
• Research

14
Narrowing down the Choices
Work Completed

• Narrowed down to 16 choices for further research
• Final 4 choices were
• Miniature water testing device attached to tap
• Icon glasses for the hearing impaired
• Seizure detection for people with epilepsy
• Sound sensor for cars that mutes stereos in
  response to important sounds

15
Work Completed
The Final Decision

• Met with Professor Wainer
• Chose between the seizure detection device and
  the icon glasses for hearing impaired
• Decided on doing a prototype of the icon
  glasses.
• Began research on the icon glasses and how we
  could implement it.

16
Work Completed

• Research on how to design prototype
• - PDA vs. Laptop
• - Vibration motors and microphones

17
Work Completed

• Research on how to design prototype
• -PRAAT / Sigview

18
Work Completed

• Why use Matlab?
• Easier to prototype than C, C, or assembler
• Sample code on web and SYSC4405 (DSP)
• Familiarity with Matlab (SYSC 4405)
• Can use it to create GUI for prototype

19
Work Completed

• FFT / Spectrum analysis
• - pros and cons
• - infinite number of samples required
• - non-tractable problem
• - use approximation by DTFT/DFT/FFT

20
Present Work
Block Diagram
Microphone
Processor
Output
System Overview
21
Present Work
Spectral pwelch Analysis
Record Sound
A to D Conversion
Store Data
Learning Mode
22
Present Work
Receive Sound
A to D Conversion
Clean-up filter
Spectral pwelch Analysis
Output or Continue
Compare
Listening Mode
23
Present Work

• - pyulear
• pwelch
• demo

24
Present Work
25
Present Work

• - pwelch
• - Spectrum analysis
• Combination

26
Present Work
Database

• Need to store the recognized sounds such that
• Sounds are easily searchable
• Can add/remove sounds
• Can extract information about the type of sound
  to give feedback to the end user.

27
Present Work
Database

• Stored in a separate file with database
  functions
• addsound(soundname, soundinfo)
• removesound(soundname)
• comparesound(receivedsound)

28
learning mode- listening mode- output
Present Work
GUI
29
Operating mode of the system
What needs to be done . . .

• Will it be constantly listening?
• - power issues
• - processing issues
• Use interrupt driven system?
• - only processes the sounds that pass a certain
  threshold
• - saves power
• - programming/hardware issues

30
Final Design
What needs to be done . . .

• Implement GUI
• Decide how program will work in listening mode
• Will not get to PDA stage, but must consider this
  transition
• Feedback system needs to be designed with
  external devices in mind

31
What needs to be done . . .
Lego Robotics

• - Remote Units
• Lego Robotics to communicate with remote unit
• - Real implementation will likely use radio
  transmission to control strobe lights

32
What needs to be done . . .
Future Potential

• Device could be implemented using a PDA
• Eventually could use an embedded controller

33
Schedule
34
CSIDC- Envirosense- Computer-based
prototype- Possible future PDA application
Conclusion