Using Voice to Solve Ergonomic Problems

1
Using Voice to Solve Ergonomic Problems

• Dr. William Lenharth, CHFP
• UNH Project54

2
When to use Voice?

• A high level of visual activity is present.
• When hands are busy with critical tasks.
• If speeds match commands - activity

3
Problems with Voice

• Training
• Accuracy
• Noise environment
• Required hardware

4
Solutions - Hardware

• Hardware Microphone types
• - Environment driven
• - Noise Cancelling
• - Headset
• - Throat

5
Project54 Mobile Platform
6
Hardware Connectivity
7
Solution - Accuracy

• How to improve accuracy?
• - Voice engines use a statistical approach.
• - Limit correct answers by changing grammar
• e.g. If the question is, Sex? Limit grammar
• to male or female.
• Grammar is a text file easy to change.

8
Sample Grammar

•  ltradargt
• ltradargt front antenna "FRONT ANTENNA"
• ltradargt front antenna off "FRONT ANTENNA OFF"
• ltradargt rear antenna "REAR ANTENNA"
• ltradargt rear antenna off "REAR ANTENNA OFF"
• ltradargt radar "RADAR"
• ltradargt lock "LOCK"
• ltradargt lock off "LOCK OFF"

9
SOFTWARE ARCHITECTURE
10
Solution - Training

• Voice systems Speaker Dependent or
• independent.
• Voice based allows 20 variation max.
• Systems can be trained with a file to help
  improve accuracy.

11
System - Control

• Push to Talk Controls when the voice is being
  processed by the computer.
• Continuous speech such as dictation.

12
Project54

• Nine years experience
• 1200 vehicles in use daily Nationwide
• Inexperienced users - over 60,000 voice samples
  collected.

13
Project54 Voice System

• Speaker Independent
• Push-to-talk controlled
• Grammars changed on the fly
• 96 accuracy using free speech engine
• Noise cancelling microphone

14
How build your Application

• Use Project54 base software to handle speech and
  process control.
• Build your own application using P54 GUI and SUI
  support.
• Connect your control computer to your device via
  the P54 CAN2B bus and interconnect devices (or
  other).
• Deploy system and test

15
Further Information

• WWW.project54.unh.edu
• whl_at_sr.unh.edu