Speech Recognition Synthesis

1
Speech Recognition (Synthesis)

• Chantel Bowie
• Intro 2 Research
• Spring 2K7

2
The Beginning

• Summer 2K5
• Dr. Allen
• REU (FAMU Math Department)
• Lamour Roberts
• Research Group Dr. Humphries, Dr. Black, Dr.
  Allen, Marko Skarika, Jason Greenwell, Lamour
  Roberts, Garreth Williams, myself
• Ambient/Ubiquitous/Pervasive Environments -gt
  Smart Environments
• Speech Recognition

3
Smart Environment Scenario

• Usual morning routine
• Wake up _at_ 6 am (alarm clock)
• Turns on television for morning news
• News goes off, turns on music (radio/cd)
• Dressed by 730
• Grabs cup of freshly brewed tea/coffee on the way
  out

4
Smart Environment Scenario

• Usual morning routine ? automated morning routine
• TIMESAVER!!!!!

5
The AyoBoard
6
The AyoBoard
7
The AyoBoard Speech
8
SALT

• Speech Application Language Tags
• Speech Add-in (Plug-in)
• Internet Explorer browsers
• Mark-up Language Extension
• Tags (Things I Learned about SR/SS)
• Prompt (Speaks to you)
• Recognition (start, stop, continuous)
• Speech-to-text
• Grammar
• Synthesis
• Text-to-speech

9
SALT/Grammars

• Software
• Microsoft Speech Server
• 180 Trial Edition
• Telephony tutorial/example
• Grammars for recognition
• Spoken language
• Are things said the correct way/way you are
  expecting

10
Grammar Pizza Tutorial (Telephony)
11
JSGF Example (Pizza Tutorial)

• Utters
• uh
• a
• Request
• I would like
• Id like
• Give me
• Ill have

12
Grammar Pizza Tutorial (Telephony)
13
JSGF Example (Pizza Tutorial)

• Size
• small
• medium
• large
• extra large
• Pizza
• Please

14
JSGF

• What It Actually Looks Like
• Grammar file representation
• Test in TalkingJava SDK
• Grammar defined accepts
• Small pizza
• Id like uh uh uh uh a large pizza
• Give me medium please
• Extra large pizza please

15
JSGF Software

• Software
• CloudGardens TalkingJava SDK
• Testing purposes
• Actual use

16
Chapter 2

• Tools, Environment, Experimental Design
• CloudGarden Talking SDK
• SpeechClipse
• Speech recognition/synthesis plug-in for Eclipse
  IDE
• Uses CloudGarden Talking SDK