Speech Graffiti Tutorial

1
Speech Graffiti Tutorial

• MovieLine version
• Fall 03

2
What is Speech Graffiti?

• SPEECH GRAFFITI is a special way of speaking that
  makes it faster for you to exchange information
  with a computer that understands your speech.
• Speech Graffiti is easy to learn
• This tutorial will teach you how
• This tutorial uses a movie information system as
  an example, and afterwards you should be able to
  use any Speech Graffiti application.
• Let's get started!

3
Phrases

• With Speech Graffiti, you provide information to
  the system as if you were filling in a form.
• Say you're wondering what time Titanic is playing
  at the Manor theater on Tuesday.
• On a form, you'd have to fill in this
  information

• With Speech Graffiti, you speak this information
  in PHRASES just as if you were filling out a
  form one phrase for each piece of information
• The phrases always sound like this
• movie is Titanic, theater is the Manor, day is
  Tuesday

4
Phrases

• With Speech Graffiti, you provide information to
  the system as if you were filling in a form.
• Say you're wondering what time Titanic is playing
  at the Manor theater on Tuesday.
• On a form, you'd have to fill in this
  information

• With Speech Graffiti, you speak this information
  in PHRASES just as if you were filling out a
  form one phrase for each piece of information
• The phrases always sound like this
• movie is Titanic, theater is the Manor, day is
  Tuesday

• See the pattern?

5
Phrases

• With Speech Graffiti, you provide information to
  the system as if you were filling in a form.
• Say you're wondering what time Titanic is playing
  at the Manor theater on Tuesday.
• On a form, you'd have to fill in this
  information

• With Speech Graffiti, you speak this information
  in PHRASES just as if you were filling out a
  form one phrase for each piece of information
• The phrases always sound like this
• movie is Titanic, theater is the manor, day is
  Tuesday

• See the pattern?
• You always give the type of thing you're talking
  about

6
Phrases

• With Speech Graffiti, you provide information to
  the system as if you were filling in a form.
• Say you're wondering what time Titanic is playing
  at the Manor theater on Tuesday.
• On a form, you'd have to fill in this
  information

• With Speech Graffiti, you speak this information
  in PHRASES just as if you were filling out a
  form one phrase for each piece of information
• The phrases always sound like this
• movie is Titanic, theater is the manor, day is
  Tuesday

• See the pattern?
• You always give the type of thing you're talking
  about
• then say is

7
Phrases

• With Speech Graffiti, you provide information to
  the system as if you were filling in a form.
• Say you're wondering what time Titanic is playing
  at the Manor theater on Tuesday.
• On a form, you'd have to fill in this
  information

• With Speech Graffiti, you speak this information
  in PHRASES just as if you were filling out a
  form one phrase for each piece of information
• The phrases always sound like this
• movie is Titanic, theater is the manor, day is
  Tuesday

• See the pattern?
• You always give the type of thing you're talking
  about
• then say is
• then state the value you want to specify for that
  field.

8
Other applications

• As you just learned, input might look like this
  in a movie application
• movie is Titanic, theater is the Manor, day is
  Tuesday
• But Speech Graffiti works with many different
  applications
• For instance, in a flight information system, you
  might say
• airline is USAirways,
  flight
  number is 28,
  departure city
  is Los Angeles
• So you can see that although the vocabulary is
  different, the structure is the same

9
Confirmation

• The Speech Graffiti system will always confirm
  what it thought it heard you say

movie is Titanic
Titanic
theater is the Manor, date is Tuesday
the Cinemagic Manor theater, Tuesday
start over

• If anything goes wrong, you can start over by
  saying start over

10
Practice phrases

• How would you make Speech Graffiti phrases with
  the following information?
• 1. Showcase East theater
• 2. on Sunday
• 3. comedies

11
Practice phrases

• How would you make Speech Graffiti phrases with
  the following information?
• 1. Showcase East theater
• 2. on Sunday
• 3. comedies

• theater is Showcase East

12
Practice phrases

• How would you make Speech Graffiti phrases with
  the following information?
• 1. Showcase East theater
• 2. on Sunday
• 3. comedies

• theater is Showcase East
• day is Sunday

13
Practice phrases

• How would you make Speech Graffiti phrases with
  the following information?
• 1. Showcase East theater
• 2. on Sunday
• 3. comedies

• theater is Showcase East
• day is Sunday
• genre is comedy

14
If things go wrong

• If the system doesnt understand a phrase, it
  wont confirm it, and it will also play this
  sound to alert you that it missed something.  
• Then you can simply repeat the missing phrase,
  like this   

theater is Showcase East, genre is thriller
theater is Showcase East 
Showcase Cinemas Pittsburgh East
15
If things go wrong

• Sometimes the system confirms the wrong
  information
• If this happens, you can erase your whole last
  utterance by saying scratch that, and then
  re-entering the erased info

theater is the Manor,
show time is after 7pm
Cinemagic Manor Theater, after 10 pm
scratch that 
scratched
theater is the Manor
Cinemagic Manor Theater
show time is after 7pm
after 7 pm
16
Where was I?

• If you ever find yourself wondering what
  information the system has successfully
  understood and retained from your query, you can
  just ask where was I?

movie is Titanic
Titanic
theater is Regent Square,
show time is before 10 pm
where was I?
movie is Titanic, show time is before 10 pm
theater is Regent Square
Regent Square theater
17
Review

• So now you know how to give information in Speech
  Graffiti phrases
• theater is the Manor
• How to recover from problems
• start over
• scratch that
• How to find out what the system has stored
• where was I?
• But you don't want to just give info to the
  system you want to get info from it
• That's the next thing you'll learn

18
Asking questions

• To get information, ask a what?-question

theater is the Manor, movie is Titanic
Cinemagic Manor Theater, Titanic
what are the show times? 
3 show times 525pm, 810pm, 1130pm
19
Asking questions

• To get information, ask a what?-question

theater is the Manor, movie is Titanic
Cinemagic Manor Theater, Titanic
what are the show times? 
3 show times 525pm, 810pm, 1130pm

• So you just say

20
Asking questions

• To get information, ask a what?-question

theater is the Manor, movie is Titanic
Cinemagic Manor Theater, Titanic
what are the show times? 
3 show times 525pm, 810pm, 1130pm

• So you just say
• what are (or what is)

21
Asking questions

• To get information, ask a what?-question

theater is the Manor, movie is Titanic
Cinemagic Manor Theater, Titanic
what are the show times? 
3 show times 525pm, 810pm, 1130pm

• So you just say
• what are (or what is)
• and then the thing you want to know about

22
Asking questions

• To get information, ask a what?-question

theater is the Manor, movie is Titanic
Cinemagic Manor Theater, Titanic
what are the show times? 
3 show times 525pm, 810pm, 1130pm

• So you just say
• what are (or what is)
• and then the thing you want to know about
• As another example, you could ask what is the
  rating?

23
Other applications

• As with specifying phrases, when you ask
  questions in other Speech Graffiti systems, the
  vocabulary is different but the structure is the
  same
• airline is United,
  flight number is 1123,
  arrival city is Las
  Vegas,
  what is the arrival time?

24
Getting help

• For general Speech Graffiti help, just say help
• Speech Graffiti can also let you know what kinds
  of things you can talk about in the system you're
  using
• just say options

options
show times are after 10 pm, genre options 
more
comedy, drama, or you can ask, what is the genre?
25
Lists

• The Speech Graffiti system plays this sound that
  you saw in the last slide when it is telling you
  about a long list
• Whenever you hear this sound, you can say more to
  hear the next chunk of the list
• When you're browsing a list, you can also
  navigate through the list by saying
• next gives you the next single item
• previous gives you the previous chunk
• first goes back to the first item in the list
• last skips ahead to the last item in the list
• repeat

26
Practice questions help

• How would do the following in Speech Graffiti?
• 1. find out which movies are playing at the Manor
  theater
• 2. find out all the neighborhoods you can ask
  about
• 3. hear the next chunk of a list

27
Practice questions help

• How would do the following in Speech Graffiti?
• 1. find out which movies are playing at the Manor
  theater
• 2. find out all the neighborhoods you can ask
  about
• 3. hear the next chunk of a list

• theater is the Manor, what are the movies?

28
Practice questions help

• How would do the following in Speech Graffiti?
• 1. find out which movies are playing at the Manor
  theater
• 2. find out all the neighborhoods you can ask
  about
• 3. hear the next chunk of a list

• theater is the Manor, what are the movies?
• neighborhood options

29
Practice questions help

• How would do the following in Speech Graffiti?
• 1. find out which movies are playing at the Manor
  theater
• 2. find out all the neighborhoods you can ask
  about
• 3. hear the next chunk of a list

• theater is the Manor, what are the movies?
• neighborhood options
• more

30
Review

• In Speech Graffiti, you provide information in
  phrases ask what-questions to get info
• theater is the Manor, what are the movies?
• start over and scratch that help you recover from
  errors
• where was I? lets you know what the system knows
• means the system didnt understand
  something you said, and means there are
  more items in a list

31
Hints

• When youre using a new application for the first
  time, say options to learn what you can talk
  about with that system
• Talk to the system in a normal voice
• Speech Graffiti remembers what you enter until
  you say start over
• see example on next slide

32
If the system already has a question stored,
saying go ahead will re-ask that question
theater is the Manor, what are the show times?
where was I?
theater is Cinemagic Manor theater, what is show
time?
title is Titanic, go ahead
where was I?
theater is Cinemagic Manor theater, what is show
time?, title is Titanic
33
Go ahead, part 2

• In some applications, saying go ahead will give
  you all the information for the items you provide
• Instead of asking what is the airline, what is
  the flight number, what is the departure time,
  etc.

departure city is Pittsburgh, arrival city is
Houston
from Pittsburgh, to Houston Intercontinental
connection is none, go ahead
more
34
Ready?

• OK that's all there is to know about Speech
  Graffiti! Have fun!