Rapid Prototyping Dialog Design 1

1
Rapid PrototypingDialog Design 1

• WIMP

2
Agenda

• WIMP
• Advantages, disadvantages, design guidelines
• Direct manipulation
• Definition, Advantages disadvantages
• Speech
• Speech generation
• Speech recognition
• Natural language interfaces
• Homework / Project hints

3
(No Transcript)
4
WIMP

• Focus Menus, Buttons, Forms
• Predominant interface paradigm now (with some
  direct manipulation added)
• Advantages
• ?

5
Menus

• Key advantages
• 1 keystroke or mouse operation vs. many
• No memorization of commands
• Limited input set

6
Menus

• Many different types
• pop-up
• pull-down
• radio buttons
• pie buttons
• hierarchies

7
Menu Items

• Organization strategies
• Create groups of logically similar items
• Cover all possibilities
• Ensure that items are non-overlapping
• Keep wording concise, understandable

8
Bad Example

• Travel web page links
• Flight page
• 3 Best Itineraries
• Flights Prices
• Timetables
• Fares
• Which do you choose for reservations?

9
Presentation Sequence

• How does Mac, Netscape, etc, do it?
• Use natural if available
• Time
• e.g. Breakfast, Lunch, Dinner
• Numeric ordering
• e.g. Point sizes for font

10
Presentation Sequence

• Choices
• Alphabetical
• Group related items
• Frequently used first
• Most important first
• Conventional order (MTWRF)
• Dont change the order on the fly!

11
Presentation Sequence

• User studies
• Novices alpha gt functional gt random
• Experts categorization
• How would you do it in general?

12
Presentation Sequence

• One possible methodology (first-gtlast)
• Natural order (if exists)
• Frequency of use
• Order of use
• Categorical
• Alphabetical
• Dont change dynamically!

13
Dialog Design

• 1. Command language
• 2. WIMP
• 3. Direct manipulation
• 4. Speech
• 5. Pen, gesture, VE

14
Direct Manipulation

• 1) Continuous visibility of the objects and
  actions of interest
• 2) Rapid, reversible, incremental actions
• 3) Replacement of command language syntax by
  direct manipulation of object of interest

15
Direct Manipulation

• Examples
• WYSIWYG editors and word processors
• VISICALC - 1st electronic spreadsheet
• CAD
• Desktop metaphor
• Video games

16
(No Transcript)
17
DM Essence

• Representation of reality that can be manipulated
• The user is able to apply intellect directly to
  the task
• The tool itself seems to disappear

18
Direct Manipulation

• Advantages

• Disadvantages

19
DM Problems

• Waste of screen space (info not all that dense)
• Need to learn meaning of components of visual
  representation
• Visual representation may be misleading
• Mouse ops may be slower than typing
• Not self-explanatory (no prompts)

20
DM Problems

• Not good at
• Repetition
• History keeping (harder)
• Certain tasks (Change all italics to bold)
• Macros harder

21
DM Advantages

• Easier to learn remember
• Direct WYSIWYG
• Flexible, easily reversible actions
• Provides context instant visual feedback
• Exploits human use of visual spatial cues
• Limits types of errors

22
What is DM?

• Word? Emacs?
• In end, must characterize direct manipulation by
  feeling of directness and illusion of
  manipulating objects at hand

23
Dialog Design

• 1. Command language
• 2. WIMP
• 3. Direct manipulation
• 4. Speech
• 5. Pen, gesture, VE

24
Speech Input

• Speech synthesis
• Speaker recognition
• Speech recognition
• Natural language understanding

25
(No Transcript)
26
English Speech

• Made up of 40 phonemes, 24 consonants and 16
  vowels

27
Speech Synthesis

• Often hear robotic voice
• Store tones, then put them together
• -gt The transition is the difficult thing to do

28
Speaker Recognition

• Tell which person it is (voice print)
• Could be important for monitoring meetings

29
Speech Recognition

• Primarily identifying words
• Improving all the time
• Commercial systems
• IBM ViaVoice, Dragon Dictate, ...

30
Recognition Dimensions

• Speaker dependent/independent
• Parametric patters are sensitive to speaker
• With training (dept) can get better
• Vocabulary
• Some are getting 50,000 words
• Isolated word vs. continuous speech
• Continuous where words stop begin
• Typically a pattern match, no context used

31
Recognition Systems

• Typical system has 5 components
• Speech capture device - Has analog -gt digital
  converter
• Digital Signal Processor - Gets word boundaries,
  scales, filters, cuts out extra stuff
• Preprocessed signal storage - Processed speech
  buffered for recognition algorithm
• Reference speech patterns - Stored templates or
  generative speech models for comparisons
• Pattern matching algorithm - Goodness of fit from
  templates/model to users speech

32
Errors

• Systems make four types of errors
• Substitution - one for another
• Rejection - detected, but not recognized
• Insertion - added
• Deletion - not detected
• Which is more common, dangerous?

33
Natural Language Understanding

• Putting meaning to the words
• Input might be speech or could be typed in
• Holy grail of Artificial Intelligence problems

34
NL Factors/Terms

• Syntactic
• Grammar or structure
• Prosodic
• Inflection, stress, pitch, timing
• Pragmatic
• Situated context of utterance, location, time
• Semantic
• Meaning of words

35
SR/NLU Assessment

• Advantages

• Disadvantages

36
SR/NLU Advantages

• Easy to learn and remember
• Powerful
• Fast, efficient (not always)
• Little screen real estate

37
SR/NLU Disadvantages

• Doesnt work good enough yet
• Assumes knowledge of problem domain
• Not prompted, like menus
• Requires typing skill (if keyboard)
• Enhancements are invisible
• Expensive to implement

38
Good in Situations

• Hands busy
• Mobility required
• Eyes occupied
• Conditions preclude use of keyboard
• Visual impairment
• Physical limitation

39
Project Part 3

• Decide on a design
• Implement a prototype
• (Develop evaluation plan)

40
Homework 1 Problems

• Organizing your report
• What is this about?
• Who are the users? Implications on design?
• Discussion of design decisions
• Then the details
• NOT another Amazon
• NOT another PDA

41
Homework 1 Problems

• What if there are too many search results? How to
  compare one book with 100 others?
• How to serve people who don't exactly know what
  they want?
• Use "real" examples
• Give enough detail (doesn't mean the thicker the
  better)