1

1
Beyond the Desktop, Part N

• Loren Terveen
• CS 5115, Fall 2007
• November 28

2
Hall of Fame/Shame

• Today
• Paul Allex Andrew Ferk
• Tyson Malchow James Tyra
• Monday
• Erik Bakke Adam Wolf
• Thomas Jonas Jose Rivera
• ??? Is that it ???

3
Internet Radio

• Paul Allex and Andrew Ferk

4
Internet Radio

• Pandora vs. Live365

4
5
Live365 What a Shame

• Heuristics for searching
• Aesthetic and minimalist design
• Too many icons and unclear meanings
• Legend at bottom
• Prevent errors
• VIP shown, but causes error

5
6
Live365 What a shame

• Heuristics for player
• Recognition rather than recall
• Only previous song is shown
• User control and freedom
• No ability to skip song
• Aesthetic and minimalist design
• Buttons not clustered together
• Unclear separation of the player and the
  advertisement
• Match between system and real world
• Volume status is also used for buffering busy
  signal
• Visibility of system status
• Doesnt change status like/dislike

Gulf of evaluation Rating a song simply tells
you that you like the song, but does not describe
what it did.
6
7
Pandora Hall of Famer

• Heuristics for searching
• Visibility of system status
• Step by step process
• Detailed information of each step
• Animations provide good feedback
• User control and freedom
• Ability to cancel actions during each step

7
8
Pandora Hall of Famer

• Heuristics for player
• Recognition rather than recall
• Ability to view all previously played songs
• User control and freedom
• Allows skipping a song that a user dislikes
• Aesthetic and minimalist design
• Soft look
• Everything on one page
• Natural dialog
• Buttons grouped together
• Visibility of system status
• Description of like/dislikes functionality
• Like/dislikes represented onscreen

8
9
Renting Movies

• Tyson Malchow
• James Tyra

10
Hall of Fame Netflix

• Obvious Affordances
• Memoryless
• Great Visibility
• Sensible Mappings
• Blatant Feedback

11
Hall of Fame Netflix

• Task Oriented
• Standards Based

12
Hall of
Shfame? Redbox.

• Great Mappings
• Task Oriented
• Obvious Affordances
• Blatant Feedback

13
Hall of Shfame? Redbox.

• Not Such Amazing Visibility
• Memory-ish
• Usage Context Less Than Perfect
• Must Leave House

14
Hall of Shame Real Life
AKA BlockBuster

• Obvious Affordances
• Sensible Mappings
• Standards Based

15
Hall of Shame Real Life
AKA BlockBuster

• More Steps Reqd
• Poor Feedback
• Horrid Visibility
• Memory-dependant
• Must Leave House

16
The Personal Computer Xerox Star, circa 1980
What do you notice?
17
One direction - mobile device applications

• Our focus how to evaluate

18
(No Transcript)
19
Challenges?
20
Challenges!

• Less memory but increasing!
• Less processing power but increasing!
• Small display and (more or less) fixed!
• Low bandwidth
• Limited input
• Often used in public
• Often used while people are with friends
• Often used while people are moving
• Often used while people have at least part of
  their elsewhere
• Heterogeneous hardware

21
Mobility 2.0

• Social
• Location-aware
• A couple of examples

22
Scenarios

• While Im in the grocery store, Id like to know
  if any of the items I typically buy are on sale
• While Im dropping my kids off at school, I
  realized it would be really convenient to find
  another parent at the school to carpool with
• Id like somebody whos passing by the Starbucks
  at Stadium Village to pick me up a Venti Decaf
  Latte and bring it to my office
• I often go from my office to the Rec Center to
  the coffee shop, then back to my office

23
Exercise

• Consider methods
• LoFi prototyping
• Cognitive walkthroughs
• Heuristic evaluation
• Questionnaires
• Interviews
• Workshops / Focus Groups
• Observation
• Which one(s) would work best to gather user
  requirements in this case? How well would any
  methods work? Why?

24
More methods, more examples
25
Time Diary (Rieman 1993)
How well would this method work for these
scenarios?
26
Limits of self-reported data

• Basic problem hard for people to remember and
  take time to enter data
• Failure of recall esp. for unremarkable
  everyday events
• Bias you remember the unusual
• Bias you remember what you expect to have
  happened
• Bias you remember what you think the
  experimenter wants you to remember

27
A couple of recent examples

• illustrating still more methods

28
Youve built this PlaceMail
Pick up my vacation pictures

• Create message
• a. Web interface
• b. Audio or text on cell phone

2. Select delivery place (delivery time, or
place time also available)
3. Receive message at requested place/time
Pick up my vacation pictures
29
How do you evaluate it?
30
4 week field study

• How do people use it?
• How did (do) they get along without it?
• Existing practices strengths and weaknesses(
  opportunities for us)
• A probe
• How well did it work?
• Lists ? good (web interface)
• Delivery scheme ? learned lots of stuff!
• Tasks are complicated
• How do we need to change it?

31
Why did we have to build a system to learn this
stuff?

• Could we have done it with mockups?

32
Alternative Approach

• Consolvo, Smith et al
• Idea location disclosure/sharing app
• Keep my spouse always aware of my location
• My mother/boss/friend/ wants to know where I am
  know should I tell her/?
• What to test?
• How to test?

33
Reno application
34
Experience Sampling Method (ESM)

• Subjects are periodically prompted to enter data,
  typically by answering a few questions
• Fixed interval random interval on event (up to
  user)
• Traditionally, prompting was via a beeper
  (beeper studies) and questionnaire was filled
  out with paper and pencil
• New technologies
• Call cell-phone, listen to voice prompts, press
  buttons or speak responses
• Blackberry pager
• Handheld computer

35
Summary of experimental methods covered

• Surveys
• Interviews
• Observation
• Controlled (laboratory) experiments
• Field experiments
• Field studies
• Time diaries
• Experience Sampling Method