Sunny Consolvo

1

• Sunny Consolvo
• Alan Coopersmith
• Anthony Polito
• Clifford Tham
• November 21, 1997
• Pilot Usability Test
• Computer Science 160
• Professor James Landay

2
Outline

• Overall Problem / Introduction
• Changes From Last Prototype
• Pilot Usability Test
• Procedure
• Results
• Possible Changes For Next Prototype
• Demonstration
• Acknowledgements
• Q A

3
The Problem

• Traditional Paper Cookbook
• Cannot customize recipes
• Sometimes ingredients or terms are unfamiliar
• Extensive glossaries are usually not present
• Recipes and terms may be in more than one book
• CUIZINE
• An electronic cookbook that solves all of these
  problems and adds functionality a traditional
  cookbook never could provide

4
Changes From Last Prototype

• Added Close Button to each window
• Added More Pictures and Real Recipes
• to create realistic situations and to test
  scrolling

5
Changes From Last Prototype (continued)

• Color Scheme - trendier cafe/bistro look

6
Changes to the Recipe Finder

• Clear Search Options Button added

• Search for Any Word Search for All Words

7
Changes to the Recipe Finder (continued)

• Added Text Boxes to the Choose Ingredient and
  Choose Category Windows to be consistent with
  other windows.

8
Changes to the Recipe Index

• Favorites have been implemented
• The Recipe Indexs Category List now has a tab
  for Favorites.

• The user can add recipes to their Favorites.

9
Changes to the Menu Planner

• Completely redesigned
• Added alphabetical list of all recipes (with text
  box)

• Smaller Recipe Finder and Recipe Index buttons

10
Other Changes

• Improved Icons
• more appropriate

11
Other Changes (continued)

• Status bar feedback when recipe added to menu plan

12
The Pilot Usability Test

• The last user test performed on CUIZINE was the
  low-fidelity prototype
• We needed to see how users would respond to
  CUIZINEs new electronic version

13
Procedure

• Greeting
• Script
• Disclosure and Pre-Test Forms
• 5 Minutes to Explore CUIZINE
• 3 Tasks
• Post-Test Forms and Debriefing

14
The Participants

• Who
• 5 Friends (2 Female, 3 Male)
• 4 Students, 1 Professional
• 3 Programmers, 1 Psychology Student, 1 Physics
  Student
• Ages 22 thru 33
• Novice and Expert Computer Users

15
Test Measurements

• Time
• Critical Incidents

16
Simple Task

• Find a recipe for chocolate chip cookies.
• Searching for a recipe is one of the most basic
  tasks that users perform using cookbooks.
• Most people know what chocolate chip cookies are.

17
Simple Task Results

• Average of critical incidents 1.2
• All 5 participants completed the task with ease
• All participants completed task

18
Moderate Task

• Your friend has just told you about this great
  ingredient called radicchio. You want to try
  some, however you are uncertain about exactly
  what it is. Do some research on radicchio. Find
  a recipe that includes it. Be certain you
  understand the other ingredients in the recipe.
• In order to perform this task, the participant
  was required to use multiple features.

19
Moderate Task Results

• Average of critical incidents 4.4
• This task was more difficult for the participants
  than we had anticipated
• 1 - 5 min. to complete
• Only four participants completed this task

20
Difficult Task

• You want to throw a dinner party. You want to
  create a menu for your party. It should include
  at least one entrée (that uses chicken breasts or
  chicken stock), one alcoholic beverage, and one
  dessert (that uses some kind of fruit). You
  would like to give a copy of the menu to your
  friend.
• This task requires the user to use many of the
  features of CUIZINE in unison.
• The user may perform this task using a variety of
  methods

21
Difficult Task Results

• Average of critical incidents 3.6
• 3 - 6 min. to complete
• Only four participants completed this task

22
Short Demonstration

• Search for the Winter Red Salad using the Recipe
  Index
• Look up Radicchio taking a link from the recipe
• Add the Winter Red Salad to the Menu Planner
• Look up Beer in Glossary

23
Problems Found During Testing

• Most trouble was with the Recipe Finder
• Participants were confused about the wording of
  the search radio buttons

24
Problems (continued)

• Participants believed that they could type in the
  white boxes of the Category and Ingredient Search

25
Things we would change to the experiment

• Recording apparatus
• More comfortable testing environment

26
Possible Changes for Next Prototype

• Recipe Finder
• Modify
• AND, OR search wording
• Appearance of non-text field boxes
• Menu Planner
• Change double-click to open recipe rather than
  add recipe to plan
• Glossary
• Link from glossary item or term to recipes

27
Acknowledgements

• We would like to thank...
• our 5 Pilot Usability Test Participants
• the group that performed the Heuristic Evaluation
  of CUIZINE
• the web sites we used to gather information

28
Questions
29
(No Transcript)