Project 2 Guidance for Evaluation

1
Project 2 Guidance for Evaluation
2
From last week

• You should have devised a QA plan, which outlines
  how youre going to test the project.
• In addition to those tests (which are really for
  you) you must write up and present results from a
  user testing sessionthe bias of which is UP TO
  YOU.

3
The Bias of the Project which priorities should
you test?

• Usability
• Accessibility
• Aesthetic
• Meaning of Message
• Knowledge Understanding

4
Devising appropriate Tests

• 1. Quantitative or Qualitative?
• Justification.
• 2. Where do you get your sample from?
• Justification
• 3. How many do you sample?
• Justification
• 4. What do you know about the sample?
• Experts? Age? Suitability?

5
Methods

• Questionnaires.When do you need a CLOSED
  question, when do you need an OPEN question?
• Possible scenerios
• Successful Completion of set tasks
• A comparative study
• Visual Impact Opinion
• TEST IT FIRST.

6
Or all of these

• http//www.web-redesign.com/downloads/08_post-sess
  ion-survey.pdf
• http//www.pages.drexel.edu/zwz22/FramedLi.htm?Qu
  estion.htm

7
Accessibility

• Bobby Testing
• http//bobby.watchfire.com
• W3C Accessibility Compliance Ratings
• Browser Compatibility Chart and Printouts.

8
Observations

• Still need to be prepared
• Set Tasks.
• Add Observer NotesSample available at
• http//www.web-redesign.com/downloads/08_sample-ob
  servation.pdf

9
Evaluating the Moving Image

• How would you rate formal properties?
• Action
• Pace
• Visuals
• Dialogue
• Audio Effects
• Music

10
Evaluating the Moving Image

• How would you rate psychological properties?
• Emotional Impact
• Level of Immersion
• Level of Viewer Interest
• Level of Understanding
• Originality

11
TickList for Report

• Introduction Putting the evaluation into
  Context Audience, Aims and Objectives
• Methodology Method, Sample, Enclose
  Questionnaire, conditions, transcripts
• Findings Collation of results preferably in
  graph form where appropriate and discussion.
• Conclusions Summary Recommendations
• Bibliography Evaluation Methods