User testing

1
User testing

• New Technology for Supporting Students

2
Why do we do user testing?

• To improve our sites for students and enquirers
  by checking that
• users can understand the interface
• the language is clear and suitable
• the advice and guidance is relevant
• they can find the information they need

3
When and what do we do?

• Timing
• developmental testing of content
• pre-launch
• post-launch evaluation of live site
• Three types of testing, depending on project
  stage
• formal testing by observation and questioning
• informal testing
• distance

4
Formal testing

• PC-based
• prototype activity
• partially built website
• planned additions to current website
• how effectively they can use a site or carry out
  a task

5
How we start

• Establish a set of usability requirements
• users
• task
• environment
• domain of knowledge
• We combine this information with particular test
  requirements and decide how to run the sessions

6
What the process involves

• 6-8 users
• one-to-one, hands-on, questioned, videotaped
• about 45 minutes - 1 hour each person
• complete tasks
• compare options

7
Advantages

• surprisingly powerful to watch real reactions
• others can watch how people use the site or
  prototype
• record to show others
• can adjust tasks and questions over subsequent
  sessions

8
Disadvantages

• takes time to set up
• identifying and getting participants
• involves several staff for each session
• tiring for the facilitator
• time, interruptions means that participants are
  only able to test the content superficially

9
Reporting

• Report can be formal or informal, depending on
  audience and purpose
• Must include recommendations
• Use facilitator and observers notes
• Watching videos often points out items missed
  during observation

10
Informal testing

• participants with particular interest or
  knowledge
• use forms or checklists
• time limit
• useful for developmental testing
• need to attract participants
• location can be busy, noisy (or isolated)

11
Testing at a distance

• participants identified through IET, Marketing
  database, Regional enquiry
• contacted by e-mail or letter
• CD-ROM and activity feedback booklet
• designed so took about half an hour
• full comments returned, thoughtful
• followed up by some telephone interviews

12
When we use the options

• Formal testing f2f video
• Site development to check complex parts and
  navigation on prototype
• On existing sites to learn about user behaviour
  for future development
• Informal testing f2f interview
• Target particular user group for specialist site
• Paper prototype or evaluate existing site

13
When we use the options

• Distance
• Existing site for purpose, achievement of
  objectives, learning outcomes
• Timescales too long for site development stage
• Survey
• Live site, to research for new concept or
  activities

14

• welcome to observe a video session
• next one planned for February 26th, Effective use
  of English activities
• Jane Lunsford - v.j.lunsford