Measuring soft outcomes workshop

1
Measuring soft outcomes workshop

• Thursday 26th May
• Jeremy Wyatt, Sarah Johnson

2
Todays workshop

• Define soft outcomes for Active England
• Why are they difficult to track?
• 7 key features of good tracking
• Two traditional and two innovative ways
• Sources of further help and ideas

3
7 steps to effective soft measurement

• Focus on 2 3 key factors
• Ask yourself how do you really know?
• Turn your gut feel into questions or
  observations
• Check for comparators and experience elsewhere
• Design your approach and pilot it
• Collect the same data at the start, middle and
  end
• Work out how to analyse and report first (use
  visuals)
• And accept it isnt perfect but nothing is!!

4
Traditional methods

• Interviews
• Surveys questionnaires Likert scales
• Focus groups
• Self assessment forms
• Journals and diaries

5
Interview benefits and limitations

• ve
• In depth exploration
• Personalised approach
• Easy to organise

• -ve
• Relies on interviewer
• Time consuming
• Open to misinterpretation
• Communication barriers

6
Surveys and questionnaires

• Likert scale rating an answer on a scale say
  1-10
• 1 strongly disagree and 10strongly agree
• For example, on a scale of 1-10 how much do you
  agree with the following statements?
• I find it difficult to motivate myself
• I feel confident
• I enjoy meeting new people
• I get nervous about learning new things

7
Benefits and limitations

• -ve
• Answers may be superficial
• Respondent may misunderstand or misinterpret
  answers
• Lots take time to analyse

• ve
• Repeated to track progress
• Easy
• Little time to complete
• Maybe less invasive
• May be completed independently

8
Innovative ideas

• Rickter Scale
• Video
• Photos
• Audio tape
• Web based surveys

9
Using video
Lights Camera Action
10
Service user before and after video diary

• What made you come here?
• What do you hope to do here?
• What do you want to get out of it?
• What did you do ?
• What was best and worse?
• What will you do next?

11
Vox pop

• Vox pop clip

12
Benefits and limitations
-ve Answers may be superficial Lots take time to
analyse in detail Cost of equipment Need editing
skill and equipment (software and hardware)
ve Enjoyable Captures info well Gets people
talking People are often more honest Useful for
reporting and PR
13
Rickter Scale

• An innovative tool
• understanding beneficiaries needs/ developing a
  baseline
• motivational interviewing target setting
• reviewing progress towards targets evaluation

14
How does it work?

• A hand-held instrument
• Non paper based assessment tool
• Empowers clients
• Focuses attention

15
A demonstration
16
Benefits and limitations
-ve Time consuming Need training and
accreditation No use without follow up
ve Engages people Overcomes communication
barriers Measures changes over time Promotes
honesty Powerful tool for setting goals
17
Next steps
18
Training

• Rickter
• Numbers?
• Locations?
• Video
• Numbers?
• Locations?
• Creating new methods
• Numbers?
• Locations?

19
Resources
20
www.aelz.org