OutofSchool Time Evaluation: Tips for Strengthening Your Evaluation Plan

1
Out-of-School Time EvaluationTips for
Strengthening Your Evaluation Plan

• May 29, 2008
• Karin Chang-Rios, Ph.D.
• Kansas Out-of-School Time Celebration

2
What is an evaluation plan?

• Road map for data collection
• Answers nuts-and-bolts questions
• What?
• When?
• Who?
• Fluid document planning
• is an ongoing process

3
What components go into a plan?

• Outcomes
• Benchmarks/Targets
• Data/Measurements
• Sources
• Person(s) Responsible
• Timeline
• Data Analysis

4
What makes a good plan?

• Group exercise - See Case Example
• What are the plans weaknesses?
• How could it be improved?

5
Tips for strengthening your evaluation plans
6
1 Make sure your indicators represent
outcomes, not outputs.
7
(No Transcript)
8
2 Identify outcomes separately
9
3 Pick benchmarks that are attainable

• Realistic Benchmark

10
4 Select data sources (tools) that measure
your indicators
Example
11
5 Use pre/post design, if possible

• Outcomes are most reliably measured with a
  pretest/posttest design
• If not possible, use multiple measures or data
  sources

12
6 Use appropriate analytical methods

• Methods to assess changes in behavior, skill, or
  knowledge
• Percent change
• Difference score
• Consult with an expert (evaluator, researcher) if
  you are unsure which method to use

13
Resources for evaluation planning
14
Websites

• United Way Outcome Measurement Resource Network .
  www.unitedway.org/outcomes
• The Community Tool Box www.ctb.ku.edu

15
Questions?

• Karin Chang-Rios, University of Kansas,
  785-864-7041, kcr_at_ku.edu