Evaluation Research Questions

1
Evaluation Research Questions

• Social Work 5983 Program Evaluation
• February 2, 2004

2
Evaluation Research Questions

• First step of evaluation
• Seems straightforward, but isnt easy
• Questions need to be responsive to stakeholders,
  but stakeholders do not know good evaluation
  questions
• Be prepared with your questions
• That are methodologically feasible and may
  evaluate an aspect of the program not considered
  by the stakeholders
• Write your questions on paper

3
Questions for program performance

• Questions must address performance that is
  appropriate and realistic for the program
• Questions often have to be scaled down
• Review questions in context of
• Actual program activities
• Applicable social science literature
• Know the service components of the program

4
Answerability of evaluation questions

• Questions must be answerable
• Avoid vague terminology
• Indicators must be available for measurement of
  effects
• May require too much data to answer
• Questions must address phenomena that is
  measurable

5
Criteria for program performance

• Must be included and might consist of
• Needs/wants of target population
• Program goals objectives
• Professional standards
• Customary practice/norms for other programs

6
Criteria (cont)

• Legal requirements
• Past performance, historical data
• Targets set by program managers
• Expert opinion
• Pre-intervention baseline levels
• Cost