COMPREHENSIVE PROGRAM EVALUATION

1
COMPREHENSIVE PROGRAM EVALUATION

• Internal Evaluation
• Sherri Kendall, LPC
• CEO, Aid to Victims of Domestic Abuse
• Houston
• External Program Evaluation / Research
• Jeff Temple, PhD
• Director, Behavioral Health and Research
  Department of Ob/Gyn UTMB Health

2
PROGRAM EVALUATION Part 1 Internal Evaluation

• Sherri Kendall
• Aid to Victims of Domestic Abuse (AVDA)
• Houston
• sherrik_at_avda-tx.org
• 713.715.6925

3
Basic Questions

• Why do we evaluate?
• What do we evaluate?
• How will we evaluate?
• When will we evaluate?
• What do we do AFTER weve evaluated?

4
Why evaluate?

1. To determine if we are meeting our mission.
2. To determine if we are meeting our targets/goals
   for the program.
3. Based on results, to modify program (and/or
   training) to improve program effectiveness.
4. To be able to accurately demonstrate
   effectiveness to our funders.
5. To bolster support for legislation (and funding)
   for BIPP through demonstrating effectiveness.

5
Scope of Evaluation

• Evaluation should seek to provide a balance
  between both depth and breadth, providing an
  overview of multiple evaluation criteria, and
  with the option for follow-up on areas which,
  once evaluated, are found to be problematic or
  not meeting goals.

6
What to evaluate - MISSION

• Are we meeting our mission?
• Improving Victim Safety Impact
• Reducing Offender Recidivism Continued Abuse
• Batterer Accountability
• Meeting Community Needs

• Additional Goals
• Societal Change re all forms of oppression
• Collaboration a Coordinated Community Response
• Contributing to the DV Field
• Growth-promoting, satisfying workplace
• Others??

7
Program Evaluation may be based on

• Goals
• Process
• Outcomes
• Needs Assessment
• Accreditation
• Cost/benefit Analysis
• Effectiveness
• Efficiency

8
Meeting Targets Goals

• MEASURABLE OUTPUTS
• Number of BIPP participants served
• Completion of participants vs. dropouts
• Outreach to victims
• 100 Compliance with BIPP Guidelines funder
  requirements
• Trainings, presentations, collaborations

9
Meeting Targets Goals

• MEASURABLE OUTCOMES
• Reduced abuse
• Increased victim safety
• Offender accountability
• Meeting community need

10
Measuring OUTPUTS

• Number of BIPP participants served
• MAR / Actual Outputs Report (from referral to
  exit)
• Caseload/activity measurement per facilitator
• Completion of participants vs. dropouts
• MAR dont limit your exit categories
• WHY are they dropping?
• Can high completion rate be a negative?
• Outreach to victims
• Victim Partner letters and resources
• Phone contact (safety concerns to consider)
• Compliance with BIPP Guidelines funder
  requirements
• External audit results internal ongoing
  monitoring
• Trainings, presentations, collaborations

11
Measuring OUTCOMES

• Cognitive awareness
• Pre/post tests
• Offender Exit Survey
• Exit Plan of Non-Abuse
• Reduced abuse Increased victim safety
• Recidivism rates
• Exit Survey (client victim/partner)
• Continued follow-up
• Meeting community need
• Operating groups in under-served areas
• Accessibility to clients (cost, schedule,
  location)
• Community Partner Referral Surveys
• Making trainings, presentations, consultations
  available to community partners (not for purposes
  of profit)

12
When to begin program evaluation

• NOW!
• Start small
• INCREASE in breadth and depth as you can.

13
Post-Evaluation

• Step 1 Analyze data, share with Board and
  Staff
• Step 2 Set NEW goals targets
• Step 3 Develop Plan of Action to meet goals
• Step 4 Implement Plan of Action

14
Step 5??

• Repeat Steps 1-4

15
Resources

• http//managementhlep.org/evaluation/program-evalu
  ation-guide.htm
• http//www.aecf.org/KnowledgeCenter/Publications.a
  spx?pubguid4977C910-1A39-44BD-A106-1FC8D81EB792
  
• (A Guide to Measuring Advocacy and Policy)
• http//managementhelp.org/evaluation/program-evalu
  ation-planning.htm
• (Checklist for Program Evaluation Planning)