INTRODUCTION TO PROGRAM EVALUATION

1
INTRODUCTION TO PROGRAM EVALUATION

• By Lizzette Rojas, PhD
• and Flordeliz Serpa, PhD
• Non-Profit Evaluation Resource Center, Inc.
  (NPERCI)

2
Lizzette Rojas, PhD

• Dr. Rojas has over seventeen years of experience
  in the area of evaluation research of health,
  education, and social services programs. She is
  the Chief Operating Officer of Non-Profit
  Evaluation Resource Center, Inc.

3
Flordeliz Serpa, PhD

• Dr. Serpa is an accomplished researcher and
  program evaluator. She has applied her skills to
  organizations in both the public and private
  sectors. Dr. Serpa is the Chief Executive Officer
  of Non-Profit Evaluation Resource Center, Inc.

4
Learning Objectives

• Learn about evaluation and evaluation research
• Learn about the evaluation process
• Be able to develop an evaluation plan
• Be able to determine appropriate evaluation
  designs

5
Definitions

• Evaluation
• Evaluation research
• Assessment
• Needs assessment

6
The Evaluation Process Characteristics

• Systematic
• Empirical
• Logical
• Inductive

• Explanatory
• Specific
• Replicable and Valid

7
Stages In TheEvaluation Process

• Goals and objectives
• Activity standardization
• Statistical model design

8
Stages In TheEvaluation Process

• Data collection
• Data analysis
• Explanation of success level
• Recommendations

9
Categories Of Evaluation

• Relevance
• Progress
• Efficiency
• Effectiveness
• Impact

10
Principles In The Selection And Elaboration Of
Variables

• Objectivity
• Verifiable
• Uniformity

• Specificity
• Pertinence
• Acceptability

11
The Evaluation Plan

• Introduction
• Conceptual framework
• Objectives
• Program description

12
The Evaluation Plan

• Measurable indicators
• Methodology
• Results
• Discussion
• Conclusions and recommendations

13
Evaluation Designs

• True-Experimental Designs
• Quasi-Experimental Designs
• Non-Experimental Designs
• Cost-Benefit Analysis
• Cost-Effectiveness Analysis

14
Critical Issues To Be Considered In The
Evaluation Design

• Description of the organization
• Mission
• Short and long term goals and objectives
• Target population
• Description of the services

15
Critical Issues To Be Considered In The
Evaluation Design

• Priorities of the organization
• Changes in the organization
• Current situation of the organization
• Available resources
• Flow chart of the organization

16
Suggested Readings

• Thinking About Program Evaluation by Berk and
  Rossi, Sage Publications, 1998
• Program Evaluation by John Owen, Sage
  Publications, 1999