Assessment of Your Program Why is it Important? What are the Key Elements?

1
Assessment of Your Program Why is it
Important? What are the Key Elements?
2
Why Conduct Evaluations?

• Required by NSF
• http//www.nsf.gov/pubs/2002/nsf02057/nsf02057.pdf
  
• Provides Information to Help Improve Project
• Provides Information to Assess Project
  Effectiveness
• Communicates Project to Stakeholders

3
Project Planning/ Modification
Needs Assessment/ Baseline Data
Project Evaluation
Project Implementation
4
Types of Evaluation

• Formative Evaluation assesses ongoing project
  activities and implementation
• Summative Evaluation assesses projects success
  in meeting goals and objectives

5
Steps in Evaluation

1. Build Conceptual Model (Logic Model)
2. Develop Evaluation Questions and Define
   Measureable Outcomes
3. Develop Evaluation Design
4. Data Collection
5. Data Analysis
6. Reporting and Dissemination

6
Conceptual Model (Logic Model)
Inputs
Activities
Outputs
Outcomes Short and Long Term
7
Evaluation Questions and Measureable Outcomes

• Identify Key Stakeholders
• Formulate Questions of Interest
• Define Measureable Outcomes

8
Develop Evaluation Design

• Select Methodological Approach
• Define Data Collection Instruments and their
  Psychometric Properties
• Determine Who Will be Studied (Power Analyses)

9
Methodological Approaches

• Quantitative
• Comparison Groups and Randomization
• Surveys
• Qualitative
• Document Analysis
• Focus Groups
• Mixed Methods
• Advisory Board

10
Data Collection and Analysis

• IRB
• Systematic Collection with Adequate Training
• Data Analysis Aligned with Questions

11
Reporting

• Varies Depending on Use
• Value of Oral and Written

12
Culturally Responsive

• Considers Context in all Stages of Evaluation
• Planning
• Implementation
• Data Analysis
• Reporting and Dissemination

13
Campus Resources

• Collaborative Assessment and Program Evaluation
  Services (CAPES)
• Florida Survey Research Center (Department of
  Political Science)
• Faculty in
• Department of Statistics
• Division of Biostatistics
• Research and Evaluation Methods in Education