WhatsuupEvaluating Extension Programs

1
WhatsuupEvaluating Extension Programs

• Accountability
• Outcomes
• Success Markers
• Impacts

2
(No Transcript)
3
Cont - Planning and Evaluation - A Step
Process

• Step 5 Information Collection Arrangements
  Needed?
• Step 6 What Analysis Procedure will be
  Followed?
• Step 7 Interpretation Procedures and Criteria
  Used Include?
• Step 8 Reporting of the Information Gathered
• To whom
• How
• When

4
Methods for Collecting Evaluation

• Surveys
• Case Studies
• Interviews
• Observations
• Group Assessments
• Delphi
• Focus Groups
• Expert or Peer Review

• Portfolio Reviews
• Testimonials
• Standard Tests
• Photographs, Videos
• Diaries or Journals
• Action Cards
• Simulations
• Unobtrusive Measures

5
Retrospective Pre-testingPost - then - Pre

• Extension Educators oft times use the Pre and
  Post test design to determine if there is any
  differences (changes of attitudes or behaviors)
  following the delivery of a program

6
Problems with Pre- Post Testing

• Pre-tests taken at the beginning of the program
  my be invalid because participants have limited
  knowledge in responding accurately to questions
  in the pre-test.
• Do you include one food rich in vitamin C in your
  diet daily?
• If participant doesnt know which foods are rich
  in vitamin C they may overestimate vitamin C on
  the pretest.

7
Problems with Pre- Post Testing

• After participating in the Extension Program and
  learning which foods are rich in vitamin C the
  participant can validly answer the question.
• On the post test (aimed at measuring change
  in behavior) the participant indicates that they
  increased their vitamin C intake as a result of
  the program. If participant over estimated their
  vitamin C intake in the pre-test and then
  reported they increased intake on the posttest
  the amount of change will appear to be no
  change at all since levels were inaccurately
  estimated in the pre-test. The program had no
  effect! ???

8
Post - then - Pre Test Design
Post
Pre

• Now Then

Think _________
How You Felt AFTER the Program
How you felt BEFORE the Program
9
Example of Post - then - Pre

• Rate your knowledge about SURVEY TECHNIQUES on
  the scale below. Place the letter N on the
  scale where you rate your knowledge NOW at the
  end of todays program. Place the letter B on
  the scale where you would rate your knowledge
  BEFORE todays program.
• 1 2 3 4 5 6 7 8 9 10
• Low High

10
Sample Instrument
11
Healthy Choices Before PregnancyPreparing You
for a Healthy Pregnancy
12
Statistical Analysis

• Use Students Paired t test to analyze the mean
  differences in the participants test with the
  before and now scale.
• A t statistic is calculated to determine if
  there is a significant difference in the group
  means before and now. Differences can potentially
  be reported as changes in behavior, attitude,
  attributes or beliefs. K Rockwell,
  University of Nebraska

13
USU EXTENSION WEB SITE

• Resources available -
• http//www.ext.usu.edu/
• Planning and Evaluations
• Instruments
• Methodologies
• Techniques
• Ideas for Evaluating
• DallasH_at_ext.usu.edu