L O G I C M O D E L

1
L O G I C M O D E L
PROGRAM DESIGN AND PLANNING
INPUTS OUTPUTS OUTCOMES -
IMPACT
Activities Participation LEARNING ACTION
IMPACT
What do we need to achieve our goals?
What do we have to do to ensure our goals are
met?
Who needs to - participate - be
involved? - be reached?
What do we think the participants will know, feel
or be able to do after the program?
How do we think participants will behave or act
differently after the program?
What kind of impact can result if the
participants behave or act differently?
Workshops Meetings Camps Curriculum
Publications Media Web site
Projects Field Days
Staff Volunteer Time Money Materials Equipment
Technology Partners
Number Characteristics Reactions
Awareness Knowledge Attitudes Skills
Aspirations
Behavior Practice Decisions
Policies Social Action
Social Economic Civic Environmental

MEASURING PROGRAM IMPACT
2
Targeted Outcome
The change in participants you would expect to
see as a result of participating in the program.
what are the participants going to know, feel
or do different after the program
3
OUTCOMES

LEARNING ACTION IMPACT
What do we think the participants will know, feel
or be able to do after the program?
How do we think participants will behave or act
differently after the program?
What kind of impact can result if the
participants behave or act differently?

Awareness Created Knowledge Gained Attitudes
Changed Skills Developed Aspirations Sparked
Behavior Changed Practice Adopted Decisions
Made Policies Changed or Adopted Social Action
Initiated
Social Impact Economic Impact Civic
Impact Environmental Impact
Susan Barkman- Purdue University
4
Outcomes Educational Domains

• Cognitive Domain Increase knowledge
• Affective Domain Change attitudes, appreciation
  or the development of a increase interest
• Psychomotor Domain Physical Movement and skills

5
Levels of Knowledge Outcomes(Cognitive Domain)
Highest
Evaluation Synthesis Analysis Appli
cation Comprehension Knowledge
Lowest
6
Knowledge
Require the participant to remember
Test items ask the participant to recall or
recognize facts, terminology, problem-solving
strategies rules.
define list recall describe match re
cite identify name select
label outline state
7
Comprehension
Require some level of understanding
Test items ask the participant to restate what
has been read, to see connections or
relationships among parts, to draw conclusions or
consequences from information.
convert explain infer defend extend parap
hrase discriminate estimate predict
distinguish generalize summarize
8
Application
Require participants to use previously acquired
information in a setting other than in which it
was learned.
Application differs from comprehension in that
questions requiring application present the
problem in a different and often applied context.
change modify relate compute
operate solve demonstrate organize
transfer develop prepare use
employ produce
9
Analysis
Require participants to identify logical errors
or to differentiate among facts, opinions,
assumptions, hypothesis, or conclusions.
Questions at the analysis level often require the
learner to draw relationships among ideas or to
compare and contrast.
break down distinguish point out
deduce illustrate relate
diagram infer separate out differentiate outl
ine subdivide
10
Synthesis
Require participants to produce something unique
or original.
Questions require participants to solve some
unfamiliar problem in a unique way, or combine
parts to form a unique or novel whole.
categorize create formulate compile design
rewrite compose devise
summarize
11
Evaluation
Require participants to form a judgment about the
value or worth of methods, ideas, people, or
products that have a specific purpose.
Questions require participants to state the basis
for his or her judgments (i.e. what external
criteria or principles were drawn upon to reach a
conclusion).
appraise criticize support compare
defend validate contrast justify conclu
de interpret
12
Levels of Attitudinal Outcomes(Affective Domain)

Internalizes Organizes Values Res
ponds Receives
Highest
Lowest
13
Levels of Skill Outcomes(Psychomotor Domain)
Automated Response Mechanized
Response - skills put together in complex
performance behavior Guided Response
Readiness to Perform Perception
Highest
Lowest
14
DATA SOURCES

• Not all data has to be collected from an
  evaluation instrument. Data sources can be
  collected from a variety of sources.

15
Case Study

• In-depth examination of a particular case
  (program, group of participants, single
  individual, site/location)
• Case studies use multiple sources of information
  and methods to provide as complete of a picture
  as possible.

16
Document Analysis

• Using content analysis and other techniques to
  analyze existing printed information
• i.e. Minutes of Meeting
• i.e. Newsletters
• i.e. E-mails

17
Diaries or Journal

• Recording of events over time revealing personal
  responses and reactions
• i.e. Life histories
• i.e. Town histories
• i.e. Eating behaviors

18
Existing records/data

• Information or record that already exist or can
  be obtained with minimal planning
• Statistical reports , logs, enrollment reports,
  receipts
• Existing data bases such as census data, housing
  tracts, Kids Count, school records, employment
  records

19
Expert or Peer Review

• Examination by a review committee, panel of
  experts, or peers

20
Group Assessment

• Using a group to collect evaluation information
• i.e. Focus Groups
• i.e. Delphi Study
• i.e. Community Meetings

21
Interviews

• Collecting information from a person on a one to
  one basis. May use a structured questionnaire or
  conversational method
• i.e. Phone
• i.e. Person to Person

22
Log

• Chronological entries which are factual
• i.e. Youth who were sent to
  principals office for disruptive
• behavior

23
Observation

• Collecting information through seeing and
  listening
• Observation may be structured using a criteria
  checklist or unstructured

24
Observation Checklists

• Used to measure
• Skills
• Behavior
• Practice

25
Portfolio Reviews

• Collection of materials that shows the breadth
  and scope of a program or activity begin
  evaluated
• i.e. Electronic portfolio
• i.e. School projects

26
Photographs, videos

• Used to capture visual images
• i.e. Community Service projects -
• rehabilitating a community
• center
• i.e. open judging caught on video
• kids answering judges questions

27
Product Assessment

• Comparing the writings or work of program
  participants
• Can use a rubric to make a quantitative analysis

28
Survey

• Collecting standardize information generally with
  a structure questionnaire
• i.e. Mail or e-mail
• i.e. Phone
• i.e. Face-to-face

29
Survey/Questionnaires

• Used to obtain information about what people do
  or what they think, feel or know
• Used to measure
• Knowledge
• Attitudes
• Skills
• Behavior
• Practice

30
Tests

• Using a standardized form to assess knowledge,
  skills or performance
• i.e. Jr. Master Gardeners

31
Testimonials

• Statements made by people about an event or
  program in which they have participated
• i.e. Have A Healthy Baby
• i.e. Space Station

32
Evaluation Methodology(when and how you are
going to administer)

• Post-Test only
• Pre-Post Test
• Post-Retro Pre-test

33
Post-Retro Pre

• Please rate your skills after the training and
  what you thought they were before the training
•  
•   BEFORE
  AFTER
• TRAINING
  TRAINING
• 
  
  None A lot None A lot
• Ability to design a 1 2 3
  4 5 1 2 3 4 5
• quantitative instrument
•  
• Ability to conduct a
• pilot test 1
  2 3 4 5 1 2 3 4 5

34
Knowledge Outcome Junior Master Gardeners will
increase their knowledge about plant growth and
development. Indicators Increase in the number
of correct answers on pre/post test. Data
Source Junior Master Gardener Test
35
Attitude Outcome Youth will develop a more
positive attitude about science, math, and school
in general. Indicators Improvement in
attitudinal score (from negative to more
positive) on pre/post assessment tool. Data
Source Space Station Attitudinal Questionnaire
36
Attitude Outcome Adults will develop a more
positive attitude towards foods that contain
products derived from biotechnology. Indicators
Improvement in attitudinal score (from
non-accepting to more accepting) on pre/post
assessment tool. A reported increase in the
consumption of foods containing products made
from biotechnology. Data Source Biotechnology
Questionnaire
37
Skill Outcome Youth will improve their horseback
riding skills. Indicators Improved performance
level when making the horse walk, trot, and
canter. Data Source Observation Checklist
38
Skill Outcome Youth will develop their skills
(communicating, interacting socially, planning
and organizing) through Action Demonstrations. In
dicators Ability to perform specific skill
indicators. Data Source Observation Checklist
39
Behavior Outcome Youth will improve their
communication skills. Indicators Increased
frequency of skill set behaviors on post/post
assessment.Data Source Four-Fold Skill
Questionnaire
40
Practice Outcome Adults will adopt practices
that will decrease the amount of drift when
applying pesticides.Indicators A reported use
of practices (i.e., drift-reducing agents,
drift-reducing nozzles) that decrease
drift.Data Source Pesticide Applicators
Questionnaire