Title: L O G I C M O D E L
1L O G I C M O D E L
PROGRAM DESIGN AND PLANNING
INPUTS OUTPUTS OUTCOMES -
IMPACT
Activities Participation LEARNING ACTION
IMPACT
What do we need to achieve our goals?
What do we have to do to ensure our goals are
met?
Who needs to - participate - be
involved? - be reached?
What do we think the participants will know, feel
or be able to do after the program?
How do we think participants will behave or act
differently after the program?
What kind of impact can result if the
participants behave or act differently?
Workshops Meetings Camps Curriculum
Publications Media Web site
Projects Field Days
Staff Volunteer Time Money Materials Equipment
Technology Partners
Number Characteristics Reactions
Awareness Knowledge Attitudes Skills
Aspirations
Behavior Practice Decisions
Policies Social Action
Social Economic Civic Environmental
MEASURING PROGRAM IMPACT
2Targeted Outcome
The change in participants you would expect to
see as a result of participating in the program.
what are the participants going to know, feel
or do different after the program
3OUTCOMES
LEARNING ACTION IMPACT
What do we think the participants will know, feel
or be able to do after the program?
How do we think participants will behave or act
differently after the program?
What kind of impact can result if the
participants behave or act differently?
Awareness Created Knowledge Gained Attitudes
Changed Skills Developed Aspirations Sparked
Behavior Changed Practice Adopted Decisions
Made Policies Changed or Adopted Social Action
Initiated
Social Impact Economic Impact Civic
Impact Environmental Impact
Susan Barkman- Purdue University
4Outcomes Educational Domains
- Cognitive Domain Increase knowledge
- Affective Domain Change attitudes, appreciation
or the development of a increase interest - Psychomotor Domain Physical Movement and skills
5Levels of Knowledge Outcomes(Cognitive Domain)
Highest
Evaluation Synthesis Analysis Appli
cation Comprehension Knowledge
Lowest
6Knowledge
Require the participant to remember
Test items ask the participant to recall or
recognize facts, terminology, problem-solving
strategies rules.
define list recall describe match re
cite identify name select
label outline state
7Comprehension
Require some level of understanding
Test items ask the participant to restate what
has been read, to see connections or
relationships among parts, to draw conclusions or
consequences from information.
convert explain infer defend extend parap
hrase discriminate estimate predict
distinguish generalize summarize
8Application
Require participants to use previously acquired
information in a setting other than in which it
was learned.
Application differs from comprehension in that
questions requiring application present the
problem in a different and often applied context.
change modify relate compute
operate solve demonstrate organize
transfer develop prepare use
employ produce
9Analysis
Require participants to identify logical errors
or to differentiate among facts, opinions,
assumptions, hypothesis, or conclusions.
Questions at the analysis level often require the
learner to draw relationships among ideas or to
compare and contrast.
break down distinguish point out
deduce illustrate relate
diagram infer separate out differentiate outl
ine subdivide
10Synthesis
Require participants to produce something unique
or original.
Questions require participants to solve some
unfamiliar problem in a unique way, or combine
parts to form a unique or novel whole.
categorize create formulate compile design
rewrite compose devise
summarize
11Evaluation
Require participants to form a judgment about the
value or worth of methods, ideas, people, or
products that have a specific purpose.
Questions require participants to state the basis
for his or her judgments (i.e. what external
criteria or principles were drawn upon to reach a
conclusion).
appraise criticize support compare
defend validate contrast justify conclu
de interpret
12Levels of Attitudinal Outcomes(Affective Domain)
Internalizes Organizes Values Res
ponds Receives
Highest
Lowest
13Levels of Skill Outcomes(Psychomotor Domain)
Automated Response Mechanized
Response - skills put together in complex
performance behavior Guided Response
Readiness to Perform Perception
Highest
Lowest
14DATA SOURCES
- Not all data has to be collected from an
evaluation instrument. Data sources can be
collected from a variety of sources.
15Case Study
- In-depth examination of a particular case
(program, group of participants, single
individual, site/location) - Case studies use multiple sources of information
and methods to provide as complete of a picture
as possible.
16Document Analysis
- Using content analysis and other techniques to
analyze existing printed information - i.e. Minutes of Meeting
- i.e. Newsletters
- i.e. E-mails
17Diaries or Journal
- Recording of events over time revealing personal
responses and reactions - i.e. Life histories
- i.e. Town histories
- i.e. Eating behaviors
18Existing records/data
- Information or record that already exist or can
be obtained with minimal planning - Statistical reports , logs, enrollment reports,
receipts - Existing data bases such as census data, housing
tracts, Kids Count, school records, employment
records
19Expert or Peer Review
- Examination by a review committee, panel of
experts, or peers
20 Group Assessment
- Using a group to collect evaluation information
- i.e. Focus Groups
- i.e. Delphi Study
- i.e. Community Meetings
21Interviews
- Collecting information from a person on a one to
one basis. May use a structured questionnaire or
conversational method -
- i.e. Phone
- i.e. Person to Person
22Log
- Chronological entries which are factual
- i.e. Youth who were sent to
principals office for disruptive - behavior
-
23Observation
- Collecting information through seeing and
listening - Observation may be structured using a criteria
checklist or unstructured -
24Observation Checklists
- Used to measure
- Skills
- Behavior
- Practice
25 Portfolio Reviews
- Collection of materials that shows the breadth
and scope of a program or activity begin
evaluated -
- i.e. Electronic portfolio
- i.e. School projects
26 Photographs, videos
- Used to capture visual images
- i.e. Community Service projects -
- rehabilitating a community
- center
- i.e. open judging caught on video
- kids answering judges questions
27 Product Assessment
- Comparing the writings or work of program
participants - Can use a rubric to make a quantitative analysis
28 Survey
- Collecting standardize information generally with
a structure questionnaire - i.e. Mail or e-mail
- i.e. Phone
- i.e. Face-to-face
29Survey/Questionnaires
- Used to obtain information about what people do
or what they think, feel or know - Used to measure
- Knowledge
- Attitudes
- Skills
- Behavior
- Practice
30 Tests
- Using a standardized form to assess knowledge,
skills or performance - i.e. Jr. Master Gardeners
-
31 Testimonials
- Statements made by people about an event or
program in which they have participated - i.e. Have A Healthy Baby
- i.e. Space Station
32Evaluation Methodology(when and how you are
going to administer)
- Post-Test only
- Pre-Post Test
- Post-Retro Pre-test
33Post-Retro Pre
- Please rate your skills after the training and
what you thought they were before the training -
- BEFORE
AFTER - TRAINING
TRAINING -
None A lot None A lot - Ability to design a 1 2 3
4 5 1 2 3 4 5 - quantitative instrument
-
- Ability to conduct a
- pilot test 1
2 3 4 5 1 2 3 4 5
34Knowledge Outcome Junior Master Gardeners will
increase their knowledge about plant growth and
development. Indicators Increase in the number
of correct answers on pre/post test. Data
Source Junior Master Gardener Test
35Attitude Outcome Youth will develop a more
positive attitude about science, math, and school
in general. Indicators Improvement in
attitudinal score (from negative to more
positive) on pre/post assessment tool. Data
Source Space Station Attitudinal Questionnaire
36Attitude Outcome Adults will develop a more
positive attitude towards foods that contain
products derived from biotechnology. Indicators
Improvement in attitudinal score (from
non-accepting to more accepting) on pre/post
assessment tool. A reported increase in the
consumption of foods containing products made
from biotechnology. Data Source Biotechnology
Questionnaire
37Skill Outcome Youth will improve their horseback
riding skills. Indicators Improved performance
level when making the horse walk, trot, and
canter. Data Source Observation Checklist
38Skill Outcome Youth will develop their skills
(communicating, interacting socially, planning
and organizing) through Action Demonstrations. In
dicators Ability to perform specific skill
indicators. Data Source Observation Checklist
39Behavior Outcome Youth will improve their
communication skills. Indicators Increased
frequency of skill set behaviors on post/post
assessment.Data Source Four-Fold Skill
Questionnaire
40Practice Outcome Adults will adopt practices
that will decrease the amount of drift when
applying pesticides.Indicators A reported use
of practices (i.e., drift-reducing agents,
drift-reducing nozzles) that decrease
drift.Data Source Pesticide Applicators
Questionnaire