Instructional Development (EDER675) Evaluating Instruction

1
Instructional Development (EDER675)Evaluating
Instruction
2
Agenda for tonight

• Review of
• Instructional Strategies
• Instructional Materials
• New
• Evaluation of Instruction
• Program Evaluation
• Case Sam Gonzales (Jeremy)

3
Instructional Strategies

• http//www.ucalgary.ca/7Eekowch/675/mar24/instruc
  tionalstrategy.htm

4
Instructional Materials

• http//www.ucalgary.ca/7Eekowch/675/mar24/materia
  ls.htm

5
Evaluating Instruction

• http//www.ucalgary.ca/7Eekowch/673/mar20/formsum
  .html

6
Evaluating Instruction

• Formative Product Evaluation
• The process of appraising instructional
  materials during preparation. To judge
  descriptive info (instruction components) and how
  much learning results from the instructional
  materials - valuing those results/
• Formative Process Evaluation
• The appraisal of instructional methods, that is,
  how well planned learning experiences are
  delivered or facilitated.

7
Evaluating Instruction Developing a Formative
Evaluation Plan

• Format of the plan
• Statement of purpose
• Description of data collection plans
• Description of procedures for analyzing data that
  are appropriate for them
• Outline the constraints imposed by the situation
• Decision rules that will guide revisions of the
  data
• A desciption of the expected results consistent
  with the data collection techniques chosen
  specific analysis plans
• Time estimates for implementation of the
  evaluation plan
• Plans for communicating results to appropriate
  decision makers.
• Roles and responsibilities of a team
• Team leadership

8
Developing a Formative Evaluation Plan

• Step 1 Determining purpose, objectives, audience
  and subjects
• How much will targeted trainees enjoy the
  instructional materials, content or methods?
• How much will the participants learn?
• How much impact will the learning experience have
  on the participants job performance?
• How much impact will the planned learning
  experience have on the organization?

9
Developing a Formative Evaluation Plan

• Step 2 Assessing Information Needs
• (of the targeted audiences.. What do we need from
  these people?)
• Instructional Designers want to know how to
  revise instructional materials
• Key decision makers
• Immediate supervisors or learners on board?
• Union reps on board?

10
Developing a Formative Evaluation Plan

• Step 3 Protocol
• Freq. Of audience contact in evaluation
• Permissions in order
• Which permissions needed?
• What formal/informal steps assure
• Decision makers experience is ok
• Labels
• Timing
• Participation
• Method of evaluation

11
Developing a Formative Evaluation Plan

• Step 5.
• Setting
• Program issues
• How much testing
• Positive outcomes
• Negative outcomes
• Cost estimates
• Accuracy of prerequisites ok?

12
Developing a Formative Evaluation Plan

• Evaluation design (for client and team)
• Define key terms
• Clarify purpose and objectives
• Provide logical series of activities
• Identify populations to be studied
• Summarize standards by which instruct. Matls will
  be judged

13
Adieu for this week, EDER 675Readings for The
Next Two WeeksEffective Communication
Chapter 16 - 19 Rothwell Kazanas.Case
Project Management Haley Lawrence p. 129 by
Diane ErlichEugene G. KowchAssistant Professor
of Educational Technology
This person is reading.. -)