NCATE Institutional Orientation Session on PROGRAM REVIEW

1
NCATE Institutional OrientationSession on
PROGRAM REVIEW

• Moving Away from Input-based Programs
• Toward Performance-based
• Programs
• Emerson J. Elliott, NCATE

2
Shifting the Concept for Program Review
3
A Performance-based Reading Program Is Judged

• By whether its completers know their subject and
  can teach
• The principal evidence is drawn from assessments
  that demonstrate candidate proficiencies
• The critical proficiencies are those described in
  IRA standards

4
E.g., English Language Arts, elementary teacher
programs

• Candidates demonstrate a high level of competence
  in use of the English language arts
• And they know, understand, and use concepts from
  reading, language and child development
• To teach reading, writing, speaking, viewing,
  listening, and thinking skills
• And to help students successfully apply their
  developing skills to many different situations,
  materials, and ideas

5
Examples assessments of candidate knowledge

• Multiple choice tests that probe for information
  about concept knowledge and applications
• Project reports or lab reports
• Videos or feedback to student work
• Essays
• Semester projects

6
Examples assessments of teaching skills
7
More examples effects on student learning
graduates progress

• For student learning
• Student work demonstrating evidence of learning,
  such as essays, projects, presentations,
  exhibitions, writing samples
• Candidate feedback on student work
• Student achievement data
• For progress after graduation
• State licensure pass rates and sub scores
• Induction year portfolio assessments
• Graduate surveys
• Employer surveys

8
Characteristics of Assessment Systems

• Are planned, purposeful, and continuing
• Span the scope of the standards
• Create assessments that measure standards in
  appropriate and multiple ways
• Set acceptable performance levels
• Are credible
• Sample and summarize information
• And the results are used!

9
What is expected of evidence for
performance-based program review?

• Evidence is organized around the standards
• Evidence is aggregated and interprets the data
• Rubrics or criteria used by faculty to judge
  candidate proficiencies are included
• Some examples of candidate work illustrate the
  qualities of proficiencies
• Information is derived from multiple measures
• Information is used to improve programs