Program Evaluation Data

1
Program Evaluation Data

• Department of Education
• SUNY Cortland

2
Points of View
3
New York State Teacher Certification Examinations
NYSTCE . . .

• Assessment of Teaching Skills (ATS)
• Elementary Version
• Required for provisional certificate
• Taken upon completion of pedagogical coursework
  and field experiences
• Liberal Arts and Sciences Test (LAST)
• 80 Multiple Choice Questions and an essay
  question
• Taken sophomore or junior year
• Required for provisional certification

4
14126 NYSTCE Records
NYSTCE . . .

• Initial examination includes only Overall Scores
  (n 2592)
• In the Spring we plan to examine subtest scores

5
2592 Overall Records
NYSTCE . . .

• Many test records were duplicated
• Identical dates, tests, scores
• Non-identical matriculation status
• Non-identical degree type (i.e. BS or BA)

6
1387 Overall Test Scores
NYSTCE . . .

• The LAST ATS constituted 91 of the scores
  (1259 records)
• The current analysis focuses on LAST ATS results

7
Tests taken more than once

• An additional 63 cases were removed from analysis
  because they were retaken
• Test retakes occurred when students failed the
  first administration
• If students failed the retake, their most recent
  attempt was kept for analysis (previous
  administrations were removed)
• Many of the students in the 2001 administrations
  have not had the opportunity to retake the test,
  therefore their scores are lower

8
Number of Tests Taken
NYSTCE . . .

• Less than 100 test scores were reported in 1998
• The number of test records have increased
  substantially each year
• 2001 administration includes non-graduates
  (sophomores, juniors seniors)

9
The Pass Rate Graduates
NYSTCE . . .
Decline in 2001 attributable to lack of
opportunity for students who failed to retake the
exam
10
Mean Scores Graduates
NYSTCE . . .

• Scores show a slight decline since 1998
• The cut score for passing 220
• The highest possible score 300

11
Field Supervisor Ratings
Student Teaching Evaluations

• Field supervisors rate candidates performance at
  the end of student teaching
• Evaluation rating scales aggregated for the past
  three years (1999-2001)
• Rating scale was modified after the 2000
  administration

12
Rating Scale Modifications
Student Teaching Evaluations

• 19 old items were deleted and 18 new items were
  added
• 19 items only partially overlapped
• 43 items with nearly complete overlap
• Only the 43 overlapping items were compared
  across years

13
Overall Evaluations
Student Teaching Evaluations

• 43 items
• Large dip in the spring 2000 ratings

14
Content Knowledge
Student Teaching Evaluations

• 5 items

15
Implementing Facilitating
Student Teaching Evaluations

• 10 items

16
Communicating Questioning
Student Teaching Evaluations

• 8 items

17
Dispositions
Student Teaching Evaluations

• 14 items

18
Graduate Survey
Grad Survey . . .

• Aggregated student opinion surveys 1998-2000
• Survey format changed somewhat, but questions
  comparable

19
Faculty Advisement
Grad Survey . . .
20
Faculty Support
Grad Survey . . .
21
Quality of Teaching
Grad Survey . . .
22
Quality of Courses
Grad Survey . . .
23
Student Teaching
Grad Survey . . .
24
Academic Preparation
Grad Survey . . .