Annual Performance Reports and Program Improvement

1
Annual Performance Reportsand Program
Improvement

• Virginia System of Performance Standards and
  Measures for Secondary Career and Technical
  Education Programs

2
Discussion Points

• 2004-2005 Annual Performance Reports (APR)
• 2004-2005 Data Analysis Reports (DAR)
• Local Performance Reports (LIP) for SY 2004-2005

3
Performance Reports

• Virginia System of Performance Standards and
  Measures for Secondary Career and Technical
  Education Programs

4
2004-2005 Contents

• Annual Performance Report
• Division and State data
• Federal and State measures
• Data Analysis Report
• School, Division, and State data
• Program Area, Tech Prep and Special Populations
  data
• Federal and State measures
• Academic Achievement Performance Data

5
Report Availability

• The APRs are available on-line
• One copy of the Data Analysis Report for each
  school was printed and distributed to a division
  representative. Each division gets one copy only
  and the DAR is not available on-line.
• A Tech Prep version of the Data Analysis Reports
  was distributed to Consortium Directors in
  February 2006

6
Annual Performance Report
Virginia System of Performance Standards and
Measures for Secondary Career and Technical
Education Programs
7
2004-2005 Annual Performance Reports

• ½ Sheet Booklets
• Division and State Performance
• 11 Performance Standards
• Current and Historical Data

8
2004-2005 APR Layout

• Find and open the Annual Performance Report (APR)
  for your division
• (There is only one APR per division.)
• APRs are available for download at
• www.doe.virginia.gov/VDOE/Instruction/CTE/cters/20
  04apr

9
(No Transcript)
10
2004-2005 APR Features

• Performance Standards identified

• 2 consecutive years of data are provided

Notes further explain the performance data
, Numerator, Denominator,
11
Measures of Performance

• Academic Achievement
• Occupational Competence
• Access/Success
• Transition
• Satisfaction

12
Academic Achievement

• Performance Standard
• Eligible students (9-12 grades) who are enrolled
  in a career and technical course(s) and also in
  an academic course(s) for which a Standards of
  Learning End-of-Course test(s) is/are required,
  will attain a passing score on the Standards of
  Learning end-of-course tests, contribute to the
  schools annual accreditation requirements based
  on the Provisional Accreditation Benchmarks, and
  contribute to annually improving the statewide
  baseline academic attainment average as
  determined for federal reporting.

13
Academic Achievement

• Provisional Accreditation Benchmarks

14
Academic Achievement

• Data Collection
• SOL End-of-Course Answer Sheets
• Grid W Section 1
• Identifies Students Enrolled in Career and
  Technical Education Courses and Tech Prep
• Grid W Section 2
• Identifies Students who are Members of a Special
  Population as Defined by Perkins III

15
Occupational Competence

• Performance Standard
• 94.34 of the Career and Technical Education
  program completers will attain 80 percent of the
  competencies on the industry-validated,
  state-provided competency lists.

16
Occupational Competence

• Data Collection
• Completer Demographics Collection
• Collected Locally within School Divisions
• Contact Information for all Completers
• Program Area of Study
• Competency and Graduation Information

17
Secondary School Completion

• Performance Standard
• The completion rate for students in career and
  technical content areas, including the secondary
  component of Tech Prep programs, will be 97.69
  percent.

18
Secondary School Completion

• Data Collection
• Completer Demographics
• Number of Completers (c)
• State Dropout Report
• Number of dropouts who completed a Career and
  Technical Education Program Area of Study (d)
• Formula c ? (cd)

19
The Carl D. Perkins Vocational and Technical
Education Act of 1998

• Defines Special Populations as
• Individuals with Disabilities
• Individuals Preparing for Nontraditional Training
  and Employment
• Individuals from Economically Disadvantaged
  Families, including Foster Children
• Displaced Homemakers
• Single Parents, including Single Pregnant Women
• Individuals with other barriers to Educational
  Achievement, including Limited English Proficiency

20
Access/SuccessSpecial Populations

• Performance Standard
• Performance Standards will be the same for all
  students.

21
Access/SuccessSpecial Populations

• Data Collection
• SOL End-of-Course Answer Sheets
• Grid W Section 2
• Identifies Students who are Members of a Special
  Population as Defined by Perkins III
• Completer Demographics
• Completer Follow-Up

22
Non -Traditional Career Preparation
Non-Traditional Enrollment

• Performance Standard
• The total (combined) enrollment rates in the
  state-identified courses for nontraditional
  career preparation of the gender that comprise
  less than 25 percent will be 13.07 percent.

23
Non -Traditional Career Preparation
Non-Traditional Enrollment

• Data Collection
• Secondary Enrollment/Demographics Report
  (SEDF/CTERS 1)

24
Non -Traditional Career Preparation
Non-Traditional Completion

• Performance Standard
• The total (combined) completion rates of the
  state-identified content areas for nontraditional
  career preparation of the gender that comprise
  less than 25 percent will be 9.88 percent.

25
Non -Traditional Career Preparation
Non-Traditional Completion

• Data Collection
• Completer Demographics
• Number of Non-Traditional Completers by Program
  Area of Study
• Number of Completers by Program Area of Study

26
TransitionCompleter Response Rate

• Performance Standard
• The response rate of career and technical
  completers is 75 percent.

27
TransitionCompleter Response Rate

• Data Collection
• Completer Follow-Up
• Only Useable Responses will be considered a
  response.
• Useable Responses - surveys which, at a
  minimum, indicate whether the completer is
  employed, pursuing further education/training, or
  unemployed (first two questions on survey)

28
TransitionSuccessful Transition Rate

• Performance Standard
• Students who are career and technical
  completers/graduates will successfully transition
  at a combined rate of 92.81 percent from
  secondary school to employment, apprenticeship,
  military or other service, further education, or
  full-time equivalency of part-time combinations
  of transition indicators.

29
TransitionSuccessful Transition Rate

• Data Collection
• Completer Follow-Up
• Are you currently employed?
• Are you pursuing additional education or
  training?

30
SatisfactionEmployee Satisfaction Rate

• Employee Rating
• Career and technical completers (employees) will
  indicate annually an 80 percent or higher
  satisfaction rate with their secondary career and
  technical studies, academic preparation, and
  employment.

31
SatisfactionEmployee Satisfaction Rate

• Data Collection
• Completer Follow-Up
• Overall, how satisfied are you with the
  preparation you received in high school for
  employment and/or further education?

32
SatisfactionEmployer Satisfaction Rate

• Employer Rating
• Employers will indicate annually an 80 percent
  or higher satisfaction rate with career and
  technical completers (employees) based on their
  secondary career and technical studies and
  academic preparation for the current occupation.

33
SatisfactionEmployer Satisfaction Rate

• Data Collection
• Employer Follow-Up Survey
• Response Rate
• All responses will be considered a response
• Satisfaction Rate
• Average of the responses to the Skills Attainment
  section of the survey

34
Performance Standards Summary
35
Performance Standards Summary
36
Performance Standards Summary
37
Performance Standards Summary
38
Data Collection Summary
39
Data Collection Summary
40
Data Collection Summary
41
2004-2005 APR Features

• Division wide Performance Summary (Academic
  Achievement Performance is included with the Data
  Analysis Reports)

42
Data Analysis Report
Virginia System of Performance Standards and
Measures for Secondary Career and Technical
Education Programs
43
2004-2005 Data Analysis Reports

• 8 x 11 Landscape Booklets
• School, Division and State Performance
• 11 Performance Standards
• Program Area, Special Populations and Tech Prep
  data for most measures
• Graphs of State data

44
(No Transcript)
45
Data Analysis Table of Contents

• Academic Achievement ... page 2
• Occupational Competence ... page 3
• Access/Success . page 4
• Non-Traditional Enrollment and Completion
  .. page 5
• Secondary School Completion . page 6
• Seal Attainment Rate ... page 6
• Response Rate .. page 7
• Transition Rate . page 8
• Employee and Employer Satisfaction .. page
  9

46
Data Analysis Features

• Performance Standards identified

• School, Division and State data

Program Area data
Numerator, Denominator,
47
Data Analysis Features

• Graphs of Historical State data by Program Area

48
Data Analysis Features

• Tables of Information to Define and Clarify

49
Academic Achievement Page 2

• Contains performance for all Students and Tech
  Prep Students Enrolled in Career and Technical
  Education courses who Passed the 2004-2005
  Standards of Learning End-of-Course Tests.
• This data is presented by Subject Area and
  End-of-Course Test

50
Academic Achievement Page 2

• Contains performance for all Special Population
  Students and Special Population Tech Prep
  Students Enrolled in Career and Technical
  Education courses who Passed the 2004-2005
  Standards of Learning End-of-Course Tests.
• This data is presented by Subject Area only for
  Special Pops.

51
Academic Achievement Page 2

• Academic Achievement Performance Summary on page
  2

Note This academic attainment data is composed
solely for federal performance and reporting
purposes for Career and Technical Education.
These data shall in no way be used in conjunction
with or interpreted for a school's accreditation
status.
52
Occupational Competence Page 3

• Contains performance for all CTE Completers, Tech
  Prep Completers and Special Population
  Completers.
• This data is provided by Program Area.

53
Access/Success-Page 4

• Contains performance for all CTE students
  belonging to a Special Population.
• Access Special Population enrollment data is
  provided for all CTE students, for grades 9-12
  only and for Tech Prep students.

54
Access/Success-Page 4

• Success Academic Achievement performance data
  is provided for all CTE students by Subject Area
  only.
• Success Occupational Performance and Transition
  data is provided for all CTE students.

55
Non-Traditional Enrollment-Page 5

• Lists state identified non-traditional programs.
• Contains enrollment for all non-traditional CTE
  students by program area.

56
Non-Traditional Completion-Page 5

• Contains completion data for all non-traditional
  CTE completers and non-traditional Secondary Tech
  Prep students by program area.

57
Secondary School Completion-Page 6

• Contains secondary school completion data for all
  CTE completers.
• School results were not available this year so
  all schools will show No Data for this criteria.

58
Diploma Credential-Page 6

• Lists the Board of Education Seal Attainment
  Specifications.
• Contains Seal Attainment Rate data for all CTE
  completers by program area.

59
Completer Response Rate-Page 7

• Contains Completer Response Rate data for all
  completers, Tech Prep completers and Special
  Population completers by program area.

60
Completer Transition Rate-Page 8

• Contains Completer Transition Rate data for all
  completers, Tech Prep completers and Special
  Population completers by program area.

61
Employee Satisfaction Rate-Page 9

• Contains Employee Satisfaction Rate data for all
  completers, Tech Prep completers and Special
  Population completers by program area.

62
Employer Satisfaction Rate-Page 9

• Contains Employer Satisfaction Rate data for all
  completers.
• Lists Statewide Employer Response statistics for
  various criteria.

63
Data Analysis Notes

• Not all reports contain data
• Discard those reports without SCHOOL data and
  notify me of said schools so I may remove them
  from the reporting process in the future.
• Use the Academic Achievement Performance Summary
  on page 2 to determine which schools must choose
  and Academic Achievement option on the Local
  Improvement Plan

64
Division WideLocal Improvement Plan for
2006-2007(based on Performance from the
2004-2005 School Year)

• Virginia System of Performance Standards and
  Measures for Secondary Career and Technical
  Education Programs

65
FYIs about the LIPs

• Division wide Local Improvement Plan (LIP) is due
  October 15, 2006
• Interim progress report is due January 15, 2007

66
FYIs about the LIPs

• LIP must include strategies and objectives to be
  carried out during the 2006-2007 school year
• A Joint Planning Form is due for each measure
  that was NOT MET for TWO consecutive years.

67
FYIs about the LIPs

• An On-Site Assessment Preparation Form is due for
  each measure that was NOT MET for THREE
  consecutive years.

68
FYIs about the LIPs

• All plans must be done electronically
• You will receive an e-mail notifying you when the
  LIPs are available on-line.
• Customized forms will be available at
• www.doe.virginia.gov/VDOE/Instruction/CTE/cters/
  2004lip/
• Email completed plans to
• cters_at_doe.virginia.gov

69
FYIs about the LIPs

• The Local Improvement Plans have been customized
  for every division/ regional center.
• All pages must be completed
• Formatting is improved.

70
Summary of Performance

• Review the Summary of Performance (page 1 in LIP)

71
Academic Achievement

• Review the Standards-of-Learning End-of-Course
  passing rates for each high school in your
  division.
• Choose an improvement option based on the
  2004-2005 Accreditation Status.

72
Academic Achievement

• Compare the results to the Academic Achievement
  data in the Data Analysis Report on Page 2.

73
Other Performance Areas

• Utilize the Sample Questionnaire to assist in
  developing objectives and strategies for
  improving the performance measure in question.

74
Interim Progress Report
Virginia System of Performance Standards and
Measures for Secondary Career and Technical
Education Programs
75
Interim Progress Report

• Designed to provide insight into the progress of
  program improvement through the implementation of
  the strategies and objectives outlined in the
  LIP.
• Due 3 months after LIP submission.

76
Interim Progress Report

• Complete the last column of the LIP
• Due January 15, 2007
• Email to cters_at_doe.virginia.gov

77
Statewide Performance Analysis

• Virginia System of Performance Standards and
  Measures for Secondary Career and Technical
  Education Programs

78
Divisions Required to Submit an Improvement Plan
79
Divisions Required toSubmit an Joint Planning
Form
80
Divisions Required toSubmit an On-Site Prep Form
81
Questions?
82
Contact Information
804-371-2924 FAX [phone] INTERNET
Blair.Seaford_at_doe.virginia.gov H. Blair
Seaford Data Management Specialist Office of
Career and Technical Education Virginia
Department of Education 101 N. 14th Street P.O.
Box 2120 James Monroe Building Richmond, VA
23218-2120 Richmond, VA 23219