Using Assessments

1
Using Assessments
Performance Measure 1.3 Professional Technical
Skill Attainment
2
Assessments

• Timeline
• Goals
• Strategies

3
Timeline of Eventsfor Assessment Implementation

• 1998 OVAE Approve Arizona Performance Measures
• September 2000 State Board Ed Approve
  Recommendations
• FY 2002 Implement Competency documentation
  Requirements
• FY 2002 Competency Documentation required during
  Data Quality reviews

4
Assessment Timeline

• January 2003 Alternative Assessment Research
  Project
• May 2003 CTE Delivery System Research Project
• Fall 2003 CTE State Advisory Committee actions
• Winter 2004 Research Report subcommittees
• Federal Perkins Reauthorization
• Next Steps Working Group
• Performance Measurement Initiative

5
Goals for CTE Technical Assessments

• Demonstrate CTE program effectiveness
• Measure technical knowledge and skills
• Measure higher levels of understanding and
  problem solving
• Measure student progress

6
Goals for Technical Assessments

• Measure comprehensive content coverage
• Meet criteria for technical assessments
• Valid
• Reliable
• Fair and non-biased
• Secure

7
Technical Assessment Goals

• Benchmarked at national, regional, state/local
  level
• Provide data management reports and services to
  state and local education agency managers and
  teachers. May use federal and state funds for
  these services

8
Technical Assessment Goals

• Align to industry standards in each CTE program
• Provide alternative strategies for students who
  require accommodation(s)

9
Technical Assessment Goals

• Provide standardized administration practices
• Encourage use of assessment results to
• Reinforce instruction
• Stimulate student interest
• Measure achievement
• Gauge student readiness for new learning
• Indicate effective instruction

10
Assessment Options Exclude

• Apprenticeships age, annual tenure, or hourly
  commitments prohibit secondary students
• Licensure available only in Cosmetology and
  Certified Nursing Assistant
• CTSO Events lack inter-rater reliability and
  objective scoring rubrics
• Events are not accessible to all students
• Many events lack reference to CTE program
  competencies

11
Cross Program Competencies

• No industry-validated or CTE standardized
  end-of-program assessments include both cross
  program and the rest of the CTE program
  competencies
• Requires separate assessment included as part of
  either an end-of-program technical assessment or
  part-of-program assessment

12
Arizona Workplace Skills Assessment

• AIMS does not measure eight (8) Workplace Skills
  standards
• 5 of 8 Workplace Skills are reflected in Cross
  Program Competencies
• AZ not currently developing AIMS test items for
  Workplace Skills
• Assessing the Cross-Program Competencies is the
  first step in developing a state assessment for
  workplace skills

13
How Do We Get There?

• Implement end-of-program assessment
• Implement part-of-program assessment when not
  available through end-of-program assessment
• Identify/develop technical skills tests for areas
  not presently available through industry or
  external source (i.e. NOCTI)

14
How Do We Get There?

• Continue curriculum revisions to include design
  team identifying end-of-program and
  part-of-program assessment sources
• Locate cross program competency assessments for
  areas not presently included in end-of-program
  assessments

15
How Do We Get There?

• Adapt/adopt CTE State Advisory Committee
  recommendations to institute a system of
  technical assessments for CTE
• Adapt/adopt technical and cross program
  competency assessments as they are identified by
  Design Teams

16
How Do We Get There?

• Establish procedures to allow local districts to
  develop alternative assessments that meet ADE
  test criteria
• Develop system to examine standardized/local
  district assessment results to verify that each
  assessment addresses the respective CTE program
  competencies

17
How Do We Get There?

• Institute professional development workshops to
  assist administrators and teachers to
  successfully use test results
• Reinforce instruction
• Stimulate student interest
• Measure achievement
• Gauge student readiness for new learning
• Indicate effective instruction

18
Thanks

• Career and Technical Education Staff
• for Teamwork