Wisconsin Knowledge

1
Wisconsin Knowledge Concepts Examination
(WKCE) Test Security Training for Proctors

• Wisconsin Department of Public Instruction
• Office of Educational Accountability

07/24/2007
2
Purpose of this Training
Security

• To emphasize the importance of test security
• To ensure the standardized administration of the
  tests
• To make sure that there is not an unfair
  advantage to some students
• To improve the overall understanding of test
  security procedures

3
Test Security

• The primary goal of WKCE test security is to
• protect the integrity of the examinations
  through
• Securing the test materials at all times
• Ensuring appropriate administration of the test

4
Consequences of Test Security Violations

• When the security of an item is breached, this
  may result in making the item unusable in future
  tests. The state then incurs additional costs
  associated with item development, which is
  already a very expensive process.
• An unfair advantage may be provided to some
  students, making it difficult to draw meaningful
  conclusions about their performance.

5
Consequences of Test Security Violations

• Invalidation of test results for individual
  students or groups of students.
• This will result in
• Parents receive no scores on their childs report
  if a test is invalidated
• Public reporting on WINSS will reflect all
  invalidated tests as not tested. This may
  reduce the percentage of students meeting
  proficiency.
• Schools may have a more difficult time meeting
  Adequate yearly progress (AYP) indicators as a
  result.

6
Stages of Test Administration During WhichTest
Security Must be Ensured

• Prior to testing
• During testing
• After testing
• During Item Analysis /data retreats

7
List of Responsibilities at Proctor Level

• Attend WKCE test administration training session
  prior to each test administration
• Sign confidentiality form and return to school
  assessment coordinator
• Ensure that test materials are in locked and
  secure location before and after each testing
  session
• Remain in the room throughout the entire test
  administration
• Read and follow the directions as stated in the
  Test Administrators Manual

8
List of Responsibilities at Proctor Level

• Report all testing irregularities to the school
  assessment coordinator such as
• Student going back to the previous session
• Student cheating
• Unallowable accommodations
• Do not copy, alter/modify items (i.e photocopying
  student writing samples)
• Follow testing policies for electronic devices
  including calculators and cell phones

9
Calculator Policy

• The use of calculators varies by grade. There are
  clear directions for the use of calculators in
  the Test Administration Manual and the Policy
  Manual both of which can be accessed at
  http//dpi.wi.gov/oea/publications.html.
• It is important to review these policies
  carefully as inappropriate use of calculators
  during test administration may result in
  invalidation of test results.

10
Appropriate Use of Test Accommodations

• For use of allowable accommodations, please refer
  to the assessment matrix available at
• http//dpi.wi.gov/oea/pdf/assessmatrix07.pdf
• In the event that an accommodation is not on the
  matrix but necessary for a student to demonstrate
  their knowledge skills in a content area , a
  non-standard accommodations request form should
  be submitted to DPI for consideration. This form
  is available at http//www.dpi.wi.gov/oea/dacforms
  .html
• If DPI agrees that the requested accommodation
  does not affect the validity of the test, it will
  be approved.
• If it does impact test validity, the school may
  use the accommodation but the student will be
  counted as not tested.

11
After Testing

• After testing, all test booksthose to be scored
  and those not to be scored are to be returned to
  the school assessment coordinator
• Follow the procedures established by the school
  assessment coordinator for returning all used and
  unused testing materials, blank paper, and
  supplemental materials

12
List of Common Errors Test Security Violations
to Avoid

• Use of a non-allowed accommodation e.g. Reading
  the reading test.
• Use of live test items for test preparation
  activities
• Allowing the use of calculator for computation
  sections in Mathematics

13
Stages at Which Test Security Violations Can be
Detected

• When DPI receives a report from district about a
  test violation / irregularity
• Statistical tests conducted by CTB to detect
  anomalies

14
Next Steps

• Districts may be contacted to conduct further
  investigation
• Districts might choose additional consequences
  related to personnel contracts / issues.

15
Process for Handling Test Security Violations
INITIAL REPORT ALLEGING A SPECIFIC VIOLATION A
test security violation is reported and received
by the Department from any individual or school
or district alleging that a specific breach in
test security has occurred in an individual
district or testing site.
INITIAL INTERNAL REVIEW OF POTENTIAL TEST
SECURITY IRREGULARITY The DPI Internal Test
Security Review Team reviews all reports brought
to the team to determine how best to resolve the
allegation by analyzing the severity of the
alleged breach of test security and the scope of
potential harm the breach may bring to the
integrity of assessment results.

• Telephone assistance from OEA to the DAC .

Invalidation of test scores
Letter from the director of OEA
Approval / no consequences
Districts may choose additional consequences
related to personnel contracts / issues.
16
Thank You!
For additional information, please contact
oeamail_at_dpi.state.wi.us