EndofCourse Assessment Test Coordinators Manual Training

1

• End-of-Course AssessmentTest Coordinators
  Manual Training
• Phase I 2008/2009

2
West Central MAP1-800-717-0605

• Alan Bancroft
• Math Regional Instructional Facilitator
  wbancroft_at_ucmo.edu
• Kathy Lewman
• Science Regional Instructional Facilitator
• lewman_at_ucmo.edu
• Linda Shippy
• Communication Arts Regional Instructional
  Facilitator
• lshippy_at_ucmo.edu

3
(No Transcript)
4
Accountability QuestionsMargie Vandeven,
Director DESE Accountability Data and
Accreditation(573)526-4886
5

• DISTRICT SPECIFIC QUESTIONS
• DESE Assessment Section
• 1-800-845-3545
• OR
• Special Education
• 573-751-5739

6
Agenda

• Testing Windows
• Test Formats
• Test Coordinators Manual
• Examiners Manual
• Questions

7

• EOC Testing Windows (inside cover)
• Spring April 15, 2009May 22, 2009
• Summer June 16, 2009August 31, 2009

8
Note New Window Flexibility

• ORIGINAL STRUCTURE
• Test all content in one week (5 consecutive days)
• OR
• NEW OPTION
• Divide content into separate weeks
• Algebra I April 15th -21st (Wed. Tue.)
• English II April 22nd - 28th (Wed. Tue.)
• Biology May 4th May 8th (Mon. Fri.)

9
New Window Limitations

• Each content area must be administered
  throughout the district at all schools within the
  same 5 consecutive school days.

10
Events Chart (inside cover)

• Event

• Date

• Shipment 1 Non-secure test materials
• Shipment 2 Secure test materials
• Deadline to order additional test materials
• Deadline for returning scorable materials to
  Riverside/ ARC

• 2-3 weeks before designated test window
• 2 weeks before designated test window
• 1 week before designated test window
• 1 week following designated test window

11
Test Return Policy

• Return all building assessments for each content
  at the same time, e.g., return all math at the
  same time.

12
Partners with Riverside Publishing Company

• Call Customer Service
• 877-553-3035
• 800 A.M. to 600 P.M. CST
• Monday through Friday
• OR
• Email mo.coordinator_at_hmhpub.com

13
Agenda

• Testing Windows
• Test Formats
• Test Coordinators Manual
• Examiners Manual
• Questions

14
EOC and MAP (p 3)

• Differences to MAP denoted using callout boxes

NOTE
15
EOC in Two Versions (p 3)

• Paper/Pencil
• Online version
• May use both versions, e.g., half the class can
  take paper/pencil and half online.

16
Phase I - Two Sessions (p 3)

• Session I
• Selected-response items
• Uses separate answer sheet
• Session II
• Performance Events/Writing Prompt
• Write directly in the test book

17
Session II Performance Events (p 3)

• Biology and Science
• Allow more than one approach for correct answer
• Assess applied knowledge to real life situations
• Algebra I PE - DOK3
• Biology PE - Inquiry strand

18
Session II Writing Prompt (p 3)

• Tests on-demand writing proficiency
• Scored holistically
• 4 point scoring guide
• May be
• persuasive, expository, narrative, descriptive

19
Snapshot of Phase I (Handout)
20
How long do the tests take?

• Session I and II (Suggested)
• 55 min, includes 10 min administrative time
• Not strictly timed
• Schedules should be flexible
• Suggest planning for more time

21
What does more time look like?

• Algebra I
• Session I 90-105 minutes
• Session II 60-70 minutes
• Biology
• Session I 70-80 minutes
• Session II 60-70 minutes
• English II
• Session I 90 minutes
• Session I 90 minutes

22
Scheduling Considerations

• Some students may need more time in sessions that
  occur right before lunch.
• Avoid scheduling a testing session at the end of
  the day in case a student needs more time to
  complete the assessment.

23
NOTE (p 3)

• Purpose of TCM
• Securing testing materials
• Distributing testing materials
• Returning testing materials to
• Riverside Session 1
• ARC Session 2

24
NOTE Test Coordinators (p.3)

• District Test Coordinator (DTC) the point
  person for testing in a school district
• School Test Coordinator (STC) the point person
  for testing in a particular building
• If a district does not have STCs, the DTC should
  assume both roles

25
Agenda

• Testing Windows
• Test Formats
• Test Coordinators Manual
• Examiners Manual
• Questions

26
Guidelines for Testing (p 4)

• Advanced Announcements -
• Notify parents and/or teachers
• About the importance of rest
• About supplies needed (may be provided by
  district)
• No. 2, non-mechanical pencils
• Scratch paper, graph paper
• Algebra 1 4-function calculator (minimum)
  straight edge
• Biology Metric rulers
• English II (Session II only) Grammar
  Handbooks, Thesauruses
• That classrooms should be free of cueing
  materials

27
Pre-Read Manual (p 4)

• Before distributing any materials
• For DTC and STC responsibilities

Who Calls Riverside?
One point of contact the DTC!
28
Contact Information (p 4)

• Riverside Publishing Company
• Customer Service
• 877-553-3035
• 800 A.M. to 600 P.M. CST
• Monday through Friday

E-mail mo.coordinator_at_hmhpub.com
29
Special Populations (p 4-5)

• IEP Students
• Must take all EOC Assessments administered by the
  district or portions of each content-area
  assessment as determined by the IEP team
• MAP-A students will not participate in EOC
• Inappropriate use of codes can invalidate scores

30
Special Populations (p 5)

• IAP/504 Students
• Considered disabled
• Not served under IDEA
• Professionals knowledgeable about IAP
  disabilities will make accommodations

31
NOTE (p 5)

• Accommodation codes are recorded on Session I
  answer sheet (see Sample p 15)
• Accommodation code definitions also found at
  http//dese.mo.gov/divimprove/assess/special
  .html

32
Further Info. - Special Populations (p 5)

• IEP/ELL
• Check accommodation descriptions in Test
  Examiners Manual Appendix

33
Further Info. - Special Populations (p 5)

• IEP/ELL - QUESTIONS
• CONTACT
• DESE Assessment Section
• 1-800-845-3545
• OR
• Special Education
• 573-751-5739

34
Students Not Tested (p 5)

• Group 1 MAP-A students
• Group 2 ELL in the US 12 months or fewer at the
  time of EOC may be exempt from taking
  English II. All other content areas MUST be
  assessed.

35
Students who move before testing (p 6)

• Test books do not move with students.
• Mark SIS Status Code
  No Longer Enrolled in District

36

• Foreign Exchange Students (p 6)
• Districts make the decision about testing these
  students
• Homebound Students (p 6)
• Take EOC if receiving instruction for assessed
  courses.
• May be tested at home or school
• Homeschooled Students (p 6)
• May take part in EOC at the districts discretion
• Take EOC courses for which they are enrolled in
  the district
• Should NOT be included in MOSIS Pre-ID and will
  not have student barcode labels

37

• MoVIP (p 6)
• MoVIP students taking EOC assessed courses will
  be assessed by MoVIP
• MoVIP Questions
• Curt Fuchs, Director
• 573-526-4219

38

• Absent During Testing (p 6)
• Make every attempt to have students take entire
  test
• If student is unable to take Session 1 and/or 2
  during the window
• Complete SIS (if barcode label is incorrect)
• Fill in the Absent bubble on SIS
• Process Session 1 answer sheet and Session 2 book
  with scorable materials

39
Large Print and Braille Procedures (p 7)

• Transcribe onto
• Session 1 answer sheet
• Session 2 regular edition test book
• Consult your Large Print/Braille test materials
  for specific instructions
• Mark SIS Codes
• Braille 01
• Large Print - 02
• Return students copy of test book to Riverside
  Scoring Services with the unused non-scorable
  testing materials.

40
Use of Translators (p 7)

• YES for Algebra I and Biology
• NO for English II
• Native language responses are acceptable from ELL
  students transcribe appropriately
• Translators must be trained in administering EOC
• Translators have access to Test Examiners
  Manuals and student test books to read/review
• Translators must follow all security measures and
  return testing materials to STC after use

41
Invalidation Procedures (Chart p 8)

• Check the chart
• Some procedures have changed
• Mark SIS appropriately
• Status Code Teacher Invalidation

42
Invalidation Procedures (p 8)
Status Code Teacher Invalidation
Code 04
Code 05
Code 06
Code 11
Code 43
43
To Invalidate A Test (pages 8-9)

• STC and Examiner must agree on Invalidation
  (between STC and Examiner)
• Invalidated answer sheet and/or test book must be
  returned with scorable materials to Riverside or
  ARC
• STC must provide DTC with student information (p
  9)
• Superintendent must send letter to DESE (p.9)
• District retains a documentation file

44
Calculator Policy/Restricted Equipment (p 10)

• Yes to calculators
• At minimum, a 4-function calculator for Algebra
  I both sessions
• Nothing with Internet access or a Qwerty keypad)
• No to cell/mobile phones, electronic music
  players, digital cameras, handheld scanners,
  gaming devices
• NOTE No mechanical pencils, pens,
  highlighters, crayons, colored pencils, or
  correction fluid

45
Test Coordinators Roles (p 11-16)

• 20 point checklist for DTC (District Test
  Coordinator)
• 14 point checklist for STC (School Test
  Coordinator)
• Examiners have their own content area manual

46
Security of Test Books

• Whenever possible, DESE recommends that test
  books should be stored away from classrooms.

47
Student Barcode Labels (p 13)

• 2 barcodes provided for each student for each
  assessment in which they are enrolled
• Labels printed by Riverside
• Information provided by districts to DESE via
  MOSIS
• Do not return any unused barcode labels

48
Student Barcode Labels (p 13)

• Check for accuracy and completeness
• Student name
• MOSIS ID
• DOB
• School Name
• District Name
• Grade

49
Sample Barcode Label
50
Student Barcode Labels (p 13)
Difference Noted
NOTE DO NOT affix an incorrect label and fill
in the SIS. The student barcode label will
override the biographic information bubbled on
the SIS.
51
If/Then Chart (p 14)
52
How to use Barcode Labels (p 14)

• Follow If/Then chart

NOTE Riverside will not be printing additional
student barcode labels. The district is
responsible for ensuring that the entire SIS is
filled out for the students who do not receive a
set of student barcode labels or whose
information on the label is incorrect. Please
see page 27 for completing required fields on the
SIS.
53
How to use Barcode Labels (p 14)

• Reminder
  When
  correcting student information on the SIS, dont
  forget to correct your districts information,
  too.

54
Sample Session I Answer Sheet SIS (p 15)
Each content area has its own set of
accommodation codes
Accommodation Codes in Test Coordinators
Manual (p. 40-43) and Test Examiners Manuals (p.
25-27)
55
Accommodation Codes
56
Status Codes
57
District Team Decision Delayed

• This is a new bubble designed for students who
  are not yet ready to take the EOC assessment for
  which they were enrolled.
• PRIOR to the testing window(s), the district
  should have their delay procedure clearly in
  place
• The procedure should
• include decision parameters
• include who is on the team to make the decision
• be in writing but does not need to be an official
  School Board policy

58
District Team Decision - Delayed

• If the district believes a particular student is
  not ready to take the EOC assessment for which
  he/she was enrolled, the district team makes the
  decision based upon the qualifications in the
  policy
• The STC bubbles in the District Team Decision
  Delayed on the students SIS
• DO NOT apply the bar code to Session II book
• The district keeps documentation about the
  decision to delay testing.

59
Inappropriate Enrollments

• An inappropriate enrollment includes any student
  who has been enrolled to take an EOC, but should
  NOT be enrolled to take the EOC assessment.

60
Inappropriate Enrollments

• If a student or group of students were
  accidentally enrolled for any EOC assessment
• Call Riverside Customer Service Line ASAP to stop
  enrollment process, if possible.
• Notify DESE Accountability Section
  (573-526-4886)
• If process cannot be stopped, follow these
  procedures

61
Inappropriate Enrollments

• If the district receives the testing materials
  and/or the barcode labels for inappropriate
  enrollments, DO NOT put those barcode labels on
  any of the test books
• Return the testing materials for those students
  to Riverside Publishing (secured, unused)
• Include the Session I answer sheet/SIS
  (appropriately marked with 2 bubbles) with the
  scorable materials.
• The STC or DTC should destroy the unused barcode
  labels.
• Note Any unused barcode labels do not have to
  be
• returned.

62
Inappropriate Enrollments

• Mark two bubbles on the Session I SIS
• First, under status codes, mark
• District Team Decision - Delayed

63
Inappropriate Enrollments

• Next, mark the 0 (zero) in the State Use bubbles
• Send a letter to DESE Accountability Section
  documenting the circumstances

64
Test Window
65
Which Form?
66
Session II Test Book SIS (p 16)

• NO Accommodations Box
• NO Test Window or Form Boxes
• NO State Use Box
• Session II SIS DOES capture Status Codes, if
  needed

67
Session II SIS (p 16)
68
Step 1 Receive Testing Materials (p
17-18)

• Shipment 1, Non-Secure Materials
• Packaged by school before being sent to district
  office address
• Comes about 2-3 weeks before districts one-week
  testing window

69
Step 1 Receive Testing Materials

• District Materials
• District Packing List
• Copy of School Packing Lists (for shipment 2 of
  secure materials)
• Test Coordinators Manual
• Test Examiners Manuals
• District Return Kit (one folder per district)

RETURN KIT
70
Step 1 Receive Testing Materials
What is UPS A.R.S.?

• United Parcel Service Authorized Return Service
• The labels are included in the shipment.
• The DTC applies the label to the package to be
  returned.
• The DTC will call UPS to pick up the testing
  material.

UPS
71
Step 1 Receive Testing Materials

• School Materials
• 2 copies of School Packing List included
• Test Coordinators Manual
• Test Examiners Manuals
• Session I Answer Sheets
• Algebra I reference sheets (districts may keep
  these)

• Note A five percent overage of the original
  enrollment will be included with the school
  testing materials in Shipments 1 and 2.

72
Step 1 Receiving Test
Materials (p 18) Shipment 2, Secure Materials

• District and School Secure Materials arrive
  approximately 2 weeks before the district test
  window

73
Step 1 Receive Testing Materials (p18)
District Materials

• Box 1 of X (shipment 2)
• District Packing List
• Cover Memo

74
Step 1 Receive Testing Materials (p 18) School
Materials

• School Packing List
• Student Barcode Labels
• Session I Test Books (Selected Response)
• Session II Scorable Test Books (Performance
  Event/Writing Task)

75
Step 2 Inventory Materials (p 19)

• Shipment 1, Non-Secure Materials
• DTCs inventory all non-secure materials
• DTCs contact Riverside if materials are missing
• DTCs/STCs save all the boxes
• STCs verify and report materials received
• DTCs ensure all required forms and labels for
  return
• DTCs store Return Kit folder and contents

76
Step 2, Inventory Materials (p 19)Shipment 2,
Secure Materials

• Again,
• DTCs inventory all secure materials
• DTCs contact Riverside if materials are missing
• DTCs record number of Session I II test books
  on Accountability Form (p 21)
• DTCs/STCs save boxes
• STCs verify and report that all materials are
  received.

77
Step 2 Inventory Materials (p 19)

• Note If replacement materials are needed
  (i.e., short shipments or insufficient receipt of
  materials that were ordered), please call
  Riverside Publishing immediately to arrange for
  supplementary materials to be shipped. If
  additional materials are needed, the DTC will
  enter an Additional Material Order (AMO) online.
  The AMO instructional insert can be found in the
  District Return Kit.

78
AMO (refer to page 25)

• DTC is responsible for appropriate amount of
  testing materials
• DTC orders more materials if needed
• Uses AMO for additional materials shipped via UPS
  ground
• Must request 1 week in advance of buildings test
  window
• STC uses overage before requesting additional
  materials

79
Step 3 Distribute Testing Materials (p 20)

• Administration Procedures DTCs, STCs, Examiners
• Pretest / Post-test
• Security Barcodes located on front cover of
  every Session I and Session II test book.
• Each test book has security barcode
• Test books should be inventoried before/after
  test administration
• Ensure 100 rate of return

80
Step 3 Distribute Testing Materials (p 20)

• Note In order to preserve the sequential
  integrity of the security barcodes, do not share
  test books among schools. If a test book is
  loaned to a school and later determined to be
  missing, the original school will be responsible
  for the missing test book.

81
Session I Selected-Response Non-Scorable Test
Books
Step 3 Distribute Testing Materials (p 20)

• Session I Selected-response - Algebra I,
  Biology, English II
• Each content has a separate test book
• Answers go on a separate answer sheet, not in the
  test book
• After testing is completed, ALL Session I
  selected-response test books (both used and
  unused) must be accounted for and returned to
  Riverside

82
Session I Selected-Response Answer Sheets
Step 3 Distribute Testing Materials (p 20)

• Scorable answer sheets machine scored
• Handle score sheets carefully must not be
  folded, clipped, stapled, taped, or torn
• When testing is complete and test materials are
• collected from students, the DTC or STC must
• Remove any stray marks on the selected-response
  sheets
• Destroy any unused Session I answer sheets

83
Session II Scannable Test Books
Step 3 Distribute Testing Materials (p 21)

• One Session II test book per content area
• Contains performance events or a writing task
• Open-ended format
• Answers written in the test book

84
Session II Scannable Test Books
Step 3 Distribute Testing Materials (p 21)

• To-be-scored Session II test books go to ARC
• All unused, non-scorable Session II tests must be
  accounted for and returned to RPC (Riverside
  Publishing Company)
• Do not apply barcode labels to unused test books

85
Pretest Administration - DTC
Step 3 Distribute Testing Materials (p 21)

• Make one copy of Test Book Accountability
  Form for each STC.
• Confirm box count of test materials
• Dont open shrink wrap verify barcode range of
  bundles
• Use Test Book Accountability Form to record of
  books on packing list
• Report discrepancies to Riverside Customer
  Service

86
Pretest Administration - STC
Step 3 Distribute Testing Materials (p 21)

• After receiving the Test Book
  Accountability Form from the DTC each STC

• Opens the shrink-wrap.
• Verifies that test books are in sequential
  security barcode order (e.g., 00000-01,
  00000-02).
• Verifies that security barcode numbers printed on
  the test books match the numbers listed on the
  packing list
• Completes the Test Book Accountability Form

87
Pretest Administration STC (cont)
Step 3 Distribute Testing Materials (p 22)

• After receiving the Test Book
  Accountability Form from the DTC each STC

• Documents any security barcode discrepancies
• Notifies DTC of any discrepancies
• Maintains Test Book Accountability Form during
  test adminsitration
• Retains a copy for school records
• Returns original with testing materials to DTC

88
Pretest Administration Examiner
Step 3 Distribute Testing Materials (p 22)

• Counts the number of books received
• Documents this in prep for returning test books
  to STC

89
Post-Test Administration DTC
Step 3 Distribute Testing Materials (p 22)

• Verify Test Book Accountability Forms for all
  buildings
• Document any missing test books on Test Book
  Accountability Form
• Explain any missing books in a letter on district
  letterhead.
• Attach to Test Book Accountability Form
• FAX Test Book Accountability Form to Riverside
• DO NOT return Test Book Accountability Forms with
  the scorables or non-scorable materials.
• Keep the original form for your district records.

90
Return Packing Forms - DTC
Step 3 Distribute Testing Materials (p 22)

• Completes the Return Packing Forms for each
  scorable district shipment
• Sends one shipment of scorable Session I answer
  sheets to Riverside
• Sends one shipment of scorable Session II test
  books to Assessment Resource Center.
• Makes corrections to preprinted information, if
  necessary.
• Records the total number of scorable materials.

91
Return Packing Forms - DTC
Step 3 Distribute Testing Materials (p 23)
Yellow Riverside Return Packing Form

• Places form on the top of all of scorable Session
  I answer sheets.
• If the district has multiple boxes of scorable
  Session I answer sheets, DTC places Riverside
  Return Packing Form on top of the documents in
  Box 1
• On yellow Session I Scorable Document Return
  Label, DTC places an X in the box labeled
  Check if this box contains the Riverside Return
  Packing Form and affixes the label to the
  outside of Box 1.

92
Return Packing Forms
Step 3 Distribute Testing Materials (p 23)
Orange ARC Return Packing Form

• Places form on the top of all of the scorable
  Session II test books
• If the district has multiple boxes of scorable
  test books, place ARC Return Packing Form on top
  of the documents in Box 1.
• On the orange Session II Scorable Document Return
  Label, DTC places an X in the box labeled
  Check if this box contains the ARC Return
  Packing Form and affixs the label to the outside
  of Box 1.

93
Building Identification Sheets
Step 3 Distribute Testing Materials (p 23)

• Two Building ID Sheets must be completed for each
  building
• One Building ID Sheet goes with Session I answer
  sheets to Riverside
• One Building ID Sheet goes with the Session II
  test books to ARC
• 4 pre-coded Building ID Sheets per school 4
  blank blank Building ID Sheets per school in
  District Return Kit DO NOT make any changes to
  format
• If info is incorrect, obtain blank Building ID
  Sheets

94
Group Identification Sheets
Step 3 Distribute Testing Materials (p 23)

• At minimum, two Group ID Sheets (GIS) per content
  area, per school, must be completed.
• The district can further break down groups of
  test takers for scoring and reporting purposes by
  using additional GIS.
• For each group identified, one GIS goes with
  Session I scorable answer sheets to Riverside and
  one GIS goes with the Session II scorable test
  books to ARC.

95
Group Identification Sheets
Step 3 Distribute Testing Materials (p 23)

• The information on the GIS must be identical for
• Session I and Session II groups
• All scorable test materials under a single GIS
  must be of the same content area and session.
• Assessment results returned based on how scorable
  materials are organized (Refer to the
  instructions on back of the GIS)
• GIS is a scanable document and cannot be
  photocopied.
• DTC can provide additional GIS.

96
Contaminated Test Books/Answer Sheets
Step 3 Distribute Testing Materials (p 24)

• Session I book, Session II book, and/or
  completed Session I answer sheet is considered
  contaminated because of the following
• Contact with any fluids resulting from a student
  health issue (e.g., blood)
• Contact with any potentially hazardous material
• Procedures for handling contaminated test
  materials see page 24 in TCM

97
Securing Testing Materials - DTC
Step 3 Distribute Testing Materials (p 25)

• The EOC Assessment testing materials MUST be
  secure at all times.
• Written and oral discussion of EOC items breaches
  the security and integrity of the test.
• NO testing materials may be photocopied,
  duplicated, scanned or made accessible to
  personnel not responsible for testing.

98
Securing Testing Materials - DTC
Step 3 Distribute Testing Materials (p 25)

• Lock materials in a secure district/school
  location, rather than classroom (if possible)
• Distribute Test Examiners Manuals to Examiners
  as soon as possible
• Keep DTCs materials for use after administration

99
Securing Testing Materials - STC
Step 3 Distribute Testing Materials (p 26)

• Checks materials upon receipt
• Identifies/verifies barcodes
• Emphasizes test security
• Ensures that each Examiner has the following
• A Test Examiners Manual
• Appropriate quantity of Session 1 II test books
• The appropriate quantity of Session 1 answer
  sheets
• Any required ancillary materials

100
Securing Testing Materials Examiner
Step 3 Distribute Testing Materials (p 26)

• The Examiner ensures
• Accuracy of the student barcode labels for each
  student.
• That they read the Test Examiners Manual before
  the day(s) of testing.

101
Securing Testing Materials Examiner
Step 3 Distribute Testing Materials (p 26)

• Ensures that any ancillary testing
  materials/tools are provided such as
• Graph paper for Algebra I
• Scratch paper for Biology
• Draft paper for English II
• Rulers for the Algebra I and Biology
• Calculators for the Algebra I
• Algebra I Reference Sheets

102
Securing Testing Materials Examiner
Step 3 Distribute Testing Materials (p 26)
NOTE Only the Test Examiners Manual can be
reviewed before testing, not the test books.
103
Post-Test AdministrationEnsure Documents Are
Completed Properly
Step 4 Collect Testing Materials (p 27)

• Check the SIS for accuracy (Table p 27)

104
Post-Test AdministrationEnsure Documents
Completed Properly - Examiner
Step 4 Collect Testing Materials (p 28)

• Session I, Test Books
• Collect test books from students after they have
  removed any stray marks
• Count and compare numbers of test books, using
  the Test Book Accountability Form
• Return all Session I test books to STC by content
  area
• Contact DTC contaminated books

105
Post-Test AdministrationEnsure Documents
Completed Properly - Examiner
Step 4 Collect Testing Materials (p 28)

• Session I, Answer Sheets

• Collect answer sheets
• Verify SIS or bar code information
• Return to STC
• Destroy unused answer sheets
• Securely shred all graph paper, scratch paper or
  draft paper
• Collect Algebra I reference sheet for Session II
• Contact STC contaminated answer sheet

106
Post-Test AdministrationEnsure Documents
Completed Properly - Examiner
Step 4 Collect Testing Materials (p 28)

• Session II, Test Books
• Collect test books
• Verify barcode labels
• Verify SIS
• Destroy Algebra I Reference Sheets (optional)
• Return all graph paper, scratch paper or draft
  paper
• Return all scorable test books to STC, separated
  by content

107
Post-Test AdministrationEnsure Documents
Completed Properly - Examiner
Step 4 Collect Testing Materials (p 28)

• Session II, Test Books (cont)
• Return any unused Session II test books to STC
• Contact STC contaminated books
• Return Test Examiners Manual for shredding

108
Remember (p. 29)

• NOTE The student barcode label should always
  be affixed when the information is correct. The
  top portion of the SIS is completed only if the
  label information is incorrect or an individual
  student did not receive a label. DO NOT affix an
  incorrect label and fill in the SIS. The student
  barcode label will override the bubbled SIS. If
  you affix an incorrect student barcode please see
  page 14 of this manual for specific instructions
  on how to proceed.

109
Post-Test AdministrationEnsure Documents
Completed Properly - STC
Step 4 Collect Testing Materials (p 29)

• Session I, Test Books
• Collect test books from Examiners
• Count and compare Session 1 test books, using
  the Test Book Accountability Form
• Return tests to DTC in separate bundles, by
  content
• All Session 1 books are considered secure,
  non-scorable material
• Contact DTC regarding contaminated test books

110
Post-Test AdministrationEnsure Documents
Completed Properly - STC
Step 4 Collect Testing Materials (p 29)

• Session I, Answer Sheets
• Collect scorable answer sheets
• Separate by content area
• Complete Group ID Sheet (GIS)
• Verify student barcode label or SIS
• Verify Building ID Sheet. Place on top of all
  GIS and scorable answer sheets (in Box 1 of X)
• Destroy unused answer sheets
• Securely shred all graph paper, scratch paper or
  draft paper

111
Post-Test AdministrationEnsure Documents
Completed Properly - STC
Step 4 Collect Testing Materials (p 29)

• Session I, Answer Sheets
• If Building ID Sheet is incorrect destroy. Use
  blank Building ID Sheet provided in District
  Return Kit. Place it on top of all answer sheets
• Return all scorable Session I answer sheest to
  DTC
• Collect and destroy all unused answer sheets and
  other non-secure testing materials.
• Contact the DTC Contaminated answer sheets

112
Post-Test AdministrationEnsure Documents
Completed Properly - STC
Step 4 Collect Testing Materials (p 30)

• Session II, Test Books
• Collect scorable materials
• Check for any ink, markers, etc. Only No. 2,
  non-mechanical pencils should have been used.
• Erase all stray marks on the coding tracks
• Verify information on barcode or SIS
• Complete Group ID sheets (instructions on back)

113
Post-Test AdministrationEnsure Documents
Completed Properly - STC
Step 4 Collect Testing Materials (p 30)

• Session II, Test Books
• Verify Group ID Sheet on top of each set of
  Session II books (at least one GIS per content
  area, per building)
• Verify Building ID Sheet. Place on top of Group
  ID Sheets and Session II test books
• If Building ID Sheet is incorrect, destroy it and
  complete blank one (in District Materials Kit)
• Return all scorable Session II test books to DTC

114
Post-Test AdministrationEnsure Documents
Completed Properly - STC
Step 4 Collect Testing Materials (p 30)

• Session II, Test Books
• Return any non-scorable Session II test books to
  DTC separately
• Contact the DTC - contaminated tests

NOTE A test book processed with the
non-scorable materials will not be included in
statewide reporting
115
Post-Test AdministrationEnsure Documents
Completed Properly - DTC
Step 4 Collect Testing Materials (p 30)

• DTCs Responsibilities
• Verify 100 rate of return
• Follow instruction on the Test Book
  Accountability Form, return one form for each
  school to Riverside via fax, and retain a copy
• Very documentation of contaminated books
• Verify Group ID Sheets are utilized consistently
  for Session 1 2 scorables
• Return all test books following procedures in
  Step 5

116
STEP 5 Packing Shipping (p 31)

• Return Shipment 1
• Scorable Session I Answer Sheets
• STCs Responsibilities
• Obtain original shipping boxes for reuse
• Place answer sheets for corresponding content
  area or class under the appropriate Group ID
  sheet. Repeat for each content per school
• Place Building ID Sheet on top of all Group ID
  sheets and Session I answer sheets in Box 1
• Count and record number of boxes to be delivered
  to DTC
• Dont tape closed

117
STEP 5 Packing Shipping (p 30)

• Return Shipment 1
• Scorable Session I Answer Sheets
• DTCs Responsibilities
• Collect packed boxes
• Complete the Riverside Return Packing Form
• Place Riverside Return Packing Form on top of Box
  1 Answer Sheets
• Use Riverside yellow Session I Scorable Document
  Return Label
• Store in secure area until shipped

118
STEP 5 Packing Shipping (p 31)

• Make sure all scorable materials are separated
  from all non-scorable materials.
• Check that no used Session I selected-response
  answer sheets are left inside the Session I test
  books.
• Make sure that all the necessary Group ID sheets
  and Building ID Sheets are completed and that the
  Return Packing Form is on top of all the scorable
  materials in the first box.

119
STEP 5 Packing Shipping (p 31)

• Return Shipment 1 must be ready for pickup
  promptly after all buildings have completed
  testing in a content area.
• Follow diagram on page 32 of the TCM
• Note Test booklets and answer sheets may be
  returned by content-area rather than in one large
  shipment.

120
P 32
Session I Answer Sheets, one school and one
content area
Diagram on right depicts the use of additional
Group ID Sheet to separate Algebra I Answer sheets
SEND TO RIVERSIDE
121
Arranging for Pickup of Return Shipment 1 to
Riverside (p. 33)

• Scorable Session I Answer Sheets
• Returned to Riverside via UPS.
• UPS A.R.S. labels have been provided in Shipment
  1 in the District Return Kit.
• Riverside is responsible for all shipping costs
  however, the DTC is responsible for making
  shipping arrangements with UPS.

122
Arranging for Pickup of Return Shipment 1 to
Riverside (p 33)

• To ship scorable Session I selected-response

• Package materials by content area and by building
• Separate scorable from non-scorable
• Seal the boxes securely with heavy-duty packing
  tape
• Affix the UPS A.R.S. labels
• Retain the bottom tracking number for district
  records. Neither UPS nor Riverside Publishing
  can track the districts shipment without the
  tracking number.
• Follow the remaining instructions on p 33 of the
  TCM.

123
UPS pickup (p 33)

• Contact UPS at 800-742-5877, and follow the
  prompts to send a package.
• Same-day pickup is available but not guaranteed.
• Follow specific instructions for materials in
  Shipment 1 in the District Return Kit.

124
Arranging for Pickup of Return Shipment 2 to ARC
(p 34)

• Session II Scorable Test Books
• STCs Responsibilities
• Prepare boxes
• Place the answer sheets for the corresponding
  content area or class under the appropriate Group
  ID sheet.
• Place a Building ID Sheet on top of all Group ID
  sheets and Session II test books in Box 1.
• Count and record the total number of boxes.
• DO NOT tape boxes closed, as the DTC will need to
  inspect and verify materials.

125
Arranging for Pickup of Return Shipment 2 to ARC
(p 34)

• Session II Scorable Test Books
• DTCs Responsibilities
• Collect all packed shipping boxes from the STCs
• Complete the ARC Return Packing Form
• Place the ARC Return Packing Form on top of the
  materials in Box 1 of the scorable Session II
  test books
• Affix orange label. Write Box number ___ of ____
  directly on the label
• Store securely until UPS pickup

126
UPS Pickup (p 34)

• Return Shipment 2 must be ready for pickup
  promptly after all buildings have completed
  testing in a content area.
• Retain the bottom tracking number for district
  records.

127
Package scorable Session II test books 1 school
and 1 content at a time
P 35
RETURN TO ARC
128
Arranging for Pickup of Return Shipment 2 to ARC
(p 36)

• All scorable Session II test books must be
  returned to ARC via UPS
• UPS A.R.S. labels in Shipment 1 in the District
  Return Kit
• Riverside is responsible for all return shipping
  costs
• The DTC is responsible for making shipping
  arrangements with UPS
• Follow 9 bulleted steps on page 36 of TCM
• Again, packaging will vary depending on how
  districts administered the tests.

129
Return Shipment 3 Secure Non-Scorable Materials
(p 37)

• Organize all the secure non-scorable materials
  for the district into relevant piles.
• All Session I (selected-response) test books and
  Session II (performance events/writing tasks)
  unused test books for all content areas are
  considered secure non-scorable materials and must
  be returned to Riverside.

130
Organize into relevant piles as shown (p. 37)
131
Return Shipment 3 Secure Non-Scorable Materials
(p 37)

• The DTC is to verify that all secure non-scorable
  materials for all content areas are returned from
  the schools. STCs have been instructed to
  organize the materials into related stacks.
• Materials are not required to be in numerical
  order upon return to Riverside Scoring Service.
• Return Shipment 3 must be ready for pickup
  promptly after each content areas testing is
  finished.

132
Non-Scorable Materials Packing
Diagram
P 38
133
Return Shipment 3 Secure Non-Scorable Materials
(p 37)

• To ship the secure non-scorable materials
• Prepare boxes
• Affix one white Non-Scorable Document Return
  Label to the box
• Seal with heavy-duty packing tape
• Write district name and address on the label
• Place one white Non-Scorable Document Return
  Label on each box
• Total the number of boxes (e.g. Box 1 of 3, etc.)

134
UPS Pickup (p 39)

• Do not include the number of boxes of secure
  scorable materials in the total for the number of
  secure non-scorable materials
• Arrange for UPS pickup

135
P 40
English Language Learners
136
Appendix Accommodation Codes List for English
Language Learners (ELL)
(p 40)

• NOTE 1 Oral reading, oral reading in native
  language, or the use of a bilingual dictionary
  during the English II assessment will result in
  the LOSS (Lowest Obtainable Scale Score).

137
Students with Disabilities
P 41
138
Students with Disabilities
P 42
139
Appendix Accommodation Codes List for Students
with Disabilities
(p 41-42)

• NOTE 1 Oral reading of the English II test
  results in the LOSS (Lowest Obtainable Scale
  Score).
• Students identified as blind/visually impaired
  (who do not read Braille) may use the oral
  reading accommodation if it is their primary
  instructional method. (Code 04)

140
Appendix Accommodation Codes List for Students
with Disabilities
(p 41-42)

• NOTE 2 Paraphrasing test questions invalidates
  all EOC assessment student scores for
  accountability purposes. (LOSS)

NOTE 3 Use of magnifying equipment,
amplification equipment, graph paper and testing
with the teacher facing the student are not
listed as accommodations because these are not
required to be reported as accommodations for the
EOC assessments.
141
Agenda

• Testing Windows
• Test Formats
• Test Coordinators Manual
• Examiners Manual
• Questions

142
Examiners Manual

• 3 separate manuals
• Algebra I
• Biology
• English II

EOC
SCIENCE
Examiners Manual
143
Step 1 Inventory Test Materials (p 4)

• Examiners Materials
• Test Examiners Manual
• Group Identification Sheet (GIS)
• Supplemental Session I answer sheets
• Do Not Disturb sign (not provided)

144
Step 1 Inventory Test Materials

• Student Materials
• Student barcode labels
• Session I test books
• Session II test books
• Session I answer sheets
• No. 2 pencils, non-mechanical (not provided)
• Scratch, graph or draft paper (not provided)
• Minimum four-function calculators for Algebra I
  (not provided)
• Rulers for Algebra I and Biology assessments (not
  provided)
• Dictionary, thesaurus, grammar handbook (for
  English II Session II only not provided)
• Algebra I reference sheet (for Algebra I Sessions
  I and II)

145
Step 1, Continued

• Testing Materials
• 2 student barcode labels, one for the Session I
  answer sheet and one for the Session II test book
• For students with no or incorrect barcodes, the
  biographic information on the Student Information
  Sheet on the backs of the Session I answer sheet
  and the Session II test book will need to be
  filled in (directions are on page 6).

146
Session I Selected-Response Non-Scorable
Test Books (p 5)

• Session I test books contain selected-response
  items
• For Session I, answers marked on a separate
  answer sheet
• After testing is completed, ALL Session I test
  books (used and unused) for all content areas
  must be accounted for and returned to Riverside
  with the other secure, non-scorable test
  materials.

147
Session I Selected-Response Scorable Answer
Sheets (p. 5)

• Session I answer sheets MUST be handled
  carefully. Do not fold, clip, staple, tape or
  tear the answer sheets.
• When testing is complete, the DTC or STC must
• Remove any stray marks on the answer sheets.
• Destroy any unused answer sheets for the Session
  I test books (these are not secure materials)

148
Session II Scannable, Scorable Test Books (p 5)

• Session II test books contain Performance Events
  or Writing Prompts. Students will write their
  answers in the test book.
• After testing
• All Session II test books that are to be scored
  will be sent to the Assessment Resource Center
  (ARC).
• All unused, non-scorable Session II test books
  must be accounted for and returned to Riverside
  Publishing in the appropriate shipment boxes.

149
Security Note (p. 5)

• ______________________________________________
• NOTE Test books are secure materials.
  Examiners are not to view, read, edit, act or
  react verbally or non-verbally in response to
  student answers. A translator may read the
  assessment in a secure environment to prepare for
  providing translation to a student.
• ________________________________________________

150
Barcode labels and Filling in the Biographic
Information on the SIS (p 6-7)

• Many DTCs and STCs prefer to apply the student
  barcode labels themselves. Please check with
  your DTC to determine how your building will be
  handling this issue.
• Follow the same advice for how to handle those
  situations when the barcode is missing or
  incorrect and the SIS will need to be used.

151
Step 2 Make Arrangements for Accommodations (p
8)

• The DTC and STC, sometimes in conjunction with
  the IEP team, should have identified those
  students who will need accommodations. The role
  of the Examiner is to implement those
  accommodations appropriately and to record them
  on the Session I answer sheet. In some
  buildings, the STC will choose to be responsible
  for recording the accommodations.

152
Step 3 Prepare for Test Administration (p 10)

• Organize the classroom
• Plan how to distribute and collect materials
• Plan seating arrangements
• Eliminate distractions under your control
• Use a Do Not Disturb sign (not provided) on your
  door
• Remove or cover any maps, charts, or other
  materials that relate to the content and
  processes of the test.

153
Administer the Tests (p 11)

• Specific directions for each content area begin
  on page 12 of the Examiners manual.
• The following symbol is used throughout the
  specific directions

The directions you are to read aloud to the
students are preceded by the word SAY in a
box. Information that is only for you and not to
be read aloud is printed in italic type.
SAY
154
Directions for Administering Session I (p 12)

• Before starting, be sure that students understand
  what each picture icon means and make sure each
  student has the appropriate materials.
• Follow the directions, as they are given
  ,beginning on page 12.

155
Directions for Administering Session I (p 12-13)

• Remember that, if a student does not understand a
  word, all you may do for them is to pronounce the
  word. Do not define, explain, or paraphrase it.
• Tests must be finished in one sitting. If a
  student is not finished in the allotted time and
  is making adequate progress, the student should
  be allowed to finish. Your district should have
  a plan for allowing extended time for these
  students.
• Test may not be returned to students to complete
  or correct.

156
Directions for Administering Session II (p 14)

• Algebra I - If your district has decided to
  supply calculators for the Algebra I EOC, make
  sure all students have one that works and meets
  the criteria (minimum 4-function, no Internet
  access, no Qwerty keypad). The Algebra reference
  sheet may also be used.
• English II Students may use a standard
  dictionary, thesaurus, or grammar handbook while
  writing their papers but the Examiner may not
  directly answer questions about grammar, usage,
  mechanics, punctuation, or spelling.
• Biology - Students may use a ruler as a
  straightedge.

157
Step 4 Student Absences and Invalidations (p 16)

• Examiners should follow the districts policy
  about how to handle student absences during the
  test. Absences were addressed in the section on
  the Test Coordinators Manual earlier in the
  presentation.
• The STC and the Examiner must agree that a
  particular students test should be invalidated,
  based on the invalidation criteria given on page
  17. It is the STCs responsibility to fill in
  the bubble for the appropriate invalidation code
  on the SIS.

158
Step 5 Review the Completed SIS (p 18)

• Your district may assign the following
  responsibilities to the STC or DTC. If not,
  these are the Examiners responsibilities with
  respect to the SIS
• Accommodations Fill in the circle(s) that best
  represent the accommodation(s) under that
  heading. Refer to the note on page 18 about
  accommodation codes.
• Test Window Fill in the single bubble that
  refers to the administration period.

159
Step 5 Review the Completed SIS (p 18)

• Form Only those testing in the SPRING will fill
  in a form number. If the form number is a single
  digit, the number should be precede by a zero
  (ex. 02).
• Status Codes Fill in the appropriate codes when
  necessary. Consult the STC for guidance

160
Step 6 Collect Testing Materials (p 21)

• Session I, Test Books
• Collect the Session I test books from the
  students
• Count the test books and verify the total with
  the pretest number before returning to the STC.
• Return all Session I test books to the STC in
  separate bundles by content area used and
  unused.
• Contact the STC for guidance regarding the
  handling of contaminated test books.

161
Step 6, cont (p 21)

• Session I, Answer Sheets
• Collect Session I completed (scorable) answer
  sheets from the students.
• Verify that the student barcode label is attached
  appropriately.
• Verify that the required information is correct
  on the SIS, when applicable.
• Return completed answer sheets by content area to
  the STC.

162
Step 6, cont (p 21)

• Session I, Answer Sheets
• Return any unused answer sheets to the STC to be
  destroyed.
• Collect all graph paper, scratch paper, or draft
  paper and return them to the STC to be securely
  destroyed.
• Collect the Algebra I reference sheet to have for
  distribution in Session II (if applicable).
• Contact the STC for guidance regarding the
  handling of contaminated answer sheets.

163
Step 6, cont (p 21-22)

• Session II, Test Books
• Collect all scorable Session II test books from
  the students
• Verify that the student barcode label is attached
  appropriately.
• Verify that the required information is correct
  on the SIS, when applicable.
• Collect all Algebra I Reference Sheets and return
  them to the STC for shredding.
• Collect all graph paper, scratch paper, or draft
  paper and return them to the STC to be securely
  destroyed.

164
Step 6, cont (p 22)

• Session II, Test Books
• Return all completed (scorable) Session II test
  books to the STC separated by content area.
• Return any unused Session II test books to the
  STC separately.
• Count all Session II test books and verify the
  total with the pretest number before returning to
  the STC.
• Contact the STC for guidance regarding the
  handling of contaminated test books.
• Return the Test Examiners Manual to the STC for
  shredding.

165
Step 7 Complete the Group ID Sheet (p. 23)

• At a minimum, two Group ID Sheets (GIS) per
  content area, per school, must be completed. For
  more information, refer to the GIS slide in the
  Test Coordinators portion of this presentation.
• The DTC will assign responsibility to the STC or
  Examiner for completing the GIS.

166
Accommodations (p. 25-27)

• Appendix B (page 25) lists the accommodations for
  students who are English Language Learners (ELL).
  Take special note of those which result in
  invalidation and of the note at the bottom of the
  chart.
• Appendix B (pages 26-27) lists the accommodations
  for students with disabilities. Again, take
  special note of those which result in
  invalidation and of the three notes at the bottom
  of the chart on page 27.

167
Agenda

• Testing Windows
• Test Formats
• Test Coordinators Manual
• Examiners Manual
• Questions

168
DESE Website EOC

• Manuals
• Systems Requirements
• Materials Orders (Spring 2008-2009)
• Resources
• http//dese.mo.gov/divimprove/assess/eoc/

169
EOC Online Test Examiners Manual

• http//dese.mo.gov/divimprove/assess/eoc/documents
  /eoc-online-em-2008-09.pdf

170
One last thingEOC Field TestApril 27-May 15

• One Field Test Coordinators Manual (FTCM)
• One Field Test Administration Manual (FTAM) to
  be used with standalone English II
• Three Field Test Examiners Manuals

171
Thank You
M A P
Evaluation