EndofCourse Assessment Examiners Manual Training

1

• End-of-Course AssessmentExaminers Manual
  Training
• Phase I 2008/2009

2

• EOC TESTING WINDOWS
• Spring April 15, 2009May 22, 2009
• Summer June 16, 2009August 31, 2009

• Districts can enroll in any or all administration
  windows.
• Districts have flexibility to choose when they
  will administer the assessments within the state
  assessment windows.

3
Testing Window Flexibility

• Districts can test all content in five
  consecutive days as originally structured for the
  fall/winter window
• or
• Districts can divide content into separate
  weeks, for example
• Algebra I from April 15th -21st (Wed. Tue.)
• English II from April 22nd - 28th (Wed. Tue.)
• Biology from May 4th May 8th (Mon. Fri.)

4
Testing Window Limitations

• All assessments for a specific content area
  (all math for example) must be administered
  throughout the district at all schools within the
  same 5 consecutive school days.

5
Test Return Policy

• Districts must return EOC assessments for the
  tested content at the same time, e.g., all math
  content must be returned at the same time.

6
Partnership with Riverside Publishing Company

• Call Riverside Publishing Company
• Customer Service
• 877-553-3035
• 800 A.M. to 600 P.M. CST
• Monday through Friday
• Or
• Email mo.coordinator_at_hmhpub.com

7
Events and Dates

• All dates for receipt of materials are arranged
  around the districts initial testing week.

8
Important Dates (after front cover)

• Event

• Date

• Districts receive Shipment 1 Non-secure test
  materials Return Kits, Manuals, and Session I
  answer sheets
• Districts receive Shipment 2 Secure test
  materials Student barcode labels, Session I and
  Session II test books
• Deadline for districts to order additional test
  materials
• Deadline for returning scorable materials to
  Riverside Publishing and ARC

• 2-3 weeks before designated test window
• 2 weeks before designated test window
• 1 week before designated test window
• 1 week following designated test window

9
Riverside Publishing Company Assessment
Resource Center

• Riverside Publishing Company (RPC) has set up a
  dedicated Missouri Customer Service telephone
  number 877-553-3035 from 800 a.m. to 600 p.m.
  Central Standard Time Monday-Friday.
• RPC will receive Session I materials
• Assessment Resource Center (ARC) will receive
  Session II materials

10
EOC in Two Versions

• EOC assessments are available in two different
  versions
• Paper/Pencil
• Online version
• Each assessment may be taken in either version. A
  district doesnt have to choose just one way
  e.g., half the class can take paper/pencil and
  half online.

11
Phase I has Two Sessions

• Session I
• Selected-response items
• Uses separate answer sheet
• Session II
• Performance Events/Writing Prompt
• Write directly in the test book

12
Selected Response Items

• 47 items in Session I Algebra I, Biology and
  English II
• Includes both operational and embedded field test
  items
• A stem (question)
• 3 distracters (incorrect answers)
• 1 correct answer

13
Session II Performance Events for Algebra I and
Biology

• Assesses students applied knowledge
• Algebra I PE assesses CLEs with a Level 3 DOK
  from the Algebraic Relationships strand
• Biology PE assesses the Inquiry strand

14
Session II Writing Prompt for
English II

• On-demand writing proficiency
• Scored holistically, using a four-point scoring
  guide
• The prompt may be persuasive, descriptive,
  expository, or narrative

15
Snapshot of Phase I
16
How long do the tests take?

• The test manual calls for 55 minutes (including
  10 minutes of administrative time) each for
  Sessions I and II. However, the tests are not
  strictly timed and schedules should be flexible
  to enable students to complete each session.
• With embedded field test items and an
  understanding of past student performance, we
  suggest planning for more time.

17
What does more time look like?

• Algebra I
• Session I 90-105 minutes
• Session II 60-70 minutes
• Biology
• Session I 70-80 minutes
• Session II 60-70 minutes
• English II
• Session I 90 minutes
• Session I 90 minutes

18
Scheduling Considerations

• Make plans for students who need more time in
  sessions that occur right before lunch.
• Avoid scheduling a testing session at the end of
  the day in case a student needs more time to
  complete the assessment.

19
Examiners Manual

• There are separate manuals for each content area.
• Algebra I
• Biology
• English II

20
Step 1 Inventory Test Materials (p. 4)

• Examiners materials
• Test Examiners Manual
• Group Identification Sheet (GIS)
• Supplemental Session I answer sheets
• Do Not Disturb sign (not provided)

21
Step 1 Inventory Test Materials

• Student Materials
• Student barcode labels
• Session I test books
• Session II test books
• Session I answer sheets
• No. 2 pencils, non-mechanical (not provided)
• Scratch, graph or draft paper (not provided)
• Minimum four-function calculators for Algebra I
  (not provided)
• Rulers for Algebra I and Biology assessments (not
  provided)
• Dictionary, thesaurus, grammar handbook (for
  English II Session II only not provided)
• Algebra I reference sheet (for Algebra I Sessions
  I and II)

22
Step 1, Continued

• Testing Materials
• 2 student barcode labels, one for the Session I
  answer sheet and one for the Session II test book
• For students with no or incorrect barcodes, the
  biographic information on the Student Information
  Sheet on the backs of the Session I answer sheet
  and the Session II test book will need to be
  filled in (directions are on page 6).

23
Session I Selected-Response Non-Scorable
Test Books (p. 5)

• Session I test books contain selected-response
  items. For Session I, answers are marked on a
  separate answer sheet.
• After testing is completed, ALL Session I test
  books (used and unused) for all content areas
  must be accounted for and returned to Riverside
  Publishing with the other secure, non-scorable
  test materials.

24
Session I Selected-Response, Scorable Answer
Sheets (p. 5)

• Session I answer sheets MUST be handled
  carefully. Do not fold, clip, staple, tape or
  tear the answer sheets.
• When testing is complete, the DTC or STC must
• Remove any stray marks on the answer sheets.
• Destroy any unused answer sheets for the Session
  I test books (these are not secure materials)

25
Session II Scannable, Scorable Test Books (p. 5)

• Session II test books contain Performance Events
  or Writing Prompts. Students will write their
  answers in the test book.
• After testing
• All Session II test books that are to be scored
  will be sent to the Assessment Resource Center
  (ARC).
• All unused, non-scorable Session II test books
  must be accounted for and returned to Riverside
  Publishing in the appropriate shipment boxes.

26
Security Note (p. 5)

• ______________________________________________
• NOTE Test books are secure materials.
  Examiners are not to view, read, edit, act or
  react verbally or non-verbally in response to
  student answers. A translator may read the
  assessment in a secure environment to prepare for
  providing translation to a student.
• ________________________________________________

27
Barcode labels and Filling in the Biographic
Information on the SIS (p. 6)

• Many DTCs and STCs prefer to apply the student
  barcode labels themselves. Please check with
  your DTC to determine how your building will be
  handling this issue. Follow the same advice for
  how to handle those situations when the barcode
  is missing or incorrect and the SIS will need to
  be used.

28
Step 2 Make Arrangements for Accommodations (p.
8)

• The DTC and STC, sometimes in conjunction with
  the IEP team, should have identified those
  students who will need accommodations. The role
  of the Examiner is to implement those
  accommodations appropriately and to record them
  on the Session I answer sheet. In some
  buildings, the STC will choose to be responsible
  for recording the accommodations.

29
Step 3 Prepare for Test Administration (p. 10)

• Organize the classroom
• Plan how to distribute and collect materials
• Plan seating arrangements
• Eliminate distractions under your control
• Use a Do Not Disturb sign (not provided) on your
  door
• Remove or cover any maps, charts, or other
  materials that relate to the content and
  processes of the test.

30
Administer the Tests (p.11)

• Specific directions for each content area begin
  on page 12 of the Examiners manual.
• The following symbol is used throughout the
  specific directions

31
Directions for Administering Session I (p. 12)

• Before starting the test, be sure that students
  understand what each picture icon means and make
  sure each student has the appropriate materials.
• Follow the directions, as they are given
  ,beginning on page 12.
• Remember that, if a student does not understand a
  word, all you may do for them is to pronounce the
  word. Do not define, explain, or paraphrase it.
• Tests must be finished in one sitting. If a
  student is not finished in the allotted time and
  is making adequate progress, the student should
  be allowed to finish. Your district should have
  a plan for allowing extended time for these
  students.

32
Directions for Administering Session II (p. 14)

• Algebra I - If your district has decided to
  supply calculators for the Algebra I EOC, make
  sure all students have one that works and meets
  the criteria (minimum 4-function, no Internet
  access, no Qwerty keypad). The Algebra reference
  sheet may also be used.
• English II Students may use a standard
  dictionary, thesaurus, or grammar handbook while
  writing their papers but the Examiner may not
  directly answer questions about grammar, usage,
  mechanics, punctuation, or spelling.
• Biology - Students may use a ruler as a
  straightedge.

33
Step 4 Student Absences and Invalidations (p. 16)

• Examiners should follow the districts policy
  about how to handle student absences during the
  test. Absences were addressed in the section on
  the Test Coordinators Manual earlier in the
  presentation.
• The STC and the Examiner must agree that a
  particular students test should be invalidated,
  based on the invalidation criteria given on page
  17. It is the STCs responsibility to fill in
  the bubble for the appropriate invalidation code
  on the SIS.

34
Step 5 Review the Completed SIS (p. 18)

• Your district may assign the following
  responsibilities to the STC or DTC. If not,
  these are the Examiners responsibilities with
  respect to the SIS
• Accommodations Fill in the circle(s) that best
  represent the accommodation(s) under that
  heading. Refer to the note on page 18 about
  accommodation codes.
• Test Window Fill in the single bubble that
  refers to the administration period.
• Form Only those testing in the SPRING will fill
  in a form number. If the form number is a single
  digit, the number should be precede by a zero
  (ex. 02).
• Status Codes Fill in the appropriate codes when
  necessary. Consult the STC for guidance.

35
Step 6 Collect Testing Materials (p. 21)

• Session I, Test Books
• Collect the Session I test books from the
  students
• Count the test books and verify the total with
  the pretest number before returning to the STC.
• Return all Session I test books to the STC in
  separate bundles by content area used and
  unused.
• Contact the STC for guidance regarding the
  handling of contaminated test books.

36
Step 6, Continued

• Session I, Answer Sheets
• Collect Session I completed (scorable) answer
  sheets from the students.
• Verify that the student barcode label is attached
  appropriately.
• Verify that the required information is correct
  on the SIS, when applicable.
• Return completed answer sheets by content area to
  the STC.
• Return any unused answer sheets to the STC to be
  destroyed.
• Collect all graph paper, scratch paper, or draft
  paper and return them to the STC to be securely
  destroyed.
• Collect the Algebra I reference sheet to have for
  distribution in Session II (if applicable).
• Contact the STC for guidance regarding the
  handling of contaminated answer sheets.

37
Step 6, Continued

• Session II, Test Books
• Collect all scorable Session II test books from
  the students
• Verify that the student barcode label is attached
  appropriately.
• Verify that the required information is correct
  on the SIS, when applicable.
• Collect all Algebra I Reference Sheets and return
  them to the STC for shredding.
• Collect all graph paper, scratch paper, or draft
  paper and return them to the STC to be securely
  destroyed.
• Return all completed (scorable) Session II test
  books to the STC separated by content area.
• Return any unused Session II test books to the
  STC separately.
• Count all Session II test books and verify the
  total with the pretest number before returning to
  the STC.
• Contact the STC for guidance regarding the
  handling of contaminated test books.
• Return the Test Examiners Manual to the STC for
  shredding.

38
Step 7 Complete the Group ID Sheet (p. 23)

• At a minimum, two Group ID Sheets (GIS) per
  content area, per school, must be completed. For
  more information, refer to the GIS slide in the
  Test Coordinators portion of this presentation.
• The DTC will assign responsibility to the STC or
  Examiner for completing the GIS.

39
Accommodations (p. 25-27)

• Appendix B (page 25) lists the accommodations for
  students who are English Language Learners (ELL).
  Take special note of those which result in
  invalidation and of the note at the bottom of the
  chart.
• Appendix B (pages 26-27) lists the accommodations
  for students with disabilities. Again, take
  special note of those which result in
  invalidation and of the three notes at the bottom
  of the chart on page 27.

40
One last thingEOC Field TestApril 27-May 15

• One Field Test Coordinators Manual (FTCM)
• One Field Test Administration Manual (FTAM) to
  be used with standalone English II
• Three Field Test Examiners Manuals
• An informational PowerPoint is available on our
  website at www.map.missouristate.edu

41
Thank You!

• If you have any further questions, please call
  the MAP office at 1-800-899-8146.
• For all accountability questions, call
  DESE Accountability Section at
  573-526-4886