Regional Training Sessions

1

• Regional Training Sessions
• Spring 2009 Administration

2
Agenda

• OSBE Update
• Overview
• NEW for Spring 2009
• System Requirements
• Roles and Responsibilities
• Prepare for Testing
• Accommodated Versions Audio Online
• Accommodated Materials
• Idaho Alternate Assessment
• Test Security
• Test Administration
• Post Test
• Important Dates
• Future Testing Windows
• ISAT Contact Information
• Questions

3
OSBE Update

• Assessment and IELA scheduled to move to the SDE
  on July 1, 2009
• Unique Student Identifiers
• Longitudinal Data System
• Revised Racial and Ethnic Coding- 2010
• Fall registration issue for your schools
• Thank you for continually improving test
  administration and data quality.
• We need your help with Not Tested codes

4
Overview

• Spring 2009 Administration
• April 13th May 8th, 2009
• Makeups allowed May 11th 15th, 2009
• Reading, Language Usage, and Mathematics at
  grades 3 8, 10, and Retest
• Science at grades 5, 7, and 10
• NCLB (Part 1) All tests have 50 60 multiple
  choice questions
• Extender (Part 2) Based on students NCLB
  score, student will receive up to 15 additional
  questions
• No time limit plan for 90 minutes to complete
  both parts of the test
• Practice Tests and Tutorials are currently
  available.

5
NEW for Spring 2009

• 10th Graders who passed in the Fall
• Students in grade 10 who passed Reading, Language
  Usage, and/or Mathematics in Fall 2008 do not
  need to take those subjects in Spring 2009.
• ALL grade 10 students must take the Science test
  in Spring 2009.
• Students in grade 10 will take both the NCLB and
  the Extender parts.
• Audio Online Updates
• Audio Available for Language Usage
• No human readers are allowed.
• Stop/Start Feature
• Audio Available for Extender
• Students taking audio online will have two parts
  (NCLB and Extender).
• Districts are required to administer the Extender
  to all students.

6
NEW for Spring 2009 (cont.)

• Audio CDs
• Provided in addition to Paper, Large Print, and
  Braille materials for those students who require
  a read aloud administration in addition to
  accommodated materials
• Available for Mathematics, Language Usage, and
  Science
• No human readers are allowed.
• Extender for Accommodated Versions
• Districts are required to administer the Extender
  to all students
• Same accommodated version as NCLB materials
  however all Braille Extender materials are
  contracted
• Updated Coding
• New codes have been added to the Student Editor
  and Student Enrollment File (SEF) to account for
  additional accommodations options.

7
NEW for Spring 2009 (cont.)

• Student Enrollment File (SEF) Downloads
• District level only
• Available 4 pm to 9 pm Mountain time
• SEF Upload Changes
• Errors no longer generated for blank rows
• Excel 2007 (.xlsx) files accepted
• SEF/Student Editor Field Updates
• Accommodation 1 Field (Language Usage, Math,
  Science)
• Coding for students who use paper, LP, or Braille
  with Audio CDs
• Accommodation 3 Field (All subjects)
• Word-for-word dictionary for Limited English
  Proficient (LEP) students with an English
  Learning Plan (ELP) only
• State ID field 9 digits, numeric only (not
  required)

8
NEW for Spring 2009 (cont.)

• 4 Levels of Management Tools Access
• Test Administrator Level
• One username/password per school for each grade
  and subject
• Access limited to Monitor Status, Student Status
  Spreadsheets, View Results
• Student Immediate Score Screen
• Default is ON
• Turn immediate scores off
• District/School decision
• District/School level access
• Settings link in Management Tools
• Audit Spreadsheet Updates
• Immediate scores on spreadsheet (View results
  file still available.)
• District/school/teacher level access
• Alternate Assessment column added

9
NEW for Spring 2009 (cont.)

• Monitor Status Updates
• Reactivation
• Teachers no longer have access to reactivation
• District/School level access only
• New and colorful icons
• Audio column added to Student Status Spreadsheet
• Class Rosters
• Finding students in a roster
• Ability to search by Local or State ID

10
System Requirements
11
Roles and Responsibilities Technology
Coordinator

• Configure student computers to support testing
• Update all student computers with new release of
  testing engine (CAL 5.6/LCS 4.6)
• Release date March 23rd, 2009
• Automatic update when students log in after March
  23rd (depending on administrator setups see
  handout)
• LCS users will have to uninstall and install new
  release
• LCS is an option, not required
• Audio Configurations
• Decide which computers will be used for testing
  these students
• Configure computers for Audio (see handout)
• Computers configured for Audio CAN be used for
  all students (not just students needing Audio)
• The Cepstral David voice and the CAL testing
  engine need to be downloaded locally to the
  computer(s) that will be used for audio.

12
Roles and Responsibilities District/School Test
Coordinator

• Update district and school contacts
• Update the information in Management
  Tools/Administrative Tools/Update Contact info
• District Test Coordinator and Technology
  Coordinator will receive email notifications of
  the status of SEF processing
• Email these updates to the ISAT Project Team

13
Roles and Responsibilities DTC/STC (cont.)

• Manage all usernames and passwords within the
  testing system
• DTC/STC decision on levels of access in schools
• New for Spring Test Administrator Account
• One username/password per school for each grade
  and subject
• Can Monitor Status
• Can View Student Status Spreadsheet
• Can View Results
• Cant Reactivate
• Cant Print Tickets
• Cant Access Class Rosters

14
Roles and Responsibilities DTC/STC (cont.)

• Verify and edit all student data
• Management Tools available March 9th
• Student information from Fall 2008 currently
  exists in the Student Editor with the exception
  of accommodation and not tested codes (including
  Audio codes).
• Districts may choose to upload new Student
  Enrollment File (SEF).
• Reminder Uploading a new SEF will update current
  student data and add new students. Removing
  students from the SEF and uploading the new SEF
  will not remove/delete a student.
• Districts may choose to edit existing data
  through Student Editor.
• Districts can exit students by submitting an
  updated SEF or can exit students manually (by
  subject) in Student Editor.

15
Roles and Responsibilities DTC/STC (cont.)

• Tickets will be available beginning March 30th
• Print Test Session Tickets
• Tickets for new students immediate availability
• Students coded Exited, Alt. Assessment, or with
  Accommodated Materials tickets will not print
• Students using Audio Online will have an audio
  indicator on the Test Session Tickets
• Tickets are used for one subject only. Students
  taking multiple subjects will need multiple Test
  Session Tickets.
• Monitor all testing ensure test security

16
Roles and Responsibilities Teacher/Proctor

• Administer Student Tutorials and Practice Tests
  prior to testing
• Print student Test Session Tickets for only their
  students (with DTC/STC approval)
• Ensure students have correct Test Session Tickets
  for each test
• Students using Audio Online MUST have an Audio
  ticket before logging into the test
• Communicate a sense of responsibility and test
  security to students

17
Roles and Responsibilities Teacher/Proctor
(cont.)

• Monitor all students during testing
• Identify any testing irregularities and report to
  STC
• Use Audit Spreadsheet to verify all students have
  tested
• Updated nightly and provides status of all
  students
• View immediate scores
• View Results (PDF and Excel)
• Audit Spreadsheet

18
Prepare for Testing

• Coordinator/Administrator Tutorial
• Provides information to all administrators who
  are involved with ISAT
• Test Administration Manual
• Spring 2009 TAM posted March 9th on the ISAT
  Website
• Provides information for test preparation and
  teacher directions for testing day
• Should be reviewed prior to testing to ensure a
  better understanding of processes
• Should be reviewed by all administration involved
  in ISAT testing

19
Prepare for Testing (cont.)

• Parent Brochures
• English and Spanish versions (PDF) will be posted
  on OSBE Website March 30th
• New for Spring Printed versions (English only)
  to be delivered to districts after testing on or
  before June 12th
• Districts are required to distribute brochures to
  all parents in grades 3 8, 10
• Delivery date and method of delivery are district
  decisions

20
Prepare for Testing (cont.)

• Student Tutorials and Practice Tests
• Grades 3 8 and 10 are currently available.
• Audio is currently available.
• Students with an audio accommodation should
  practice listening to the Cepstral David voice by
  using the Practice Tests.
• Practice with testing tools.
• Teachers/Proctors should discuss test procedures
  with students.
• Test Session Tickets - test security
• NCLB (Part 1) allows students to move/skip
  questions.
• Extender (Part 2) requires student to answer a
  question before moving to next question.

21
Prepare for Testing (cont.)

• Student Tutorials and Practice Tests
  Teachers/Proctors should discuss test procedures
  with students
• Students should review final Review Page to
  confirm all answers are complete
• Review page Green checkmarks
• indicate question answered -
• NOT a correct answer
• Shaded gray questions
• those questions students
• may not review
• (math only)

22
Prepare for Testing (cont.)

• ISAT Management Tools
• ISAT Management Tools User Level Access (see
  handout)
• New students can be added at any time ticket
  will be available immediately.
• No updating is necessary for 9th, 10th, 11th, or
  12th graders (do not mark as exited, not tested,
  etc.)
• 10th graders who tested in Fall 2008 and are
  NOT retesting Reading, Language Usage, or
  Mathematics
• Edits are allowed through the end of the testing
  window (May 15th).
• No Student Enrollment Files will be processed
  after 12 pm Mountain time on May 15th.
• Once students begin testing, the grade and/or
  audio code cannot be changed through SEF upload
  or Student Editor.

23
Prepare for Testing (cont.)

• Student Test Session Tickets
• Teachers/Proctors may print tickets for their
  students only
• A Test Session Ticket is required for each part
  of a test
• Part 1 NCLB
• Part 2 Extender
• Students taking multiple subjects will need
  multiple Test Session Tickets
• Test Session Tickets are live, secure materials
  and must be distributed and collected as such

24
Prepare for Testing (cont.)

• Student Test Session Tickets
• Students can move to Part 2 without using second
  ticket
• The last page of Part 1 has option of continuing
  into Part 2. If student clicks Continue, the
  test will move into Part 2 (Extender) and the
  student will not need the second ticket.
• If student clicks Exit the Part will close and
  the student will need the Part 2 Ticket to log
  into the Extender.
• Administrators must plan!
• DRC/OSBE recommendation Print both Part 1 and 2
  tickets. Administrators should distribute ONLY
  Part 1 tickets to students, holding Part 2 until
  (if) needed. (Assuming students will attempt to
  complete NCLB and Extender sections at one time.)

25
Prepare for Testing (cont.)

• Student Test Session Tickets
• Tickets can be imported and printed on labels,
  card stock, etc.
• Tickets will be available to print beginning
  March 30th.

26
Accommodated Version Audio Online

• Audio Online
• Available for Mathematics, Language Usage, and
  Science
• No human readers are allowed.
• Reading no audio online, no human readers
  allowed
• Reminder Technology Coordinators, preparing
  computers to use the Audio Online accommodation
  will require additional setup prior to testing
  (see handout).
• New for Spring Speak function will have
  start/stop function within test question.
• New for Spring Extender available for Audio
  Online.
• Districts are required to administer the Extender
  set to all students.

27
Accommodated Materials

• Accommodated paper materials are available for
  those students whose IEP requires an assessment
  that is not presented on a computer
• Large Print, Braille, and Paper versions are
  available
• Braille levels 17 levels for Reading and
  Language Usage Nemeth (Contracted) for
  Mathematics and Science
• New for Spring Audio CDs
• Available for Mathematics, Language Usage, and
  Science
• Provided in addition to Paper, Large Print, and
  Braille materials for those students who require
  a read aloud administration in addition to
  accommodated materials
• Extender
• New for Spring Districts are required to
  administer the Extender set to all students
• Same accommodated version as NCLB materials
  however, all Braille Extender materials are
  Contracted
• NCLB materials must be returned on April 24th in
  order to receive targeted Extender materials
• If NCLB materials are not returned on April 24th,
  student will receive on-grade Extender materials

28
Accommodated Materials (cont.)

• Ordering Materials Deadline was February 20th
• If you need materials for new students after
  February 20th, follow the steps below.
• Note Only Contracted Braille (no levels) will
  be available to order after February 20th
• Step 1 Email ALL of the following information
  to the ISAT Project Team (ISAT_at_datarecognitioncorp
  .com) ASAP
• District Number
• School Number
• Student Name
• Student ID
• Student Grade
• Subject(s)
• Type of Material Needed (Paper, Large Print,
  Braille, Audio CD)
• Audio CDs can be ordered in addition to any other
  type of material Paper, Large Print, or Braille

29
Accommodated Materials (cont.)

• Step 2 Identify the accommodated materials
  needed for each student in the Student Editor.
• Students using accommodated materials must be
  manually entered or uploaded into Student Editor
  no later than March 30th.
• The accommodation codes MUST be entered into the
  Student Editor by April 24th for those materials
  returned on April 24th.
• The accommodation codes must be entered into the
  Student Editor by May 15th for those materials
  returned after April 24th.
• If you order for new students before April 10th,
  you will receive NCLB materials only in your
  initial shipment, and will receive Extender
  materials on May 6th.
• If you order for new students after April 10th,
  you will receive NCLB and on-grade Extender
  materials in one shipment.
• No orders will be accepted after May 8th.

30
Accommodated Materials (cont.)

• Accommodation codes from Fall 2008 have been
  removed from the Student Editor.
• Be sure to code students accordingly for Spring
  2009!
• Precode labels containing student name and
  demographic information will be shipped with your
  order.  Any changes made to this data in the ISAT
  Student Editor before May 15th will be reflected
  on the score reports and data files.
• Schools are responsible for transcribing student
  responses to answer document if necessary.

31
Accommodated Materials (cont.)

• New for Spring Shipping/Receiving Materials
• Two return shipping deadlines
• April 24th for NCLB materials in order to receive
  targeted Extender materials
• May 15th for all remaining materials
• Material pickups are pre-scheduled on above dates
  no longer need to call DRC to schedule pickups
• Materials must be ready for UPS by 800 AM (local
  time) on pickup days.

32
Idaho Alternate Assessment

• New Tasks for Test Coordinators 2009
• Include all students who will be taking the Idaho
  Alternate Assessment in the March 30th SEF
  upload, verify coding for IAA in Student Editor
  (no tickets)
• Receive shipment of IAA materials
• Work with Special Ed Director to distribute and
  collect materials
• Return materials on the SDE timeline
• http//sdestatic.sde.idaho.gov/alternateassessment
  /
• http//itcnew.idahotc.com/dnn/iaa/Documents/tabid/
  249/Default.aspx

33
Test Security

• Test Security guidelines Test Coordinators
  Guide to State and Federal Assessments
• http//www.boardofed.idaho.gov/saa/documents/TC_Up
  dates/2008/TC_GuidewithISAT_rev-0109.pdf
• All Administrators, Teachers and Proctors must
  complete the Test Security Agreement (found in
  TAM) prior to each administration.
• Completed agreements are to be filed in district
  office for 2 years.

34
Test Security (cont.)

• All Test Session Tickets, Math Reference Sheets,
  periodic tables, and scratch paper are secure
  materials and must be collected after testing is
  completed.
• Pause Test function used for brief
  emergencies (restroom break)
• Inactivity for longer than 15 minutes during
  testing will cause the system to log off the
  test.
• Teachers/Proctors are not allowed to login
  students without students being in the room to
  verify attendance
• If student becomes locked out of the system after
  multiple login attempts
• Close out of the ISAT student application
• Reopen ISAT student application
• Log in using same Test Session Ticket

35
Test Administration

• NCLB Part 1
• Reading/Language Usage/Science - may go back to
  previous questions
• 3rd and 4th grade Mathematics - may go back to
  previous questions
• 5th 8th, 10th grade, Retest Mathematics -
  limitations on returning to questions
• Non-calculator questions are presented first.
• Student must answer these questions before moving
  to calculator questions.
• Student may not return to non-calculator
  questions.
• Reading layout Student may choose to see one
  question, all questions or no questions with the
  passage. The default will be one question with
  passage.

36
Test Administration (cont.)

• Extender Part 2
• Based on students NCLB score, student will
  receive up to 15 additional questions
• Student must answer the question before going to
  the next question.
• Reading/Language Usage/Science - may go back to
  previous questions
• Mathematics - limitations on returning to
  questions
• For the lower performing (3rd or 4th grade
  levels) students, those questions will be the
  calculator questions
• For the higher performing (5th grade and above)
  students, those questions will be the
  non-calculator questions

37
Test Administration (cont.)

• Mathematics - limitations on returning to
  questions
• When the student reaches the end of these
  restricted areas they will see a similar warning
  before they are able to go to the next question
• At this point the student may choose to return to
  the question for further review or move on to the
  next question. Once the student moves on to the
  next question the restricted question is no
  longer available for review. The restricted
  question will be shaded gray in the status bar in
  the top left corner.

38
Test Administration (cont.)

• Monitor Status and Reactivations
• Students can log back in using same Test Session
  Ticket within 90 minutes of initial login.
• Fire Drill, emergency, power outage
• All students must complete a test within one
  school day. Under no circumstances should a test
  be started unless there is enough time to
  complete it.
• Additional time must be given as an extension of
  the same testing period, not at a different time
  (unless required by a students IEP).
• Teachers/Proctors must confirm online audio is
  available for those identified students and
  students have the correct ticket PRIOR to
  testing.
• OSBE will not allow a students test to be reset
  if audio was not made available or if the
  incorrect ticket was used.

39
Test Administration (cont.)

• Monitor Status and Reactivations
• A test may be reactivated during the school day
  with approval from the School Test Coordinator
  (no OSBE approval needed). If a student leaves
  the computer lab/classroom during a test, that
  student must be monitored by an adult until the
  student returns to the lab to continue testing.
• If for any reason a test should be reactivated
  the next day, the DTC must obtain OSBE approval.
  Approval may be obtained ahead of time.
• The School or District Test Coordinator must
  contact the Accountability Office of OSBE prior
  to the reactivation
• Phone [phone]
• Email accountability_at_osbe.idaho.gov
• Form for Reactivation to provide to OSBE when
  submitting request via email
• http//www.boardofed.idaho.gov/saa/documents/Distr
  ict_Reactivation_Form.xls

40
Test Administration (cont.)

• Reactivations

In order to reactivate a student test part, click
on the box next to the monitor screen and click
Reactivate Selected Student(s). After
reactivation, the original Test Session Ticket
will be valid again. Please note Once a student
has completed a test (answered all questions) the
system will not allow that test to be
reactivated. Please make sure the student has had
time to review all questions during the time
scheduled.
41
Post Test

• Student Invalidations
• Possible reasons for invalidations are found in
  the Test Coordinators Guide to State and Federal
  Assessments
• The school principal must determine if test
  should be invalidated
• Invalidations are made in the Student Editor by
  subject

42
Post Test (cont.)

• Student Invalidations
• Coding under Testing in Student Editor

43
Post Test (cont.)

• Not Tested Codes
• Students who are unable to test due to absence,
  medical reasons, parent refusal, student refusal,
  or suspension must be coded in the ISAT system.
• Same location as invalidations
• Not Tested Codes are required for all students
  who are unable to test.

44
Post Test (cont.)

• Data Clean Up
• District Test Coordinators need to be sure that
  ALL data in the system is clean before the end of
  the testing window, May 15th.
• Fill out and fax in the District Test
  Coordinators Checklist to OSBE
• http//www.boardofed.idaho.gov/saa/documents/ISAT-
  DataCleanUpChecklist_rev-1208.pdf
• This final check will eliminate errors that have
  occurred in the past and will ensure correct
  reporting for your districts and schools.

45
Post Test (cont.)

• Immediate scores for students after completion
  of Part 2
• The score reported will be the NCLB score
• Retesters will receive an immediate score after
  completion of Part 1, as the Retest has only one
  part.
• This page can not be printed.
• These scores are to be considered preliminary.
• New for Spring Immediate score screen can be
  turned off by DTC/STC. This is a district and/or
  school decision and must be communicated prior to
  testing.
• Default ON

46
Post Test (cont.)

• Immediate results available
• New for Spring Audit Spreadsheet (Excel format
  only) includes all scores and can be used to
  download scores for all students.
• Note Audit Spreadsheet has a key to the
  reporting categories.
• Available in PDF or MS Excel
• These rosters can be printed.
• These scores are to be considered preliminary.

47
Post Test (cont.)

• Immediate Preliminary Student Report Template
• Preliminary reports available to send home to
  parents
• Template and instructions will be posted on OSBE
  and ISAT websites
• One report for each subject

48
Post Test (cont.)

• Final Score Reports
• Individual Student Reports
• NCLB Report
• NCLB plus Extender Report
• Growth Report (no Fall/Spring growth NA will
  appear on report)
• NCLB requires the NCLB Report to be sent to all
  parents
• NCLB Report may be sent home along with the
  Parent Brochure
• Final Score Reports available - June 12th

49
Important Dates

• March 9th Spring 2009 TAM available
• March 23th Release of new CAL testing engine
  LCS
• March 30th Test Session Tickets available
• March 30th Spring 2009 Parent Brochures
  (English and Spanish) posted to OSBE website
• March 30th Recommended deadline for all student
  data to be uploaded
• April 13th May 8th Spring 2009 testing window
• May 11th May 15th Makeup window
• May 15th Deadline for updating all student data
• No Student Enrollment Files will be processed
  after 12 pm Mountain time on May 15th.
• June 12th Release of final Spring scores/data

50
Future Testing Windows

• Summer Retest Administration
• July 6 July 31, 2009
• Retest only (11th and 12th graders)
• Fall Administration
• September 14 October 23, 2009
• Retest only (11th and 12th graders)
• Winter Retest Administration
• December 7, 2009 January 22, 2010
• Retest only (11th and 12th graders)
• To be determined by OSBE.

51
ISAT Contact Information

• Toll Free 866-572-2050
• Email ISAT_at_datarecognitioncorp.com
• http//isat.caltesting.org/

52
Questions