Fall 2005 Division Directors of Testing Regional Assessment Workshops

1

• Fall 2005 Division Directors of Testing Regional
  Assessment Workshops
• Virginia Standards of Learning Assessment
  Program Update

2
Todays Topics

• Fall 2005 Writing Administration
• New for Fall 2005
• Manuals
• Student Demographics
• New End-of-Course Tests
• Miscellaneous
• Important Reminders for Fall 2005

3
Fall 2005 Writing Administration
4
Fall 2005 Writing Administration

• Schedule
• Multiple-Choice administered on 10/17 or 10/18
• Writing Prompt administered on 10/19
• Answer Documents shipped by 10/28
• Pass/Fail reports available around winter break
• Appeals due by 2/20/06

5
Fall 2005 Writing Administration

• Materials Delivery
• Non-secure and secure materials delivered from
  9/26 to 10/7
• EOC secure materials will include equal
  quantities of main forms/prompts and alternate
  forms/prompts. May be used for second
  opportunity testing for Term Graduates.

6
Fall 2005 Writing Administration

• Second Opportunity Writing Tests
• Available for Term Graduates who have not passed
  the End-of-Course English Writing test.
• Students scheduled to graduate by August 31,
  2006, are considered Term Graduates for writing.
• Answer documents for each of the two attempts for
  Term Graduates must be bundled separately.
• Both bundles may be packed in the same box for
  shipping.

7
Fall 2005 Writing Administration

• Writing Equating Equating Divisions
• Certain divisions have volunteered to serve as
  equating divisions for Fall 2005 Writing.
• For equating divisions
• Administer multiple-choice component on October
  17 or 18 (same as other divisions).
• Administer writing prompt on Thursday, October
  20th (1 day later than others).
• Main prompt for equating divisions will be the
  prompt used as the alternate by most other
  divisions.

8
Fall 2005 Writing Administration

• Writing Test Appeals
• Automatic appeals for term graduates will
  continue.
• Appeals process for other students remains the
  same. Two staff members review according to
  rubric and determine if the potential exists for
  receiving a higher score. If in agreement,
  submit for rescoring.

9
New for Fall 2005Manuals
10
New for Fall 2005

• Test Implementation Manual
• Previous DDOT and STC manuals have been combined
  into a single Test Implementation Manual for the
  Fall 2005 Writing Administration
• Test Implementation Manual includes
• Documentation of DDOT and STC responsibilities
• Guidelines for implementing SOL Assessments
  before, during, and after student testing.

11
New for Fall 2005

• Test Implementation Manual
• The Fall 2005 Non-Writing Test Implementation
  Manual will integrate DDOT and STC information
  for online testing.
• A separate document, Web-based Test Directions,
  will continue to be used for Examiners
  administering online tests this fall.

12
New for Fall 2005

• Resource Manual
• An assessment resource manual is now available on
  the Department of Educations Website at
  http//www.doe.virginia.gov/VDOE/Assessment/home.s
  html
• Resource Manual includes reference information
  for use before, during, and after student
  testing.

13
New for Fall 2005Student Demographics
14
New for Fall 2005

• Student Demographic Changes
• Various changes have occurred in the student
  demographic data to be collected during testing.
• For paper/pencil testing, changes are reflected
  in sections on the answer documents.
• For online testing, changes are reflected in
  Student Data Management (SDM) or Test Session
  Management (TSM).

15
New for Fall 2005

• Student Demographic Changes
• Test Date
• Section A2 (paper/pencil) - Students enter the
  date of testing for non-writing SOL tests
  administered.
• TSM (online) Date of testing is automatically
  recorded upon student login for online SOL tests.

16
New for Fall 2005

• Student Demographic Changes
• State Testing Identifier (STI)
• Unique 10-digit number assigned to each student
  by the Education Information Management System
  (EIMS)
• Required for any student taking a Virginia
  assessment (SOL, VAAP, VGLA, VSEP, SELP)
• Once assigned, the STI remains the same
  regardless of where the student attends school
• Obtained through the local divisions EIMS
  Project Manager within 24 48 hours of request

17
New for Fall 2005

• Student Demographic Changes
• STI (for paper/pencil testing)
• Pre-ID STI is required within the pre-ID file.
  (Pre-ID files currently will be processed with
  blank STI fields.)
• If the pre-ID file must be submitted without an
  STI, a) leave the STI field blank in the
  file, and b) eventually hand-code the STI
  field on the answer doc.
• Divisions are strongly encouraged NOT to submit
  pre-ID files with blank STI fields.

18
New for Fall 2005

• Student Demographic Changes
• STI (for paper/pencil testing)
• Section G2 Must be completed if pre-ID label is
  not used or if STI is blank on the pre-ID label.
• If the student must test prior to having an STI,
  a) leave Section G2 blank, and b)
  complete Section G2 prior to shipping
  answer docs.
• STI must exist in pre-ID file OR hand-coded on
  the answer doc. An alert will result if not
  included. Alerts will delay scoring processes.

19
New for Fall 2005

• Student Demographic Changes
• STI (for online testing)
• Student Data Upload STI is required within the
  Student Data Upload (SDU) file. An SDU file
  without a value in the STI field will be
  rejected.
• If the SDU file must be submitted without an STI,
  a) enter a single zero in the STI field,
  and b) eventually hand-code the STI field on
  the students SDM screen.
• A 0 in the STI field will cause an alert in the
  online alert report. Update the STI on the
  students SDM screen to resolve the alert.

20
New for Fall 2005

• Student Demographic Changes
• STI (for online testing)
• SDM If hand-entering a student in SDM, the STI
  field must be completed to proceed.
• If the student must test prior to having an STI,
  a) enter a single zero in the STI field,
  and b) eventually return to update the STI
  field on the students SDM screen.
• A 0 in the STI field will cause an alert in the
  online alert report. Update the STI on the
  students SDM screen to resolve the alert.

21
New for Fall 2005

• Student Demographic Changes
• Limited English Proficient (LEP) Status
• Section S, Status Code ONE value to identify the
  students LEP Status as of October 1st of the
  current school year.

1 Receiving Services2 Monitor Status 1st
Year3 Monitor Status 2nd Year 4 NOT
Receiving Services 5 Post-Monitor Status 1st
Year 6 Post-Monitor Status 2nd Year
22
New for Fall 2005

• Student Demographic Changes
• LEP Proficiency Level
• Section S, Proficiency Level (paper/pencil)

If LEP Status 1 OR 4 , then a
Proficiency
Level also must be
coded.
1 Proficiency Level 1 2 Proficiency Level 2 3
Proficiency Level 3 4 Proficiency Level 4
23
New for Fall 2005

• Student Demographic Changes
• LEP Status
• SDM (online) Choose a value in the LEP Status
  drop-down to identify the students LEP Status as
  of October 1st of the current school year.
• Select No and is the default.

24
New for Fall 2005

• Student Demographic Changes
• LEP Proficiency Level
• SDM (online) If LEP Status 1 OR 4, an LEP
  Proficiency Level must be selected in the
  drop-down menu.
• Select No and is the default.

LEP Proficiency
Select 1 Proficiency Level 1 2 Proficiency
Level 2 3 Proficiency Level 3 4 Proficiency
Level 4
25
New for Fall 2005

• Student Demographic Changes
• SOA Adjustment LEP (Section T)

AND the student has been enrolled in VA schools
less than 11 semesters,
Then select LEP
If LEP Status 1,2, 3, or 4
26
New for Fall 2005

• Student Demographic Changes
• SOA Adjustment - LEP
• SDM (online)

Then select Yes
If LEP Status 1, 2, 3, or 4
SOA Adj-LEP
Select Yes
27
New for Fall 2005

• Student Demographic Changes
• Special Test Accommodations
• SECTION AA (paper/pencil) Code B available to
  identify a non-standard accommodation not listed
  in the Special Test Accommodation Codes but
  provided based on students IEP or 504 Management
  Plan. An example is word prediction/selection
  software.
• See Examiners Manuals or the 2005 - 2006 SOL
  Assessment Resource Manual.

28
New for Fall 2005

• Student Demographic Changes
• Special Test Accommodations
• TSM (online) Code B available to identify a
  non-standard accommodation not listed in the
  Special Test Accommodation Codes but provided
  based on students IEP or 504 Management Plan.
  (Not likely to used with online testing at this
  time.)
• See Examiners Manuals or the 2005 - 2006 SOL
  Assessment Resource Manual.

29
New for Fall 2005

• Student Demographic Changes
• RP Code
• Section B (paper/pencil) - RP Code is to be
  completed for any student in grades 8-12
  enrolled in a class or course with an SOL test
  and who is in a Regional Alternative Education
  Program during the 2005-2006 school year.
• List of regional alternative programs is in the
  SOL Assessment Resource Manual.

30
New for Fall 2005

• Student Demographic Changes
• RP Code
• SDM (online) RP Code is to be completed for
  any student in grades 8-12 enrolled in a class or
  course with an SOL test and who is in a Regional
  Alternative Education Program during the
  2005-2006 school year.
• List of regional alternative programs is in the
  SOL Assessment Resource Manual.

RP Code
Select Yes
31
New for Fall 2005New End-of-Course Tests
32
New for Fall 2005

• New Algebra II Test
• Beginning in Fall 2005, the EOC Algebra II test
  is being developed based on a revised blueprint.
• Students who are completing an Algebra II course
  in Fall 2005 shall take this new test called
  Algebra II (2001 Revised).
• Students who have previously passed the
  coursework for Algebra II but failed the SOL test
  should continue to be administered the previous
  Algebra II test called Algebra II (2001).

33
New for Fall 2005

• New Algebra II Test
• Paper/pencil New and old Algebra II tests will
  be packaged separately under cover sheets with
  identifying watermarks.
• Paper/pencil New Algebra II test booklets will
  indicate Algebra II 2001 Standards (Revised) on
  the booklet cover.
• Online Algebra II tests will be listed in the
  TSM menu as
• Algebra II (2001)
• Algebra II (2001 Revised)

34
New for Fall 2005

• New Algebra II Test Booklet Cover

35
New for Fall 2005

• New EOC English Reading Test
• Beginning in Fall 2005, the EOC English Reading
  test is being developed based on a revised
  blueprint.
• Students who are completing coursework in Fall
  2005 for the grades 9 -11 English SOL shall take
  the new test called English Reading (2002).
• Students who have previously passed the
  coursework for the grades 9 -11 English SOL but
  failed the SOL test should continue to be
  administered the previous English Reading test
  called English Reading (1995).

36
New for Fall 2005

• New EOC English Reading Test
• Paper/pencil New and old EOC English Reading
  tests will be packaged separately under cover
  sheets with identifying watermarks.
• Paper/pencil New EOC English Reading test
  booklets will indicate English Reading 2002 on
  the test booklet cover.
• Online The EOC English Reading tests will be
  listed in the TSM menu as
• English Reading (1995)
• English Reading (2002)

37
New for Fall 2005

• New EOC English Reading Test
• The new English Reading (2002) tests will have
  only one sample item.
• The previous English Reading (1995) tests have
  two sample items.
• The Examiners manual will address the number of
  sample items for each test.
• Scratch paper is allowed for all English Reading
  tests.

38
New for Fall 2005

• New English Reading Test Booklet Cover

39
New for Fall 2005

• New Algebra II and English Reading Tests
• The same answer document will be used for the old
  and new Algebra II tests
• The same answer document will be used for the old
  and new EOC English Reading tests.
• Two forms will be available for Fall 2005 (Main
  and Alternate or Main and Expedited Retake)
• No previously equated forms of these two subjects
  will be available for the Fall 2005
  Administration.

40
New for Fall 2005Miscellaneous
41
New for Fall 2005

• New Test Security Guidelines
• Ensure all individuals involved in testing
  (paper/pencil OR online) read, understand, and
  sign the new Test Security Guidelines.
• A statement is included that the person signing
  understands if the test security procedures are
  not followed his or her license may be suspended
  or revoked.
• A copy is available in your packet and will
  continue to be available in the manuals.

42
New for Fall 2005

• Requests to Make Late Shipments
• DDOTs must request permission from the DOE to
  ship answer documents after their main shipment
  has been sent.
• DDOT must provide assurance that answer documents
  have been kept in a secure location.
• Please restrict such requests -- costs of late
  shipments are high.

43
New for Fall 2005

• New Record Layout
• Beginning with Fall 2005 assessment data, a
  single record layout will be used for all SOL
  Non-Writing Tests.
• Single record layout is based on the 600
  character EOC record layout and will be used for
  EOC, Grades 3 through 8 Multiple-choice, and
  Content Specific History tests.
• Please share this information with appropriate
  school division staff.

44
New for Fall 2005

• Online Manipulatives
• For science and mathematics tests where
  blueprints allow the use of a ruler, the online
  straight-edge tool will now be available to
  students in TestNav.
• All science and mathematics ePAT applications
  have been republished to include the
  straight-edge tool.

45
New for Fall 2005

• Online Manipulatives
• No manipulatives should be used by students
  during an online test that involve touching,
  writing on, and/or tracing on the computer
  monitor. Examples of such manipulatives that are
  not allowed include patty paper, tracing paper,
  transparencies, dry erase or overhead markers.

46
Fall 2005 Important Reminders
47
Fall 2005 Important Reminders

• Term Graduates (Non-Writing)
• Term Graduates for the Fall 2005 Non-Writing Test
  Administrations are defined as those students
  attempting to earn verified credits to graduate
  at the end of the Fall semester.

48
Fall 2005 Important Reminders

• A-CODE (Grade 8 Only)
• Section N -- Complete Section N for those
  students who are participating in the Virginia
  Alternate Assessment Program (VAAP).
• If your divisions regular education students
  will be testing in both the fall and spring
  administrations, mark the A-code ONLY ONCE for
  each VAAP student, especially for reading and
  mathematics.
• Used to calculate participation rate for AYP.

49
Fall 2005 Important Reminders

• Additional Test Codes Retest
• Select Retest for students who have passed the
  class and who are retaking the SOL test for
  verified credit or to meet the requirements of
  the modified standard diploma.
• Paper/pencil testing Section Y
• Online testing Test Session Management (TSM)

50
Fall 2005 Important Reminders

• Paper/pencil testing
• Ensure answer documents indicate 2005-2006 in
  upper left corner.
• The formula sheets for mathematics tests (Grade
  8, Algebra I, Geometry, and Algebra II) and the
  periodic table for the Chemistry test are located
  inside the front cover of the SOL test booklets.
• Examiners Manual tells students when to remove
  these documents.

51
Fall 2005 Important Reminders

• 8888 Headers
• Used for students who are placed outside of your
  division and are not on the rolls of a particular
  school.
• Answer documents submitted under 8888 headers
  are included in division summary but not in
  school summary data.
• Contact Harcourt Coordinator to order.

52
Fall 2005 Important Reminders

• All online testing data for 2004 2005 will be
  purged beginning October 14th. The following
  dates are critical to maintaining your divisions
  data
• October 12th All online data must be finalized
  for ATP.
• October 12th All online student data alerts
  must be resolved.
• October 12th Overnight requests for online
  reports and student data files must be submitted
  in the eMeasurement System.
• October 13th All online SOL reports must be
  retrieved and printed or archived.
• October 14th Online data purge begins.

53
Fall 2005 Important Reminders

• Online tests available in Fall 2005 include
• All EOC SOL Tests (except Writing)
• Includes new Algebra II and English Reading
  tests
• All Content Specific History Tests
• Grade 8 Science Test
• If administering Grade 8 Science online,
  paper/pencil answer doc for Grade 8 Science must
  be coded as DNA 8.

54
Fall 2005 Important Reminders

• Multiple forms (Main, Alternate, Expedited
  Retake) will be available for all EOC subjects
  except for the following
• VA US History (1995), World History I (1995),
  World History II (1995)
• Two forms No audio forms available
• World Geography (1995)
• One form No audio form available
• Algebra II (2001 Revised) and English Reading
  (2002)
• Two forms Audio and Read-Aloud forms will be
  available

55
Fall 2005 Important Reminders

• TestNav software must be updated to version 4.15.
  Update will be available for download beginning
  October 3rd.
• Mac OS X v10.4 (Tiger) will be supported by this
  version of TestNav.
• Enhanced Early Warning System may be selected
  during the TestNav update process.
• Early Warning System Reference Manual available
  on Resources Page
• To be addressed in Fall 2005 training sessions

56
Fall 2005 Important Reminders

• Verify division-level and school-level network
  hardware and software configurations. Changes
  may have occurred during summer maintenance,
  upgrades, or replacements.
• Firewalls
• Proxy servers and Internet content filters
• Network and/or local workstation virus protection
• Load balancers and bandwidth management devices
• Other network devices or software Refer
  to Infrastructure Guidelines and/or Pearson
  Help Desk for additional information.

57
Fall 2005 Important Reminders

• Online Training Center will be purged of all data
  and unavailable from October 7th to October
  12th.
• Beginning October 12th, the Training Center will
  be available again with standard training logins.
• Login ID is trainNNN (where NNN division code)
• Password is training (all lowercase)
• EOC Training Test, Middle School Training Test,
  ePATs and MSATT are available to prepare
  students for fall online testing.

58
Fall 2005 Important Reminders

• To Contact the Division of Assessment Reporting
• Telephone
• [phone]
• Email
• Paper/pencil general issues darfax_at_doe.virginia.
  gov
• Online testing issuesesol_at_doe.virginia.gov

59
Fall 2005 Important Reminders

• Remediation Recovery
• Proposed revision to remediation recovery
  guidelines accepted on first review at 9/21/05
  Board meeting. See handout.
• Final review in October to allow school divisions
  to review and comment
• Revisions applicable to 2005-2006 testing year
  only.

60
Fall 2005 Important Reminders

• Remediation Recovery Proposed Revisions
• Avoids double testing for students who failed 3rd
  or 5th grade reading and mathematics tests and
  participated in remediation recovery program
• Counts passing 4th or 6th grade reading and/or
  math score twice in pass rate - once as part of
  4th or 6th grade pass rate and again under
  recovery

61
Fall 2005 Important Reminders

• Remediation Recovery Proposed Revisions
• Students who failed grade 8 reading or
  mathematics tests or EOC math test still retake
  failed test.
• Passing scores counted in accreditation pass
  rate.
• Scores of students who pass under remediation
  recovery counted in both numerator and
  denominator.

62
Fall 2005 Important Reminders

• Testing Accelerated Students
• Informational Superintendents Memo 159, August
  12, 2005.
• Students who are being instructed in higher level
  content should be tested on higher level SOL test
  (e.g., grade 4 student being instructed in grade
  5 math SOL would take grade 5 math test).

63
Fall 2005 Important Reminders

• Testing Accelerated Students
• May school divisions choose whether to administer
  the grade level test or accelerated content test?
• Under current SOA, school divisions have
  authority to determine appropriate test for
  students (must be grade level or above).

64
Fall 2005 Important Reminders

• Testing Accelerated Students
• May students be tested on both grade level test
  and accelerated test?
• Under the current SOA, the Department can
  recommend but not require that only one test be
  given. Should be aware that the expectation is
  students will have only one score in AYP and
  accreditation.

65
Fall 2005 Important Reminders

• Revisions to the SOA
• Proposed Revisions may be found on DOE website
  at http//www.pen.k12.va.us/VDOE/Accountability/p
  roposed-SOA-regs.pdf
• Public Comment period begins soon
• Issues addressed
• Testing accelerated students
• Foreign exchange students
• Others

66
Fall 2005 Important Reminders

• Contract Status
• RFP for test development, administration,
  scoring, and reporting services for all statewide
  testing programs (paper and online SOL tests,
  alternate assessment programs) released on May
  13, 2005.
• Intent to award contract to Pearson Educational
  Measurement posted on September 16, 2005.

67
Fall 2005 Important Reminders

• Transition Year
• 2005-2006 will be transition year with current
  vendors providing test administration, scoring,
  and reporting services. New contract will cover
  test development. New vendor focus on
  preparation to begin test administration in
  2006-2007.

68
Questions?