20052006 Regional Assessment Workshop Lincoln County School District

1
2005-2006 Regional Assessment WorkshopLincoln
CountySchool District
2
Goal
Overview of New State Test Support Structures and
Test Administration

• Participants will
• Become familiar with key responsibilities and
  roles of District/School Test Coordinators.
• Understand changes in state testing processes and
  procedures.
• Understand links to Oregon EdVantage.
• Identify future district/school training needs.

3
New District Support Structure

• ESDs are involved in training and providing
  state assessment support.
• ODE will be providing information to ESDs.
• There will be no support staff dedicated to
  answering questions at ODE as in the past.
• For the questions and training the state has been
  divided into three regions.

4
Support Regions
5
Region 1 Support

• Important numbers to remember
• Susan Halliday, LBL
• 541-812-2600
• Region 1 TESA Help Desk
• 800-970-TESA (8372)
• Vantage Learning Help Desk
• 800-326-8328

6
What will your ESD partner do for you?

• Remind you of the need for consistent statewide
  assessment administration.
• Assist with TESA and paper/pencil test support.
• Provide you additional paper/pencil testing
  materials in emergency situations.
• Provide e-mail updates of current news and needs.
• Provide a link between you and the ODE Office of
  Assessment and Information Services.

7
What will your ESD partner not do for you?

• Take the place of your district or school testing
  coordinator.
• Order your paper/pencil state test materials
  through the ODE site.

8
Administration Manual

• The single Administration Manual for the 2005
  2006 school year will ONLY be found on the web at
  
• http//www.ode.state.or.us/teachlearn/testing/manu
  als/

9
Administration Manual - Appendix

• The Appendix for the Administration Manual for
  the 2005 2006 school year will ONLY be found on
  the web at
• http//www.ode.state.or.us/teachlearn/testing/man
  uals/

10
TESA Users Guide

• TESA Users Guide
• 2005-06
• Getting Started
•  
• http//www.ode.state.or.us/search/
• results/?id164

11
Purposes of State Testing

• Individual student learning.
• Student performance by various groups for student
  learning purposes
• Cohort Data
• Year-to-Year Data
• Student performance by various groups for
  compliance purposes.
• LBL Real Solutions for Education

12
Test Schedule

• Located on ODEs Webpage
• http//www.ode.state.or.us/search/results/?id169
• Highlights include
• Writing window January 9 February 24
• Social Sciences Optional and Web only
• Grade 3 Reading test available in Spanish!
• English Language Proficiency Assessment (ELPA)
  Test Window April 4 June 9

13
Testing Opportunities
14
Planning Testing Times
15
Knowledge and Skills Testing Schedule

• TESA September 27-May 19
• Availability of test based on SSID.
• Paper/Pencil March 13-April 21
• Assessment Collection for bar code schools sent
  at end of the testing window, based on tests
  coded.
• Go To https//district.ode.state.or.us/apps/logi
  n/
• Bar Code Schools select BCSpring2006MC

16
Grade LevelPerformance Standards

• Performance standards for math and reading
  knowledge and skills tests are based on content
  expectations consistent with previous benchmarks.
• Final performance standards were adopted by the
  State Board in October 2005.

17
Grade Level Performance Standards

• Reading and Literature
• 4th Grade 223 (Exceeds) 208 (Meets)
• 6th Grade 233 (Exceeds) 219 (Meets)
• 7th Grade 236 (Exceeds) 226 (Meets)
• Mathematics
• 4th Grade 223 (Exceeds) 208 (Meets)
• 6th Grade 233 (Exceeds) 219 (Meets)
• 7th Grade 236 (Exceeds) 226 (Meets)

18
Writing Testing Schedule

• Grades 4, 7, CIM students
• January 9 - February 24
• Or
• CIM students only
• April 14 - May 5.
• Senior Writing Retests on TESA
• Either October 31 November 18
• (Early Graduating Seniors Only)
• Or April 14 to May 5

19
Approved Grade LevelPerformance Standards

• Writing Composite Scores
• 7th Grade 50 Exceeds 40 Meets
• 4th Grade 40 Exceeds 32 Meets
• A score of three or higher in each of the
• Following traits
• Ideas and Content Sentence Fluency
• Organization Conventions
• Conventions score doubled for 7th grade.

20
Writing Assessment Opportunities

• Students at Grades 9 and 11 may test once during
  one of the two regular windows Grade 10 students
  must test once during one of the two windows
• Grade 9 students should only be tested if they
  are taking CIM-level classes and have produced
  work that shows they are capable of meeting CIM
  standards
• Only early-graduating seniors may participate in
  the October/November window all other seniors
  may re-test during either or both of the two
  later windows.

21
Practice Testing

• ONLY those grade 9 students, receiving
  instruction at the CIM level, and showing CIM
  level proficiency, should test at the CIM level.
• Using the state test as a format for practice
  testing is out of compliance with state policy.

22
Accommodations Overview

• Accommodationa change in how a test is presented
  to or responded to by a student.
• Provides the student equal access and equal
  opportunity to demonstrate proficiency.
• Considered standard administration and have the
  opportunity to meet or exceed the standard.

23
Modification Overview

• A Modification is a substantial change in the
  standard administration of the test.
• Allows the student to engage productively in the
  assessment which includes changes in the
  instructional level, content, and performance
  criteria.
• Under modified conditions scores are not
  considered for determining whether the student
  meets or exceeds the CIM benchmark.
• Scores obtained under modified conditions
• Are included in AYP (does not meet)
• Do NOT count toward meeting performance standards
  for individual students
• Are included in participation counts for AYP and
  Report Card

24
Other Assessments

• Targeted Assessments
• Either TESA or Paper Pencil
• Side-by-Side
• Spanish (Mathematics, Science, Social Sciences)
• Russian (download only)
• Mathematics grades 3, 4, 5, 6, 7, 8, CIM
• Science benchmarks 2, 3, CIM
• Career and Life Role Assessment System (CLRAS)
• Extended Reading, Mathematics, Writing, and
  Science
• Juried Assessments
• Appeals
• English Language Proficiency Assessment

25
Targeted Assessments

• A Targeted Assessment (formerly challenge) is
  from a different level than the grade of
  enrollment and is consistent with the level of
  instruction.
• A student may target a lower grade level ONLY if
  doing so is described in the students IEP.
• If approved by the USDOE for 2005 2006, 2 of
  all assessments used to determine a districts
  AYP may include these tests.

26
Side by - Side

• The side-by-side assessments have the same items
  presented in both Spanish and English or in both
  Russian and English.
• Students benefiting from seeing the items in
  both languages can meet standards for both the
  CIM and for AYP. These are standard
  administration tests.

27
Extended Assessments/CLRAS

• What are they?
• Alternatives to grade level assessments
• Who takes them?
• Students with significant disabilities that are
  unable to take the general statewide assessment
• Who gives them?
• Only qualified assessors should administer
  extended assessments
• For more information about Extended Assessments
  CLRAS go to
• http//www.ode.state.or.us/search/results/?id178

28
Juried Assessments

• What is it?
• Juried Assessments are an alternative path for
  students who can meet the CIM standards, but are
  unable to demonstrate mastery on one or more
  statewide assessments.
• Who uses the Juried Assessment process?
• Any student who has mastered grade level content,
  but is unable to demonstrate the mastery on
  statewide assessments.
• Students who have entered Oregon schools at
  grades 11 or 12, and choose not to take the
  statewide assessments.
• Eligible students demonstrating reading and/or
  writing skills at the standard level, but in
  their native language.

29
Juried Assessments

• What is a Collection of Evidence?
• A set of materials gathered to show that the
  student is performing at the standard level on
  the grade level content.
• The collection must address the State
  Board-adopted content and performance standards
• How does the Juried Assessment Process begin?
• Districts are required to notify parents of the
  opportunity for students to use the Juried
  Assessment Process
• Do JAs count for AYP and/or CIM?
• In general, yes!
• For detailed requirements and intent to submit
  deadlines go to http//www.ode.state.or.us/search
  /results/?id175

30
Writing Test Appeals

• State scores must be in the appropriate range of
  composite scores.
• CIM 25 39
• 7th 25 39
• 4th 20 31
• Trained rater re-scores paper. If score appears
  higher, re-submit paper.
• Attach original paper to Appeals Form.
• Completely fill out form.
• Local rater and district test coordinator must
  sign form.
• ODE must receive by May 31, 2006.
• Appealed scores always replace original score.

31
Test Security

• Security procedures are designed to protect the
  integrity and confidentiality of those test
  questions, prompts, and problems that are not
  released for public use the security of these
  materials is necessary so that they can be used
  in later years to measure trends in performance.
• Test administration procedures are to ensure
  consistent statewide test administration. When
  this doesnt happen
• Report to ODE Office of Assessment and
  Information Services
• Determine an action plan
• Conduct an investigation
• Report the results of the investigation
• If appropriate contact TSPC re possible loss
  of licensure
• A PowerPoint presentation about test security is
  available on the ODE website.
• Go to http//www.ode.state.or.us/teachlearn/testi
  ng/admin/testsecurity.ppt

32
Test Security Q/A

• To maintain secure and fair test administration
• Teachers and proctors must sign the Assurance of
  Test Security form to communicate the importance
  of standardized administration of tests each
  year. These are to be kept at the district office
  for one year.
• Concepts that had not been taught earlier may not
  be introduced to students prior to giving the
  test (dont give test materials out too soon)
• Proctors may not suggest which prompt a student
  ought to select for writing
• Unused test materials, after each testing window,
  must be returned to the District Test
  Coordinator. Schools may not keep extra booklets
  or copy test forms for practice or future
  instructional use
• Test forms have a core set of items that are
  the same year to year. This set links the current
  test to previous years tests and ensures the
  test is consistent and fair from year to year
• Any teacher responsible for proctoring test
  administration for students must be in the room
  monitoring this process and be available for
  students who may have operational questions.

33
Online Ordering

• Tests available for order online
• Writing Performance Assessments
• November 2 November 23, 2005
• February 10 February 24, 2006
• Knowledge and Skills Tests
• January 10 January 27, 2006
• Grade 3 Reading in Spanish
• January 10 January 27, 2005
• Lincoln County School District staff will work
  with schools to order appropriate numbers of
  paper/pencil test documents.

34
Student Staging (formerly PADM)

• Student Staging Overview
• The intent of the Student Staging web site is to
  make Assessment data more complete and accurate
  before state-generated reports are issued.
• The Student Staging web site is preloaded with
  the demographic portion of student records.
• Each Assessment Window is a different Student
  Staging database file.
• One student record is displayed on the screen at
  a time.
• Each student will have multiple records if s/he
  has taken more than one test.
• For instructions on accessing and using the
  Student Staging site go to https//district.ode.s
  tate.or.us/docs/asmt/tststg/
• StudentStagingUserGuide.pdf
• NOTE TESA data updates student staging daily!

35
Work Sample Requirements

• For writing, speaking, and mathematics problem
  solving, students in grades 3, 4, 5, 6, 7 8
  must complete one work sample scored with the
  state scoring guide.
• Students at the CIM level must complete 2 work
  samples from different strands (SRCs 3, 4, or 5)
  in mathematics problem solving and 3 samples in
  writing (one persuasive, one expository AND one
  imaginative or narrative). In speaking, CIM
  students must complete 3 samples (one persuasive,
  one informative, and one unrehearsed).

36
Work Sample Requirements

• For scientific inquiry, students in grades 4 8
  and at the CIM level must complete one work
  sample, scored in the required dimensions.
• For social sciences analysis, students in grades
  6 8 and at the CIM level may complete one work
  sample, scored in the required dimensions,
  beginning in 2005 06.
• The Overview of Oregons assessment system can be
  found at
• http//www.ode.state.or.us/search/results/?id239
• The phase in schedule for science work samples
  can be found at
• http//www.ode.state.or.us/search/results/?id240
• The phase in schedule for social science work
  samples can be found at
• http//www.ode.state.or.us/teachlearn/subjects/so
  cialscience/assessment/survey

37
English Language Proficiency Assessments (ELPA)

• Districts have traditionally used one of four
  purchased assessments
• As of 05-06, schools must use Oregons ELPA
  Assessment
• There are two field test opportunities fall and
  spring
• The operational assessment will be April - June
• Web-Based assessment, with K-12 being assessed
• Questions please contact Elaine Hultengren at
  503.378.3600 ext. 2345 or elaine.hultengren_at_state
  .or.us

38
Sample Tests

• The Oregon Department of Education provides
  sample tests to demonstrate the types of
  questions students might encounter on the Oregon
  Statewide Assessment.
• The sample questions were taken from previous
  years tests, are no longer secure and have been
  released for public use.
• Sample tests are available in
• Mathematics and Reading at grades 3, 4, 5, 6, 7,
  8, and CIM
• Science and Social Sciences at benchmarks 2, 3,
  and CIM
• Extended Mathematics, Reading and Writing
• Sample tests can be found on TESA or
• on the ODE website at
• http//www.ode.state.or.us/search/results/?id226

39
Bar-Coding Districts

• LBL will bar code ordered documents for the state
  writing test.
• LBL will be prepared to begin coding state
  writing test answer documents well ahead of
  testing window.
• School districts will be responsible for bar
  coding all knowledge and skills answer documents
  locally.

40
WebEx Training Available

• Go to
• http//techserv.lblesd.k12.or.us/software/secure/w
  ebex/index.php
• Select
• Other Student Applications
• OSAT
• Three options are available for viewing
• OSAT Introduction
• OSAT Secondary School Student Assignments
• OSAT Printing

41
Bar Code Availability

• Bar coding options for the Writing Performance
  Test will be available in early December. This
  will allow you to select students well ahead of
  testing.
• Please provide LBL with five working days of lead
  time for printing of answer documents.

42
Score Loading and Resolution

• All state test scores will be loaded into the LBL
  Student Information System on a weekly basis.
• For resolution of duplicates, please view option
  DO 155 or SO 135.
• Changes in scores may only be made through the
  ODE site.

43
TESA for 2005-2006 A Look at Whats New

44
TESA Access

• Secure Browser (Recommended)
• TESA Web site

45
? New for 2005-06 ?
46
? New for 2005-06 ?
47
? New for 2005-06 ?
48
? Number of Opportunities ?
49
Test Names ?Reading Tab
50
Test Names ?Math Tab
51

• Test Names ?Science Tab

52

• Test Names ?Social Science Tab

53
? Test Names ?
54
Considerations

• Lab Usage
• Testing All Students
• Testing Times
• Proctoring
• Computer Rights
• Testing Location
• Test Protocol
• Etc

55
Data Management

• HALLIDAY, Susan ABC School
• SSID 7654321 School ID 4321
•  
• Look for access key and test key
• for today.
•   
• Similar idea to the data card template found in
  your TESA Notebook.

56
From a Students Perspective
57
TESA 2005 Logging in as a Student
58
TESA 2005 Student Welcome/Confirmation Screen
59
TESA 2005 Student Welcome/Confirmation Screen
Student must verify School Name and School ID
60
TESA 2005 Student Test Center
Click on a colored tab to see available tests.
Only one test per subject can be opened at a time.
Spanish tests are located in Other.
61
TESA 2005 Starting a Test
62
TESA 2005 SCHOOL NAME
ODE is still determining how to use this
function. It will be on to start the year while
we gather feedback. It may be removed if it is
shown to not be helpful to students.
School name appears on screen through the entire
test
63
TESA 2005 Reading Passage Preview
Previews all questions within a passage.
64
TESA 2005 Reading Passage Preview
65
Accessing TESA
66
TESA 2005 HOME PAGE
67
TESA 2005 Administrator, Teacher, Proctor Log In
68
TESA 2005 Teacher/Proctor Welcome/Confirmation
Screen
69
TESA 2005 Teacher Main Menu
70
TESA 2005 Modify Account
71
TESA 2005 Group Setup
72
TESA 2005 Group Information
73
TESA 2005 Group Members
74
TESA 2005 Reports Menu
75
TESA 2005 Reports Criteria
76
TESA 2005 Reports
Reports can be sorted by clicking on each heading.
77
How to Test a Student
78
TESA 2005 HOME PAGE
Click on Student Login
79
TESA 2005 Logging in as a Student
Enter SSID, School ID, and Access Key.
80
TESA 2005 Student Welcome/Confirmation Screen
Click on Yes, this information is CORRECT.
81
TESA 2005 Student Welcome/Confirmation Screen
Click on Yes, this information is CORRECT.
82
TESA 2005 Student Test Center
Select a tab to see a list of available tests.
83
TESA 2005 Launching a Test
Select the test youd like to take.
84
TESA 2005 Launching a Test
Click OK to start the test.
85
TESA 2005 Enter Test Key
Enter the Test Key and click on the login button
86
TESA 2005 Modifying the test
If modifying the test, enter modify in place of
the test key.
87
TESA 2005 Modification code screen
Click the modifications code(s) that apply for
this test and enter the teachers email address.
88
TESA 2005 Confirmation Box to Stop Test and
Finish Later
89
TESA 2005 Resume a Test
Tests to be resumed are listed at the top of the
screen.
90
TESA 2005 Math Item with Finish Button
Click on COMMENT AND FEEDBACK to report a problem
with the question to ODE.
The flag will appear on the last question of the
test.
91
Whats new in...Language Arts

• Reading
• 2005-2006 is implementation year for new
  standards.
• New Score Reporting Categories are now in effect
  for all grades.
• New Test Specifications and SRC Charts are now
  posted on the Web.
• New Sample Tests for grades 3, 5, 8, and CIM are
  also posted. These documents can be found at
• http//www.ode.state.or.us/search/results/?id236

92
Whats new in...Language Arts

• Writing
• 2005-2006 is implementation year for new
  standards.
• New Test Specifications have been posted on the
  Web (http//www.ode.state.or.us/search/results/?id
  238).
• New anchor papers/exemplars will be posted for 3,
  5, 8, and 10 by the end of October.
• New process for appealing state assessment
  scoressee the Administration Manual.
• State tests with all 4s except for one 3 will be
  given a third reading at each of the tested
  grades in 2005-2006.
• New writing scoring guide minimal changes.

93
Whats new in...Mathematics

• Knowledge and Skills
• The standards and new weighting are in effect for
  all grades and are modeled in the sample tests.
• New K/S Test Specifications (for grades 3 4, 5
  6, 7 8, and CIM) are now posted they
  intentionally represent a sampling of content to
  be assessed at each grade level.
• Item Difficulty Charts (ranges of difficulties
  for ranges of grade levels by SRC) are posted.
• These documents can be found at
• http//www.ode.state.or.us/search/results/?id257

94
Whats new in...Mathematics

• Mathematics Problem Solving
• At each grade level (3, 4, 5, 6, 7, 8 at the
  CIM) and from each strand statistics/probability
  , algebraic relationships, and geometry you can
  find a task, anchor papers/exemplars (high,
  medium, and low), scores and commentaries!
• These can be found at either
• http//www.ode.state.or.us/subjects/mathematics/re
  sources/pssupport
• or
• http//www.ode.state.or.us/search/results/id224
• OCTM Professional Development Cadre contact
• Eastern Oregon Molly Smith molly_at_eoni.com
• Northwestern Oregon Lynn Bonser
  lbonser_at_nwresd.k12.or.us
• Southern Giny Christensen giny.christensen_at_sut
  herlin.k12.or.us
• General Info Phil Bartsch pbartsch_at_ipns.com

95
Whats new in...Science

• Three test opportunities on TESA for CIM
• One Benchmark 2 and one Benchmark 3
  Spanish/English test on TESA
• Scientific Inquiry work sample requirement for
  10th graders (CIM) and Benchmark 3 students now
  includes Forming
• Scientific Inquiry work sample requirements for
  Benchmark 2 students now includes Analyzing
• Scientific Inquiry Teacher Leaders available for
  scoring facilitation at http//www.ode.state.or.us
  /teachlearn/subjects/science/SciInqProfDevelopers
  0405.doc

96
Whats new in...Social Sciences

• Social Sciences Tests are on TESA ONLY.
• Two tests are available at Benchmarks 2 3 and
  at the CIM level.
• One Spanish/English test is also available at
  each level.
• Social Sciences Analysis Teacher Leader Cadre
  available for scoring facilitation are listed at
• http//www.ode.state.or.us/teachlearn/subjects/soc
  ialscience/curriculum/teachres/leaders.aspx

97
Q A

• What did you learn?
• Other QUESTIONS you still have?
• Future training needs?

98

• Thank You