TELPAS Reading: The Final Countdown

1
TELPAS Reading The Final Countdown

• Heather Roeters Solano, TELPAS Manager, TEA
  Student Assessment Division

2
English Language Proficiency Assessments

• The acronyms TOP and RPTE are no longer used.
• There are two types of TELPAS assessments
  multiple choice reading assessments (TELPAS
  reading) for grades 2-12 and holistically rated
  components (TELPAS listening, speaking, writing,
  and reading) for the other grades and domains.

3
ELLs in Texas

• In spring 2007, about 640,000 ELLs were assessed
  with TELPAS.
• In Grades 3-12, more than 21,000 1st year
  immigrants were reported.
• In Grades 3-12, about 37 of 1st year immigrants
  received a TELPAS composite rating of beginning.

4
ELLs in Texas, Grades 3-12

• In Grades 3-12, approximately 146,000 ELLs were
  reported as having been enrolled for 5 or more
  years.
• Nearly 16,000 ELLs enrolled for 3, 4, or 5 years
  are still at the beginning level of proficiency
  in English.
• More than 35,000 ELLs enrolled for 3, 4, or 5
  years are still at the intermediate level of
  proficiency in English.

5
TELPAS Results

• ELLs Making Yearly Progress in TELPAS
• Proficiency Levels
• Grades 3-12, Spring 2006 and 2007
• (Composite Results)

6
TELPAS Results

• ELLs at Each TELPAS Proficiency Level
  Grades 3-12, Spring 2006 and 2007
• (Composite Rating)

7
ELP Assessment Goals

• TELPAS is part of an NCLB accountability system
  for ELLs. States must show annual increases in
  the progress ELLs make in learning English and
  attaining proficiency.
• The goal in Texas is for all ELLs to make at
  least one proficiency level of progress each year.

8
What Do We Know About TELPAS Reading for Grades
2-12?

• These tests replace RPTE, which was administered
  to grades 3-12 ELLs since 2000.
• These new tests assess students in grades 2-12.
• Students will be assessed in 1 of 6 grade
  clusters 2, 3, 4-5, 6-7, 8-9, 10-12.
• There are 4 proficiency level ratings Beginning,
  Intermediate, and Advanced, and Advanced High.

9
What Do We Know About the Tests?

• Each test has items at all 4 proficiency levels.
• There are items associated with a reading
  selection and stand-alone items.

10
Why Did We Need a New Version of our States
English Reading Proficiency Test?

• States must assess the ability of their ELLs to
  use English in academic contexts. The academic
  contexts need to include math and science. The
  reading selections relating to math and science
  need to show whether students are learning the
  English they need to succeed in these content
  areas.

11
Objectives

• TELPAS reading for grades 2-12 will report
  results at 3 objectives
• Objective 1 - Word Meaning and Language
  Structures
• Objective 2 - Basic Understanding (old 2-3)
• Objective 3 - Analysis and Evaluation (old 4)

12
Item Types

• TELPAS reading tests will continue to have both
  stand-alone items (items not associated with a
  reading selection) and items associated with a
  selection.
• Stand-alone item types include cloze items and
  questions about a picture.

13
Stand-Alone Cloze Item
14
Stand-Alone Cloze Item
15
Stand-Alone Question About a Picture
16
New Types of Items and Selections

• There will be a new content-area cloze
  stand-alone item type.
• There will be 2 new types of reading selections.

17
New Item Type

• Content-Area Cloze Stand-Alone a stand-alone
  item type that requires students to find the
  missing word in a short paragraph that students
  might read in math or science class

18
Content-Area Cloze Stand-Alone Item
19
Content-Area Cloze Stand-Alone Item
20
New Passage Types

• Content-Area Cloze Selection a short series of
  paragraphs on a math or science topic that will
  have several blanks to fill in
• Content-Based Selection similar to the
  traditional narrative with questions, but the
  plot of the passage will involve the application
  of a math or science skill

21
Content-Area Cloze Selection
22
Content-Area Cloze Selection Items
23
Content-Based Selection
The story continues to another page (not shown).
24
Content-Based Selection Item Examples
25
New Selections and Item Types

• Note that these new selections and item types are
  intended to assess the advanced and advanced high
  levels of English language proficiency!

26
Types of Reading Selections

• The tests will continue to have narrative and
  informational selections similar to RPTE and TAKS
  reading tests.

27
Functional Selection
28
What Color? Item Examples
29
Narrative Selection
30
Nothing to Do Item Examples
31
Informational Selection
32
(No Transcript)
33
Mangroves Item Examples
34
Mangroves Item Examples
35
New Types of Items and Selections

• Examples of these new types of selections and
  items and are posted on our website.
• To find them, go to www.tea.state.tx.us. Under
  Most Popular Information click on the link that
  says Student Assessment Division. From that
  page, click on the ELL Assessment Information
  link in the left column.
• Examples can also be found in the new information
  booklet (discussed later).

36
Plans for Test Implementation

• In spring 2005, TEA completed two activities in
  preparation for the new version of RPTE
• A grade 2 pilot test was administered to second
  graders in volunteer districts to determine the
  appropriateness of item types and selections
• Several prototypes of the new item types were
  included on the regular RPTE field test for
  students in grades 3-12

37
Plans for Test Implementation

• In spring 2006, in preparation for the new
  version of RPTE
• Items were field tested as embedded items on the
  regular RPTE test for students in grades 3-12
• A grade 2 paper field test was administered
  statewide
• Grade 2 students in volunteer districts completed
  their field test online

38
Plans for Test Implementation

• In spring 2007, in preparation for the new
  version of RPTE
• Items were field tested as embedded items on the
  final RPTE test for students in grades 3-12
• A grade 2 paper field test was administered
  statewide
• Approximately one-third of the ELLs across the
  state participated in a separate online field
  test

39
Test Implementation

• The new test will go live in spring 2008!

40
Test Implementation

• Because the multiple choice TELPAS reading tests
  now include a grade 2 assessment, teachers WILL
  NOT be rating second graders in reading using the
  holistic rating process.

41
Information Booklets

• The TELPAS Reading Preliminary Information
  Booklet was published in August 2007 and posted
  to the ELL Assessment Information page of the TEA
  Student Assessment Division website.
• The information booklet contains annotated
  examples of items and selections at all
  proficiency levels.
• It is planned that an updated version will be
  published next school year with additional
  information and item examples.

42
Accommodations

• Except for dyslexia-bundled accommodations and
  braille tests, the same accommodations available
  for TAKS reading are available for TELPAS
  reading. The new accommodations manual lists
  TAKS accommodations.
• The TELPAS test administrator manual contains
  accommodation information specific to TELPAS.

43
Administration Considerations

• While the tests have not gotten much longer, more
  of the reading material on the tests assesses the
  higher levels of proficiency, so TELPAS reading
  tests may take longer than RPTE did.
• This may result in students needing to take more
  breaks.
• Remember that students must be given as much time
  as necessary to complete the tests.

44
Plans for Online Implementation

• In preparation for the test to be administered
  exclusively online in 2009, both paper and online
  testing will occur this spring as the new test is
  implemented.

45
Online Administrations

• Districts were strongly encouraged to administer
  the online version of TELPAS reading to at least
  two-thirds of their grades 2-12 ELLs this spring.
• Within a campus, grades that will be
  participating in the online administration must
  test all students online. Campuses may not
  choose to administer the test to some students in
  one mode and to other students in another mode
  (within a grade).

46
Online Administrations Testing Materials

• For grades registered for paper testing
  Districts will receive materials according to
  normal distribution formulas
• For grades registered to test online
• Grades 2-3 A booklet will be shipped for each
  online tester because the booklets are needed to
  record holistic ratings.
• Grades 4-12 Answer documents will be shipped for
  each student (regardless of mode of testing) for
  purposes of recording holistic ratings. Booklets
  will not be shipped for students in grades
  registered to test online. Only overage will be
  provided.
• Additional booklets can be ordered if necessary.

47
Online Administrations Manuals

• Online testing procedures are covered in the 2008
  General Guide to Online Testing, not in the
  coordinator manual or test administrator manual.
  This guide will be shipped to districts.
• The 2008 TELPAS Reading Test Administrator Manual
  contains general instructions and the read-aloud
  directions for administering the test both online
  and on paper. This manual will arrive in
  districts the week of February 19.
• Note This manual does not include technology
  information for online testing.

48
Online Administrations Accommodations

• An ELL with a visual impairment who needs a
  large-print test but is in a grade registered for
  online testing should take the test on paper.
• If a student needs any other accommodation that
  would not be possible online, test the student on
  paper and please inform TEA by emailing a
  description of the situation to
  ELL.Tests_at_tea.state.tx.us

49
Online Administrations Additional Administration
Considerations

• Test administrators and/or technology staff
  should check computers to make sure screen glare
  is minimized. Screen glare can cause eye
  fatigue. The test administrator manual contains
  ideas for preventing this problem.
• During an online administration, the test
  administrator and/or technology staff must be
  familiar with the tasks for administering a
  session and the procedures for giving students
  breaks.
• All other considerations previously mentioned
  (test time possibly longer than RPTE, additional
  breaks, time allowance) apply to online
  administrations as well.

50
Online Administration Resources Online
Interactive RPTE

• What is it? A nonreleased RPTE test in an
  online-scorable format
• When will it be available? Now!
• Where can I find it? Go to www.tea.state.tx.us.
  Under Most Popular Information, click on
  Student Assessment Division. In the left
  column, choose Released Tests. Scroll down to
  the heading Interactive Online Versions and
  choose the test you need.
• What information will it provide about students?
  After the student submits the test, a score
  report will appear. The score report will
  provide the number of items correct, the number
  of items correct by proficiency level, the scale
  score, and the proficiency level. The students
  answer and the correct answer will also be
  provided for each question.

51
Online Administration Resources

• On October 24, a broadcast email was sent to
  districts indicating the availability of online
  administration preview tests and tutorials to
  familiarize students and teachers with TestNav,
  the testing software.
• These resources are available from the Resources
  page of the Texas State Assessments website at
  www.etesttx.com/resources
• Users can download the software needed to launch
  the tutorials and previews as well as
  administration directions for the tutorials.

52
Online Administration Resources TestNav TELPAS
Tutorials

• TestNav is the name of the software used for
  online testing.
• These tutorials are available now for teachers to
  use with students.
• The tutorials will teach students how to navigate
  and use the available tools when taking an online
  assessment.
• Tutorials can be presented to a whole group using
  a projector or in a computer lab. It can also be
  used in smaller groups or individually as needed.
• Tutorials contain very few items and are not
  scored.

53
Online Administration Resources TestNav Preview
Tests

• TestNav versions of 2006 RPTE tests for grades
  3-12, TestNav versions of piloted items for grade
  2
• These tests contain the same items as the online
  interactive versions, but are formatted like the
  2007 field test and 2008 and 2009 live tests
  will be.
• TestNav preview tests are scorable, but will not
  provide the same amount of information as the
  online interactive version score report. Only
  raw scores are provided.

54
Online Administrations

• If your district has not yet registered to
  administer TELPAS reading online, but plans to do
  so, please call Pearson at 800-252-9186 and
  select option 3.

55
Reporting Plans

• New proficiency-level cut points for the new
  tests will be established using spring 2008 test
  performance. This process will occur over the
  summer.
• The K-12 test results that districts receive in
  May will not include Standard and Optional
  Reports. Only electronic student lists will be
  provided. The holistic ratings for each student
  (K-12) and the raw score performance on TELPAS
  reading (grades 2-12) will be listed.

56
Reporting Plans

• Districts will receive complete shipments of
  TELPAS reports in September 2008.
• Districts will still be required to notify
  students and parents of results by September 30,
  2008.
• Note that these dates are not reflected in the
  2008 District and Campus Coordinator Manual.
  These reporting plans were made final after the
  manual was printed. A letter will be sent to
  districts in December explaining this information.

57
Reminder

• This year, the TELPAS testing window is from
  March 17 - April 11. All TELPAS testing
  activities (holistic ratings, paper and online
  test administrations) must be completed during
  that time.

58
Contact Information

• Email Address ELL.Tests_at_tea.state.tx.us
• Student Assessment Division phone
• 512-463-9536