Getting Ready PSSA 2005

1
Getting Ready!PSSA 2005

• Assessment and Accountability
• September 2004

2
Purpose and Goals

• Provide an update on the assessment system
• Describe improvements to the 2005 PSSA for Math,
  Reading and Writing
• Identify tools that are available for teachers to
  use

3
Agenda

• Tools/Highlights
• Reading and Math 3, 5, 8 and 11
• Update
• Reading and Math 4, 6 and 7
• Update
• Writing 5, 8 and 11
• Accountability Update
• Coming Soon!

4

• Reading and MathGrades 3, 5, 8 and 11

5
Tools You Haveor will have this Fall
6
Assessment Handbooks

• Replace any earlier versions
• Provide helpful hints for instruction
• Include NEW test blueprints and the format

7
Test Design and Format
8
2005 Test Format
9
Test Blueprints
10
Reading Test Blueprint
Percents and Score points approximate
11
Mathematics Test Blueprint
2005 PSSA Grades 3, 5, 8 and 11 Mathematics
Assessment Blueprint
At each grade level the table shows the range in
the percent of points to be devoted to each
reporting category. The exact percent for a
reporting category will depend upon where the
open-ended items are placed. At each level, 12
of the total points will be from 3 open-ended
items, each scored from 0 through 4.
12
Item Banks

• On the website now
• Items from other states
• Close match to our Anchors
• Not meant to drill and killtest prep is not the
  answer

13
Data Tools and Instructional Resources

• New print reports _at_ www.grownetwork.com
• PSSA reports online _at_ www.PaGrow.com
• Instructional strategies
• Data tools training

14
Accommodations Policies

• New this year
• No dictionaries for Reading, Writing and
  Mathematics except for LEP translation dictionary
• Math tests in Spanish
• Revised Accommodations Guidelines ready end of
  October

15
Spanish Language Math Test

• Format
• Side-by-side translation
• Who is eligible
• Students enrolled for fewer than three years in
  U.S.
• Students with adequate Spanish language
  proficiency

16
Item Samplers

• Coming end of October
• Each school will receive two (2) copies each of
  Reading and Math, by grade level, or a CD
• 2 open-ended items per grade level with student
  work and rubrics

17
How to Use the Released Items

• What is required in the task?
• Would my students perform well?
• How do you know?
• Why? Why not?
• What would it take to have all students perform
  well?

18
Assessment Anchors

• Assessment Anchors with sample items
• Strategies
• Adopt-an-Anchor
• Anchors in Practice

19
Where Were Headed

• Conducted a national review
• Minor changes to Reading Reporting Categories
  this year
• Math Reporting Categories are the same this year
• Adding Eligible Content for 4, 6 and 7
• Anchors will be revised by 2007 based on input

20
Tools Summary

• Assessment Handbooks
• Item Banks
• Data Tools/Resources
• Accommodations Guidelines
• Item Sampler
• Assessment Anchors

21
What You Need to Know

• Highlights for
• Grades 3, 5, 8 and 11

22
Reading Highlights

• New reporting categories
• No longer assessing word origins and research
• Open-stem and closed- stem statements
• Item specific scoring guidelines with 0 - 3 pt.
  scale

23
Math Highlights

• New Reporting Categories
• Item-specific scoring guides on a 0 - 4 pt. scale
• Shorter/scaffolded open-ended items
• Explain why only when appropriate

24
Test Security

• Policy online
• NEW! Certification of proper test administration

25
Whats the same?

• Rigor
• Alignment
• Problem solving in Math
• Short answer in Reading

26
Questions?
27
Reading and Math Grades 4, 6 and 7
28
What You Need to Know

• Mandatory Field Test
• April 4-15, 2005
• Only Reading or Math
• 1 hour
• DRC will send notices
• No scores generated

29
Assessment Anchors 4, 6 and 7

• Target Release November
• PennLink to be sent
• Check the Web!

30
Writing Grades 5, 8 and 11
31
Writing Whats New in 2005?

• Grades 5, 8 and 11
• All together February 14 - 23, 2005
• Mode-specific scoring guidelines

32
Why these Changes?

• October was an awkward time of the year
• Really assessing Grades 5, 8 and 11
• Continue to use domains, but modified the scoring
  process

33
Grades 5

• Field Test
• One prompt plus 2 multiple-choice sections
• Narrative, informational or persuasive
• 60 minutes

34
Grades 8

• Field Test
• One prompt plus 2 multiple-choice sections
• Informational and Persuasive
• 60 minutes

35
Grade 11

• Operational
• 3 prompts (one embedded field test)
• 2 multiple-choice sections
• Informational and Persuasive
• 60 minutes per prompt

36
About the Multiple-Choice

• Adds to the validity and reliability of
  Conventions Score
• Includes short passages that need revision or
  editing
• Approximately 20 minutes

37
Why Only 2 Modes (Gr 8 and 11)?

• Narrative is largely story telling
• Post secondary and business feedback
• Most of the writing in middle and high school is
  informative and persuasive

38
Rubric vs Scoring Guide

• The 5-Domain Rubric should still be used for
  instruction
• Will release new Mode-Specific Scoring guides
  later this year

39
Accountability Update
40
Where Weve Been

• Released in August
• Should have seen a BIG difference
• BUT WE NEED YOUR HELP.

41
Help Us Help You

• Submit quality data
• Pre-enrollment information
• Final enrollment information
• Demographic page of PSSA booklet

42
Help Us Help You

• Submit quality data
• Properly apply school attribution rules
• Verify correct, current school number
• Use the DRC online data correction system

43
Recommended Process

• Print the student list report for the school and
  review
• Select a school from the Navigation Window
• Correct student information as necessary

44
Recommended Process

• Complete all updates and print updated student
  list report for your records
• Repeat (14) for all schools within your district
• Print the district confirmation letter, sign and
  return it to DRC
• Only confirmed data corrections will be applied
  for reporting and AYP calculations

45
Select School
46
Reporting Print Student List
47
Student List
48
Student Detail
49
Print, Sign and Fax Confirmation
50
Coming Soon!
51
Coming Soon!

• DRC/CTB Test Administration sessions in January
• Potential Writing Professional Development in the
  Fall
• Reports for Grade 3 Reading and Math and Grade 11
  Writing

52
Coming Soon!

• Revisions to Assessment Anchors
• Released Item Bank next year!
• September 30th www.grownetork.com will have
  disaggregated data reported by academic standard

53
Performance Levels

• Using Anchors in 2005
• Made changes in the test
• Need to validate performance levels for 5, 8 and
  11
• Need to set performance levels for 3, 4, 6 and 7
• June 2005 validation study
• May report scores late b/c of adjustments being
  made

54
Our Partners

• Who Does What?

55
Data Recognition Corporation

• Develops items for Grades 4 - 8 and 11 Math and
  Reading PSSA, also Writing
• Grade 12 retest
• Conducts bias review
• Produces tests
• Scores tests
• Produces numeric AYP data file

56
CTB/McGraw Hill

• Develops Grade 3 Math and Reading PSSA until
  October 2006
• Conducts bias review
• Produces tests
• Scores tests

57
The Grow Network

• Develops student, school and district reports
• Produces AYP website
• Manages on-line instructional resources site

58
Teacher Committees

• Review EVERY ITEM that goes on the PSSA
• Review the item data to select items
• Get the word out!

59
Plus

• Intermediate Units
• PaTTAN Centers
• Education Associations
• and others

60
Questions and Unusual Circumstances

• DRC 1-800-451-7849
• CTB 1-866-282-2249
• GROW 1-800-481-4769

61
Good luck!