NeSA-W Grade 8 Online Assessment

1
NeSA-WGrade 8Online Assessment

• Nebraska Department of Education Statewide
  Assessment
• Pat Roschewski pat.roschewski_at_nebraska.gov
• Edward Foy edward.foy_at_nebraska.gov
• Julie Barger ESU 16, Ogallala, NE

2
The Nebraska Department of Education and Nebraska
educators continue to direct the process of
statewide assessment.
3
Nebraska Educators continue to be involved in
these aspects of NeSA-W

• Prompt Creation
• Field Testing
• Prompt Selection
• Rangefinding
• Appeals
• Continued training and communication

4
The Rangefinding Process

• Included 7-10 Nebraska educators from a variety
  of educational backgrounds
• Two DRC reps facilitated the work

5
The Rangefinding Process

• Analytically scored, discussed, and came to
  consensus on 90-100 papers from the field testing
  of the test prompt.
• DRC will use the papers selected and scored by
  this group to establish the anchors and train the
  raters prior to the scoring of the assessment.

6
Grade 8 Online Assessment

• Grade 8 will remain a descriptive essay.
• The 8th grade NeSA-W assessment will only be
  available online.
• Students with IEPs or 504 Plans may take the
  test in pencil and paper if documented in an IEP.
• Students responding in Spanish will take a
  pencil and paper assessment.

7
Grade 8 Online Assessment

• 5. NeSA software scheduled for release November
  14th. (All subjects, including writing and
  practice test)
• 6. Districts will need to schedule a download or
  update of software prior to administering the
  assessment.
• 7. The results will be analytically scored.

8
Grade 8 Online Assessment

• 8. Printing options are available.
• Both the practice and operational test may be
  printed in 2012.
• The printed copy may be used for local scoring,
  place in a student portfolio, or shared with the
  student/parents.
• Districts will need the printed copy for appeal
  purposes This copy is used to decide if an
  appeal is warranted and, if so, a copy must be
  attached to the appeal form.

9
Grade 8 Online Assessment

• 9. Changes have been made to the 8th grade
  rubric.
• The rubric was changed to an analytic rubric in
  the fall of 2010 from the previous holistic
  rubric.
• The content of the new rubric has been tightened,
  and although most of the previous criteria
  remain, they have been redistributed into fewer
  domains.

10
Grade 8 Online Assessment

• The domains of the rubric will be weighted as
  follows
• Content/Ideas 35
• Organization 25
• Word Choice/Voice/Tone 20
• Sentence Fluency/Conventions - 20

11
(No Transcript)
12
Grade 8 Online Assessment

• Changes were made to the rubric for a number of
  reasons.
• A revision of the Language Arts standards
  occurred in 2008-2009.
• An external study determined that the new
  standards and the writing assessment rubric did
  not match, necessitating a review/revision of the
  rubric.

13
Grade 8 Online Assessment

• Changes were made to the rubric for a number of
  reasons.
• Influence favoring analytical assessment was
  expressed in an effort to provide more specific
  data to data users.
• The use of a computer based assessment reflects a
  real world application of writing.
• Five vendors responded to the RFP(Request for
  Proposal.

14
Grade 8 Online Assessment

• The new rubric is available on the Assessment
  page of the NDE website.
• http//www.education.ne.gov/Assessment/NeSA_Writin
  g.htm

15
Grade 8 Online Assessment

• 10. NeSA-W testing window
• January 23, 2012---February 10, 2012
• 8th and 11th grade tests will be administered
  online.
• 4th grade assessment will be administered via
  paper/pencil test booklets as in the past. No
  plans to administer this test online.

16
Grade 8 Online Assessment

• The recommended testing time is 90 minutes to
  occur on one day.
• The test is not timed, but 90 minutes is
  recommended by NDE as the amount of time to
  schedule for the assessment.
• If a student needs more than 90 minutes, that is
  allowable, the same as for NeSA-R.

17
Grade 8 Online Assessment

• 11. Pre-writing may be done on paper furnished by
  the district. Students may choose to prewrite and
  produce a rough draft on paper before entering it
  on the computer, or they may choose to work
  entirely on the computer.

18
Grade 8 Online Assessment

• 12. A new thesaurus, dictionary, and cut/paste
  are available. The spell check will not be
  available.
• 13. An online practice test for 8th and 11th
  grade writing will be made available. You can
  access this assessment through the CAL software
  on November 14th.

19
Practice Test Instructions
20
Practice Test Prompt
21
Practice Test Self Assessment Tool
22
Grade 8 Online Assessment
Additional Information

• Graphic organizers, story starters, and story
  frames are not to be provided to students as part
  of the state testing program.
• In the testing room, visual aids and clues should
  be removed or covered and remain covered
  throughout the administration of the writing
  assessment.

23
Grade 8 Online Assessment
Additional Information

• Teachers are NOT to provide editing assistance to
  students on the NeSA-W.
• No NeSA-W 8th grade online test will be provided
  in Spanish. All Spanish tests will be
  administered via paper/pencil test booklets.
• Districts will submit request for Spanish prompts
  via eDirect October 3-14.

24
Grade 8 Online Assessment
Additional Information
The composite score is calculated from the domain
scores as 1. Composite 1.4D1 1.0D2 0.8D3
0.8D4 D1, D2, D3, and D4 are the sums of the
two reader scores for the four domains. The table
below illustrates the calculation for a student
who received a 2 or 3 from each reader on each
domain.
R1 R2 DR1R2 W WD
Ideas / Content 3 3 6 1.4 8.4
Organization 2 3 5 1.0 5.0
Voice / Word Choice 3 2 5 0.8 4.0
Sentence Fluency / Conventions 2 2 4 0.8 3.2
Composite Score 20.6
The corresponding Scale Score can then be
retrieved from the table supplied by DRC.
25
Grade 8 Online Assessment
Additional Information

• Current information about the NeSA-W assessment
  and all NeSA assessments can be found on the NDE
  website.
• Go to http//www.education.ne.gov
• On your left, click on Statewide Assessment.
• Click on NeSA Writing.

26
Questions?

• Nebraska Department of Education
• Statewide Assessment
• Pat Roschewski pat.roschewski_at_nebraska.gov
• Edward Foy edward.foy_at_nebraska.gov

27
The Process of Analytical Scoring

• The New Statewide Process

28
Holistic vs. Analytical Scoring

• Holistic scoring involves one score being
  given that represents the overall quality of the
  paper against a set of criteria, i.e. the six
  traits and their criteria.

29
(No Transcript)
30
Holistic vs. Analytical Scoring

• Analytic scoring involves a score being given
  for each domain and its criteria. These
  individual weighted scores are combined to
  calculate the final score.

31
(No Transcript)
32
The Analytical Scoring Process

• The Process
• First read focus on Ideas/Content and
  Organization--assign a score to each domain of 1,
  2, 3, or 4.
• Then review paper focus on Word Choice/Voice and
  Sentence Fluency/Conventions-- assign a score to
  each domain of 1, 2, 3, or 4.

33
The Analytical Scoring Process

• The Process
• Each paper is scored by two readers.
• Agreement Exact matches or adjacent scores
• A Third Read by the table leader is required for
  each domain if scores are not in agreement

34
The Analytical Scoring Process

• Rules for obtaining the final score for a student
  after the third read
• If the third score is an exact match to one of
  the original scores, the two matching scores are
  used.
• If the third score is adjacent to one of the
  original scores but not the other, the third
  score and the score adjacent to it are used.
• If the third score is adjacent to both scores,
  the third score is used twice.

35
The Analytical Scoring Process

• Possible impact of analytical scoring
• Information Each student report will include
  four sub scores and one scale score. These
  reports are shared with students and parents.
• Trends Over time, data from this assessment can
  indicate domain strength or weakness at a
  classroom, school, and/or district level.

36
Scoring Practice
37
Think about your dream house.  It could be any
place you wish.       Write an essay describing
your dream house by creating a vivid mental
picture using sensory details for the readers so
that they can see it, experience it, and be able
to understand why you would want to live there. 
8th Grade Prompt
38
My dream house is located in western Nebraska.

• 1-6

39
Analytical Scoring

• Ideas Content 4
  Well-focused, numerous details,
  clear and vivid picture
• Organization 4
  Intro, body, conclusion
  effective, controlled pacing, transitions
  effective, sound paragraphing
• Voice Word Choice 4
  Expressive wording, sense of the writer,
  appropriate voice, specific and vivid language
• Sentence Fluency Conventions 4
  Sentence variety, natural phrasing, stylistic use
  of fragments and conventions, correct.

40
If I could design my own home

• 2-13

41
Analytical Scoring

• Ideas Content 3
  Generally focused, adequate details,
  clear picture
• Organization 3
  Intro, body, conclusion are
  functional, generally controlled pacing,
  transitions functional, generally sound
  paragraphing
• Voice Word Choice 3
  Generally expressive wording, sense of the
  writer, and appropriate voice, adequate specific
  language
• Sentence Fluency Conventions 4
  Sentence variety, natural phrasing, stylistic use
  of fragments and conventions, correct.

42
My dream house is going to be the nicest.

• 3-15

43
Analytical Scoring

• Ideas Content 3
  Generally focused, adequate details,
  clear picture
• Organization 2
  Intro, body, conclusion are
  limited, inconsistent pacing, transitions weak,
  irregular paragraphing
• Voice Word Choice 2
  Occasionally expressive wording, limited
  sense of the writer, possible inappropriate
  voice, occasional specific language
• Sentence Fluency Conventions 3
  Generally correct conventions, general sentence
  variety.

44
My dream house where be in New York

• 1-1

45
Analytical Scoring

• Ideas Content 2
  Some digressions, limited details,
  limited picture
• Organization 1
  Intro, body, conclusion lacking,
  awkward pacing, transitions and paragraphing
  missing or unclear
• Voice Word Choice 2
  Occasionally expressive wording, limited
  sense of the writer, possible inappropriate
  voice, occasional specific language
• Sentence Fluency Conventions 1
• Sentences seldom vary, phrasing may be
  confusing, convention errors may distract the
  reader

46
If I could design my own dream house the first
thing

• 4-3

47
Analytical Scoring

• Ideas Content 2
  Some digressions, limited details,
  limited picture
• Organization 2
  Intro, body, conclusion are
  limited, inconsistent pacing, transitions weak,
  irregular paragraphing
• Voice Word Choice 2
  Occasionally expressive wording, limited
  sense of the writer, sometimes inappropriate
  voice, occasional specific language
• Sentence Fluency Conventions 2
• Sentences occasionally vary, awkward phrasing,
  confusing, convention errors distract the reader

48
Your Turn.

• I would like my dream house to be big.
• 3-1

49
Analytical Scoring

• Ideas Content 2
  Some digressions, limited details,
  limited picture
• Organization 2
  Intro, body, conclusion are
  limited, inconsistent pacing, transitions weak,
  irregular paragraphing
• Voice Word Choice 2
  Occasionally expressive wording, limited
  sense of the writer, sometimes inappropriate
  voice, occasional specific language
• Sentence Fluency Conventions 2
• Sentences occasionally vary, awkward phrasing,
  confusing, convention errors distract the reader

50
Further Questions??Nebraska Department of
Education Statewide AssessmentPat Roschewski
pat.roschewski_at_nebraska.govEdward Foy
edward.foy_at_nebraska.gov