Setting the Standard

1
Setting the Standard
MAP
Mathematics Communication Arts Achievement
Level Setting Conference December 7-9, 2005
2
A Brief History of theMissouri Assessment
Program (MAP)

• The 1993 Outstanding Schools Act mandated the
  development of state academic standards and
  performance assessments to assess student
  progress in attaining those standards .
• From 1996 through 2001, assessments were
  developed in these six content areas to assess
  student progress in achieving the Show-Me
  Standards.
• To date MAP assessments have been
• grade-span tests.

3

• The No Child Left Behind (NCLB) legislation
  requires states to assess students in math and
  communication arts at grades 3-8 and in one high
  school grade beginning in 2005-2006.
• In the spring of 2006 Missouri students will take
  grade-level MAP assessments in math and
  communication arts for the first time.
• Prior to the administration of these tests,
  Missouri educators and citizens must meet to
  recommend cut points to the State Board of
  Education that represent the performance levels
  on these tests.

4
Creating the New Tests

• Reading passages are reviewed by Missouri
  teachers
• Items are written and edited by Missouri teachers
• Items are reviewed by Missouri teachers
• Items are reviewed for bias by Missouri readers
• Items are administered in a field test
• Standards are set (Dec. 7-9, 2005)
• Live or operational test administration and
  reporting of test results

5
Use of the Test

• Student performance on the MAP assessments is a
  key component in school district accreditation.
• Student performance on the MAP is the criterion
  used in reporting Adequate Yearly Progress (AYP),
  as required by the No Child Left Behind
  legislation.
• The MAP test is not used in a high-stakes fashion
  for students. Nor is performance on the MAP used
  to determine funding for districts.

6
Setting the StandardThe Conference Panels

• Each content area will have 56 panelists.
• There will be 7 grade-level tables with 8
  panelists at each table.
• The panelists are
• 4 classroom teachers
• 2 non-teacher educators
• 2 non-educators
• A MAP Regional Facilitator (RF) will serve as a
  table leader for each group. The RF will be a
  non-voting panelist.

7
Setting the Standard

• Performance standards for the MAP tests will be
  established using a modification of the Bookmark
  Standard Setting Procedure (BSSP).
• A modification of the BSSP is necessary because
  of the recently passed Missouri law, Senate Bill
  1080, which states that by June 30, 2006, the
  State Board of Education shall

8

• Align the performance standards of the MAP so
  that such indicators meet, but do not exceed, the
  performance standards of the National Assessment
  of Educational Progress (NAEP) exam..

9

• In other words, the percent of students who
  attain Proficient on the MAP should be similar to
  or slightly higher than the percent attaining
  Proficient on the NAEP.

10

• The initial range of cut points will be based on
  the percentage of students classified as
  Proficient or above on the NAEP and MAP tests.
• The same range of percentages will be used for
  all grades/content areas.

11

• The high end of the range (scale score) will be
  based on the NAEP results. This cut score will
  be set for each grade/content area such that
  approximately 26 of students are at or above the
  cut score. This was the lowest percentage of
  students classified as Proficient or Advanced on
  the NAEP test for Grades 4 and 8 Reading and Math
  using both national and state data.

12

• The low end of the range (scale score) will be
  based on current MAP results. This cut score
  will be set for each grade/content area such that
  approximately 44 of students are at or above the
  cut score. This is the highest percentage of
  students classified as Proficient or Advanced on
  grades 3 and 7 Communication Arts and/or grades 4
  and 8 Math MAP tests.

13
MAP and NAEP Reading Results

• Percentage of Students at Proficient/Above
  Achievement Levels
• Grade 4 2005 NAEP 32
• Grade 3 2004 MAP 33
• Grade 8 2005 NAEP 31
• Grade 7 2004 MAP 34
• same cohort

14
MAP and NAEP Math Results

• Percentage of Students at Proficient/Above
  Achievement Levels
• Grade 4 2005 NAEP 31
• Grade 4 2005 MAP 44
• Grade 8 2005 NAEP 26
• Grade 8 2005 MAP 16

15
Setting the Standard

• There will be three rounds of Bookmark
  activities. After rounds one and two there will
  be cross-grade level discussion among the
  panelists to ensure a reasonable and logical
  progression of Proficient as well as the cut
  points for Advanced and Basic.
• The recommended cut points will be presented to
  the State Board in January.