New England Common Assessment Program

1
New England Common Assessment Program
Bias Sensitivity Review Committee Meeting
May 3rd and 4th, 2005 Nashua, NH
2
Welcome and Introductions

• Michael Hock Director of Assessment
• Vermont Department of Education
• Harold Stephens NECAP Project Director
• Measured Progress

3
Logistics

• Committee Member Expense Reimbursement Form
• Substitute Reimbursement Form
• NECAP Nondisclosure Form
• Bias Sensitivity Guidelines for NECAP item
  development
• NECAP Bias Sensitivity Committee Charge

4
What Is Item Bias?

• Bias is the presence of some characteristic of an
  assessment item that results in the differential
  performance of two individuals of the same
  ability but from different student subgroups
• Bias is not the same thing as stereotyping
  although we dont want either in NECAP
• We need to ensure that ALL students have an equal
  opportunity to demonstrate their knowledge and
  skills

5
How Do We Prevent Item Bias?

• Item Development
• Bias-Sensitivity Review
• Item Review
• Field-Testing Feedback
• Pilot-Testing Data Analysis (DIF)

6
Role of the Bias-Sensitivity Review Committee

• Review reading passages, and then both math and
  reading items
• Complete evaluation forms and record comments
• Be prepared to discuss Mixed Reviews and
  Problem Items with your review team Make final
  recommendations

Please Note The Bias-Sensitivity Review
Committee plays an advisory role. Final decisions
on which passages and items to include in NECAP
will be made by the NH, RI and VT DOEs
7
Role of the Bias-Sensitivity Review Committee
The Bias-Sensitivity Review Committee DOES need
to make recommendations concerning

• Sensitivity to different cultures, religions,
  ethnic and socio-economic groups, and
  disabilities
• Balance of gender roles
• Use of positive language, situations and images
• In general, items and text that may elicit strong
  emotions in specific groups of students, and as a
  result, may prevent those groups of students from
  accurately demonstrating their skills and
  knowledge

8
Role of the Bias-Sensitivity Review Committee
The Bias-Sensitivity Review Committee DOES NOT
need to make recommendations concerning

• Reading Level
• Grade Level Appropriateness
• GLE Alignment
• Instructional Relevance
• Language Structure and Complexity
• Accessibility
• Overall Item Design

9
General Guidelines

• Avoid issues and topics considered sensitive by
  the general public
• Keep in mind that some topics that are
  appropriate for classroom discussion may not be
  appropriate for assessment
• Consider context and setting Bias-Sensitivity
  Review is not a literal process
• Think of bias as an assessment issue as well as
  a cultural issue, that is, a specific topic or
  feature of a passage or item that may
  disadvantage one of two otherwise equally matched
  groups of students

10
Topics to Avoid in Test Passages and
Items

• Rape
• Religious Doctrine
• Sex/Sexuality
• Sexual Orientation
• Weight
• Suicide
• Sexually Transmitted Diseases

• Abortion
• Birth control
• Child Abuse/Neglect
• Creationism
• Divorce
• Incest
• Occult/Witchcraft
• Questioning Parental Authority

11
Topics Which May or May Not Be Acceptable

• Murder
• Racism, Sexism Ageism
• Pregnancy
• Violence
• Use of Animals/ Animal Rights
• Religion (Except in Historical Context)

• Death
• Drugs, Alcohol Tobacco
• Family Issues
• Guns/ Gun Control
• Handicapping Conditions
• Homelessness
• Holidays

12
Awareness Issues

• Avoid economic, regional, cultural or gender bias
  in questions, prompts, identified situations,
  graphics or reading selections
• Assure that areas of reference emphasize academic
  programs and learning rather than life
  experiences
• Avoid profanity unless it has a clear literary or
  historical context
• Remember that we are proud of our states and
  region and expect to see that pride reflected in
  assessment passages and items

13
Passage Review Rating Form
14
Information, Questions and Comments

• Tim Kurtz Director of Assessment
• NH Department of Education
• [phone]
• Mary Ann Snider Director of Assessment and
  Accountability
• Rhode Island Department of Elementary
  and Secondary Education
• [phone] ext. 2100
• Michael Hock Director of Educational Assessment
• Vermont Department of Education
• [phone]