46-320-01%20Tests%20and%20Measurements

1
46-320-01Tests and Measurements

• Intersession 2006

2
Test Bias

• Ethnic groups
• Why individual differences?
• Environment? Biology?
• Differential validity
• Language base of IQ tests
• Focus of criticism
• Individual items, classes of items
• Differential item functioning (DIF) analysis

3
Test Bias

• Criterion-related sources of bias
• Differential prediction of scores?
• Regression revisited
• One regression equation vs. two
• Equal slopes equal predictive evidence

4
Prediction Bias
Criterion score
Criterion score
Criterion score
Test score
Test score
Test score
Group A Group B
5
Testing Minority Group Members

• Outlaw tests?
• Develop alternative strategies
• Basic assumption
• Ignorance vs. stupidity
• The Chitling Test
• Theory Hodos and Campbell (1969)
• African American specific body of information
  (mid 1960s culture)
• Validity

6
Black Intelligence Test of Cultural Homogeneity
(BITCH)

• Williams et al. scientific racism
• Survival Quotient (SQ)
• BITCH
• 100 vocabulary words relevant to African-American
  culture
• AA children gt white children
• Reliability AA gt white
• Validity poor
• Children unfairly assigned to EMR

7
System of Multicultural Pluralistic Assessment
(SOMPA)

• Different bases of knowledge
• All groups have same average potential
• 3 approaches
• Medical
• Social-system
• Pluralistic
• Validity

8
Solutions

• Unqualified Individualism
• Quotas
• Qualified Individualism
• Models of Fairness
• Regression
• Constant ratio
• Cole/Carlington
• Quota

9
Solutions

• New Interpretations of Data
• Differences in problem-solving approaches by
  group
• Differential process theory (Goldman)
• Different types of intelligence
• Different Criteria
• Usually standardized tests
• Opportunity to learn vs. ability to learn
• Grades
• Academic performance vs. career performance

10
Changing Society

• Social and economic inequality reflected in tests
• Aptitude?
• Criterion prediction
• Test or society?

11
Future of Testing Professional Issues

• Theoretical Concerns
• Reliability based on stability
• Trait question Stable characteristics that hold
  despite environment
• Trait? Environment? Both?
• Intelligence adaptability
• Index of competence
• Underlying theory

12
Future of Testing Professional Issues

• Adequacy of Tests
• How are tests used?
• Validity documentation should be improved for all
  tests
• Selection bias
• Prediction
• Accuracy actuarial vs. clinical prediction

13
Moral Issues

• Human rights
• Right not to be tested (informed consent)
• Right to know results
• Confidentiality
• Labeling
• Stigma
• Access to help
• Medical label not responsible

14
Moral Issues

• Invasion of privacy
• Limitations of tests
• Is it wrong to know about a person?
• Misuse of information
• Limits of confidentiality
• Divided loyalties
• IP
• Adverse decision
• Responsible test use

15
Social Issues

• Dehumanization
• Computer interpretation
• Usefulness of tests
• Better predictions
• Risk-benefit analysis
• Access to service
• Who refers?
• Who pays?
• Physicians