The Computer Adaptive Baseline Test CABT

1
The Computer Adaptive Baseline Test (CABT)
Robert CoeQingping HeChris Wheadon
2
Plus
New Zealand Hong Kong Scotland Australia China
3
A A B C D E F G U
Average residual 0.26
YELLIS test score
4
Monitoring Educational Progress

• Baseline tests
• A curriculum-free ability measure
• Nationally standardised
• Diagnostic information
• Short but accurate
• Projections to KS3, GCSE, Standard Grade
• Value-added
• To KS3, GCSE, Standard Grade

5
Computerised adaptive testing

• Adaptive test responds to individual performance
• More efficient
• More enjoyable (esp. for those who dont like
  tests)
• Instant feedback
• Reduces costs for marking, printing and shipping

6
CEM Centre Computer Adaptive Baseline Test

• CABT comprises a calibrated item bank and a
  question display system
• The adaptive test contains an adaptive maths test
  and an adaptive English vocabulary test
• Testing is delivered through the Web or from the
  schools local area network

7
Establishing a Calibrated Item Bank

• Testing of items by school students from
  different year groups through the administration
  of a series of tests containing common items
• Calibration of items in each test using the Rasch
  model (items meeting the Rasch requirements are
  used)
• Setting of the reference test and equating of
  different tests using the Rasch model and common
  items
• Further new item calibration through the
  embedding of new items in the adaptive test

8
Developing The Question Display System -
Conducting Adaptive Testing

• Realisation of adaptivity is achieved through the
  implementation in the question display system of
  the Rasch model for ability estimation (MLE
  method is used) and question selection
• Rules for stopping test minimum number of
  questions maximum number of questions and
  convergence value
• Variable starting difficulty for the first
  question for different year groups.

9
Test content Maths
10
(No Transcript)
11
(No Transcript)
12
Test Content Vocabulary
Which of the following words means the same, or
nearly the same, as the word on the
left? Implausible unlikely stiff dirty
different
Which of the following words means the same, or
nearly the same, as the word on the
left? Intersection ruin junction hive n
ode
13
Convergence and Test-Retest
14
Overall test-retest correlation 0.9
15
Timing and difficulty
16
Agreement with paper baseline test
17
Agreement with outcome
18
Dr Robert CoeCurriculum, Evaluation and
Management (CEM) CentreUniversity of
DurhamMountjoy Research Centre 4Stockton
RoadDurham DH1 3UZTel 0191 334 4184 Fax
0191 334 4180Email r.j.coe_at_dur.ac.ukwww.cemcen
tre.org