Introduction to M

1
Introduction to M

• Nicola Forster

www.midyisproject.org
2
Introduction to M

• Three parts
• Overview of MidYIS Test
• Baseline feedback
• Value-added feedback

3
The M Test
Baseline Test
Test Medium
Follow-up Test?
Attitudinal Questionnaire
Year
N
9/S2
Extended MidYIS
-
-
Extended MidYIS
J
8/S1
or
Included as part of test
Additional Test
Yes
J
7
Extended MidYIS
-
4
Current MidYIS Participation Figures
Registration for MidYIS 2005/6 now taking place!
5
The M TestA baseline assessment designed
specifically for Value Added studies in secondary
schools

• Not an IQ Test!
• A curriculum-free baseline test. A test of
  developed ability
• Fits into one lesson - No pre-test preparation
  necessary
• Fully standardised administration - therefore
  fair to schools
• Innovative, up-to-date content
• Predicts subsequent achievement (Predictive
  Validity)

6
The M Test

• 2 equivalent formats

• Computer-based
• Online or software-based versions available
• Adaptive test questions suited to the ability
  of the pupil
• Efficient no time wasted answering questions
  that are too easy or difficult
• Number of pupils tested at one time limited by
  number of computers available
• First feedback ready online within 24 hours
• Full Baseline Feedback in about a week
• Enjoyable experience

• Paper-based
• No pre-test set-up
• Can be done in hall or in form groups
• Administered by tape recording
• Marked by computer
• Baseline Feedback in about 3 weeks

7
M Paper Test - Front Cover

• 45 minutes of testing time, administered by tape
  recording.
• Year 7, 8 9 Tests follow similar format.

8
M Paper Test - Practice Sheet

• Tape recorded instructions ensure all pupils know
  how to complete the answer boxes

9
M Paper Test - Vocabulary

• 5 minute test
• Pupils must choose the word from the four options
  on the right, that is most similar to the word on
  the left

10
M Paper Test - Maths -1

• 15 minute test
• Measures fluency and speed as well as
  mathematical ability
• Constructed answer and multiple choice questions

11
M Paper Test - Maths -2

• Long test to minimize ceiling effects

12
M Paper Test - Proof Reading

• 5 minute test
• Find mistakes in the text such as spelling,
  capital letters, punctuation etc.

13
M Perceptual Speed Accuracy Test

• 2 minute, speeded test
• Pupils must match sequences of letters, numbers
  and/or symbols on left with four possible options
  on the right

14
M Paper Test - Cross Sections

• 5 minute test
• Which solid has been cut to produce the cross
  section?

15
M Paper Test-Block Counting

• 5 minute test
• How many small and how many large blocks are
  there?

16
M Paper Test - Pictures

• 5 minute test
• Adding pictures together, subtracting pictures
  and following sequences of pictures.

17
M Computer Based Test - Vocabulary
18
M Computer Based Test - Maths
19
M Computer Base Test - Cross Sections
20
The M Test

• No marking required by school
• Accurate results returned promptly
• Results for each pupil clearly presented in Excel
  files
• Nationally-Standardised Scores
• Predictions to Key Stage 3 and GCSE/Standard
  Grade examination
• Value Added Feedback to KS3 and GCSE/Standard
  Grade included in cost
• Confidentiality
• Credibility - strict administration of tests
  which are then marked and analyzed externally to
  the school
• Support by phone, e-mail, INSET and conference
  dedicated software helplines
• Access to all feedback and documentation on
  secure website

21
The M Test - Summary

• No pre- test preparation needed
• Marked by scanning or computer
• Administered by audio tape/computer, fits in one
  lesson
• Vocabulary, Maths, Cross Sections, Block
  Counting, Pictures, Proof Reading, and Perceptual
  Speed and Accuracy sections
• Baseline feedback within 1-3 weeks of returning
  booklets

22
M Baseline Feedback

• Nationally-Standardised Feedback
• How did pupils do on the MidYIS test?
• What strengths and weaknesses do they have?
• As a group how able are they?
• Predictions
• Given their performances on the test, how well
  might they do at KS3 or GCSE or Standard Grade?

23
M Timetable of Feedback
- The main batch of test booklets should be
completed and returned for processing by the end
of Term1.
- Long-term absentees and new starters can be
tested any time up until Easter. Remember to keep
a few tests and a tape! Updated results can be
downloaded from the web.
24
M Baseline Feedback - Nationally Standardised
25
M Baseline Feedback - Nationally Standardised
       National Mean 100, Standard Deviation
15        4 MidYIS Performance Bands A, B, C,
D        Averages Band Profiles for the
cohort        95 of scores lie between 70
130        No ceiling at 130 or floor at 70-
26
Bands, stanines, percentiles, standardised
scores
C
B
A
D
Standardised scores (MidYIS Test Scores)
Percentiles
Stanines
M Baseline Feedback
27
M Baseline Feedback Nationally StandardisedVocabu
lary Band Profile Graph

• Monitor intake profile over time
• An intake like the national sample, in terms of
  its average ability and range of abilities, would
  have 25 of pupils in each band

28
M Baseline Test - Individual Pupil Record Sheet

• Bands
• Stanines
• Percentiles
• Standardised scores

Slide 38
29
M Baseline Feedback

• For each pupil in each section
• Nationally-Standardised Scores
• Mean 100, Standard deviation 15
• National quartiles A,B,C and D
• Average scores
• Band profile graphs
• Also
• Individual Pupil Records including stanines and
  percentiles
• Standardisations for Independent schools, LEAs,
  other consortia

30
M Baseline Feedback
Predictions...
Average performance by similar pupils in past
examinations
31
M Predictions Feedback
Key Stage 3 Score
MidYIS Test Score
32
M - Predictions Feedback
Trend line (regression line)
33
M - Predictions Feedback

• 3 Core KS3 and 9 Non Core KS3 subjects
• Over 30 GCSE subjects
• Up to 10 short course GCSE subjects
• Up to 8 Vocational GCSE subjects

34
GCSE Points Scale A8 A7 B6 C5 D4 E3 F2 G1
U0
M - Predictions Feedback

• Predictions outside normal range displayed in
  blue
• Value Added adjustments can be made

35
M Predictions Feedback -Chances Graphs
30 chance of a grade D the most likely single
grade. 70 chance of a different grade
0
1
2
3
4
5
6
7
8
Chances Graphs based on Pupils MidYIS Test Score
36
Not a label for life...just another piece of
information

• The Chances graphs show that, from almost any
  baseline score, students come up with almost any
  grade - - -there are just different probabilities
  for each grade depending on the baseline score.
• In working with students these graphs are more
  useful than a single predicted or target grade
• Chances graphs serve as
• a warning for top scoring students and
• a motivator for low scoring students

37
M Predictions Feedback - Summary

• For each pupil
• Predictions for 3 Core KS3, 9 Non Core KS3
  subjects, over 30 GCSE subjects, up to 10 short
  course GCSE subjects, and up to 8 Vocational GCSE
  subjects
• Average performance of former pupils with similar
  MidYIS scores
• Display as point predictions, grades/levels or
  QCA scales
• Pupil Chances graphs
• Can adjust predictions
• Also
• School chances graphs for each subject
• Percentage 5A-C
• Each pupils odds of achieving 5 A-C
• School 5A-C chances

38
M Value Added Feedback

• For each subject, answer questions
• Given their abilities, have pupils done better or
  worse than expected?
• Can we draw any conclusions at the department
  level?

39
M Value Added Feedback

• National Regression Line with your schools data
  superimposed
• Have any groups over or under achieved?

40
M Value Added Feedback
Value Added feedback - pupil level by subject
41
M Value Added Feedback - Raw Residual graph
Average subject-level performance in fractions of
a GCSE grade
Blue bars show positive raw residuals Yellow bars
show negative raw residuals
42
M Value Added Feedback - Standardised Residual
Graph
Standardised Residuals shown with confidence
limits at 2 (95) and 3 (99.7) standard
deviations Standardised Residuals can be compared
fairly between subjects and over years
43
M Value Added Feedback - Summary

• For each pupil in each subject
• Raw residual Achieved predicted
• Standardised residual allows comparison between
  different subjects and years
• At subject level
• The higher the average standardised residual the
  better (regardless of the width of the confidence
  bounds)
• Confidence bounds are narrower with more pupils
• If average standardised residual lies within
  bounds you cannot draw any conclusions

44
Thank you Contact Details
E-mail Nicola.Forster_at_cem.dur.ac.uk
Or midyis_at_cem.dur.ac.uk
Telephone [phone]
Website http//www.midyisproject.org