Quality Assurance

1
Quality Assurance
2
Quality Assurance - Internal Moderation

• These processes need to be documented
• to assure the quality of assessments
• to improve assessments for future use
• to ensure continuity when staff or
  responsibilities change
• to ensure materials are kept for external
  moderation
• so the school and NZQA can monitor internal
  quality assurance

3
Quality Assurance - Internal Moderation

• The revised Internal Moderation Cover Sheet
  provides a
• step-by-step guide to
• 1 Critiquing the materials before use
• 2 Ensuring consistency across classes
• 3 Verifying sample grades and benchmarking
• 4 Logging professional interactions on
  assessment
• 5 Reviewing materials before re-use

4
www.nzqa.govt.nz/ncea/prof/index.html under
Assessment Documents
5
Quality Assurance - External Moderation

• 33 full and part-time moderators appointed
• 12 submission dates
• Increase in student work samples from 3 to 10
• 2 to 21/2 times the number of standards
• random sampling from July (details yet to be
  decided from 2007 research)

Advice July to October submissions keep all
materials for the standards in the moderation
plan until you know the random sampling detail
6
What to send to the moderator?

• Secondary Moderation Cover Sheet include
  standard version (not the version number of a TKI
  sample)
• the assessment (activity/task/instructions to
  students) and any teacher instructions or other
  guidance not in the student brief
• any resources that accompany the assessment
• the assessment schedule specific to the
  assessment
• evidence statements (examples of student
  answers at each grade)
• judgement statement (interpretation of
  evidence/sufficiency to award the grade)
• samples of student work

7
Samples of student work

• Submit
• material that has not been submitted for
  moderation before
• material from this year or from last year, if
  this years
• is not yet available
• Unit standards 4 samples across the grades
• Achievement standards 8 samples across the
  grades

8
Samples of student work

• If VISUAL evidence is provided-
• Send it in a format the moderator can use - all
  performance evidence must be in VHS standard
  format or CD-R or DVD-R
• and
• Accompanying detail
• Visual Evidence Cover Sheet
• Student Identification on Visual Submissions

www.nzqa.govt.nz/ncea/acrp/secondary/docs/mod-vise
vidence-cvr.pdf
9
Samples of student work

• Visual Arts, Graphics, Technology can send
  photographic or other evidence together with
  teacher-signed attestation, checklist etc.
• CD/DVD
• Use a new, unused CD-R or DVD-R
• File Format Type
• The following file format types are
  acceptable
• Portable Document Format (.pdf)
• JPEG Image Format (.jpg, .jpeg, .jpe )
• Graphics Interchange Format (.gif)
• Standard formats as used in Windows Media Player
• PowerPoint
• QuickTime
• Schools must comply with external moderation even
  if material is to be dismantled for use in
  another standard this needs to be planned for
  at the outset of the assessment

10
Retention of student work- External Moderation

• Samples of student work should be retained in the
  school until they can be replaced with updated
  samples
• Where fewer than 4 (US) or 8 (AS) samples of
  student work are submitted, PNs should check the
  number of results reported in the previous year
• Random samples will be required from schools with
  a July moderation submission date or later

11
Retention of student work - Benchmark Samples

• Benchmarks may or may not be the samples of
  student work for external moderation
• Benchmarks are carefully selected and annotated
  samples of student work used to
• refresh professional memory
• help teachers new to the standard
• ensure consistency of marking from year to year
• Samples should be updated if even better ones are
  found

12
The External Moderation Summary

• Issues
• Standards with no results reported and not
  negotiated out of the moderation plan generate a
  Materials Not Received report
• Other providers codes were not entered
• The assessment schedule was missing or did not
  include evidence statements specific to the
  assessment
• The same samples of student work were resubmitted
• No materials were sent for a selected standard
• No student work was sent although results were
  reported
• Fewer than 4 or 8 samples of student work were
  sent although more results were reported

13
Non-Compliance

• A school will be regarded as failing to comply
  if
• it has failed to establish rigorous internal
  moderation processes
• it has failed to submit materials for external
  moderation by the submission date
• it has failed to include all required material
  for external moderation
• invalid assessment materials are repeatedly
  submitted for external moderation
• it has not actioned any of the requirements set
  out in a Managing National Assessment report
• it has refused to submit to a Managing National
  Assessment systems check
• it has failed to meet the requirements of the
  Quality Assurance Standard for Accreditation of
  Secondary Schools