Features of a Good Examination

1
Features of a Good Examination

• Validity
• construct validity (syllabus)
• content validity (weightings in the exam)
• consequential validity (outcome of the exam)
• skills required and examination format

2
Features of a Good Examination

• Reliability
• intramarker (same examiner)
• intermarker (different examiners)
• examination time (length of examination)

3
Features of a Good Examination

• Fairness
• examination bias (content)
• written examination (conditions, timing)
• listening component (accent and sound)
• oral component (structure and delivery)
• access to past papers

4
The Syllabus

• A teaching syllabus
• An examination syllabus
• An examination syllabus needs to be updated
  regularly.
• Syllabus needs to be set by panel that includes
  professionals/stakeholders
• It needs to outline the content that the
  candidates will be assessed on.

5
Content of an exam syllabus (1)

• Aims
• Objectives for each section
• Content
• Weightings for sections and level of difficulty
• Grade descriptors
• Grade D in written examination fair
  performance not good
  enough to proceed to oral component.

6
Content of an exam syllabus (2)

• Procedural information for candidates
• Specimen paper with new/updated syllabus in the
  public domain
• Exemplars to show level/s expected
• Examiners reports giving feedback on performance
• Other?

7
Quality Assurance in the Exam Process

• Chairperson - responsible for the complete
  process
• Setting the examination paper (panel)
• Leading the marking process (panel)
• Setting standards and issuing results (panel)

8
Setting the Exam Paper

• A panel is responsible for setting the
  examination paper
• A reviser (not involved in the setting) to
  work out paper content validity, format,
  weightings and timing.
• Issues of Security
• location where panel meets to set paper.
• access to computer/s where it is typed and saved.
• communication among setters via email
• printing and storing the examination papers.

9
The Oral Examination (1)

• Structure
• - sections and timing
• Purpose
• fluency in the language? and/or
• cognitive level of understanding content? and/or
• confirmation of performance in the written
  examination?

10
The Oral Examination (2)

• Assessment
• criteria set and used
• standardization using criteria
• examiners (number, training, expectations?)

11
The Written Examination

• Student identity not to be revealed to markers
• Script to be marked by more than one person
• Double blind marking for writing skills
• (marks/comments not to be written on script)
• Checking - allocation of marks and addition of
  marks
• Revision of Paper
• checking of marks and/or
• feedback to candidate written/oral components
• presence/absence of script?

12
Grading

• Descriptors for each grade recommended
• Gap between different levels needs to be
  significant - reliability issues
• Grade boundaries private/public?
• Breakdown of marks for the different sections
  (oral/written?)
• Results to be accessed on an individual level.

13
Examiners Report

• Input by all examiners for all components of the
  examination.
• Feedback to EFL Board (confidential)
• Feedback to teachers, candidates and prospective
  candidates.
• Report is to be in the public domain.