Quality Assurance as a means of raising standards

1
Quality Assurance as a means of raising standards

• NABSE Annual Conference 2005

2

• Emphasis on BTECs
• Quality in assignment design
• Internal verification
• Briefs
• Assessment decisions
• Late work
• What the EV expects
• Issues in 2004/05
• Outcomes to date
• Future developments

3
BTEC Assignment design

• Two aspects monitored in NSS of selected units
• Assignment briefs
• Assessment decisions
• Flawed assignment briefs inaccurate assessment
  decisions
• Send briefs to EV for selected units prior to
  visit

4
BTEC learning outcomes and assessment criteria

• Learning outcomes give an overview of what the
  learner is expected to do to achieve the unit
• You cannot assess or grade against the learning
  outcomes
• Assessment Guidance grid used to assess and grade
  learners work

5
BTEC Unit content

• Amplifies the content coverage required when
  addressing the assessment criteria
• Indicates the extent of coverage required in
  delivery
• Any content that begins with e.g. is indicative
  
• ALL aspects of the listed topics should be
  covered in learners work where the list is not
  indicative and not introduced by e.g.

6
BTEC Good assignment briefs

• Has
• Scenario in a vocational context
• Is interesting
• Clearly presented with tasks indicating which
  assessment grading criteria can be evidenced
  next to tasks
• Uses a variety of methods of assessment

7
BTEC Assignment tasks

• Tasks should allow the learner to fully cover the
  grading criteria
• Pass describe, show, identify, select, use
• Merit explain in detail, analyse, monitor
• Distinction assess, evaluate, justify,
  criticise, initiate
• Tasks dont have to repeat the criteria BUT
  departure from the wording must not misdirect the
  learner

8
BTEC Assignment briefs fit for purpose

• Covers the criteria?
• Vocationally relevant?
• Correct level?
• Clear language?
• Guidance given?

9
BTEC IV

• All briefs must be IVd prior to delivery
• Ensure Fit for purpose
• Allow time for amendments after IV
• IV evidence must be made available to EV
• Date and signature alone is NOT acceptable
  evidence

10
BTEC Feedback

• Must clearly evidence the achievement of the
  criteria annotate on work
• Record on front sheet
• Criterion referenced
• IV Feedback must be feedback on assessment on
  the learners work
• Provides audit trail

11
Late work

• The QCA require work to be assessed and graded on
  the basis of the evidence submitted
• Centres cannot penalise learners for late work by
  issuing a lower grade than that should be awarded
  on the basis of the evidence submitted
• This is both a quality and policy issue for the
  centre

12
2005-06

• Centres will be required to submit work that
  covers at least one group of Pass, Merit
  Distinction criteria
• Discourage less than 3 or 4 criteria submitted to
  EV
• IVA must be completed units (as 04/05)
• Standardisation as well as IV required

13
The EV will check

• There is an effective IV process operating at
  programme level
• Briefs prior to issue
• Assessment decisions 50
• Briefs fit for purpose
• IV records available for audit
• IV recommendations are actioned and recorded

14
The EV will check (2)

• Assessed learner work
• IVd prior to return to learners
• Accuracy of assessment decisions are checked in a
  systematic way
• Effective IV records are available for audit
• IV recommendations actioned and recorded

15
The IV process

• Accurate and consistent
• Across teams and assessors
• Completed systematically
• Adequate audit trail available
• Completed fully, accurately and on time
• Allows for remedial action

16
EV check on IV

• Evidence that it is rigorous and robust
  feedback there NOT just signature and date
• Objective improved programme over time
• IV has
• Checked assessments relates to BTEC requirements
• Checked standardisation of assessment

17
EV check on IV (2)

• Checked validity of evidence
• Safeguard integrity of certification
• Checked that quality feedback is given to the
  learner
• Ensured every assessor is sampled over time
• Ensured standardised documentation is used

18
Some IV realities

• Undertaken just before EV visit
• Pay lip service to it
• Management not signed up to it
• No time allowed for IV to carry out duties
• Teams not signed up to it
• Dont understand the Why? How? When?
• Reluctance and confidence to criticise
  colleagues
• Focus on learner work not assessment
• Feedback on learner work not assessment
• Not providing evidence of remedial action

19
Some IV realities (2)

• Do it because NSS requires it
• Evidence only signature date
• Brief, general comments on assessment decisions
  covering all learners
• Inappropriate documentation
• Full documentation not made available
• Time issue little time left for QA
• In schools unfamiliar practice
• In colleges may be allocated to the one with
  the lightest timetable
• IV lacking confidence

20
Some IV realities (3)

• Not undertaken at right time, briefs IVd
  retrospectively or not at all
• No time for remedial action if brief IVd just
  before issue
• Teams not able to meet often enough
• Poor leadership
• Lack of planning time for course delivery
• Last minute panic for assignment preparation

21
2004/05 NSS/IVA No

• Three main reasons
• Briefs misdirect learner
• Lacking in content
• Lacking in depth/ level

22
2004/05

• To date both
• No persistent Nos in Business
• Less than 1 have requested second review of EV
  decisions
• Overall 64 Yes on first sample
• BTEC First diploma/ Certificate - 86
• BTEC National Award 89
• BTEC National Certificate 81 overall, 38 year
  1, 80 year 2
• BTEC National Diploma 79 overall, 34 year 1,
  80 year 2

23
Future developments

• New BTEC First 2006
• Focus group on BTEC National September 2005
• e Business will not be redeveloped
• Recent survey on specialist Introductory

24
(No Transcript)