How can online assessment

1
How can online assessment feedback help
students learn?

• University of Brighton Learning and Teaching
  Conference
• 16th of July 2003
• Patrick Saintas, Nursing and Midwifery
• Dr Dick Rayne, Jenny Phillips and Ellen McCarthy,
  Birkbeck College, The OLAAF Project

2
Workshop Aims

• To introduce you to the OLAAF project
• To demonstrate an Interactive Context Analysis
  Tool
• To give an example of how INaM will be using CBAF
  
• To demonstrate examples of assessments produced
  using TRIADS
• To explore the benefits and barriers to using
  CBAF

3
Introducing OLAAF

• OnLine Assessment and Feedback
• Three year project (until September 2005)
• Funded by HEFCE Fund for the Development of
  Teaching and Learning
• To support authors in the design, delivery and
  evaluation of Computer Based Assessment with
  Feedback (CBAF)

4
OLAAF Network

• Consortium Partners
• Birkbeck College
• University of Birmingham
• University of Brighton
• Brunel University
• London Metropolitan University
• University of Plymouth
• University of Wales College of Medicine

5
OLAAF Network

• Interest Group
• British School of Osteopathy
• Edgehill College
• Keele University
• Kingston University
• Warwickshire College
• Manchester Metropolitan University
• University of Ulster

6
OLAAF support for staff

• Workshops To develop and embed project outcomes
• OLAAF Web Log http//mac4.biol.bbk.ac.uk8080/On
  line forum to facilitate discussion, exchange of
  ideas and technical support for the OLAAF Network
• OLAAF Annual ConferencesTwo-day focused events
  bringing together OLAAF participants to report
  experiences, consolidate ideas, and plan future
  directions
• Quarterly Newsletter

7
OLAAF support for staff

• Project Outcomes
• Assessment Toolkit
• Context Analysis
• Evaluation Guide
• CBAF Examples
• Case Studies

8
Assessment Toolkit

• Assessing higher cognitive skills
• Assessment and learning outcomes
• Assessment Structure
• Impact on student learning strategies
• Uses of scoring
• Feedback to students
• Usability and Accessibility

9
Context Analysis

• A database-driven, structured questionnaire to
  support staff in formulating their individual
  approach to CBAF.
• Demonstration

10
OLAAF at Brighton

• Institute of Nursing and Midwifery
• Numeracy skills is an outcome for the foundation
  Programme
• Teaching of Numeracy in the common foundation
  programme in the Pre-registration Diploma in
  Nursing course and the BSc Hons Nursing
• The cohorts have mixed abilities for Numeracy and
  consist mainly of mature home and overseas
  students
• Formative and diagnostic use
• Randomised number generation allows practice

11
Demonstration of Questions

• Assessments produced using TRIADS (Tripartite
  Interactive Assessment Delivery System) a product
  of the Centre for Interactive Assessment
  Development (CIAD) at University of Derby.
• The TRIADS system, based on Macromedia
  Authorware, was chosen as the primary authoring
  tool for its ability to deliver highly
  interactive computer-based tests capable of
  testing higher cognitive skills.

12
Benefits and Barriers

• In Pairs
• Think about your perceptions and/or experience of
  computer based assessment
• Then write down
• 3 barriers to using CBAF
• 3 benefits of using CBAF
• Discussion will follow

13
Conclusion

• How to get involved in the OLAAF project
• Sign up for quarterly email newsletter
• Visit the web site for resources and events,
  including the Context Analysis tool
• Submit case studies and evaluate our materials
• Join in the online discussion OLAAF Web Log
• Any other ways we can support you??

14
Links

• OLAAF Web Site
• www.bbk.ac.uk/olaaf
• OLAAF Web Log http//mac4.biol.bbk.ac.uk8080/
• Context Analysis Tool http//www.bbk.ac.uk/olaaf/
  acr_context.htm