Computer Assisted Assessment

1
Computer Assisted Assessment

• CAA encompasses the use of computers to deliver,
  mark and analyse assignments or examinations
• CAA can be used for
• Student monitoring
• Early detection of problems
• Testing a broad range of topics
• Easing the marking load
• Enabling more frequent testing

2
Potential Advantages of CAA

• Tests available on demand
• Automatic/randomised selection of questions
• Automatic marking
• Objective marking
• Self-assessment/immediate user feedback
• Detailed results analysis
• Can incorporate features to make assessment more
  realistic (sound, video)

3
Potential disadvantages of CAA

• Implementation can be costly and time consuming
• Students without IT skills may be disadvantaged
• Construction of questions requires skill and
  practice
• Support needed from all parties involved
• Security issues

4
Use in UK Higher Education

• National HE Survey by the CAA Centre
• 80 universities report some use of CAA
• 24 of assessment marked by OMR
• 56 of assessment distributed over closed network
• 24 distributed via the web
• Predominantly used in computing, science and maths

www.caacentre.ac.uk
5
CAA Projects and On-line Resources

• CAA Centre, University of Luton
• www.caacentre.ac.uk
• Scottish Computer Assisted Assessment Network
• www.scaan.ac.uk
• CAA Unit at Loughborough University
• www.lboro.ac.uk/service/ltd/flicaa/

6
CAA Tools

• Many types of software tools available
• Free Tools
• Commercial software packages
• Programming technologies
• Virtual Learning Environments

7
Free Tools

• CASTLE Toolkit
• Creating on-line multimedia assessments
• Easy to use
• Suitable for Self-assessment - allows students to
  monitor their own progress
• Only multiple choice question type
• www.le.ac.uk/ltg/castle

8
Commercial Tools

• Question Mark Perception
• World leader in computerised assessment software
• Wide range of question types
• Possible to add graphics, sound, video etc
• Range of reporting and analytical features
• Secure delivery of tests
• Demo software available from
• www.qmark.com

9
Virtual Learning Environments

• Tools which integrate features such as
• Lecture support material
• Chat discussion boards
• Course admin (calendar, lecture schedules)
• Assessment
• Usually dont require programming/HTML knowledge
• Local use at the UU
• TopClass www.wbtsystems.com/products/
• WebCT www.webct.com/

10
Implementing CAA

• Critical success factors (according to
  respondants of a CAA survey)
• Support (pedagogical and technical)
• Time to develop assessments and tests
• Ease of use
• Institutional commitment
• Case Study see the Luton Experience at
• www.icbl.hw.ac.uk/assessit/luton.htm

11
Summary

• CAA refers to the use of computers in assessment
• Advantages include automatic marking and
  immediate user feedback
• Many tools available, from free on-line services
  to sophisticated assessment packages
• Successful implementation requires institutional
  commitment, training and technical support

12
(No Transcript)