CAA using QuestionMark Perception

1
CAA using QuestionMark Perception

• by
• Catherine Ogilvie
• Educational Development Officer

2
Why Use CAA?

• enhance learning by using CAA
• broaden range of knowledge
• improve feedback to both students and lecturers
• variety of assessment
• encourages and motivates
• infinitely repeatable
• instant results

• objective and consistent
• reduce marking loads
• aid administration efficiency
• creation of easily accessible banks of questions
• more interesting and interactive

3
What can CAA test?

• Primarily focuses upon objective testing

BUT this is only good at testing simple factual
recall and not much else
4
Blooms Taxonomy

• knowledge
• comprehension
• application
• analysis
• synthesis
• evaluation

relatively easy to use CAA to test these 4 levels
more difficult to use CAA to test these levels
5
Example Questions

• Web address https//qm.rgu.ac.uk/q/perception.dll
  
• Name RGU
• Password RGU
• More examples at
• http//www.questionmark.co.uk
• Try It Out, Sample Assessments
• Scroll down and click on the appropriate link

6
QuestionMark Perception

• Creates questions and organises them into tests
  or surveys for online delivery

7
Building an Assessment
Create a bank of questions
Organise into tests
Publish onto the webserver
Access tests through the internet
Results collected analysed
8
Question Types

• Multiple Choice
• Assertion/Reason
• True/False
• Yes/No
• Selection
• Multiple Response
• Likert Scale
• Matrix

• Fill in the blanks
• Text Match
• SAQ / Essay
• Hotspot
• Drag and drop
• Ranking
• Numeric

9
Question Manager Structure
the question text
the type of question
possible options to select
different feedback scoring can be created
10
Assessment Manager

• Once questions have been created in Question
  Manager, use Session Manager to put them into
  session.

11
Summative Assessment

• Question Checklist
• Pre Examination Checklist
• Examination Checklist
• Contingency Plan

12
Contingency . . .

• Restart computers?
• Transfer to new computer?
• End assessment / exam?
• Provide a paper copy?
• Spare equipment?
• Loss of results?

13
Potential of Cheating?

• present same questions in random order
• random questions from question bank
• randomise the order of the answer choices/options
• privacy screens
• seating arrangements

14
Evaluation

• Staff
• Student
• Question Evaluation
• are there some questions students get
  consistently wrong
• are there distractors which are always selected
  by students

15
Efficiency

• how much time spent on assessment
• devising or selecting assessment tasks
• administering the assessment
• grading/marking
• giving feedback
• was it time well spent?

16
Example Questions

• Web address https//qm.rgu.ac.uk/q/perception.dll
  
• Name RGU
• Password RGU
• More examples at
• http//www.questionmark.co.uk
• Try It Out, Sample Assessments
• Scroll down and click on the appropriate link

17
Creating Questions

• New, local repository, called KBTU and your name
• New topic, Example Questions
• Add a Question

18
Multiple Choice Type Question

• In which country is Almaty located?
• Kazakhstan
• Uzbekistan
• Turkmenistan
• Tajikistan

19
Multiple Response Type Question

• Select all the official languages of Kazakhstan?
• Russian
• Kazakh
• Kyrgyz
• Tajik
• Turkmen
• Uzbek
• English
• French
• German

20
Multiple Response

• Select which of the following towns are in
  Kazakhstan
• Almaty
• Ust-Kamenogorsk
• Kyzylorda
• Paris
• New York
• London

21
True/False

• Almaty is the capital of Kazakhstan

22
Hotspot

• Drag and drop the pin marker onto the country of
  Kazakhstan.
• clsco_worldmap
• Markerpin
• Or use the following graphics . . .
• clsco_mapofasia
• clsco_Kazakhstan

23
Hotspot

• Drag and drop the text, Almaty, to the correct
  location of Almaty on the map

24
Drag and drop

• Drag and drop the city names to the correct
  location on the map
• Clsco_mapofkazakhstan
• clsco_kyzylorda
• clsco_ustkamenogorsk
• clsco_almaty

25
Drag and drop

• Drag and drop the animal name into the box below
  the animal.
• The background graphic to be used is
  clsco_animalnames
• The text to drag and drop is
• clsco_koalatext
• clsco_ostrichtext
• clsco_polartext
• clsco_chimptext

26
Matching

• Match the city to the country
• London United Kingdom
• New York United States of America
• Paris France
• Almaty Kazakhstan

27
Fill in the blanks

• The letters CAA represent Computer Aided Assessent

28
Pull Down List

• Where are the following Universities located
• KBTU
• EKSTU
• KKSU
• Almaty, Ust Kamenogorsk, Kyzylorda

29
Exercise

• Create at least one of each of the following
• Multiple Choice
• Multiple Response
• Pull Down List
• Fill in the blanks
• Hotspot or Drag and Drop