Analysing qualitative feedback using CEQuery and SPSS Text

1
Analysing qualitative feedback using CEQuery and
SPSS Text

• Beverley Oliver, Beatrice Tucker and Julie-Ann
  Pegden

2
eVALUate

• Online
• Unit survey
• Automatic (mandatory)
• Reported to staff and students
• Teaching survey
• User initiates (voluntary)
• Confidential (promotion)

3
eVALUate unit survey

• 11 quantitative items
• 2 qualitative items
• Response rate 100

4
eVALUate unit survey

• 11 quantitative items
• 2 qualitative items
• Response rate 100
• OK 28.5

5
eVALUate quantitative items

• The learning outcomes in this unit are clearly
  identified.
• The learning experiences in this unit help me to
  achieve the learning outcomes.
• The learning resources in this unit
• The assessment tasks in this unit evaluate my
  achievement of the learning outcomes.
• Feedback on my work in this unit .
• The workload in this unit is appropriate to the
  achievement of the learning outcomes.
• The quality of teaching in this unit .
• I am motivated to achieve the learning outcomes
  in this unit.
• I make best use of the learning experiences in
  this unit.
• I think about how I can learn more effectively in
  this unit.
• Overall, I am satisfied with this unit.

6
eVALUate quantitative items

• The learning outcomes in this unit are clearly
  identified.
• The learning experiences in this unit help me to
  achieve the learning outcomes.
• The learning resources in this unit
• The assessment tasks in this unit evaluate my
  achievement of the learning outcomes.
• Feedback on my work in this unit .
• The workload in this unit is appropriate to the
  achievement of the learning outcomes.
• The quality of teaching in this unit .
• I am motivated to achieve the learning outcomes
  in this unit.
• I make best use of the learning experiences in
  this unit.
• I think about how I can learn more effectively in
  this unit.
• Overall, I am satisfied with this unit.

Engagement?
7
eVALUate qualitative items

• What are the most helpful aspects of the unit?
• How might the unit be improved?
• (limit 600 characters)

8
Findings Sem 1 2006 event

• 25090 surveys
• 67 at least 1 comment
• Divisional variation
• Health Sc (71)
• CBS (61)
• Hum (67)

9
Qualitative feedback

• Most helpful aspects
• (59 and 181 chs)
• How unit improved
• (58 and 137 chs)

10
Student characteristics
11
CEQuery analysis

• Most helpful aspects
• Unit design Methods of learning
• Staff Quality attitude
• Support Learning resources
• Staff Accessibility responsiveness
• Staff Teaching skills

12
CEQuery analysis

• How unit might be improved
• Support Learning resources
• Unit design methods of learning and teaching
  structure and expectations flexibility and
  responsiveness
• Assessment Standards expectations feedback and
  return
• Staff Quality and attitude teaching skills
  accessibility and responsiveness

13
Limits of CEQuery

• Thats very nice
• What are really they saying about ?
• Overall, course, unit

14
SPSS text analysis
15
SPSS text analysis
16
SPSS text analysis

• The tutorials are helpful because
• info is reinforced and clarified
• interactive and practice and
• students like case studies, examples, solutions

17
SPSS text analysis
Engagement?

• The tutorials are helpful because
• info is reinforced and clarified
• interactive and practice and
• students like case studies, examples, solutions

18
What else?

• Quantitative qualitative?
• Feedback highest disagreement and UJ
• We read all the comments
• Are they abusive?
• What were the main messages?

19
So what?

• Transparency
• University-wide comparisons
• Growing student participation
• Growing student voiceUSRs
• Any improvement yet?

20
Now what?

• Embed, research, explore eVALUate
• Stronger LT team
• Stronger ties with Planning
• But, theres more

21

• LTPF AUQA gt eVALUate ACR C2010

22
Curriculum 2010

• Review and redefine all awards
• Establish course sustainability
• Map every course curriculum
• Manage course data

23
But

• LTPF AUQA gt eVALUate ACR C2010

24
But

• LTPF AUQA gt eVALUate ACR C2010
• If eVALUate ACR C2010

25
But

• LTPF AUQA gt eVALUate ACR C2010
• If eVALUate ACR C2010
• Then LTPF AUQA ?

26
But

• LTPF AUQA gt eVALUate ACR C2010
• If eVALUate ACR C2010
• Then LTPF AUQA ?
• ?

27
But the keys are

• Course experience
• Good teaching scale

28
But the keys are

• Course experience
• Good teaching scale
• You must love you subject,
• love your students,
• and be utterly determined that they shall learn.