Canadian Evaluation Society Ontario Chapter

1
Canadian Evaluation SocietyOntario Chapter

• Member Training Survey Results
• Prepared by Jeff Cole
• Georgian College Research Analyst Program
• April 2004

2
Overview

• Introduction
• Participation
• Results
• Trends
• Conclusions
• Future Research

3
Introduction

• Recap
• Survey to gather information about members
  interest in training
• 15 options 2 other categories
• Responded on scale of 1 (low interest) to 6 (high
  interest)

• Method / Sample
• Invitation by email to approx. 450 members
• Accessed online
• 108 respondents
• 24 response rate
• Average completion time 3 min. 28 sec. ?

http//firstclass.smcdsb.on.ca/jcole/CESO
4
Participation by Location
n108
5
Participation by Sector
6
Results Overall Interest?

• Indication of interest in training
• Theoretical grand mean 3.5
• Actual grand mean 3.7
• Conclusion Above average interest in receiving
  training

1
1
2
3
4
5
6
Low Interest
High Interest
7
Results Best Estimates

• Looked at mean score for each of 15 training
  topic options
• Ranked options 1 15 based on mean score

8
Results Above Average
9
Results Below Average
10
Results Comments

• 26 suggestions for other evaluation related
  training topics
• Suggestions for other sources of training
• Statistics Canada
• Essential Skills Series
• Internal Provincial Government training
• University of Guelph Program Evaluation course
• Wellesley Central Help Corporation
• Health Communication Unit, U of T
• Group Works facilitation training
• York University Summer Stats Courses

11
Trends Cross tabulations

• Tested to see if certain sectors expressed
  interest in particular topics - none
• Tested to see if there was a difference between
  interest in topic among GTA vs. Elsewhere - none
• Other trends?

12
Conclusions

• Mean scores are good indicators, but
• No guarantees
• If we offer it, will they come?
• When? Where? How much?
• How will these factors impact interest /
  attendance?
• What about the other 76 of members?

13
Future Research

• Keep surveying
• Short is good
• Web / fax worked
• Did we reach everyone?
• Ask about other potential influential factors
• Years as evaluator / as member
• Tolerances for travel distance, cost, length of
  time
• Optimal time of year, etc.