CONTEXTUAL FACTORS OF EVALUATION PRACTICES

1
CONTEXTUAL FACTORS OF EVALUATION PRACTICES

• Evaluation is a must in any program planning
  model
• There is a gap between model and practice of
  program evaluation
• In general evaluation models suggest
• Formal
• Systematic
• Comprehensive

2
Purpose of the Study

• To identify how contextual factors shape
  evaluation practices

3
Specific Research Questions

1. What are the evaluation practices of different
   adult and continuing education agencies in
   Malaysia
2. What are the contextual factors involved in the
   evaluation practices of the agencies

4
RESEARCH METHODOLOGY

• Qualitative multiple case study
• Purposive Sampling
• Three types of organization
• Panel of experts
• Four criteria

5

• Data Collection
• Triangulation
• Semi structured interview guide
• Official documents
• Data Analysis
• Within case
• Cross-case

6
Findings

• Type of organization
• Agency A Continuing education
• Agency B Agricultural extension
• Agency C Entrepreneurial development

7

• Numbers of respondents
• Agency A 4
• Agency B 4
• Agency C 8
• Evaluation unit
• Agency A - Publication Consultancy Bureau
• Agency B Research Evaluation Unit
• Agency C Every departments conduct own
  evaluation activities

8

• Evaluation activity
• Agency A Informal process evaluation end of
  course evaluation
• Agency B Periodic evaluation throughout the
  program oral evaluation
• Agency C Periodic, informal evaluation
  throughout program and seminar

9
Contextual Factors

• Importance of evaluation to the organization
• Mission of public organizations
• Organizational structure of the
  organizations
• Managements attitude toward evaluation

10

1. Ability of the evaluators
2. Culture of the clientele
3. Tradition bound evaluation practices

11
Conclusions

• Minimalist formal evaluation approaches
• Reaction level
• Monitor input
• Findings are not fully utilized

12

• Not comprehensive nor systematic
• The four contextual factors
• Interconnected
• Collectively influence practice