CanadaOntario LMDA Formative Evaluation

1
Canada-Ontario LMDA Formative Evaluation

• Program Standards and Evaluation Unit (PSEU)
• Programs Branch, SPPD
• Nov. 27, 2008

2
Purpose of Presentation

• To provide an update on the status of the
  evaluation
• To consider issues, process and timelines
  regarding field work of the external LMDA
  evaluator in relation to Employment Ontario
  activity

3
Evaluation Scope

• Timeframe
• Jan 1 2007 to Mar 31 2008
• Programs
• OEAS, OSD, OTWS, OJCP, OSEB, OLMP
• Issues (process evaluation)
• Client participation and satisfaction
• Client service process
• OEBSM service planning and implementation
• Governance

4
External LMDA evaluation consultant

• The RFP for the Canada-Ontario LMDA Formative
  Evaluation resulted in responses from 5 external
  evaluation consultants
• A joint Canada-Ontario review has selected TNS
  Canadian Facts which has been awarded the
  contract for the LMDA Formative Evaluation
• TNS has considerable experience in conducting
  both formative and summative LMDA evaluations in
  British Columbia, Alberta, North West
  Territories, Ontario and New Brunswick.
• TNS Project Manager is Keith Vodden

5
Evaluation Timelines

• Planning Nov 18 2008 to Feb 2 2009
• Data assessment, Document review
• Survey questionnaire and protocols
• Field work guides
• Methodology report and MTCU workshop
• Field work Feb 3 2009 to Apr 20 2009
• Survey
• Interviews
• Reports Apr 21 2009 to Sep 11 2009
• Technical reports
• Final report

6
Data Collection Methods

• Discussion Groups (10)
• Participants, staff, 3rd party service providers
• Central, East, North, West regions
• Surveys (2000 completed)
• Telephone survey of Participants (all regions)
• Key Informant Interviews (up to 20)
• Staff, employers, service providers, community
  groups
• Central, East, North, West regions
• Ontario Skills Development Case Study

7
Communication

• LMDA Formative evaluation update will be sent to
• MTCU staff
• OEBSM service providers
• Information will include
• Evaluation objectives
• Identification of selected consultant
• Timeframe for evaluation activity
• Possibility of being asked to participate in the
  evaluation
• Program Standards and Evaluation unit contacts
  for further information

8
Discussion

• Do you have any questions on the evaluation?
• Are there any issues or consideration we need to
  know about as we conduct the evaluation?