Evaluation of The San Francisco Foundation Oral Health Initiative

1
Evaluation of The San Francisco FoundationOral
Health Initiative

• Dana Hughes
• University of California,
• San Francisco
• August 22, 2006

2
Purposes of the Evaluation

• Whether the Initiatives objectives were met
• Whether grantees achieved their objectives
• Whether funded projects can be replicated and
  under what conditions
• What conditions are needed to sustain funded
  projects
• Ascertain the Foundations ability in launching
  and managing the Initiative

3
Purpose of the First Interview

• Review purposes and goals of projects
• Clarify objectives, data collection and analysis
  plans
• Offer assistance in developing measurable
  objectives, as needed
• Assess progress thus far, identify/trouble shoot
  challenges
• Discuss the role of the Foundation in launching
  the Initiative

4
Early Results

• Most projects are on track
• Some are ahead of schedule

5
Early Lesson

• The more developed and detailed the proposal, the
  easier it has been to launch the projects,
  anticipate necessary steps and move along on
  schedule.

6
Unanticipated Issues(for some projects)

• HIPPA training-Institutional Review Board (IRB)
  approval
• Rules are more strict than previously
• When reporting on patient contacts, considered
  research
• Requires assuring protection of human subjects

7
Technical Assistance

• No requests yet for technical assistance
• But it is available

8
The San Francisco FoundationPerformance

• Generally very favorable
• Appreciation for joint meetings
• Small number of minor issues

9
Issues to Consider Over Time

• What works and what doesnt
• How can TSSF and evaluators help with challenges?
• What is needed to replicate projects
• Ideas for sustained funding

10
Reporting Template

• Striving to produce unified reporting to The San
  Francisco Foundation and the evaluators
• Qualitative
• Quantitative
• Financial

11
Content of Qualitative Reporting

• Project description
• Progress towards objectives
• Significant, unanticipated events
• Project partnerships
• Project impact
• Anticipation of difficulties with the timeframe
• Preliminary lessons learned
• Extra activities/accomplishments
• Financial sustainability

12
Content of Quantitative Reporting

• By age
• Number of services rendered (by type)
• Number of mobile van visits (by type)
• Number of new insurance enrollees
• Number of dental providers recruited
• Number of new provider sites
• Number of dentists trained

13
Content of Quantitative Reporting(continued)

• Aggregate demographic characteristics of the
  population served
• Language spoken
• Race and ethnicity
• Poverty level
• Insurance status by type

14

• Questions and Comments?