Evaluation Results

1
Evaluation Results

• Ohios SAMHSA
• Garrett Lee Smith Grant

2
Evaluation of Ohios Infrastructure for
Statewide Mental Health Check Ups
Responsivity Continuous Quality Improvement
Do-Study-Reflect-Plan
School Climate

Responsivity Consent Climate Referral Climate
Capability (Stakeholder perception of innovation
adoption)
Program Providers
Receptivity Family motivation to give consent,
complete referral
Output Consents and screenings offered Counts
Youth and Families
Activities consent, screening, referral
Outcomes Consents granted Referrals completed
3
Consents
NOT Returned
Total Offered
Row
Count
52
October 1, 2006- June 30, 2008
4
Consents
We need to improve consent rates by applying what
we have learned in Year 1 2 Barriers,
Challenges and Strategies Newsletter
5
What Works What DoesntBarriers,
Challenges and Strategies Newsletter

• Strategies Proven to Work
• Sending consent form home with begin-year
  registration
• Sending consent from a classroom combined with
  prevention education
• Strategies that are Not Effective
• Mailing consents
• Incentives

6
Education Mental Health Higher Consent Rates

• Of consents returned
• TeenScreen YES 63.4
• SOS YES 81.2

7
Project Totals

1. Screenings Offered 25,662
2. Consents Returned 12,232
3. Screenings 7,658
4. Clinical Interviews 1,936
5. Referrals Made 1,238

Oct 2006 June 2008
8
Program Outputs and Outcomes

1. Offer Screening
2. Obtain Parental Consent
3. Conduct Screenings
4. Conduct Clinical Interviews
5. Refer for Counseling

9
Consents by Program Type
  TeenScreen SOS Juvenile Justice
Consents Offered 85 13 2
Consents Distributed Not Returned 79 21 0
Consents Returned Yes 63 81 99
Consents Returned No 37 19 1
10
Screens by Program Type
  TeenScreen SOS Juvenile Justice TeenScreen
Screened 5,577 2,001 593
Screened Positive 29 9 48
Screened Negative 71 91 52
The TeenScreen Tool is more sensitive and finds
more positive youth.
11
Clinical Interview by Program Type
  TeenScreen SOS Juvenile Justice
Screened Positive 1601 191 286
Interviews Completed 1746 198 276
Youth Identified for Emergency Care 27 0 2
More interviews completed than positive due to youth interviewed due to debriefing results More interviews completed than positive due to youth interviewed due to debriefing results More interviews completed than positive due to youth interviewed due to debriefing results More interviews completed than positive due to youth interviewed due to debriefing results
12
Clinical Interview Results

• TeenScreen and SOS programs completed 100 of
  clinical interviews of youth positive
• TeenScreen programs identified 27 youth that
  needed emergency care

13
Referrals by Program Type
  TeenScreen SOS Juvenile Justice
Total referred after clinical interview 1084   131   196  
Completed Referrals 552 51 41 31 144 73
14
Crisis Referrals 27 (2.3)

• 18 Accepted by youth and parent
• 4 Accepted by parent not youth
• 1 Accepted by youth not parent
• 4 rejected by youth and parent

15
Does Follow-up Aid Intervention?

• 1238 Referrals made, 990 received first follow-up
  call
• 680 First appointments made
• 576 First appointments kept (85)
• 34 First appointments missed (5)
• 68 Made Second appointments (9 missed the 2nd
  appt.)
• Of 34 known missed first appointments,
• 5 Missed due to lack of interest
• 1 Missed due to provider not accepting insurance
• 3 Had transportation concerns
• 25 Did not report or reported other reasons

16
Referrals Rejected 116

• 72 (62) received follow-up call
• 4 made and kept an appointment
• 68 made no appointment
• 44 (38) not called

17
Referrals by type of site
18
System Motivation
18
19
Perception of Screening (Innovation Adoption)
20
Perception of Screening Questionnaire

• Stakeholders Perceptions of
• Compatibility
• Complexity
• Observability

21
Stakeholder Perceptions
22
Referral Climate
Youth
Parent
23
Referral Climate Items

• Provided choices and options
• Understood me
• Conveyed confidence
• Listened to me
• Encouraged questions
• Tried to understand how I see things before
  making suggestions

24
Referral Climate
25
Referral Climate
26
Referral Climate Findings

• Lowest Rated Youth Item
• The person who talked with me showed confidence
  that I can make changes if I want to

27
Referral Climate Questioner Findings

• Lowest Rated Adult Item
• The person who talked with me understands how I
  see things with respect to seeing a counselor