Monitoring Report

1
Monitoring Report 6

• Braam Oversight Panel
• March 23, 2009

2
Monitoring Report 6

• Published March 16, 2009
• Based on requirements of Revised Implementation
  Plan
• Reviewed by both parties in Braam public
  meetings during early 2008
• Published July 2008
• Action steps, outcomes, informational reports

3
Braam Action Steps
4
Action Steps

• Revised Implementation Plan includes 15 action
  steps that are subject to continued monitoring
• Status of all action steps is found in appendix
  to Revised Implementation Plan. 54 action steps
  had been found complete by the time Imp. Plan was
  revised (July 2008).
• Monitoring Report 6 assesses performance on
  these action steps through December 31, 2008
• Panel reviews progress based on Status Updates
  provided by the Department.

5
Action Steps Summary of Findings

• Complete- 6 AS
• Unsafe inappropriate placements
• AS1- Monthly visits (Panel will continue to
  monitor related outcome)
• AS2- Visits in the first week of out-of-home care
  (Panel has requested informational report)
• Sibling separation, AS 1- sibling visits
• Services to Adolescents
• AS 2- Educational outreach
• AS 3- Tutoring and mentoring services
• AS 5- Documentation of credit accumulation and
  GPA

6
Action Steps Summary of Findings

• Complete through performance period- 5 AS
• Foster Parent Training, AS 1- FP survey
• Mental Health
• AS 2- CHET QA plan
• AS 3- Annual review of mental health services
• Services to Adolescents
• AS 6- IL contracts
• AS 7- Juvenile Detention
• Under approved compliance plans- 2 AS
• Compliance plan not complete through period- 1 AS
• Placement stability, AS 1- Caseload size
  reduction
• Compliance plan complete through period- 1 AS
• Services to Adolescents, AS 1- Educational
  Attainment study

7
Action Steps Summary of Findings

• Incomplete- compliance plan required- 1 AS
• Mental Health, AS 1- Initial health screen
• Pending- 1 AS
• Services to Adolescents, AS 4- Attendance,
  truancies, suspensions, expulsions

8
Action Steps
9
Braam Outcomes
10
Outcomes

• Revised Implementation Plan includes 33 outcomes
• Some outcomes measures revised
• Some outcome measures converted to informational
  reports
• Benchmarks for most outcomes were revised

11
Outcomes

• Monitoring Report 6 assesses performance for 20
  Braam outcomes for FY2008 (7/07-6/08) based on
• FY08 Performance Report (DSHS Administrative
  Data)
• 2008 Case Review Reports
• Remaining 13 outcomes not reviewed in this report
• Data source is FP survey or another source that
  is not available at this time. Will be included
  in fall 2009 Monitoring Report OR later timeline
  for review based on Implementation Plan.

12
Outcomes

• For the 20 outcomes for which new data findings
  are presented in Monitoring Report 6
• Reached annual benchmark- 8 outcomes (40)
• Failed to reach annual benchmark compliance plan
  required- 12 outcomes (60)

13
Outcomes

• Multiple ways of looking at performance
• Performance relative to benchmark
• Was the 2008 benchmark reached?
• This is the approach used to assess compliance in
  Monitoring Report.
• How close/ far from the benchmark was
  performance?
• Performance compared to previous year
• Did performance improve or decline?
• By how much?
• Regional variation

14
Outcomes Performance Relative to Benchmark

• Summary
• Reached/ exceeded 2008 benchmark- 8 outcomes
• Failed to reach 2008 benchmark
• Met statewide benchmark, but not regional rules-
  2 outcomes
• Less than 10 short of benchmark- 2 outcomes
• More than 10 short of benchmark- 6 outcomes
• Acceptable data not available- 2 outcomes (CHET,
  shared planning meetings)

15
Outcomes Performance Relative to Benchmark

• Of the 20 outcomes for which new data are
  included in Monitoring Report 6.

16
Outcomes Reached/ Exceeded 2008 Benchmark (8)
17
Outcomes Failed to Reach 2008 Benchmark

• Met statewide benchmark, but not regional rules
  (2)

B 2.1- regional range from 41 (reg. 5) to 100
(reg. 3) F 3.2- regional range from 47 days
(reg.5) to 18 days (reg. 1)
18
Outcomes Failed to Reach 2008 Benchmark

• Performance was short of benchmark by less than
  10 (2)

19
Outcomes Failed to Reach 2008 Benchmark

• Performance was short of benchmark by more than
  10 (6)

20
Outcomes Performance Relative to Previous Year

• Of the 12 outcomes for which Monitoring Report 6
  included new findings AND comparable data from
  the year before are available

Note- for an additional 6 outcomes, no comparable
2007 data were available.
21
Outcomes Performance Relative to Previous Year

• Performance improved by 4 or more (5 outcomes)
• MH assessment w/in 30 days of request MH
  services w/in 30 days of assessment Runaways
  () Runaways (median days) DLR/ CPS
  investigations
• Performance same or improved by less than 1 (5
  outcomes)
• Two or fewer placements ratio of beds to
  children federal safety measure overnight stays
  at DSHS offices, hotels, apartments placements
  in adult facilities
• Performance declined (2 outcomes)
• Siblings placed together (with some siblings,
  with all siblings)
• (additional details in separate handout)

22
Outcomes Regional Analysis

• This analysis was not included in Monitoring
  Report 6 and covers different set of outcomes.
• There are 24 outcomes for which regional data are
  currently available
• The following slides look at the most recent year
  of data for some outcomes, this is FY08 for
  other outcomes, it is CY07

23
Outcomes Regional Analysis

• Questions
• Which outcomes show a high amount of regional
  variation? Which dont?
• Are there patterns by region e.g. regions that
  consistently meet benchmarks or outperform the
  statewide average?

24
Outcomes Regional Analysis

• Degree of regional variation
• For 12 outcomes, all regions were within /-15
  of the statewide average
• For 12 outcomes, at least one regions
  performance was at least 15 higher or lower than
  the statewide average.
• See handout for specific outcomes.

25
Outcomes Regional Analysis

• Patterns by region-- comparison to benchmarks

26
Outcomes Regional Analysis

• Patterns by region-- comparison to statewide
  average

27
Outcomes Regional Analysis

• Does any region consistently outperform others?
• Some patterns, but not really.

28
Braam Informational Reports
29
Informational Reports

• Revised Implementation Plan requires numerous
  informational reports on an annual basis
• Informational only-- no benchmarks or assessment
  of compliance
• Monitoring Report 6
• 1st monitoring report to include informational
  reports
• Part III of report Panels summary of
  informational reports
• Race/ ethnicity data-- to be discussed

30
Additional Issues for Discussion

• Selected Braam outcomes
• Sibling placement
• Runaways
• Education
• DLR/ CPS measurement issue