SubGrantees Program Progress Report Training

1
Sub-Grantees Program Progress Report Training

• Don Chronister
• Juvenile Justice Specialist
• http//www.kansas.gov/jja/

2
Introductions

• Name and program services, target population,
  referral sources
  
• An issue that you want to understand before
  leaving today

3
Juvenile Justice Authority Federal Programs

• Juvenile Justice and Delinquency Prevention Act
  of 2002
  
• Kansas Advisory Group (KAG)
• Core requirements (DSO, jail removal, sight and
  sound, and DMC)
  
• Juvenile Justice Specialist
• Federal Grant Specialist

4
Quarterly Progress Report

• Narrative Goals and Objectives as identified in
  the grant application
  
• Use the narrative to explain the specific
  activities behind the numbers in performance
  measures ie. MOU with agency data gathering,
  survey tools, planning activities

5
Demographic Spreadsheet

• Number of males and females entered into age,
  race and ethnicity should be equal
  
• Hispanic is an ethnicity not a race.
• Complete a second spreadsheet if significant
  services provided to parents

6
What is Performance Measurement?

• Performance measurement is a system of tracking
  progress in accomplishing specific goals,
  objectives and outcomes.
  
• Performance measurement
• Is directly related to program goals and
  objectives
  
• Measures progress quantitatively
• Is not exhaustive
• Provides a temperature reading it may not tell
  you everything you want to know but provides a
  quick an reliable gauge of selected results.

7
Comparisons between performance measures and
evaluation

• Performance measurement is less formal and can be
  component of a formal evaluation
  
• Evaluation is a comprehensive, formal process
  often done by an experienced researcher outside
  of the program.

8
Principles of Performance Measurement

• Q Quantitative
• U Useful/meaningful
• I Important
• R Results oriented, reliable, realistic
• C Cost-effective, comparable, credible
• QUI yourself in the Rs and Cs of Performance
  measurement

9
Prevention Definitions

• Primary Prevention A program or service
  directed at the population at large that is
  designed to prevent juvenile crime.
  
• Secondary Prevention A program or service
  directed at populations or persons identified as
  at risk for juvenile crime involvement that is
  designed to prevent juvenile crime before it
  occurs.
• Tertiary Prevention A program or service
  provided to youth and families after an incident
  of juvenile criminal behavior has occurred. The
  intervention is designed to prevent future
  incidents from occurring.

10
Preparing for Performance Measurement

• A program can participate in performance
  measurement if
  
• there is a sound and formal program design or
  model in place
  
• the program serves the population it is intended
  to serve
  
• the resources (e.g. staffing, funding) required
  to operate the program are in place
  
• the activities are being implemented as designed,
  and
  
• the program has the capacity to provide data for
  performance measurement.

11
Performance Indicators Outputs and Outcomes

• Outputs are products of program implementation
  and activities (volume of work accomplished-number
  s)
  
• Outcomes are benefits or changes that result from
  the program. Related to changes in participants
  
• Behavior
• Attitudes
• Skills
• Knowledge (BASK)
• Or in a communitys values or condition

12
Output Performance Measures

• Number of Program Youth Served An unduplicated
  count of the number of youths served by the
  program during the reporting period. Demographic
  spreadsheet is the preferred data source

13
Short-term Outcome Performance Measures

• Number and percent of youth successfully
  completing program requirements.
  
• Program requirements will vary by program but
  should be predefined list of requirements or
  obligations that clients must meet prior to
  program completion.

14
Short-term Outcome Performance Measures

• Number and percent of program families satisfied
  with program (Questionnaire)
  
• Number and percent of program youth satisfied
  with program (Questionnaire)
  
• The number of program youth/families satisfied
  with the program in the areas such as staff
  relations and expertise, general program
  operations, facilities, materials and service.
• Self reported date using program evaluation
  forms are the expected data sources.

15
Short-term Outcome Performance Measures

• Number and percent of program youth exhibiting
  desired change in targeted behavior (Targeted
  behaviors substance abuse, school attendance,
  antisocial behavior, family relationships,
  pregnancies) occurs at program completion

16
Long-term Outcome Performance Measures

• Number and percent of program youth exhibiting
  desired change in targeted behaviors. (occurs 1
  year after program completion or program enters
  maintenance phase)
• Annual Performance Report due October 30th

17
Planning for Data Collection and Reporting

• For each measure you will need a data source
• Use existing instruments and sources when
  possible
  
• Create new sources or forms when necessary

18
Location of Data Sources

• School
• Law Enforcement
• Juvenile Court
• Local Youth Serving Agency
• Communities That Care (CTC) data - RPC
• State Agency (Juvenile Justice Authority, KBI,
  SRS, Child Welfare, Mental Health

19
School Data

• Attendance
• Grades
• Expulsions/Suspensions
• Drop outs
• Disciplinary Actions
• http//www.ksde.org/k12/k12.html

20
Law Enforcement

• Arrest Records
• http//www.accesskansas.org/kbi

21
Juvenile Court Data

• Juvenile offender or CINC cases filed
• Post filing diversion
• Adjudications or pleas
• Court services probation
• Transfer to adult court

22
Juvenile Justice Authority

• Intake and Assessment JO and CINC
• Commitment to a Correctional Facility
• Out of home placements
• Intensive Supervised Probation

23
Survey Instrument Types

• Risk and Protective Factors CTC data
• Pre-post test associated with the curriculum
• Youth Risk Behavior Surveillance (YRBS)
• CSAP Survey
• Developmental Assets Surveys
• Source Book of Instruments
• http//ncjrs.org/pdffiles1/ojjdp/204956.pdf

24
Data Collection Highlights

• Archival data (arrest data, school data) is the
  easiest type of long-term outcome data to find.
  
• Choose forms, records, and other tools to measure
  outcome and output data.
  
• Use existing instruments when possible.

25
New Forms

• Youth and Parent Satisfaction Surveys
• Participant Locator Form (long term follow-up)
• Youth Data Collection Form (sample)
• Time and Effort Time Sheet (sample)

26
Site Visit Monitoring Report

• First year programs
• Second year programs require significant
  progress for continuation funding
  
• Access to OJJDP consultants through NTTAC, if
  needed

27
Quarterly Progress Report

• Narrative Goals and Objectives as identified in
  the grant application
  
• Performance Measures Explain the activities
  behind the numbers
  
• Demographics Unduplicated numbers of program
  participants by gender, age, race, and ethnicity
  
• Financial Report

28
Questions