Results and Performance Accountabilty, Decision-making and Budgeting

1
RBA Results-Based Accountability
TM
The Fiscal Policy Studies Institutewww.raguide
.org www.resultsaccountability.com
Book - DVD Ordersamazon.comresultsleadership.org
2
SIMPLE COMMON SENSE PLAIN LANGUAGE MINIMUM
PAPER USEFUL
3
Results-Based Accountabilityis made up of two
parts
4
Results-Based Accountability
COMMON LANGUAGE
COMMON SENSE
COMMON GROUND
5
THE LANGUAGE TRAPToo many terms. Too few
definitions. Too little discipline
Benchmark
Result
Outcome
Modifiers Measurable Core
Urgent Qualitative Priority
Programmatic Targeted
Performance Incremental Strategic
Systemic
Indicator
Goal
Objective
Measure
Target
Core qualitative strategic objectives
Make up your own jargon.
Measurable urgent systemic indicators
Lewis Carroll Center for Language Disorders
6
DEFINITIONS
RESULT
1.
Children born healthy, Children ready for school,
Safe communities, Clean Environment, Prosperous
Economy
Children born healthy
Children ready for school
Safe communities
Clean Environment
Prosperous Economy
INDICATOR
2.
Rate of low-birthweight babies, Percent ready at
K entry, crime rate, air quality index,
unemployment rate
Rate of low-birthweight babies
Percent ready at K entry
crime rate
air quality index
unemployment rate
PERFORMANCE MEASURE
3.
1. How much did we do? 2. How well did
we do it? 3. Is anyone better off?
Customer Results
7
From Ends to Means
From Talk to Action
From Talk to Action
Population RESULT
ENDS
INDICATOR
PERFORMANCEMEASURE
MEANS
8
1
IS IT A RESULT, INDICATOR OR PERFORMANCE MEASURE?
1
1
1. Safe Communities 2. Crime rate 3. Average
police response time 4. Adolescents are
physically mentally healthy 5. Rate of teen
suicide 6. People have living wage jobs and
income 7. of people with living wage jobs and
income 8. of participants in job training who
get living wage jobs
RESULT
1
INDICATOR
1
PERF. MEASURE
1
1
RESULT
1
INDICATOR
RESULT
INDICATOR
PERF. MEASURE
9
Translation Guide/Rosetta StoneNot the Language
Police
Ideas
Group 1
Group 2
Group 3 etc.
1. A condition of well-being for children,
adults, families communities 2. 3. etc.
RESULT
OUTCOME
GOAL
10
POPULATION ACCOUNTABILITY
11
Community Outcomesfor Christchurch, NZ
1. A Safe City 2. A City of Inclusive and
Diverse Communities 3. A City of People who
Value and Protect the Natural
Environment 4. A Well-Governed City 5. A
Prosperous City 6. A Healthy City 7. A City for
Recreation, Fun and Creativity 8. City of
Lifelong Learning 9. An Attractive and
Well-Designed City
12
Georgia Policy Councilfor Children and
Families RESULTS

• ? Healthy Children
• ? Children Ready for School
• ? Children Succeeding in School
• ? Strong Families
• ? Self Sufficient Families

13
CARDIFF, WALESCommunity Outcomes
1. People in Cardiff are healthy 2. Cardiff has a
clean attractive and sustainable
environment 3. People in Cardiff are safe and
feel safe 4. Cardiff has a thriving and
prosperous economy 5. People in Cardiff
achieve their full potential. 6. Cardiff is a
great place to live, work and play. 7. Cardiff
has a fair, just and inclusive society.
14

New Zealand
Coventry, UK
Kruidenbuurt Tilburg, Netherlands
Cardiff, Wales
15
(No Transcript)
16
Leaking Roof(Results thinking in everyday life)
Experience
Inches of WaterBASELINE
Not OK
Measure
Turning the Curve
Story behind the baseline (causes)
Partners
What Works
Action Plan 2
Action Plan
17
(No Transcript)
18
The Matter of Baselines
OK?
Point to Point
Turning the Curve
History
Forecast
Baselines have two parts history and forecast
19
75 people per day
2010
20
Rebound
21
Newcastle, UK
Nov 08 Jan 09
8.5
Source Connexions Tyne and Wear, UK
Revised 9 Nov 2007
22
Hull, UK"Woundings"
23
PERFORMANCE ACCOUNTABILITY
24
All performance measures that have ever
existed for any program in the history of the
universe involve answering two sets
of interlocking questions.
25
Performance Measures
Quantity
Quality
HowMuch did we do? ( )
HowWell did we do it? ( )
26
Performance Measures
Effort How hard did we try?
Effect Is anyone better off?
27
Performance Measures
28
Performance Measures
Quantity
Quality
How much service did we deliver?
How welldid we deliver it?
Effect Effort
Output Input
How much change / effect did we produce?
What quality of change / effect did we produce?
29
Performance Measures
Quantity
Quality
How much did we do?
How welldid we do it?
Effect Effort
Is anyonebetter off?


30
Education
Quantity
Quality
How much did we do?
How well did we do it?
Student-teacherratio
Number ofstudents
Effect
Effort
Is anyone better off?
Number ofhigh schoolgraduates
Percent ofhigh schoolgraduates
31
Education
Quantity
Quality
How much did we do?
How well did we do it?
Student-teacherratio
Number ofstudents
Effect
Effort
Is anyone better off?
32
Pediatric Practice
Quantity
Quality
How much did we do?
How well did we do it?
Percent ofpatients waitingless than30 min in
thewaiting room
Number ofchildrentreated
Effect
Effort
Is anyone better off?
childrenfullyimmunized(in the practice)
childrenfullyimmunized(in the practice)
33
Drug/Alcohol Treatment Program
Quantity
Quality
How much did we do?
How well did we do it?
Percent ofstaff withtraining/certification
Number ofpersonstreated
Effect
Effort
Is anyone better off?
Number of clientsoff of alcohol drugs - at
exit - 12 months after exit
Percent of clientsoff of alcohol drugs -
at exit - 12 months after exit
34
Fire Department
Quantity
Quality
How much did we do?
How well did we do it?
ResponseTime
Number ofresponses
Effect
Effort
Is anyone better off?
of fireskept toroom of origin
of fireskept toroom of origin
35
General Motors
Quantity
Quality
How much did we do?
How well did we do it?
Employees pervehicleproduced
of production hrs tons of steel
Effect
Effort
Is anyone better off?
of cars sold Amount of Profit Car value
after 2 years
Market share Profit per share Car value after
2 years
Source USA Today 9/28/98
36
Not All Performance Measures Are Created Equal
Quality
Quantity
Quality
How much did we do?
How well did we do it?
LeastImportant
Least
AlsoVery Important
Effect
Effort
Is anyone better off?
MostImportant
Most
37
RBA Categories Account for All Performance
Measures(in the history of the universe)
Total Quality Mgmt (TQM)
Efficiency, Admin overhead, Unit costStaffing
ratios, Staff turnoverStaff morale, Access,
Waiting time, Waiting lists, Worker safety
Cost
Quantity
Quality
Process Input
Effort

Customer Satisfaction(quality service delivery
customer benefit)
Product Output Impact
Effect
Cost / Benefit ratioReturn on investment Client
results or client outcomes
Benefit value
EffectivenessValue addedProductivity
38
The Matter of Control
Quality
Quantity
How much did we do?
How well did we do it?
MostControl
Effect
Effort
Is anyone better off?
LeastControl
PARTNERSHIPS
39
Advanced Baseline Display
Create targets only when they areFAIR USEFUL
AspirationNOTPunishment
Goal (line)
Target or Standard
Avoid publicly declaringtargets by year if
possible.
Your Baseline
InsteadCount anything better than baseline as
progress.
Comparison Baseline
40
Program Performance Measures
Quantity
Quality
How much did we do?
How welldid we do it?
Effect Effort
Is anyonebetter off?


41
Performance AccountabilityTypes of Measures
found in each Quadrant
How much did we do?
How well did we do it?
Clients/customers served
Activities (by type of activity)
Is anyone better off?


42
Service __________________________________
Hospital
Job Training
School
Fire Department
How much did we do?
How well did we do it?
Primary customers
Unit cost
students
patients
persons trained

Workload ratio
Primary activity
of ___x___ that happen on time
hours of instruction
diagnostic tests
job courses
alarms responded to

Is anyone better off?
If your service works really well,how are your
customer's better off?

students who graduate
patients who fully recover
fires kept to room of origin
persons who get jobs

43
Choosing Headline Measures and the Data
Development Agenda
Quantity
Quality
How much did we do?
How well did we do it?
3 DDA
Measure 1 ----------------------------
Measure 2 ----------------------------
Measure 3 ----------------------------
Measure 4 ----------------------------
Measure 5 ----------------------------
Measure 6 ----------------------------
Measure 7 ----------------------------
Measure 8 ----------------------------
Measure 9 -----------------------------
Measure 10 ---------------------------
Measure 11 ---------------------------
Measure 12 ---------------------------
Measure 13 ---------------------------
Measure 14 ---------------------------
2 Headline
Effect
Effort
Is anyone better off?
2 DDA
Measure 15 ----------------------------
Measure 16 ----------------------------
Measure 17 ----------------------------
Measure 18 ----------------------------
Measure 19 ----------------------------
Measure 20 ----------------------------
Measure 21 ----------------------------
Measure 15 ----------------------------
Measure 16 ----------------------------
Measure 17 ----------------------------
Measure 18 ----------------------------
Measure 19 ----------------------------
Measure 20 ----------------------------
Measure 21 ----------------------------
3 Headline
1 Headline
1 DDA
44
Select 3 to 5 Performance MeasuresACROSS THE
BOTTOM OF THE ORG CHART
3 - 5
3 - 5
3 - 5
3 - 5
3 - 5
3 - 5
3 - 5
3 - 5
20 60 20 Rule
45
Primary v. Secondary
Direct v. Indirect
Internal v. External
46
(No Transcript)
47
(No Transcript)
48
(No Transcript)
49
(No Transcript)
50
New Mexico Christus St. Vincents Medical Center
51
How Population Performance
AccountabilityFIT TOGETHER
52
THE LINKAGE Between POPULATION and PERFORMANCE
POPULATIONRESULTS
Contributionrelationship
Alignmentof measures
Pre-natal Nutrition Program
attendance Unit cost
ofwomenserved
Appropriateresponsibility
low birth-weight births (for participating
women)
low birth-weight births (for participating
women)
CUSTOMERRESULTS
53
Performancemeasure
PopulationIndicator
54
Population Accountability
Result to which you contribute to most directly.
Indicators
Story
Every timeyou presentyour program, Use
atwo-partapproach.
Partners
What would it take?
Your Role as part of a larger strategy.
Your Role
Performance Accountability
Program
Performance measures
Story
Partners
Action plan to get better
55
The Special Case of Prevention Programs
(Read page 100)
56
(No Transcript)
57
Population Accountability
Result HEALTHY PEOPLE.
Indicator
Story
Partners
What would it take to significantly reduce this
rate?
Your Role Smoking Prevention Program
Your Role
Contribution
Performance Accountability
Program
Smoking Prevention Program
Performance measures
- youth in HS assembly who change attitudes
about tobacco - Ad campaign effectiveness in
hitting target audience ( reached by target
demographic)
Story
Partners
Action plan to get better
58
Different Kinds of Progress
1. Data a. Population indicators Actual
turned curves movement for the
better away from the baseline.
b. Program performance measures
customer progress and better service
How much did we do?
How well did we do it? Is
anyone better off?
2. Accomplishments Positive activities, not
included above.
3. Stories behind the statistics that show how
individuals are better off.
59
Board of Directors MeetingAGENDA
1. New data
1. New data
2. New story behind the curves
2. New story behind the curves
3. New partners
3. New partners
4. New information on what works.
4. New information on what works.
5. New information on financing
5. New information on financing
6. Changes to action plan and budget
6. Changes to action plan and budget
7. Adjourn
7. Adjourn
60
SUMMARY
61
(No Transcript)
62
RBA in a Nutshell2 3 - 7
plus language discipline      Results
Indicators      Performance measures
2 - kinds of accountability      Population
accountability      Performance accountability
 3 - kinds of performance measures.     
How much did we do?      How well did we
do it?      Is anyone better off?
7 - questions from ends to means in less than
an hour.
Baselines Turning the Curve
63
(No Transcript)
64
EXERCISES
65
Creating a Working Baselinefrom Group Knowledge
Indicator or Performance Measure
Not OK?
Forecasting
Backcasting
66
Turn the Curve Exercise Program Performance
5 min Starting Points - timekeeper and
reporter - identify a program to work on -
two hats (yours plus partners)
10 min Performance measure baseline - choose 1
measure to work on from the lower right
quadrant - forecast (to 2017) OK or not OK?
15 min Story behind the baseline -
causes/forces at work - information research
agenda part 1 - causes
Two pointers to action
15 min What works? (What would it take?) -
what could work to do better? - each partners
contribution - no-cost / low-cost ideas -
information research agenda part 2 what works
10 min Report convert notes to one page
67
4. --------- Off the Wall
ONE PAGE Turn the Curve Report Performance
Program _______________
Performance Measure (Lay definition)
PerformanceMeasureBaseline
Story behind the baseline
---------------------------
--------------------------- (List as many as
needed)
Partners ---------------------------
--------------------------- (List as many
as needed)
Three Best Ideas What Works 1.
--------------------------- 2.
--------------------------- 3.
---------No-cost / low-cost
SharpEdges
4. --------- Off the Wall
68
Turn the Curve Exercise LessonsTalk to Action
in an hour
1. How was this different from other processes?
What worked and what didnt work?
2. Why did we ask for a. Results before
indicators? b. Forecast? c. Story? d. No cost
/ low cost? e. Two hats? f. Crazy idea? g.
Only 3 best ideas?
3. Do you think a lay audience could understand
the reports?
4. How many think you could lead this exercise
with a small group? (2 curves at the same
time)
69
Next Steps
1. Whats one thing I could personally do
with what I learned today?
2. Whats one thing I would like to ask
someone else to do to support this work?
70
Resources
www.raguide.org www.resultsaccountability.com RBA
Facebook Group
Book - DVD Ordersamazon.comresultsleadership.org
71
THANK YOU !
Book - DVD Ordersamazon.comresultsleadership.org