MIDTERM REVIEW

1
Ronette Engela PCAS, The Presidency
DPSA Performance management 12 June
2008 Content GWME system Performance measures
Additional information
2
In 2005 Cabinet approved an implementation plan
to develop a monitoring and evaluation system
for use across government
Cabinet memorandum 2005
3 Components 1) Principles 2) Compendium
of indicators 3) Implementation plan Linked
to planning framework
1 Monitoring Evaluation Early
warning Verification Data collection Analysis
Reporting
2 Based on standard, shared indicators
3 Composite system Built over time Pilot Roll-out
Not a single automated IT system
3
Schematic vision of roll out
2005-2007
2008-?2010
2011 onwards
indicative
Quality improvement and analysis phase
IT systems
Framing phase
Fellowship
Battle
Victory
Quest
4
Green Book
Well conceptualised, consistent with
international practice

• Composite system that draws its data from
  contributory systems
• Emerging system built up over time with
  consistent and sustained participation by all
  stakeholders

Conceptual anchor matrix of indicators
National vision doesnt just happen at provinces
5
Status quo
What do we have?

• SYSTEMS Large existing systems in place that have
  taken years to build up
• Performance monitoring system by NT of 500
  indicators of concurrent functions
• Extensive systems in Housing, Education, Health,
  DWAF, SAPS, Soc Dev
• Some provinces FS, GT, WC EC

• Good CAPACITY and experience
• Conceptual coherence between core national
  departments, even joint projects

Need to focus on quality improvement
6
Status quo
Products and Processes

• Cross cutting ME products
• PoA
• Development Indicators
• Public Mang Watch
• IGR publication of non financial information
• ENE include performance indicators
• Provincial Budget Statements performance
  indicators

• Policy platform established 2007
• GWME framework
• PPI framework
• SA Statistical Quality Assurance framework
• Draft DPLG LG framework
• Common definitions document

Learning Network 2 events, 300 att, Web link
Revitilised ME Task Team Coordinating Forum
7
GWME System Policy platform
GWME framework
Evaluations
Social, Economic Demographic
Statistics Registers and Admin data
SASQAF
Programme Performance Information
Common definitions
PPI framework
8
GWME System data terrains
Evaluations
Social, Economic Demographic
Statistics Registers and Admin data
National Indicators
Programme Performance Information
9
PoA

• Annual State of the Nation priorities are
  announced
• Web based system 300 users
• Bi-monthly report to Cabinet

Positive

• Established the culture of reporting
• Does not allow proper outcome/impact assessment
• Sometimes need process - court cases
• Will be assessed, redesigned end 2007
• Building custom based web system

Negative
10
72 Development Indicators
National Indicators
www.ThePresidency.gov.za
11
(No Transcript)
12
GWME Framework Programme Performance Information
E
Stats
13
E
E
Programme Performance Information
Stats
CS
dept
sector
Exec Authority
Dept exec
Programme manager
Line manager
14
PPI service delivery information
500 indicators

• Annual MTSF informs MTEF - budget
• Annual Performance Plans tabled in parl /
  legislatures
• Prov APP prescribed format with indicators that
  measures delivery of services
• Quarterly reports to provincial Treasuries who
  passes it on to NT
• To be published
• Monitor Annual Report against APP

8 years to build
15
Education
16
Health
17
Social Development
18
Agriculture
19
Transport
20
Status quo
PRESIDENCY
CABINET
PoA
NAT CONCURRENT
NATIONAL
NAT CONCURRENT
NATIONAL
DPSA
DPSA
SECTOR DEPT
TREASURY
SECTOR DEPT
TREASURY
Performance information
Financial information
Govt PoA
PROVINCIAL
PROVINCIAL
PREMIERS
PREMIERS
TREASURY
TREASURY
OFFICE
OFFICE
Human resource info
Human resource info
Output outcome info
Output outcome info
Output outcome info
Output outcome info
indicators
Output outcome info
Financial information
Performance information
PROVINCIAL DEPARTMENT
PROVINCIAL DEPARTMENT

• Systems initiated in response to specific needs
• Hard working, but not smart working systems
• Smart analysis to align information

21
Focus for 2008

• Premiers office guideline on ME
• Generic framework for ME to be work shopped in
  each sector
• Data forums per sector
• Demographic data HH data seminar
• Admin datasets (300)
• Massive GIS project
• Need to develop institutional ME system Thusong
  centres

22
Ke ya leboga Ke a leboha Ke a
leboga NgiyabongaNdiyabulela Ngiyathokoza
Ngiyabonga InkomuNdi khou
livhuha Dankie Thank you
23
Evaluation

• Need for detailed policy evaluations on a number
  of different levels
• Departmental led reviews and evaluation of
  policies and programmes
• Sectoral reviews (Pres NT)
• Broad, cross cutting reviews led by centre of
  government (15 Y R)

Monitoring and evaluation have different
purposes
M before E part of public sector reform
initiative
24
Programme Performance Information

• National Treasury

25
Constitution S.215 S.216 Budget Exp
Management PFMA MFMA
Mandate Treasury
Ensure information on inputs, outputs and
outcomes
underpins planning, budgeting, implementation
management and accountability reporting
to promote transparency and expenditure control.
26
Area of Responsibility
E
Programme Performance Information
CS
Dept
Dept
Exec Authority
Dept exec
Programme manager
Line manager
27
Current focus Treasury
PPI policy framework
Develop a Programme Performance
Information manual for each sector

• The process for updating the Manual
• Structures and systems to manage performance
  information
• Processes to identify performance information
• Listing and definitions of all the performance
  information
• collected by the institution
• Technical standards for the institutions
  performance information
• Collecting and collating performance information
• Checking and verifying information
• Confidentiality
• Use of performance information
• Publication of performance information

28
Next steps Treasury
PPI manual per sector - extensive consultation to
determine needs of different users

• Ensure Programme Performance Information
• is appropriately used for
• planning, budgeting and management purposes
• set performance standards and targets prior
• to the start of each year
• review performance and take management action
• evaluate performance at the end of a service
• delivery period

Part of budget documentation requirement
29
PERFORMANCE EVALUATIONS
CENSUS AND SURVEY INFORMATION
10 YEAR PERFORMANCE REVIEWS
THE CENSUS
IMPACTS
END TERM REVIEWS
HOUSEHOLD SURVEYS
OUTCOMES
PERIODIC PROGRAMME EVALUATIONS
BENEFICIARY / USER SURVEYS
OUTPUTS
SERVICE DELIVERYEVALUATIONS
MANAGEMENTSURVEYS
ACTIVITIES
PERFORMANCE MANAGEMENT
INPUTS
PROGRAMME PERFORMANCE INFORMATION
30
Methodology
31
National Statistical System

• StatsSA

32
Area of Responsibility
Evaluations
Census and Survey Information Registers and
Admin data
PPI
Dept
Dept
Dept
33
Mandate StatsSA
The Statistics Act (No. 6 of 1999) 2002 January
Cabinet Legkotla State of the Nation Addresses
2004 and 2005

• Section 14 subsection 6 clauses (a), (b) and (c)
  where the
• Statistician-General may advise an organ of state
  on the
• application of quality criteria and standards
• Section 14 subsection 7 clauses (a) and (b)
  grants
• the Statistician-General power to designate
  statistics
• produced by other organs of state as official
  statistics
• Section 14 subsection 8 clauses (a) and (b)
  authorises
• the Statistician-General to comment on the
  quality
• of national statistics produced by another organ
  of state
• and to publish such other departments statistics

34
Problem
Demand for information user groups or indicator
categories
Official statistics
Unknown quality

• Insufficient supply of quality information

• Uncertain quality?
• Poor comparability
• Isolated producers
• No shared standards

• Insufficient statistical skills

Stats SA
Other producers departments
35
Proposed solution
Demand for information user groups or Indicator
categories

• Adequate information
• Reliable information
• quality, sustainable
• Sufficient skills

Feedback
Feedback

• Regulatory environment
• Statistics Law
• Governance structure
• Quality standards
• Advocacy programme
• Code of conduct

Stats SA
Other producers departments, CSOs, etc
Coordination
36
Proposed new approach
Maintain the decentralised system of statistical
production

• Use official statistics to ensure quality
• SASQAF quality framework
• Framework of international best practice
• UN Principles of Official Statistics

Transform all national statistics into official
statistics
SASQAF Draft available
37
Transform existing departmental data (registers
surveys) into sustainable sources of
official statistics
Programme NSS

• More use of administrative data than
• of surveys - sustainability and cost
• Agreements and collaboration
• between Stats SA and individual dept
• Joint Working Party between Stats SA
• and each of the departments to improve quality

38
Concerns

• Inadequate appreciation of the practice of
  managing for results
• Measurement of performance and objective info
  for planning and decision-making not a priority
• Current practice of existing ME units without
  measurement
• Circumlocutionary behaviour of public officers
  (multiple formalities)
• Waiting for approval (all the way to the
  minister!) inadequate delegation of authority
• Lack of institutional memory in government
  departments change the head start afresh
• Operational silos protecting ones turf
• Cover-ups fear of exposure

39
Derived systemDPLG local government

• DPLG

40
GWME Framework DPLG Derived Information
E
PPI
CS
Dept
Dept
Dept
Dept
Derived information system
41
Mandate DPLG
Constitution Chapter 3 7 Municipal Systems
Act Municipal Structures Act

• 5 Local Govt KPAs
• Municipal Transformation and Organisational
• Development
• Basic Service Delivery
• Local Economic Development
• Financial Viability and Management
• Public Participation and Community
• Involvement

42
Collaboration with key national departments
Responsibility DPLG

• The Presidency
• National Treasury
• Dept of Public Service and Administration
• Dept of Water and Forestry
• Dept of Mineral and Energy
• Dept of Housing
• Statistics South Africa
• South African Institute for Management
• Development (MRE capacity building)

43
Problem
DPLG assessed readiness of provincial depts of
local govt and Office of Premiers to do Local
govt ME
Varying degrees of understanding and of ME
capacity and readiness

• Lack of integrated approach to local government
• ME across 3 spheres
• Lack of appropriate ME reporting structures to
• monitor local government service delivery
• Capacity and capability to monitor local govt
• service delivery

44
Collated all indicators on local govt Phase 1
Initially 500
Now 150
45
Shared understanding of Local government
indicator development across all three spheres
Phase 2
GWME System
GPOA
National
PGDS
Provincial
IDP
District
Indicators
IDP
Local
46
Achievements to date
Done

• Readiness assessment of provincial dept of local
  government
• Draft Local Government MRE framework, aligned to
  GWME
• MRE business process mapping of Local government
  indicators
• National Local Government MRE forum established
• Collaboration with SAMDI and NT TAU for capacity
  building

47
Next steps
Plans

• Finalise Local Government ME policy framework
• Develop a compendium of indicators for Local
  Government
• Design and implement Local govt MRE system that
  extracts information with multiple sector
  departments that deal with Local Government
  based on impact model
• Capacity building for provinces and municipalities

48
Conclusion

• Data quality will improve with public attention
  and utilisation
• AG auditing
• on performance mang system, not content

• Conceptual clarity - IGR
• Key role players involved
• Convergence around indicators

• Myth at the press of a button
• Systems to alert about problem, need political
  will to deal with it

• Concerns
• Need to incorporate Public Opinions/ Imbizo
  processes
• Incorporate indicators into performance contracts

Steady does it
49
Ke ya leboga Ke a leboha Ke a
leboga NgiyabongaNdiyabulela Ngiyathokoza
Ngiyabonga InkomuNdi khou
livhuha Dankie Thank you