An overview

1

An overview of corruption AC assessment tools

Photos by Adam Rogers/UNCDF
2
Country-level corruption and anti-corruption
assessment tools
Corruption
Transparency/Accountability/Integrity
Diagnostic Assessments
Compliance monitoring
Perception
Experience/ victimisation
Public opinion
General population / vulnerable groups
Institutions
Processes
Experts
Sectors
Public sector
Public sector
Mapped by Transparency International
Local level
Private sector
3
Selecting an appropriate assessment tool

• Start with a clear objective
• Map out relevant tools, and select a
  methodology that is suited to your purpose
  and focus
• Dont just replicate a generic tool developed
  by an international organization, or a tool used
  in another country adapt it to your setting
  (country-specific indicators)
• Make sure to use indicators that are
  complementary (input vs. outcome de jure vs. de
  facto)
• Invest in proper design, testing and initial
  consultation of stakeholders before
  rolling-out

4
WB governance AC diagnostic surveys
Tools for measuring corruption

• Collect experiential rather than perception data
• Standard questionnaire adapted to the reality of
  each country
• Conducted by local independent survey firm or
  local NGOs
• All info gathered strictly confidential
• 3 different polls carried out simultaneously
• 1) Public officials survey to understand the
  specific determinants of corruption, extent of
  discretionality / informality
• 2) Private sector survey to understand effects
  of public sector governance corruption on
  private sector development
• 3) Household survey To study citizens
  experience with and perception of corruption in
  public private sector

5
Country-level corruption and Anti-corruption
assessment tools
Corruption
Transparency/Accountability/Integrity
Diagnostic Assessments
Compliance monitoring
Perception
Experience/ victimisation
Public opinion
General population / vulnerable groups
Institutions
Processes
Experts
Sectors
Public sector
Public sector
Mapped by Transparency International
Local level
Private sector
6
GAC diagnostic survey Household
Tools for measuring corruption

• Nature of the problem
• Probability of situational scenarios
• Characteristics of using public services
  (responsiveness, costs bribes)
• Judicial system (Professionalism, cost
  accessibility)
• Education system (Obstacles to education)
• Analyzing the corruption problem (reporting
  corruption resolution mechanisms)
• Additional info on the respondents (personal info
  related to quality of life, social welfare)

7
Existing data source TI Global corruption
barometer

• Assesses the general publics perceptions and
  experiences of corruption bribery in different
  public institutions
• Macedonia, Kosovo Turkey (since 2004)
• Carried out by Gallup International or reputable
  local polling organization
• Can access dataset (XLS files) Possibility to
  disaggregate by demographic variables (household
  income, age, education, employment)

8
Existing data source TI Global corruption
barometer

• To what extent (1-5) do you perceive these
  institutions to be affected by corruption?
  Political parties, parliament, private sector,
  media, civil servants, judiciary
• Which of these institutions/sectors do you
  consider to be the most affected by corruption?
• In the past 12 months, have you or anyone living
  in your household paid a bribe in any form?
• How would you assess your current governments
  actions in the fight against corruption?
  (ineffective, neither, effective)

9
Country-level corruption and Anti-corruption
assessment tools
Corruption
Transparency/Accountability/Integrity
Diagnostic Assessments
Compliance monitoring
Perception
Experience/ victimisation
Public opinion
General population / vulnerable groups
Institutions
Processes
Experts
Sectors
Public sector
Public sector
Mapped by Transparency International
Local level
Private sector
10
GAC diagnostic survey Public official
Tools for measuring corruption

• Management of personnel (e.g. payment of wages)
• Budget administration
• Performance / provision of services (e.g.
  discretion used in decision-making process)
• Information management
• Governance system (corrupt practices, mechanisms
  for reporting corruption, awarding public
  contracts, etc.)
• National situation (effects on personal living
  conditions)
• Respondents own suggestion for fighting
  corruption

11
Country-level corruption and Anti-corruption
assessment tools
Corruption
Transparency/Accountability/Integrity
Diagnostic Assessments
Compliance monitoring
Perception
Experience/ victimisation
Public opinion
General population / vulnerable groups
Institutions
Processes
Experts
Sectors
Public sector
Public sector
Mapped by Transparency International
Local level
Private sector
12
Business Environment and Enterprise Performance
Survey (BEEPS) WB EBRD

• Compiles the experiences of 200-600 firms in
  each country, in 26 transition countries (in
  Central and Eastern Europe and CIS) plus Turkey
  in four rounds 1999, 2002, 2005 and 2008
  (results not out yet)
• Survey examines the quality of the business
  environment unofficial payments corruption,
  crime, regulations and red tape, customs and
  taxes, labor issues, firm financing, legal and
  judicial issues, infrastructure
• Corruption is an important topic roughly 25 of
  400 variables in the BEEPS dataset pertain to
  corruption, unofficial payments, or tax evasion.
• No pure perception questions asking instead
  about specific aspects of the business
  environment as they affect their firm

13
Another existing source Ease of Doing Business
Index (WB)

• Ease of Doing Business index generated by
  asking lawyers, accountants, etc. in each country
  about the details of the laws, rules, and
  procedures that govern various aspects of doing
  business ? De jure!
• All four countries are covered
• 10 topics are assessed

14
(No Transcript)
15

• Ranking Ease of Doing Business Index
• Under category Eastern Europe Central Asia (out
  of a total of 27 countries)
• Macedonia (rank no. 5)
• Montenegro (rank no.15)
• Turkey (rank no.17)
• Kosovo (rank no.22)
• But what does the Macedonian BEEPS report say,
  on the overall corruption as a problem in doing
  business indicator?

16
BEEPS Macedonian report
The BEEPS indicators measure what firms are
saying about the ways that government policies,
rules, and procedures are implemented in practice.
17
Country-level corruption and Anti-corruption
assessment tools
Corruption
Transparency/Accountability/Integrity
Diagnostic Assessments
Compliance monitoring
Perception
Experience/ victimisation
Public opinion
General population / vulnerable groups
Institutions
Processes
Experts
Sectors
Public sector
Public sector
Mapped by Transparency International
Local level
Private sector
18
CRINIS (Political Party Finance)
Tools for measuring integrity

• TI-led initiative
• Assessment of a countrys legal framework and
  practice in the area of political party financing
  focus on transparency
• Data collection administrative data, interviews
  with insiders, survey of key actors, field tests
• A research team (local specialists) feeds data
  into a series of 11 online questionnaires on the
  legal framework and compliance with laws

19
CRINIS (Political Party Finance)
Tools for measuring integrity

• 10 dimensions of political party transparency
• Internal book keeping
• Reporting to the electoral management body
• Disclosure of information to the public
• Comprehensiveness of reporting
• Depth of reporting
• Reliability of reporting
• Prevention
• Sanctions
• State control
• Public oversight

20
Country-level corruption and Anti-corruption
assessment tools
Corruption
Transparency/Accountability/Integrity
Diagnostic Assessments
Compliance monitoring
Perception
Experience/ victimisation
Public opinion
General population / vulnerable groups
Institutions
Processes
Experts
Sectors
Public sector
Public sector
Mapped by Transparency International
Local level
Private sector
21
Rapid Assessment for Justice Systems

• A method developed by an NGO, Due Process of
  Law, originally for Latin America, but adaptable
  to any context
• To explore the specific phenomenon of judicial
  corruption, and ask why, under what conditions,
  and in what form it occurs
• Focuses on control mechanisms (organs with
  disciplinary control capacity or other functions
  related to improper conduct by judges judicial
  employees)
• Their capacity resources
• Their performance in practice, what type of
  control?

22
Rapid Assessment for Justice Systems

• Triangulation of information sources laws,
  press reports, files, statistics, reports,
  academic papers
• Questions found in the last column (source
  comparison and data interpretation) are designed
  to facilitate data consolidation and comparison
• Primary data interviews with judges, judicial
  officials, prosecutors, Public Ministry
  officials, litigators, NGO leaders,
  specialized journalists, academics
• Final output a report that can serve as a
  basis for indicator development

23
Country-level corruption and Anti-corruption
assessment tools
Corruption
Transparency/Accountability/Integrity
Diagnostic Assessments
Compliance monitoring
Perception
Experience/ victimisation
Public opinion
General population / vulnerable groups
Institutions
Processes
Experts
Sectors
Public sector
Public sector
Mapped by Transparency International
Local level
Private sector
24
Open Budget Index

• To provide citizens, legislators and civil
  society advocates with the information needed to
  gauge a governments commitment to budget
  transparency and accountability
• A questionnaire to be completed by independent
  non-governmental experts, reviewed by OBI staff
  and reviewed by anonymous peer reviewers
• Criteria based on generally accepted good
  practices in public financial management
• Objective data only (evidence provided for each
  question)
• Indicators country reports available for
  Macedonia Turkey

25
Open Budget Index (122 questions)
Tools for measuring corruption

• Availability of budget documents
• Budget year of documents used in completing
  questionnaire, internet links, distribution of
  budget proposals of enacted budget, etc.
• Executives budget proposal
• Estimates for budget year and beyond
  (comprehensiveness), narrative and performance
  monitoring
• Budget process
• Execs formulation of the budget, legislative
  approval, executive implementation and year-end
  report, supreme audit institution

26
Open Budget Index - examples
Tools for measuring corruption
3. Budget process Executives formulation of the
budget Does the executive release to the public
its timetable for its budget preparation
process? Legislative approval of the
budget Does the executive present more details
or provide a better explanation of any budget
proposal, if members of the legislature
(including from minority parties) request such
information?