Committee on World Food Security

1

• Committee on World Food Security
• Monitoring Food Security
• Comments on Session 4
• Measuring Hunger what is required for
  policy-making ?
• Paulo Jannuzzi
• Secretariat of Evaluation and Information
  Management of
• Ministry of Social Development and the Fight
  against Hunger
• (SAGI/MDS)

SAGI Secretariat of Evaluation and Information
Management
2
My comments aims also to contribute to the
questions raised in the first panel

• Developing a suite of indicators
• Dimensions to be monitored
• Which indicators
• How to select them
• Platform for commom dissemination
• An Interactive Tool to present and analyze the
  indicators
• Suite vs. Composite Index
• International standards on food measurement
• International cooperation on designing Surveys
  and Registers, organizing existing data on
  monitoring panels and using them as tools for
  policy and program improvements.

3
Measuring Hunger what is required for
policy-making ?

• Evidence based Policy-makers and program managers
  need a suite of indicators that reflect key
  dimensions of a normative or logical framework of
  Food Policy on food production/distribution,
  food access/consumption and food diversity,
  quantitative and qualitative intake, to allow the
  improvement of public initiatives - as programs
  and legislation- and the achievement of goals on
  one or more of the policy objectives as alleviate
  of hunger, guarantee adequate nourishment and
  promote food and nutrition security.

4
Measuring Hunger what is required for
policy-making ?

• Evidence based Policy-makers and program managers
  do not need an exhaustive suite of indicators,
  but mainly relevant, valid, consistent and
  easy-to-understand indicators , organized by
  the operational aspect, geographical and
  decision-level they are involved, in a timely and
  costly basis, build by means of information
  available on different sources national census
  and household surveys, administrative registers,
  data produced by programs, contracted specific
  surveys etc- that can answer the questions they
  have over the Policy-Program Cycle (indicators
  for Diagnosing the problem, Planning the
  programs, Monitoring the public actions,
  Evaluating the overall effort).

5
Measuring Hunger what is required for
policy-making ?

• A Possible Logical Framework on Food
  Policy-Making

Policy instruments programs and legislation
Policy objectives/impacts
Food Production
Food Avaliability
Alleviate Hunger
Food Intern. Trade
Garantee adequate nourishment
Food equipaments
Food Access
Food and Nutrition Security
Family income
Food consumption
External factors not or not totally controled by
Food Policy-Makers
6
Measuring Hunger what is required for
policy-making ?

• Key indicators chain based on Logical
  Framework on Food Policy-Making

Impacts indicators
Policy, Program and Context indicators
Environment ind
Commodities Stos ind
Food stocks ind
Crop production ind
Extreme poverty ind
Food prices ind
Ethanol internal demand ind
Anthropometric ind
Food sales ind
Chinas food demand ind
Nutrition surveys ind
Food purchases
Govern Cash Tranfers ind
The impact measure depends on the nature of
public intervention
Unemployment ind
7
Brazils experience on Indicators for Food
Related Policy-Making

• Institutional framework
• National Policy on Food and Nutrition Security
  Law
• Food Security National Information System
• National Council composed by civil society and
  governmental institutions representatives,
  supported by Presidency
• Technical aspects
• 7 dimensions Production, Avaliability, Income,
  Access, Health, Education, Public Policy Efforts
• More than 50 indicators
• National, state and local indicators
• More than 20 sources of information (Statistical
  Agency, Public Registers, Program data etc)

www4.planalto.gov.br/consea/publicacoes
SAGI Secretariat of Evaluation and Information
Management
8
Measuring Hunger what is required for
policy-making ?

• Evidence based Policy-Makers and Program
  Managers do not need a exhaustive set of
  indicators, but set of indicators on context,
  input, resource, process, intermediate, output
  and impact dimensions, to follow the Public
  Budget and resources being transformed into
  social well-being.

Process and Output indicators refleting the
products and deliveries of food programs
Budget and Resource indicators refleting the
public effort on food programs
Effect and Impact indicators
Context indicators that may affect Food programs
achievements
9
Measuring Hunger what is required for
policy-making ?

• Evidence based Policy-Makers and Program
  Managers do not need a exhaustive set of
  indicators, but a set of indicators organized in
  panels of level of relevance for decision making
  and explicative power.

Key indicators, sensitive and timely
avaliable
Key indicators for action
Could be the FAO/CFSs priority indicators
A broader set of indicators, to help to
understand the evolution of the key ones
2nd level Indicators for first understanding
An even broader set of indicators to
contextualize, diagnose and analyze the previous,
computed in more detailed geography
3rd level Indic for explication the whole picture
10
Measuring Hunger what is required for
policy-making ?

• Evidence based Policy-Makers and Program
  Managers need easy-to-understand indicators,
  that can be very complex to build but
  catches/points what they are suppose to mean, and
  which limitations are clearly known.

Suite of good Indicators
Composite Indicators
Reality of Food Related Problems
11
Measuring Hunger what is required for
policy-making ?
Evidence based Policy-Makers and Program Managers
need a different set of indicators- with specific
properties- depending on their step on Policy
cycle
Public agenda A broad set of indicators to
quantify, qualify and localize the food problem
Formulation Ad hoc Indicators to help program
design
Food related problems
Sistema de MA
indicators needs
Decision making Multicriteria or composite
indicators to help choosing alternatives
Evaluation Specific measures built by surveys
designed to evaluate the program impact and its
improvements
Implementation Timely indicators to monitor
implementation process
SAGI Secretariat of Evaluation and Information
Management
12
Measuring Hunger what is required for
policy-making ?

• Evidence based Policy-Makers and Program
  Managers may need indicators from different
  sources, because of costs and timeliness, but
  also because they need to get a better
  comprehension of the food issues phenomena.
  Measure Triangulation should not be a problem, if
  they know the potential and limitations of each
  indicator.

Extreme poverty and consumption ind
FAO undernourishment indicator
Hunger
Household Food Security Scale ind
13
Measuring Hunger what is required for
policy-making ?

• Evidence based Policy-makers and program managers
  do not blame for too many indicators or a single
  composite one, but ask for
• a normative or logical framework to understand
  the whole picture
• indicators of some key dimensions of this
  framework
• detailed information for diagnosing population
  vulnerability and for policy/program formulation,
  which takes time, large budget and less frequent
  data collection
• monitoring indicators, timely, based on
  low-costly official records, quick data
  collecting strategies or simplified surveys
• evaluation indicators, carried on a reasonable
  period of time, including specific population
  and geographical areas, balancing
  internal/external validity and costs
• cost-efectiveness measures, as food programs get
  maturity, to support budget allocation
  discussion
• analytical tools to investigate relations not
  just to check goals

14
Measuring Hunger what is required for
policy-making ?

• Some of the Brazilian institutions, research
  centers and agencies that produce data,
  information and studies on Food Policy Agenda

Institution Food Related Themes/Surveys
IBGE Brazilian Statistical Agency www.ibge.gov.br Information for mainly Diagnosis and Monitoring, feed Logical Framework at macro-level, evaluate overall Policy (not programs) Crop and Cattle annual surveys (Food production) Food products quaterly surveys (Food avaliability) Crops Prospective estimates (Food production in near future) Price Consumer Index (Food costs, monthly basis for 11 major areas) Price Producer Index (Commodities costs, planned for next years) Market and sales annual and monthly surveys (Food sales) Agriculture-Cattle-Farm Census (Food production, area used, 10/10-year) Decennial Demographic Census (Water,Sewage, Poverty/Income in very small areas ) HHold surveys (Water, Sewage/Pov/Income, state-lev, on 3-month basis (2011 on) Expenditure and Income Survey (Food acquisition and intake, poverty subjective indicators, anthropometric and food security ind, 5/5-year, state, urban, rural) Students Health National Survey (Anthopometric indicators, 2009 )
15
Measuring Hunger what is required for
policy-making ?

• Some of the Brazilian institutions, research
  centers and agencies that produce data,
  information and studies on Food Policy Agenda

Institution Food Related Themes/Surveys
Ministry of Social Delopment and the Fight against Hunger www.mds.gov.br Information for mainly evaluation of deliveries and impact of specific MDS programs Bolsa Familia Longitudinal Impact Evaluation Study (Food acquisition, access to health services, subjective poverty, sewage, anthropometric indicators, national, 3-macro-areas, 2005, 2009 and planned 2013) National HH Supplement questionnaire on Food Security done with IBGE ( Food Security Scale, state, urban, rural areas, 2004 and 2009) Nutrition Surveys (Anthropometric indicators, live conditions, access to programs) Semiárido (deprived region in Northern ) 2005 , planned 2012 Quilombola (originated by refugee slaves in last centuries) 2006/07, current 2011 Urban Amazonas State 2006/07 Ribeirinhos (familes living over Amazonia rivers) planned 2012/13 Milk Acquisition/Distribution Program Evaluation ( Food production, beneficiaress profile and satisfaction) Food Equipament Evaluations (Food quantity and diversity offering, users profile and satisfaction)
16
Evaluation studies on Social Programs and Food
Security Agenda

• MDS Experience on Evaluation Studies
• Since 2004 till september 2011, 88 evaluation
  studies done
• Mainly done by external contracted studies, as
  IBGE, universities, research centers, NGOs,
  consultancy firms
• Tight supervision on sample planning,
  questionnaire design, field operations, final
  report, microdata provision
• Mix-methods approach quantitative, qualitative,
  quasi-experimental techniques
• Developing Tools for Information Gathering and
  Program Monitoring

www.mds.gov.br/gestaodainformacao/disseminacao/201
0/no-13-sintese-das-pesquisas-de-avaliacao-de-prog
ramas-sociais-do-mds-versao-atualizada-e-revisada-
2006-2010/no-13-sintese-das-pesquisas-de-avaliacao
-de-programas-sociais-do-mds-versao-atualizada-e-r
evisada-2006-2010
SAGI Secretariat of Evaluation and Information
Management
17
Measuring Hunger what is required for
policy-making ?

• Some of the Brazilian institutions, research
  centers and agencies that produce data,
  information and studies on Food Policy Agenda

Institution Food Related Themes/Surveys/Registers
Ministry of Health www.saude.gov.br www.datasus.gov.br Information for mainly monitoring health programs National Demographic and Health Surveys ( Anthropometric ind, Women and Children Health Status, HH Food Security Scale, national, 5 macro-areas, 1996/2006) National Health Survey, partnership with IBGE (Health indicators, feeding habbits, anthropometry, morbidity indicators, state level, each 5 years) Health National Registers with information organized in a user-friendly web plataform to gather micro-local-data Basic attendance made by Household-attedance-teams (Children malnutrition ind, local-level , monthly basis ) Hospitalization attendance (Malnutrition-caused hospitalization, local-level , monthly basis ) Vital Statistics Registers (7-day, 28-day, 1-year Child mortality measures, local level, yearly basis)
18
Measuring Hunger what is required for
policy-making ?

• Figures on Food Security in Brazil data from
  Food Security Scale Supplement

www.ibge.gov.br/home/estatistica/populacao/seguran
ca_alimentar_2004_2009/default.shtm
SAGI Secretariat of Evaluation and Information
Management
19
Measuring Hunger what is required for
policy-making ?

• Figures on Food Security in Brazil data from
  Consumer Expenditure Survey

www.ibge.gov.br/home/estatistica/populacao/condica
odevida/pof/2008_2009_encaa/default.shtm
SAGI Secretariat of Evaluation and Information
Management
20
Measuring Hunger what is required for
policy-making ?

• Figures on Food Security in Brazil data from
  National Students Heath Survey

www.ibge.gov.br/home/estatistica/populacao/pense_a
valiacao_nutricional_2009/pense_avaliacao_nutricio
nal_2009.pdf
SAGI Secretariat of Evaluation and Information
Management
21
Measuring Hunger what is required for
policy-making ?

• Figures on Food Security in Brazil data from
  HHold Socioeconomic Survey

www.ipea.gov.br
SAGI Secretariat of Evaluation and Information
Management
22
Thank you !! www.mds.gov.br paulo.jannuzzi_at_mds.g
ov.br
SAGI Secretariat of Evaluation and Information
Management