Millennium development indicators in ESCAP context

1
ESCAP/WHO Pilot Study Overview
Wei Liu Statistics Division, ESCAP liuw_at_un.o
rg Sixth Meeting of the Washington Group on Disa
bility Statistics, Kampala, Oct 10-13, 2006
2
1. Objective2. Background and
methodology3. Questions tested4. Analysis and
results5. Moving forward
Outline
3
Objectives

• Comparing the Washington Group 6-question short
  set with a WHO long set of questions
  
• Studying the relative importance of different
  domains
  
• Considering differences in underlying concepts
  and phrasings of questions

4
Background

• Pilot countries Fiji, Indonesia, India,
  Mongolia, Philippines
  
• Test Design
• Study One Testing sensitivity and specificity
• Study Two Test-Retest Reliability
• Study Three Linguistic Evaluation Cognitive
  interviewing
  
• Other Partners Australian Bureau of Statistics
  (ABS)
  

5
Sample Selection

• India Meerut District, Uttar Pradesh State
• Indonesia Central Jakarta
• Mongolia Ulaanbaatar
• Philippines A selection of urban and rural
• geographic clusters
• Fiji 2 rural and 8 urban enumeration areas in
  Central Division (capital city surrounding
  areas)

6
Sample Sizes
7
Sample Summary Age Structure
8
Pilot Study Packets

• Study Instructions
• Questionnaire
• Version A
• Version B
• Cognitive Interview Schedule

9
Support Materials

• Translation
• Guidelines
• List of key terms
• Linguistic evaluation form
• Interview Guidelines Q-by-Q specifications
• Disability Statistics Training Manual - Draft
• Quality assurance standards guidelines
• Data entry program

10
Questions Tested

• Question set 1
• Washington Groups general disability measures, 6
  Qs
  
• Question set 2
• -World Health Survey body structure/functions
  domains, 17 Qs
  
• -WHO Disability Assessment Schedule II (WHO DAS
  II), activity and participation domains, 36 Qs
  
• Australian Bureau of Statistics,
  need-for-assistance domains, 4 Qs

http//www.unescap.org/stat/meet/widsm4/disabilty_
questionnaire_Ver.A.pdf
11
Study 1 Sensitivity and Specificity of WG Qs
12
Study 1 (cont.)
13
Study 2 Kappa Statistics for Test-retest
Reliability
14
Study 2 (cont.)
15
Study 3 Cognitive Debriefing

• Most questions are understood well
• 95 of the respondents had no difficulties
  responding to questions
  
• Minor difficulties with questions on
• Mental disability (i.e. cognition, anxiety,
  getting along with people, etc.)
  
• Need-for-assistance questions
• W6 communication question
• Translation

16
Identifying Core Domains

• ESCAP/WHO 4th Workshop on Improvement of
  Disability Statistics and Measurement (Bangkok,
  June, 2006)
  
• Factor analysis research

17
Factor Loadings
18
Domain Selections

• Factor Analysis
• Life Activities
• Hearing
• Self Care
• Participation
• Mobility
• Vision

• 4th Bangkok Workshop Recommendation
• Life Activities
• Hearing
• Self Care
• Communication
• Mobility
• Vision

19
Moving Forward

• Further analysis of core domains
• To select/reconsider the phrasings of the
  questions for the selected domains
  
• Follow-up pilot studies for census
  recommendations and for an extended question
  set for use in surveys
  
• Regional training and advisory missions

20
Thank You!
www.unescap.org/stat/