Mixed Methods

1
Mixed Methods

• Thilo Kroll, PhD
• SCI RRTC on Prevention of Secondary Conditions
  Through Exercise

2
Defining Mixed Methods

• A mixed methods study involves the collection or
  analysis of both quantitative and/or qualitative
  data in a single study in which the data are
  collected concurrently or sequentially, are given
  a priority, and involve the integration of the
  data at one or more stages in the process of
  research.
• (Creswell, Plano Clark, Gutmann Hanson, 2003,
  p. 212)

3
Reasons for MM use

• Exploratory research
• Explanatory research
• Theory building
• Program development and evaluation
• Community participation (CBPAR)

4
Common MM combinations
5
Design criteria

• Implementation sequence (sequential, concurrent,
  nested)
• Implementation goal (exploratory, explanatory,
  transformative)
• Priority
• Integration
• Theoretical perspective

6
Stages of Integration
7
Mixed Method Design Types
8
R4 Comparison of exercise training formats in
individuals with SCI

• Sequential-exploratory
• Phase 1 Qualitative study phase What do
  consumers think could work for them?
• 4 consumer focus group interviews to determine
  preferred exercise formats, barriers to and
  facilitators of physical activity
• Phase 2 Quantitative study phase What does
  work?
• n75, followed over 2 years, Peer mentor contact,
  4 experimental groups, 1 control
• Medical complications, Exercise activity, Quality
  of Life Measures, Satisfaction with exercise
  program

9
R4 Sequential-exploratory
10
R5 Exercise and Secondary Conditions A National
Prospective Survey of People with SCI

• Sequential-explanatory
• Phase I Quantitative study phase What are the
  relationships between exercise and secondary
  conditions?
• N1000 individuals with SCI, stratified sample
• 2 survey waves exercise behavior, secondary
  conditions
• Phase II Qualitative study phase Why do (not)
  people exercise? What are the perceived benefits?
• 30 individual interviews (15 exercisers 15
  non-exercisers personal, social, environmental
  barriers to and facilitators of exercise
  perceived benefits

11
R5 Sequential-explanatory
12
Data analysis and interpretation
13
Triangulation

• Qualitative and quantitative results may
• converge and lead to the same conclusions
• be complementary
• be divergent or contradictory

14
Software use

• Qualitative software (e.g. Atlas ti, NVivo)
  allows for import of survey data (search of
  qualitative data by quantitative attributes)
• Qualitative software allows for export of
  tabulated data (e.g. numeric information on coded
  text segments)
• Quantitative software (e.g. SPSS) allows for txt
  and rtf export of string variables, which can be
  processed/coded by qualitative software packages
• Quantitative software (e.g. SPSS) allows for
  integrated analysis through add-on modules (e.g.
  TextSmart)

15
Strengths and Weaknesses of MM

• Strengths
• comprehensiveness
• extended external validity (ecological validity)
• opportunity for consumer participation
• applied focus and practice orientation

• Weaknesses
• challenges to methodological rigor
• time consuming, costly designs
• require multi-method expertise
• higher planning risk (multiple study phases)

16
Summary

• MM designs have significant practical value
• MM designs promote consumer involvement
• MM designs are time consuming, costly, and have a
  higher implementation risk
• MM studies require MM expertise
• Quality control of MM studies poses a challenge