Evaluation of Discussionbased Exercises

1
Evaluation of Discussion-based Exercises

• Dale C. Brandenburg
• Elizabeth A. Prebles
• Aylin D. Sayir

2
Background

• Limited research in understanding the
  effectiveness of disaster / emergency
  preparedness exercises
• Agency / Business Coordination How is it
  defined? What process used to achieve it?
• What are the components needed to understand how
  exercises can contribute to increased
  coordination?

3
Logic Model for Exercise Effectiveness
4
Method

• Data Set
• 4 discussion-based exercises
• 4 locations across the U.S.
• Varying points in time
• Telephone interviews
• Online Survey
• Follow-up Interviews

5
Telephone Interviews

• Small sub-sample from each exercise
• Confirm evaluation issues
• Email notification
• Data Collection
• Approximately 20 minutes long
• Three interviewers same protocol

6
Interview Interview Analysis

• 14 interviews analyzed
• Constant comparison analysis by
• Question
• Individual participant
• Region of exercise
• Most common themes determined

7
Online Survey

• Survey Measures
• Exercise Outcome
• Organizational Actions
• Personal/Organizational Characteristics
• Exercise Design Features
• Data Collection
• Main participants
• Control group

8
Next Steps

• Status of online survey
• Further analysis
• Publication of Results