Using the Web to Support Data-based Decision Making

1
Using the Web to Support Data-based Decision
Making
Jay Buzhardt, Dale Walker, Charles Greenwood
Juniper Gardens Childrens Project Division of
Early Childhood Conference October 15, 2010
2
IGDI Website www.igdi.ku.edu

• Publicly accessible material
• IGDI descriptions
• Materials needed for IGDI implementation
• Scoring definitions
• Scoring sheets
• Administration checklists
• Toys for administration
• Psychometric properties
• Training and certification resources
• Intervention materials
• Contact information

• Online data system (password-protected)
• Data management
• Web-based certification
• Assessor management
• Child rosters and demographics
• Program-wide aggregated reports
• Data-based intervention decision making tools
• Making Online Decisions (MOD)

3
Current Data System and MOD Use

• IGDI Online data system use
• Over 32,000 assessments entered into the data
  system
• Over 11,000 infants and toddlers assessed
• Approximately 1,100 user accounts (certified
  assessors, program directors, data entry
  personnel, trainees, etc.)
• Usage covers 22 states and three countries
• MOD currently being tested in a limited number of
  midwestern Early Head Start and Part C programs
• Five Kansas Early Head Start programs currently
  using the MOD
• Iowa Heartland Area Agency (Part C)

4
Graphs and Reports that SupportData-based
Decision Making

• Base level support
• Progress Monitoring Graphs
• Weighted Total Communication
• Key Skill Elements
• Program Reports
• Identify children falling below benchmark
• Identify children due for an assessment
• Individual Child Reports

5
Individual Child Report
Childs Data Table
Childs Data Summary
6
Progress Monitoring GraphWeighted Total Early
Communication
Slightly Below Benchmark
Below Benchmark
7
Key Skill Elements Gestures Graph
8
Key Skill Elements Vocalizations Graph
9
Key Skill Elements Single Words Graph
10
Key Skill Elements Multiple Words Graph
11
Additional Support Making Online Decisions (MOD)
System

• Automate identification of low-performing
  children
• Document decision making progress within the data
  system
• Intervention(s) used
• Work with caregivers on implementing intervention
  strategies
• Caregiver intervention implementation
• Intervention changes
• Analysis of childs response to the intervention

12
MOD Overview
Quarterly ECI Assessments
No
Is there a problem?
13
Randomized Trial of the MODs Efficacy

• Primary Research Questions
• Does the MOD impact child outcomes?
• Does the MOD affect service providers
  decision-making behavior?
• Participants 5 Kansas Early Head Start programs
• Home visitors in each program randomly assigned
  to either use the MOD (n28) or continue standard
  services (n24)
• NonMOD group (standard services) used the ECI,
  entered data into data system, provided and/or
  referred child for intervention services as
  needed
• MOD group Standard services the MOD
• Children whose ECI score fell at least 1 sd below
  benchmark either receive MOD services (n45) or
  standard services (n53)

14
Effect of the MOD on ECI OutcomesLevel-1
Analysis(Children who score at least 1 sd below
benchmark on the ECI)
15
Effect of the MOD on ECI OutcomesLevel-2
Analysis(Children who score at least 1 sd below
benchmark on the ECI)
16
Effect of the MOD on Home Visitors Intervention
Services
17
Effect of the MOD on Home Visitors Intervention
Services
18
Home Visitor Perception of the MOD