State Data Quality Review Program

1
State Data Quality Review Program Improving the
Quality of State Crash and Inspection Data
Uploaded to MCMIS
2
State Data Quality Review Program Components

• Select state
• Preanalysis
• On-site visit
• Post Visit
• Document data reporting processes, observations
  and recommendations
• State selects which recommendations to pursue
• FMCSA technical assistance is available

3
State Data Quality Program Components

• Select a state
• Preanalysis
• On-site visit
• Post Visit
• Document data reporting processes, observations
  and recommendations
• State selects which recommendations to pursue
• FMCSA technical assistance is available

4
How do we decide where to go?
5
State Selection Methodology

• State Safety Data Quality (SSDQ) Results
• Contribution to the Nations data quality
  performance
• States willingness to participate

6
SSDQ Results June 2006
Crash Accuracy
Crash Timeliness
18
13
9
13
5
5
7
State Data Quality Program Components

• Select state
• Preanalysis
• On-site visit
• Post Visit
• Document data reporting processes, observations
  and recommendations
• State selects which recommendations to pursue
• FMCSA technical assistance is available

8
Preanalysis Completed Before the On-Site Visit

• SSDQ results (AI On-Line)
• Crash statistics (AI On-Line)
• Ad hoc MCMIS reports
• Crash form analysis

9
State Data Quality Program Components

• Select state
• Preanalysis
• On-site visit
• Post Visit
• Document data reporting processes, observations
  and recommendations
• State selects which recommendations to pursue
• FMCSA technical assistance is available

10
Who Participates in an On-Site Visit?

• Federal team
• HQ representation (when possible)
• MCMIS crash and inspection data
• Crash form
• Collection reporting process
• SafetyNet use
• State managers and support staff
• Crash and inspection data
• Collection, reporting, training

11
What HappensDuring an On-Site Visit?

• Talk to managers
• Talk to support staff
• Use as series of questions to guide the group
  through the discussions
• Define collection and reporting process
• Identify bottlenecks and practices resulting in
  compromised data quality
• Last day Federal team provides draft list of
  observations

12
On-Site Visit Covers Entire Crash Process
Input to State System
Crash Event
Data Collected
Upload/ Input To SNET
Upload to MCMIS
13
Observation Crash Collection Process
Compromises Data Accuracy
Input to State System
Complete Crash Form
Data Collected
Upload/ Input To SNET
Upload to MCMIS
14
Observation Crash Collection Process
Compromises Data Accuracy

• No distinction between interstate and intrastate
  trucks on crash form
• Crash reports sent to the State with common
  errors (USDOT, GVWR, cargo body types)
• Prior versions of the crash form used

15
Observation Crash Reporting Process Compromises
Data Accuracy
Input to State System
Complete Crash Form
Data Collected
Upload/ Input To SNET
Upload to MCMIS
16
Observation Crash Reporting Process Compromises
Data Accuracy

• Missing data filled-in with incorrect information
• Conversion of State data elements to SafetyNet
  elements

17
Observation Some Practices and Procedures at
the MCSAP Office Compromise Data Quality
Input to State System
Complete Crash Form
Data Collected
Upload/ Input To SNET
Upload to MCMIS
18
Observation Some Practices and Procedures at
the MCSAP Office Compromise Data Quality

• SafetyNet carrier match process not being used
  before sending data to MCMIS
• Infrequent census updates to SafetyNet
• MCSAP office uploads from SafetyNet to MCMIS
  occurring infrequently

19
Observation Not all FMCSA Reportable Crashes
are Uploaded to MCMIS
Input to State System
Complete Crash Form
Data Collected
Upload/ Input To SNET
Upload to MCMIS
20
Observation Not all FMCSA Reportable Crashes
are Uploaded to MCMIS

• State and FMCSA CMV definitions do not match
• Officers trained to identify FMCSA reportable
  crashes according to States definition.
• States definition used to extract FMCSA
  reportable crashes from States database.

21
State Data Quality Program Components

• Select state
• Preanalysis
• On-site visit
• After the on-site visit
• Document data process flows, observations and
  recommendations
• State selects which recommendations to pursue
• FMCSA technical assistance is available

22
After the On-Site Visit Document Crash Process
Flow
23
After the On-Site Visit The State is in Control

• State decides which recommendations to pursue
• FMCSA Technical Assistance is Available
• Crash form design to capture FMCSA data elements
• Officer training for crash form completion
• SafetyNet training

24
FMCSA Learns Too

• Opportunity for the state to give feedback to
  FMCSA
• Improve SafetyNet and MCMIS activity log formats
• SafetyNet training course needed for new user

25
For more information, please contactBetsy
BenkowskiFMCSA, Analysis Division202-366-5387B
eth DeysherUSDOT, Volpe Center617-494-2570