FMCSA State Safety Data Quality: Enhancing the Evaluation August 2006

1
FMCSA State Safety Data Quality Enhancing the
Evaluation August 2006
2
Presentation OverviewState Safety Data Quality
Enhancements

• Where are we now?
• How can we improve?
• Where are we headed?

3
Where are we now?Data Driven

• Through our partnership in the MCSAP the FMCSA
  shares a common safety goal with the States
• FMCSA and State partners share in recognition
  that quality data is essential
• Uniform, complete, accurate and timely
  information needs to be collected and reported to
  FMCSA on crashes and roadside inspections

4
Where are we now?Data Quality Efforts
UMTRI Off-site Analysis of State Crash Data
Monthly Monitoring of State Data Quality
On-site State Data Quality Reviews
FMCSA Data Quality Improvement Program
Analysis and Improvement of State PARs
DataQs
Safety Data Improvement Funding
5
Where are we now?Data Quality Efforts
UMTRI Off-site Analysis of State Crash Data
Monthly Monitoring of State Data Quality
On-site State Data Quality Reviews
FMCSA Data Quality Improvement Program
Analysis and Improvement of State PARs
DataQs
Safety Data Improvement Funding
6
Where are we now?State Safety Data Quality (SSDQ)

• Objective
• To evaluate the completeness, timeliness,
  accuracy and consistency of State-reported crash
  and inspection data in the Motor Carrier
  Management Information System (MCMIS)
• Methodology
• Consists of 5 performance measures and 1
  overriding indicator
• Results in a scorecard for each State

7
Where are we now?SSDQ Measures and Indicator
Fatal Crash Completeness
Crash Timeliness
Inspection Accuracy
Crash Accuracy
Inspection Timeliness
8
Where are we now?SSDQ Measures
Fatal Crash Completeness
Crash Timeliness
Inspection Accuracy
Crash Accuracy
Inspection Timeliness
Crash Reporting Consistency Indicator
9
Where are we now?SSDQ Enhancements to date
10
Where are we now?June 2006 SSDQ results
11
Where are we now?SSDQ results 27 Month
Comparison
March 2004
Good
24 States
Fair
13 States
Poor
14 States
12
How can we improve?2005 GAO Data Quality Report

• GAO Recommendations related to SSDQ
• Develop an Action Plan to implement enhancements
  to the SSDQ map and methodology
• Provide a crash-specific data quality rating
  separate from the Overall State rating
• Provide information on the website on the
  limitations of the map and the underlying ratings

13
How can we improve?Potential Enhancements to SSDQ

• GAOs evaluation highlighted areas for
  improvement in the SSDQ methodology
• FMCSA is addressing these items as well as
  developing potential new measures.

14
Where are we headed?Potential New Crash Measures
Crash Reporting Completeness
Crash Record Completeness
Crash Record Accuracy
15
Where are we headed?Crash Reporting Completeness

• Non-Fatal Crash Completeness Measure
• Evaluates the completeness of reporting of
  non-fatal crash records
• Fatal to non fatal crash records in MCMIS
  compared to the expected number of fatal to non
  fatal crash records

16
Where are we headed?Crash Record Completeness

• Driver Identification Record Completeness
• Evaluates whether a crash record has driver
  identification fields filled out completely
• Driver Identification fields
• Driver License
• Driver date-of-birth
• Driver First Name
• Driver Last Name
• License class

17
Where are we headed?Crash Record Completeness

• Vehicle Identification Record Completeness
• Evaluates whether a crash record has truck/bus
  identification fields filled out completely
• Vehicle Identification fields
• VIN
• License plate
• Vehicle configuration
• Cargo body type
• GVWR

18
Where are we headed?Crash Record Accuracy

• Hazmat Information Accuracy
• Evaluates the integrity/agreement of the hazmat
  information reported within a crash record
• Hazardous Material fields
• HM Placard
• HM Class Number
• HM Release
• HM 4 digit number

19
Where are we headed?Crash Record Accuracy

• Vehicle Information Accuracy
• Evaluates the integrity/agreement of the vehicle
  information reported within a crash record
• Vehicle Information fields
• Vehicle configuration
• Cargo body type

20
Where are we headed?Next Steps in Measure
Development

• Perform analyses to determine the existing
  quality of data reported by the States in the
  areas of interest
• Develop potential criteria for good, fair and
  poor performance
• Provide opportunity for States to give feedback
  on new measures
• Integrate new measures into SSDQ methodology

21
Where are we headed?Development of SSDQ Crash
Rating
22
In conclusion

• Weve made a lot of progress...
• SSDQ methodology shows improvement in the quality
  of data reported to MCMIS

• There are opportunities for improvement
• Develop additional measures for a more complete
  evaluation of the quality of data reported by the
  states

23
For more information or if you are interested in
providing input
http//ai.fmcsa.dot.gov/DataQuality/dataquality.as
p
Contact info Betsy BenkowskiFMCSA, Analysis
Division202-366-5387