DOE Corporate Safety Performance Indicators ISM Best Practices Workshop Patrice Bubar Office of Corp

1
DOE Corporate Safety Performance
IndicatorsISM Best Practices WorkshopPatrice
BubarOffice of Corporate Safety Analysis
2
What is the basis for DOE to utilize Corporate
Safety Performance Indicators?

• A review of industry practices shows that
  successful industries use corporate indicators.
  They are also using them as management tools to
  reward good performance.
• Businesses know what business lines they manage
  and therefore know what they have to control and
  measure. This includes operations and safety.
• DOE can do this as well but must overcome some
  complexities.

3
Proposal for Consideration

• The Department would benefit at a site level and
  corporately from having a more predictable set of
  corporate safety indicators
• Define a base set of Unacceptable Outcomes as
  Corporate Safety Performance Indicators
• Progress towards avoiding these outcomes can be
  measured by using a predictable set of leading
  indicators
• Predictability not only benefits DOE management
  but aids its contractors in meeting its
  customers needs. (While this meets the
  Departments needs overall, it also fulfills the
  requirements of DOE P 450.7)

4
Unacceptable Outcomes

• Those events that must be avoided.
• DOE Corporate safety performance is defined in
  terms of the DOEs ability to avoid such
  outcomes.
• Poor performance in preventing these outcomes
  would likely indicate serious systemic failures
  and impact the Departments success.

5
Proposed Unacceptable Outcomes

• Significant Offsite Loss of Control of
  Radiological or Contaminated Material
• Significant Offsite Environmental or Public
  Impact (non-radiological)
• Inadvertent Criticality
• Deaths/Serious Injuries
• Serious Radiation or IH Exposure to Workers
• Serious Unplanned Fire or Explosion
• Loss of Control of SNM
• Loss of Control of Critical/Sensitive Information
• Mission Failures

6
Reporting Results

• Status Report
• A one point determination (quarterly) of
  overall performance against an Unacceptable
  Outcome. Performance is expressed in terms of
  Green (Good), Yellow (Average) and Red
  (Poor).
• Trend Report
• A measure of the quarterly change in
  performance compared over a rolling 24 month
  period. Performance is expressed in terms of
  Acceptable Trend and Unfavorable Trend.

7
Corporate Indicator Process
Unacceptable Outcome

• Establish
• performance,
• benchmarked
• against
• 2 yrs. DOE Experience
• commercial industry
• management
• expectations

• Normalize
• Hours worked
• Rates of occurrence
• Number of events

Normalized Leading Indicator

• Weighting
• Factor
• Relevance of
• Indicator to outcome
• Size of data set
• Quality and depth
• of data

Weighted Normalized Events x Number of events
Score of Leading Indicator
Leading Indicators
Sum of all scored Leading Indicators
Legend Acceptable Trend
Unfavorable Trend Significant
Weakness Requires Immediate
Attention
Total Result
8
Path Forward

• Proposal for Corporate Indicators to be discussed
  with ISM Champions at September Meeting.
• Concept being tested with actual results (from
  earlier quarters) to determine its predictive
  capability.
• Begin reporting in 1st Quarter FY07.

9
Appendix

• LEADING INDICATORS

Draft indicators are being reviewed against data
availability, amount, accessibility, quality and
relevancy criteria
10
Initial Data Sources for Leading Indicators
11
Precursors (Leading Indicators) for Significant
Offsite Loss of Control of Radiological and
Contaminated Material

• Normalization Source Where Is It
  Reasonable
• Performance Measures Factor Data Comes From
  and Relevant?
• Offsite Loss of Control of
  ORPS Group 6A(1- 3)
• Radioactive Materials or Spread Work
  Hours 6B(1) Yes
• of Contamination
  Keywords 2A, 9B
  
  
• Transportation Incidents involving
• Radiological and Contaminated Number per
  Year ORPS Group 8(1- 4) Yes
• Material Keywords 10A, 10D, 10E
• Events Related to Excessed Number per
  Year ORPS Group N/A Yes
• Equipment Keywords 11K
• Onsite Loss of Control of
• Radioactive Materials or Spread ORPS
  Group 6A(2- 3)
• of Contamination Work Hours 6B(2- 4)
  Yes
• Keywords 2A, 6B, 9B
• Personnel Radiation Exposure ORPS Group 6C(1-
  4)

12
Precursors (Leading Indicators) for Significant
Offsite Environmental or Public Impact
(non-radiological)

• Normalization Source Where Is It
  Reasonable
• Performance Measures Factor Data Comes From
  and Relevant?
• OSHA Reportable Exposures Work Hours
  ORPS Group 2A(4, 5) Yes
• Keywords 8C
• 
  
• Transportation Incidents involving
• Hazardous Material (Non-Rad) Number per Year
  ORPS Group 8(1- 4) Yes
• Keywords 10A, 10E
• Noncompliance Notification Number
  per Year ORPS Group 9(1, 2) Yes
• Keywords 2C, 10D
  
• Onsite or Offsite Reportable
• Environmental Release Number per Year ORPS
  Group 5A(1- 4) Yes
• Keywords 2A, 2E

13
Precursors (Leading Indicators) for Inadvertent
Criticality

• Normalization Source Where Is It
  Reasonable
• Performance Measures Factor Data Comes From
  and Relevant?
• Loss of Criticality Control Events
  Number per Year ORPS Group 3C(1, 2) Yes
• Keywords 1J
• TSR Violations Related to Criticality
  Number per Year ORPS Group 3A(1- 3) Yes
  
• Keywords 1J, 4B, 12L
• Inadvertent Transfer Number per Year ORPS Group
  4B(5) Yes
• Keywords 1E

14
Precursors (Leading Indicators) for
Deaths/Serious Injuries

• Normalization Source Where Is It
  Reasonable
• Performance Measures Factor Data Comes From
  and Relevant?
• Deaths due to DOE Operations
  N/A Accident Investigations
• ORPS Group 2A(1) Yes
• Keywords 8E
• Serious Injuries or Exposures
  Accident Investigations
• (Individuals Multiple Persons) Work
  Hours ORPS Group 2A(2- 6) Yes
• Keywords 8(A-D)
• CAIRS
• Violations of Hazardous Energy
• Control Process (electrical and/or Work
  Hours ORPS Group 2C(1, 2)
• mechanical) and Electrical Keywords
  1(K, L, M ) Yes
• Safety 8(A, J), 12(C I)
• Near Misses Work Hours ORPS Group 10(3)
  Yes
• Keywords 12K, 8J, 8K __
• TRC DART (with Filter) Work Hours CAIRS
  Data Yes

15
Precursors (Leading Indicators) for Serious
Radiation or IH Exposure

• Normalization Source Where Is It
  Reasonable
• Performance Measures Factor Data Comes From
  and Relevant?
• OSHA Reportable Exposures Work
  Hours ORPS Group 2A(4, 5) Yes
• Keywords 8C
• CAIRS
• Personnel Radiation Exposure ORPS Group 6C(1-
  4)
• and/or Contamination Work Hours
  6D(1-3) Yes
• Keywords 6A, 6C, 6F, 6G
• Ventilation System
• Equipment Failures Number per Year Keywords
  5C, 5G Yes

16
Precursors (Leading Indicators) for Fire or
Explosion

• Normalization Source Where
  Is It Reasonable
• Performance Measures Factor Data
  Comes From and Relevant?
• Explosion Number per Year ORPS Group
  2B(1- 3), 7 Yes
• Keywords 3C, 3D, 11A, 11C
• Onsite Fires Number per Year ORPS Group
  2B(1- 3) Yes
• Keywords 3(A-E)
• Offsite Fires Number per Year ORPS Group
  2B(4) Yes
• Keywords 3C