Calibration Software Uncertainty Implementation Philosophies and Practices

1
Calibration Software Uncertainty Implementation
Philosophies and Practices Speaker/Author
Jorge Martins
2
Laboratory to Document and Approve

• Calibration procedures
• Uncertainty analysis
• Uncertainty budgets
• Calibration procedures validation plan
• Calibration procedures validation results
• Traceability chain for each measurement method

3

• Early Developments of Calibration Procedure
  Software
• Lack of uncertainty standardization
• Focus on the needs of a particular organization
• No international uncertainty standards to follow

4
ISO/IEC 17025 and GUM
5
ILAC-P14 12/2010 Policy for uncertainty in
calibration

• Requires that to issue an accredited calibration
  certificate a laboratory must
• Estimate expanded uncertainty for each
  measurement
• Estimation is compliant with GUM
• Certificate shall report numerical value of
  uncertainty for each measurement
• Implicit references to uncertainty are NOT
  acceptable

6
(No Transcript)
7
Uncertainty Implementation in Software
Group Measurement Uncertainty Type of SW
I Not supported Open source Procedure can be modified by the laboratory
II Budget is supported Open source Procedure can be modified by the laboratory
III User defined per point Locked by developer Procedure cannot be modified by the laboratory
IV Developer defines budget Locked by developer Procedure cannot be modified by the laboratory
V Developer defines budget Locked by developer Procedure cannot be modified by the laboratory Unc. Budget ISO 17025 Accredited by 3rd party
8
(No Transcript)
9
(No Transcript)
10
(No Transcript)
11
Document maintenance and validation responsibilities Document maintenance and validation responsibilities Document maintenance and validation responsibilities Document maintenance and validation responsibilities Document maintenance and validation responsibilities Document maintenance and validation responsibilities
Group I Group II Group III Group IV Group V
Uncertainty analysis (UA) External maintained External maintained External maintained External maintained Not available to user
Uncertainty budget (UB) External maintained Internal user available External maintained Internal user available Internal Not available to user
Repeatability (type A) collection Not available Original readings user available Not available Original readings user available Internal Not available to user
Uncertainty analysis approval User resp. User resp. User resp. Developer responsibility Dvlp. Resp. 3rd party IT test accredited
Unc. budget calculations validation User resp. Not need SW framework validated User resp. Not need SW framework validated 3rd party IT test accredited
Calibration Procedure validation User resp. User resp. Not need SW framework validated Not need SW framework validated Not need SW framework validated
Traceability Req. User defined User defined User defined Developer defined Developer defined
12
Laboratory Calibration Procedure implementation
Efforts
13
Major Characteristics Major Characteristics Major Characteristics Major Characteristics Major Characteristics Major Characteristics
I II III IV V
User has complete control of measurement process v v X X X
Uncertainty validation is independent of measurement procedure v X v X X
Merged data (measurement and uncertainty) is available to issue calibration certificate X v v v v
Validation of uncertainty engine calculations X v X v v
Uncertainty budget is not directly synchronized with measurement procedure X v X v v
Type A data collection in real time X v X v1) v1)
Noisy units detection in real time X v X v1) v1)
User technically challenging to make changes on the measurement process v v X2) X2) X2)
Requires metrologist with SW knowledge v v X2) X2) X2)
User defined environmental conditions v v X X X
User defined Uncertainty analysis constraints and assumptions v v X X X
14
Calibration SW Validation Efforts
15
Commercially Available Software

• When the software is
• Commercially available
• Documented
• Locked by the development house
• The laboratory procedure validation
• Trained technicians
• Operational Capabilities
• Resources

16
Calibration SW Development Process
17
Calibration SW Development Deliverables

• SW House Calibration Final Report
• Reference to Documented calibration procedure
  implemented
• Validation Report summary
• Uncertainty analysis Summary
• Detailed SW specifications

18
(No Transcript)
19
Conclusion

• Significant difference in Laboratory
• Validation efforts
• Calibration procedure control
• Uncertainty analysis control

Group I Group II Group III Group IV Group V
Estimation Laboratory Approval Efforts 100 90 55 25 20
20
Questions?