The EIA-731 Capability Maturity Model,

1
(No Transcript)
2
The EIA-731 Capability Maturity Model, its
Relationship to Other Systems Engineering
Standards

• Paul Davies
• Thomson Racal Defence Ltd

3
Themes

• What Standards are Out There?
• Where did they come from?
• What topics do they cover?
• Whats their current status?
• Who uses them, and what for?
• Where are they going?
• Which one is best to use now?
• How do they support business process improvement?

4
The Frameworks Quagmire - What Standards are
out there?
MIL-Q -9858
SDCCR
PSP
MIL-STD-1679
SW-CMM
SW-CMM
DOD- STD- 2168
People CMM
SCE
DOD-STD -2167A
IEEE Stds. 730,828 829, 830,1012,1016
1028,1058,1063
NATO AQAP1,4,9
SA-CMM
ISO 15504 (SPICE)
EQA
MIL-STD- 498
FAA- iCMM
CMMI
Baldrige
Trillium
BS 5750
IPD- CMM
EIA/IEEE J-STD-016
DO- 178B
ISO/IEC 12207
DOD IPPD
SECM(EIA/IS 731)
SE-CMM
IEEE 1074
SECAM
TickIT
AF IPD Guide
SSE- CMM
Q9000
IEEE 1220
IEEE/EIA 12207
EIA/IS 632
ISO 10011
ISO 15288
MIL-STD -499B
EIA 632
Not released CMMI-SE/SW released IPPD
not yet released
Also see www.software.org/quagmire
5
The Frameworks Quagmire - What Standards are
out there?
MIL-Q -9858
SDCCR
PSP
Color Meaning of color Red A Capability Maturity
Model Green A U.S. Government or military
document Purple An international
standard Blue Commercial, professional, or
industrial association document (mostly U.S.)
Black Other
MIL-STD-1679
SW-CMM
SW-CMM
DOD- STD- 2168
People CMM
SCE
DOD-STD -2167A
IEEE Stds. 730,828 829, 830,1012,1016
1028,1058,1063
NATO AQAP1,4,9
SA-CMM
ISO 15504 (SPICE)
EQA
MIL-STD- 498
FAA- iCMM
CMMI
Baldrige
Trillium
BS 5750
IPD- CMM
EIA/IEEE J-STD-016
DO- 178B
ISO/IEC 12207
DOD IPPD
SECM(EIA/IS 731)
SE-CMM
IEEE 1074
SECAM
TickIT
AF IPD Guide
SSE- CMM
Q9000
IEEE 1220
IEEE/EIA 12207
EIA/IS 632
ISO 10011
ISO 15288
MIL-STD -499B
EIA 632
Not released CMMI-SE/SW released IPPD
not yet released
Also see www.software.org/quagmire
6
The Frameworks Quagmire - What Standards are
out there?
MIL-Q -9858
SDCCR
PSP
Software Development and Documentation
Standards, including Lifecycle models
MIL-STD-1679
SW-CMM
SW-CMM
DOD- STD- 2168
People CMM
SCE
DOD-STD -2167A
IEEE Stds. 730,828 829, 830,1012,1016
1028,1058,1063
NATO AQAP1,4,9
ISO 15504 (SPICE)
EQA
MIL-STD- 498
FAA- iCMM
CMMI
Baldrige
Trillium
BS 5750
IPD- CMM
EIA/IEEE J-STD-016
DO- 178B
ISO/IEC 12207
DOD IPPD
SECM(EIA/IS 731)
IEEE 1074
SECAM
TickIT
AF IPD Guide
SSE- CMM
Q9000
IEEE 1220
IEEE/EIA 12207
EIA/IS 632
ISO 10011
ISO 15288
Not released CMMI-SE/SW released IPPD
not yet released
Also see www.software.org/quagmire
7
The Frameworks Quagmire - What Standards are
out there?
MIL-Q -9858
SDCCR
PSP
MIL-STD-1679
SW-CMM
SW-CMM
DOD- STD- 2168
People CMM
SCE
DOD-STD -2167A
IEEE Stds. 730,828 829, 830,1012,1016
1028,1058,1063
NATO AQAP1,4,9
ISO 15504 (SPICE)
Quality, Quality Management and Quality Audit
Standards
EQA
MIL-STD- 498
FAA- iCMM
CMMI
Baldrige
Trillium
BS 5750
IPD- CMM
EIA/IEEE J-STD-016
DO- 178B
ISO/IEC 12207
DOD IPPD
SECM(EIA/IS 731)
IEEE 1074
SECAM
TickIT
AF IPD Guide
SSE- CMM
Q9000
IEEE 1220
IEEE/EIA 12207
EIA/IS 632
ISO 10011
ISO 15288
Not released CMMI-SE/SW released IPPD
not yet released
Also see www.software.org/quagmire
8
The Frameworks Quagmire - What Standards are
out there?
MIL-Q -9858
SDCCR
PSP
MIL-STD-1679
SW-CMM
SW-CMM
DOD- STD- 2168
People CMM
SCE
DOD-STD -2167A
IEEE Stds. 730,828 829, 830,1012,1016
1028,1058,1063
NATO AQAP1,4,9
ISO 15504 (SPICE)
EQA
MIL-STD- 498
FAA- iCMM
CMMI
Baldrige
Trillium
BS 5750
Integrated Product ( Process) Improvement Standar
ds
IPD- CMM
EIA/IEEE J-STD-016
DO- 178B
ISO/IEC 12207
DOD IPPD
SECM(EIA/IS 731)
IEEE 1074
SECAM
TickIT
AF IPD Guide
SSE- CMM
Q9000
IEEE 1220
IEEE/EIA 12207
EIA/IS 632
ISO 10011
ISO 15288
Not released CMMI-SE/SW released IPPD
not yet released
Also see www.software.org/quagmire
9
The Frameworks Quagmire - What Standards are
out there?
MIL-Q -9858
SDCCR
PSP
MIL-STD-1679
SW-CMM
SW-CMM
DOD- STD- 2168
People CMM
SCE
DOD-STD -2167A
IEEE Stds. 730,828 829, 830,1012,1016
1028,1058,1063
NATO AQAP1,4,9
ISO 15504 (SPICE)
EQA
Quality-Related Standards Linked to IPPD
Business Capability
MIL-STD- 498
FAA- iCMM
CMMI
Baldrige
Trillium
BS 5750
IPD- CMM
EIA/IEEE J-STD-016
DO- 178B
ISO/IEC 12207
DOD IPPD
SECM(EIA/IS 731)
IEEE 1074
SECAM
TickIT
AF IPD Guide
SSE- CMM
Q9000
IEEE 1220
IEEE/EIA 12207
EIA/IS 632
ISO 10011
ISO 15288
Not released CMMI-SE/SW released IPPD
not yet released
Also see www.software.org/quagmire
10
The Frameworks Quagmire - What Standards are
out there?
Software CMMs and Capability Evaluation Standard
s
MIL-Q -9858
SDCCR
PSP
MIL-STD-1679
SW-CMM
SW-CMM
DOD- STD- 2168
People CMM
SCE
DOD-STD -2167A
IEEE Stds. 730,828 829, 830,1012,1016
1028,1058,1063
NATO AQAP1,4,9
SA-CMM
ISO 15504 (SPICE)
EQA
MIL-STD- 498
FAA- iCMM
CMMI
Baldrige
Trillium
BS 5750
IPD- CMM
EIA/IEEE J-STD-016
DO- 178B
ISO/IEC 12207
DOD IPPD
SECM(EIA/IS 731)
IEEE 1074
SECAM
TickIT
AF IPD Guide
SSE- CMM
Q9000
IEEE 1220
IEEE/EIA 12207
EIA/IS 632
ISO 10011
ISO 15288
Not released CMMI-SE/SW released IPPD
not yet released
Also see www.software.org/quagmire
11
The Frameworks Quagmire - What Standards are
out there?
MIL-Q -9858
SDCCR
PSP
MIL-STD-1679
SW-CMM
SW-CMM
DOD- STD- 2168
People CMM
SCE
DOD-STD -2167A
IEEE Stds. 730,828 829, 830,1012,1016
1028,1058,1063
NATO AQAP1,4,9
ISO 15504 (SPICE)
EQA
MIL-STD- 498
FAA- iCMM
CMMI
Baldrige
Trillium
BS 5750
IPD- CMM
EIA/IEEE J-STD-016
DO- 178B
ISO/IEC 12207
DOD IPPD
SECM(EIA/IS 731)
IEEE 1074
SECAM
TickIT
AF IPD Guide
SSE- CMM
Systems Engineering Standards
Q9000
IEEE 1220
IEEE/EIA 12207
EIA/IS 632
ISO 10011
ISO 15288
MIL-STD -499B
EIA 632
Not released CMMI-SE/SW released IPPD
not yet released
Also see www.software.org/quagmire
12
The Frameworks Quagmire - What Standards are
out there?
MIL-Q -9858
SDCCR
PSP
MIL-STD-1679
SW-CMM
SW-CMM
DOD- STD- 2168
People CMM
SCE
DOD-STD -2167A
IEEE Stds. 730,828 829, 830,1012,1016
1028,1058,1063
NATO AQAP1,4,9
ISO 15504 (SPICE)
EQA
MIL-STD- 498
FAA- iCMM
CMMI
Baldrige
Trillium
BS 5750
IPD- CMM
EIA/IEEE J-STD-016
DO- 178B
ISO/IEC 12207
DOD IPPD
SECM(EIA/IS 731)
Systems Engineering Capability Maturity
Models (including Evaluation Methods)
SE-CMM
IEEE 1074
SECAM
TickIT
AF IPD Guide
SSE- CMM
Q9000
IEEE 1220
IEEE/EIA 12207
EIA/IS 632
ISO 10011
ISO 15288
Not released CMMI-SE/SW released IPPD
not yet released
Also see www.software.org/quagmire
13
The Frameworks Quagmire - What Standards are
out there?
MIL-Q -9858
SDCCR
PSP
MIL-STD-1679
SW-CMM
SW-CMM
DOD- STD- 2168
People CMM
SCE
DOD-STD -2167A
IEEE Stds. 730,828 829, 830,1012,1016
1028,1058,1063
NATO AQAP1,4,9
EQA
MIL-STD- 498
Integrated Capability Maturity Models (the whole
nine yards)
FAA- iCMM
CMMI
Baldrige
Trillium
BS 5750
IPD- CMM
EIA/IEEE J-STD-016
DO- 178B
ISO/IEC 12207
DOD IPPD
SECM(EIA/IS 731)
IEEE 1074
SECAM
TickIT
AF IPD Guide
SSE- CMM
Q9000
IEEE 1220
IEEE/EIA 12207
EIA/IS 632
ISO 10011
ISO 15288
Not released CMMI-SE/SW released IPPD
not yet released
Also see www.software.org/quagmire
14
Status of Lead Standard in each Framework
15
Status of Lead Standard in each Framework
16
What EIA 632 is about
17
EIA 632 Overview
18
EIA 632 Process Requirements
19
What EIA-731 is about

• Defines Focus (Process) areas generally felt to
  be of benefit for most businesses
• Defines capability levels for each FA
• Suggests questions to ask to evaluate whether the
  maturity level has been reached by the
  organisation performing the activity
• Provides recommended scoring scheme
• Provides recommended conduct of an evaluation
• Allows tailoring of FAs and questions to
  specific business needs

20
How is EIA 731 arranged?

• SE Domain - 3 Categories
• 19 Focus Areas
• Themes - 1-5 per Focus area
• Specific Practices within each theme
• Capability Domain
• Generic Practices
• Applied to any SE Domain Focus Area / Theme
• An activity which, when applied, enhances the
  capability to perform those practices
• Grouped by Maturity Level
• e.g. GP2.2 Verify Compliance with approved plans
  processes...
• Generic Attributes
• Effectiveness and Value of products achieved
  by SE Domain Themes
• Descriptions of Effectiveness Value for each
  Maturity Level
• Applicable to any Focus Area

21
SECM FAs for TC 1.0 SE Technical

• FA 1.1 Define Stakeholder and System Level
  Requirements
• FA 1.2 Define Technical Problem
• FA 1.3 Define Solution
• FA 1.4 Assess and Select
• FA 1.5 Integrate System
• FA 1.6 Verify System
• FA 1.7 Validate System

22
SECM FAs for TC 2.0 SE Management

• FA 2.1 Plan and Organize
• FA 2.2 Monitor and Control
• FA 2.3 Integrate Disciplines
• FA 2.4 Coordinate with Suppliers
• FA 2.5 Manage Risk
• FA 2.6 Manage Data
• FA 2.7 Manage Configurations
• FA 2.8 Ensure Quality

23
SECM FAs for TC 3.0 SE Environment

• FA 3.1 Define and Improve the Systems Engineering
  Process
• FA 3.2 Manage Competency
• FA 3.3 Manage Technology
• FA 3.4 Manage Systems Engineering Support
  Environment

24
SECM Capability Levels

• Level 0 Initial
• Level 1 Performed
• Level 2 Managed
• Level 3 Defined
• Level 4 Measured
• Level 5 Optimizing

25
Level 0 Initial

• Development Process characterised as
• Chaotic or Ad Hoc
• General Properties
• Not all practices accepted as enabling Systems
  Engineering are performed
• General failure to perform activities
• No easily identifiable work products
• No evidence tasks are accomplished

26
Level 1 Performed

• Development Process characterised as
• Informal
• General Properties
• All basic practices accepted as enabling Systems
  Engineering are performed
• Planning and tracking of practices is
  inconsistent
• Dependence upon individuals knowledge (heroes)

27
Level 2 Managed Characteristics

• Development Process characterised as
• Formal
• General Properties
• Activities are planned, tracked and verified
• Processes are defined but programme specific
• Adherence to specified process is monitored and
  enforced

28
Level 3 Defined Characteristics

• Development Process characterised as
• Institutionalised / Established
• General Properties
• Standard SE development process across the
  organisation
• Tailored if required for specific programmes
• Process metrics are collected
• Qualitative process improvement occurs

29
Levels 4 5 Characteristics

• Level 4 Process
• Improving
• Measurable quality goals established for work
  products
• Processes are quantitatively improved
• Level 5 Process
• Optimised
• Continuous quantitative process improvement

30
Which model is Best to use?

• It depends which you are most comfortable with
• 731 is very specific - perhaps good if you dont
  know where to start, and want a list of possibles
  to select
• CMMs give you a guideline for process
  improvement but perhaps assume a prior level of
  maturity?
• How do you want to measure yourself
• At intervals (staged)?
• Or continuously - harder work, but quicker
  feedback
• Lets hear the speakers
• . And debate it afterwards!