Specification Document Metrics

1
Specification Document Metrics
Professor Ron Kenett Tel Aviv Unversity School
of Engineering
2

• DIMENSIONS OF QUALITY
• Functionality
• Usability
• Reliability
• Performance
• Serviceability
• Hewlett-Packard in the late 1970s, ISO 9126,
  Information Technology
• Software Produvct Evaluation - Quality
  Characteristics and
• Guidelines for their use., IEEE Software, January
  1996.

3

• Metric
• Understandable.
• Field Tested.
• Economical
• High Leverage.
• Timely.
• Measurement
• Setting of standards or goals
• Computation in a timely manner
• Comparison with appropriate standards or goals
• Evaluation of difference to determine required
  action
• Periodical review of standards, metrics
  definition, actions.

4
SOFTWARE SPECIFICATIONS METRICS -
Completeness - Accuracy - Correctness -
Consistency - Redability - Testability
5
? Initiator ? Action ? Conditions for action ?
Constrains on action ? Object of action ? Source
of object ? Destination of object ?
Mechanization ? Reason
Parsing Requirements (1) Initiator of Action
Initiator of Action is the subsystem, function
or subfunction which causes the action.
Initiators may be applied, as is frequently true
when the action is passive but are required
attributes in all sentences. The initiator is
analogous to the subject in English grammar. (2)
Action There are two types of action
positive and negative. A positive action is
the information processing or transfer of data as
performed by the Initiator. A negative action is
the assignment of constraints to an
operation. (3) Conditions For Action The
conditions for actions are the prerequisite
states, activities, and/or data which are
necessary for the action to occur. (4)
Constraints on Action The constraints on Action
define the boundary conditions enforced on the
action after initiation. Constraints bound
influence, define termination criteria, and
specify limits.
6
Parsing Requirements - 2 (5) Object of
Action The Object of Action is the subsystem,
function, subfunction, or data item which is
being acted on by Initiator via the action. (6)
Source of Object The source of Object is the
immediate subsystem, function, subfunction, or
information structure (data base) from which the
Object originates. (7) Destination of
Object The Destination of Object is the immediate
subsystem, function, subfunction, or information
structure (data base) where the Object is
sent. (8) Mechanization of Action How is the
action accomplished?. (9) Reason for Action
Reason for Action provides the rationale for the
action. This information is not strictly
necessary, but often helps to clarify the intent
of a requirement sentence.
7
An RSI shall be provided when either of the
following conditions occur... would be
rewritten (for analysis purposes only) as
Remote Status Reporting shall provide
an RSI when either of the following conditions
occur...
8
Referencing Sentence XX.2.1.1 INPUTS - The
inputs shall be as described in Table XX.2.1-1
9
? Initiator ? Action ? Conditions for action ?
Constrains on action ? Object of action ? Source
of object ? Destination of object ?
Mechanization ? Reason
Parsed translated requirements sentence
? ? ? XX.2.1.1/1 Functi
on 1 shall input the activity Inititation
Request
? ?
from the application software on request
? ?
? XX.2.1.1/2 Function 1 shall input the elapsed
time indicator ?
? from the timer control on request
10
? Initiator ? Action ? Conditions for action ?
Constrains on action ? Object of action ? Source
of object ? Destination of object ?
Mechanization ? Reason
? ? ? ? In
post-attack, the ALCC shall report
?
? the launcher summary status from the OCC
?
? to higher authority via the MF radio
? and within TBD
seconds of status verification
? to prevent a delay in
decision resolution.
11
? Initiator ? Action ? Conditions for action ?
Constrains on action ? Object of action ? Source
of object ? Destination of object ?
Mechanization ? Reason
? ? ? ? In
post-attack, the ALCC shall report
?
? the launcher summary status from the OCC
?
? to higher authority via the MF radio
? and within TBD
seconds of status verification
? to prevent a delay in
decision resolution.
12
SPECIFICATION METRICS RAW DATA N1 - Total number
of sentences N2 - Total number of attributes N3 -
Total number of missing attributes N4 - Total
number of ambiguous attributes N5 - Total of
missing source attribs N6 - Total of missing
destination attribs N7 - Total of ambiguous
source attribs N8 - Total of ambiguous
destination attrs N9 - Total number of source
attributes N10 - Total of destination
attributes N11 - Total number of valid attribs
(lt9) N12 - Total number of TBD N13 - Total of
missing conditions attribs N14 - Total of
missing constraints N15 - Total of descriptive
sentences
? Initiator ? Action ? Conditions for action ?
Constrains on action ? Object of action ? Source
of object ? Destination of object ?
Mechanization ? Reason
13
SPECIFICATION METRICS DEFINITIONS SM1 - Missing
information N3/N2 SM2 - Ambiguous information
N4/N2 SM3 - Functional Connectivity
(N5N6N7N8)/(N9N10) SM4 - Attributes presence
N11 SM5 - TBD frequency N12/N2 SM6 - Missing
conditions information N13/N1 SM7 - Missing
constraints N14/N1 SM8 - Descriptive
information N15/N1
? Initiator ? Action ? Conditions for action ?
Constrains on action ? Object of action ? Source
of object ? Destination of object ?
Mechanization ? Reason
14

• SM1lt1/200 is considered excellent
• 1/200ltSM1lt5/400 is considered fair
• 5/400ltSM1lt5/200 is considered deficient
• SM1gt 5/200 is considered highly deficient
• BLUE - Exceeds all required performance levels
  excellent
• GREEN - Complies with required performance
  levels fair
• YELLOW - Contains some deficiencies in
  performance levels
• RED - Contains major deficiencies in performance
  levels.
• Blue and Green are considered accepable
• Yellow and Red are considered unacceptable.

15

• Completeness 8(SM14SM2SM3) (9-SM4)/5.5
  2SM5
• Readability 40SM3 (.33 -SM8)/.25
• Accuracy 20SM2 40SM5 5SM6 0.5SM7.

16

• Completeness 8(SM14SM2SM3) (9-SM4)/5.5
  2SM5
• Readability 40SM3 (.33 -SM8)/.25
• Accuracy 20SM2 40SM5 5SM6 0.5SM7.

17
(No Transcript)