Statistics in Software Quality and Reliability

1
Statistics in Software Quality and Reliability

2
Distribution of 465 references
3

• Statistical modelling
• Object modelling quality and reliability
  strategies based on statistical methodology
• Meta modelling empirical studies in software
  engineering

4

• I. Object Modelling

5

• Software reliability models
• conditional failure rate for time to failure
  (CFR) Jelinski Moranda (1972) etc.
• CFR extended by prior distribution Langberg
  Singpurwalla (1985) etc.
• nonhomogeneous Poisson for failure numbers Goel
  Okumoto (1979) etc.
• marked point processes as a general framework
  Goel Okumoto (1979)

6

• autoregressive times between failure with random
  coefficients Singpurwalla Soyer (1985)
• non-Gaussian Kalman filter for coefficients Chen
  Singpurwalla (1994)
• shot noise models point process (shots) with
  random marks (stress) deceasing deterministically
  between shots, Al-Mutairi et. al. (1998)

7

• Statistical models for testing
• test case selection, sampling from vector
  populations
• latin hypercube sampling McKay et al. (1979),
  Stein (1987) etc.
• DOE approaches Phadke (1993), Cohen et al.
  (1994)

8

• Statistical models for optimal testing
• based on reliability models
• sequential decision theory
• Dalal Mallows (1988, 1990, 1992), Singpurwalla
  (1991) etc.

9

• Statistical quality control (SQC) for software
• Ishikawa tools
• control charts Xbar-S, Xbar-R, XmR, p, np, u, c
• Six Sigma
• SQC monographs Burr Owen (1996), Florac
  Carleton (1999)
• Six Sigma monograph Tayntor (2002)

10

• Controversial discussion on SPC
• Manufacturing tools for software development?
• Inhomogeneity of processes
• Rapid technological change
• Multiform cause systems
• High dispersion

11

• Statistical models for experimentation
• classical DOE and analysis of experiments
• Monographs Wohlin et al. (2000), Juristo
  Moreno (2001), Prechelt (2001)

12

• Statistical models in development cost
  prediction
• CART (classification and regression trees)
• classical regression analysis, ANOVA
• Poisson regression
• ordinal regression
• stepwise regression and ANOVA
• Bayesian models

13

• Conclusion on statistical modelling
• Reliability models highly diversified, specific
  research for software sector
• SPC models adopted from manufacturing, few
  specific research for software sector
• Links between reliability/testing models and SPC
  models?
• General variation transmission modelling?

14

• II. Empirical Studies

15

• Topics of empirical studies
• Cost of software quality
• Software development cost prediction
• SPC feasibility studies
• Testing procedures

16

• Statistics in empirical studies
• elementary descriptive
• explorative (classification and regression trees,
  clustering etc.)
• regression analysis, ANOVA
• linear models