Maintaining Quality in Large EnterpriseWide Implementations:

1
Maintaining Quality in Large Enterprise-Wide
Implementations The Impossible Dream?
2
Agenda

• The Enterprise
• Don Moore
• QA and IVV
• Glenn Truglio
• Managing Quality
• Vijay Reddy
• Benefits to the Business Owner
• Don Moore

3
Agenda

• The Enterprise
• Don Moore
• ACESS Project Director,
• State of Louisiana

4
The Enterprise

• Louisiana Department of Social Services
• Office of Family Support
• Office of Community Services
• La. Rehabilitation Services
• Office of Management and Finance

5
The Enterprise

• Office of Family Services
• Programs TANF, Food Stamps, Child Support
  Enforcement, Child Care Assistance
• 2,739 Staff
• 523,425,664 (An additional 780,000,000 in Food
  Stamp benefits authorized annually) Annual Budget

6
The Enterprise

• Office of Community Services
• Programs Foster Care, Adoptions, Child
  Protective Services, Family Services
• 1,865 Staff
• 211,405,665 Annual Budget

7
The Enterprise

• La. Rehabilitation Services
• Programs Vocational Rehabilitation, Independent
  Living, Commission for Deaf, Traumatic Head and
  Spinal Cord Injury Trust Fund
• 385 Staff
• 61,603,781 Annual Budget

8
The Enterprise

• Office of Management and Finance
• Fiscal Services, Information Technology,
  Licensing, Human Resources, Administration
• 334 Staff
• 61,692,746 Annual Budget

9
Deployment Strategy Phase 1
10
ACESS After Phase 2
11
Agenda

• Quality Assurance (QA) and Independent
  Verification Validation (IVV)
• Glenn Truglio
• Technology Support Division
• President, MAXIMUS

12
QA and IVV

• Ongoing Processes Built Into the Project
• Based on Industry Standards
• IEEE / ISO 9000 / CMM
• Focus on Risk Mitigation
• QA Focus is on Project Management Processes
• IVV Focus is on Technical and Software

13
QA and IVV
14
QA and IVV
Sources of Software Errors
McCabe, Thomas J., and Schulmeyer, G. Gordon,
"The Pareto Principal Applied to Software Quality
Assurance," in The Handbook of Software Quality
Assurance, Schulmeyer, G. Gordon and McManus,
James I., ed., New York Van Nostrand Reinhold
Company, Inc., 1992, 2nd ed.
15
QA and IVV

• Risk Management
• Planning
• Identification
• Assessment
• Mitigation
• Tracking

16
Agenda

• Managing Quality
• Vijay Reddy
• ACESS QA/IVV Project Manager,
• MAXIMUS

17
QA and IVV Structure
18
QA Approach

• Prevention
• Processes to get it right the first time
• Risk analysis for products and processes
• Appraisal
• Testing and control to measure quality
• Deliverable reviews
• Process reviews
• Failure
• Prioritize
• Address problems and defects
• Determine how to prevent recurrence

19
QA Methodology
Organization
Test Policy ISO 9001 / IEEE 730
Test Strategy ISO 9000-3 / IEEE 1012
Project
Project Test Plan IEEE 829
Phase
Phase Test Plan (Unit) IEEE 829
Test Documentation IEEE 829
Test Terminology IEEE 610.12
Test Process IEEE 1028
Incident Management IEEE 1044
Test Process Improvement SEI CMM / ISO 9000 /
ISO 12207
20
IVV Definition

• VERIFICATIONEnsure that the system gets built
  right
• VALIDATION Ensure that the right system was
  built

21
IVV Approach

• Ensure a comprehensive system engineering
  development process exists and is followed
• Evaluate ALL key engineering products and
  processes
• Conduct detailed requirements-to-design-to-code
  analysis based on code criticality, complexity,
  and defect history
• Ensure comprehensive verification testing by
  developer
• Continually assess project risks and address
  cost-effective mitigation actions

22
IVV Methodology
Concept Exploration
Validate
Allocate to Hardware, Software, Procedures,
etc.
Requirements Analysis
Assess for Quality Factors
Enhancements
Subsystem/System
Design
Corrections
Traceability
Implementation
Preliminary or Top Level Design
Testing
Traceability
Unit Level Coding
Traceability
Installation and Checkout
Detailed Design
Unit Testing Unit Integration
Acceptance
Traceability
Traceability
Unit Integration Testing
Operations and Maintenance
Operational Testing
Traceability
Disposal
- Corrections - Enhancements
An Overlaid Software Life Cycle(IEEE 1074-1995)
23
Agenda

• Benefits to the Business Owner
• Don Moore
• ACESS Project Director,
• State of Louisiana

24
Benefits to the Business Owner

• Ensures monitoring, tracking, and reporting on
  project work plan progress against plan
• Ensures monitoring, tracking, reporting, and
  mitigation of risk during each project lifecycle
  phase

25
Benefits to the Business Owner

• Allows for an independent, objective, third party
  assessment based on industry accepted standards
  and best practices
• Provides for quality review of all project
  deliverables

26
Benefits to the Business Owner

• Louisiana Benefits To Date
• Credibility - has provided affirmation of the
  state teams assessment of the project status and
  contractor deliverables.
• Expertise provides subject matter expertise in
  assisting state in issue and risk evaluation and
  mitigation.
• Mentoring provides state staff broader
  perspective of process and impacts.

27
(No Transcript)