Algorithm Implementation Process

1
 Algorithm Implementation Process 

• Pam Emch
• NGST Algorithm Thread Lead
• NPP Science Team Kick-off Meeting
• Annapolis, MD
• Nov 4-6, 2003 

2
Topics

•   Introduction to the SSPR Organization
•   Algorithm Lifecycle for NPP/NPOESS
• Top-Level Algorithm Status
•   Algorithm Configuration Management
•   Provision of Algorithms to OATs and NASA

3
SSPR Contractor Organization
Vice President and NPOESS Program Director Fred
Ricker Vice President and NPOESS Assistant
Program Director Mike Mader
Raytheon Deputy Program Manager Gerard
Wittman Operations Manager Bill Havens Technical
Director Terry Larson Supply Chain Manager
Brian Chappel Chief Engineer Ben James Project
Scientist Michael Mussetto Chief SW Engineer
Scott Yanke QA Manager Rick Ikemoto Raytheon
Subcontract Manager Bill Rightmier
System Engineering Integration Roy Tsugawa
System Test Evaluation Steve Young
Payloads Tom Kolesar
Space Segment Terry Larson
Ground Segments Keith Reinke
Operations Support Ben James
Spacecraft Don Adkins
IDPS, FTS Kerry Grant
Ground OS Tom Baugh
System Engineering TBD
LSS Rex Desilets
C3S Mark Sargent
Flight OS Terry Watson
System Integration Gary Waldeck
SSPR presenters come from these organizations
8/29/02
4
Algorithm Lifecycle Defined for Life of
NPP/NPOESS Program

• NGST has a defined cradle-to-grave algorithm
  process
• Prelaunch tools and processes are now in use
• Algorithms placed under software configuration
  management (SCM) upon delivery to NGST
• Maintained in common SCM environment throughout
  lifecycle
• Science definition of algorithms controlled by
  Algorithm CCB throughout lifecycle
• Developed a detailed definition of roles
  responsibilities across program throughout
  algorithm lifecycle

5
Algorithm Lifecycle
Payload IPT

• Delivered Science Algorithms
• ATBD
• Science-grade code
• Test Data Sets

Science Algorithm Development/ Procurement
SE IPT
Science Algorithm Verification

• Verified Science Algorithms
• ATBD
• Science-grade code
• Test Data Sets
• OADs

• Correction requests
• Incomplete delivery
• Non-compliant products
• Failure Analysis

IDPS IPT
Launch
Science to Operational Algorithm Migration

• Operational Algorithms
• Operational Algorithm Document
• Operational-grade code

• Science Discrepancy Reports
• Timeliness failure
• Quality failure
• EDR Test output

IDPS, SE, STE IPTs

• Operational Verification Test Reports
• Pass
• Fail
• - Timeliness failure
• - Quality failure

Operational Algorithm Performance Verification

• Verified Operational Algorithms
• Operational-grade code

• Calibrated/Validated Operational Algorithms
• Calibration Coefficients
• Operational-grade code

STE IPT

• Discrepancy reports
• New calibration coefficients

Operational Algorithm Cal/Val
Specific IPTs have responsibility and budget for
assigned algorithm activities within program
phases
OS IPT

• Discrepancy Reports
• Operation
• Performance

Long-Term Operational Algorithm Cal/Val
6
Current Lifecycle Status of Algorithms
7
Algorithm Lifecycle

• Delivered Science Algorithms
• ATBD
• Science-grade code
• Test Data Sets

Phase I - Payload IPT

• VIIRS, OMPS, and CrIS algorithms are currently
  furthest along, in Phase 2 and Phase 3
• All other algorithms are still in Phase 1

Science Algorithm Development/ Procurement
Phase 2 - SE IPT

• Verified Science Algorithms
• ATBD
• Science-grade code
• Test Data Sets
• OADs

Science Algorithm Verification

• Correction requests
• Incomplete delivery
• Non-compliant products
• Failure Analysis

Phase 3 - IDPS IPT
Launch
Science to Operational Algorithm Migration

• Operational Algorithms
• Operational Algorithm Document
• Operational-grade code

• Science Discrepancy Reports
• Timeliness failure
• Quality failure
• EDR Test output

Phase 4 - IDPS, STE IPTs

• Operational Verification Test Reports
• Pass
• Fail
• - Timeliness failure
• - Quality failure

Operational Algorithm Performance Verification

• Verified Operational Algorithms
• Operational-grade code

• Calibrated/Validated Operational Algorithms
• Calibration Coefficients
• Operational-grade code

Phase 5 - STE IPT

• Discrepancy reports
• New calibration coefficients

Operational Algorithm Cal/Val

• Discrepancy Reports
• Operation
• Performance

Phase 6 - OS IPT
Long-Term Operational Algorithm Cal/Val
8
NPP Algorithm Status
On schedule
Not on schedule
Schedule Legend
Issue
Watch Area
Comment Legend
Drop 1 (up to 3-31-03)
Drop 2 (4-1-03 to 9-17-04)
9
Provision of Algorithms, ATBDs, OADs and
supporting documents to OATs and NASA
10
Copies of Science Algorithms Available

• NGST, IPO, and NASA collaborated to enable
  provision of copies of versions of science
  algorithms to OATs, etc.
• These are copies of the delivery packages sent
  from SE IPT to IDPS IPT
• All of these versions are at intermediate steps
  in the lifecycle and are not final
• The algorithms are available via the NASA NEXT
  server
• Deliveries from SE to IDPS to date are available
• Individuals must be approved for access
• NASA individuals contact Bruce Guenther, GSFC

11
Algorithm Lifecycle Deliveries to the NASA NEXT
Server
Phase I - Payload IPT

• Quicklook A copy of this delivery, consisting
  of untested and unverified algorithms, is
  delivered to the IDPS IPT. An identical copy is
  to NASA NEXT.

• Delivered Science Algorithms
• ATBD
• Science-grade code
• Test Data Sets

Science Algorithm Development/ Procurement
Phase 2 - SE IPT

• Verified Science Algorithms
• ATBD
• Science-grade code
• Test Data Sets
• OADs

• An identical copy of the Verified Science
  Algorithm deliveries is sent to NASA NEXT.

Science Algorithm Verification

• Correction requests
• Incomplete delivery
• Non-compliant products
• Failure Analysis

Phase 3 - IDPS IPT
Science to Operational Algorithm Migration

• Operational Algorithms
• Operational Algorithm Document
• Operational-grade code

• Science Discrepancy Reports
• Timeliness failure
• Quality failure
• EDR Test output

Launch
Phase 4 - IDPS, STE IPTs

• Operational Verification Test Reports
• Pass
• Fail
• - Timeliness failure
• - Quality failure

Operational Algorithm Performance Verification

• Verified Operational Algorithms
• Operational-grade code

Phase 5 - STE IPT

• Discrepancy reports
• New calibration coefficients

Operational Algorithm Cal/Val

• Calibrated/Validated Operational Algorithms
• Calibration Coefficients
• Operational-grade code

• Discrepancy Reports
• Operation
• Performance

Phase 6 - OS IPT
Long-Term Operational Algorithm Cal/Val
12
Algorithm Configuration Control
13
Algorithm Configuration Control Board (ACCB)

• Roles and Responsibilities
• The ACCB has authority to review and approve
  changes to the documents and items under its
  control that do not affect the baseline-released
  documents under Program CCB control.
• Items Controlled
• Algorithm Theoretical Basis Documents (ATBDs)
• Science Code
• Algorithm Test Data
• Operational Algorithm Documents (OADs)
• ARB/ACCB meets weekly

14
Algorithm Configuration Control Board (ACCB),
contd

• Membership
• Chairman (SEI IPT Algorithm Implementation
  Process Lead Emch)
• 3 IPO Members (Haas, Duda, Baker)
• Reps for six IPTs (P/L, SE, SI, IDPS, STE, OS)
• Software Chief Engineer Rep
• Other attendees
• NGST Configuration Management
• Supporting individuals (additional members of the
  IPTs, including SSPR team, IPO, NASA)

15
Precursor Meetings Flow Up Change Requests to
ACCB

• Bi-weekly SE IPT VIIRS and CrIS/ATMS Algorithm
  Performance meetings
• Discuss hardware and software topics of
  importance to algorithm and product performance
• Weekly SE IPT MS S/W CCB meetings
• Discuss and request changes to ACCB controlled
  items for work done within SE strict CM
  processes applied
• Regular IDPS IPT Software Peer Reviews
• Discuss and request changes to ACCB controlled
  items (e.g. OADs) and other items during the sci
  to ops migration process for work done within
  IDPS

16
Following Presentations Touch on Aspects of
Science and Operational Algorithms
Phase I - Payload IPT

• Delivered Science Algorithms
• ATBD
• Science-grade code
• Test Data Sets

Science Algorithm Development/ Procurement
Phase 2 - SE IPT

• Verified Science Algorithms
• ATBD
• Science-grade code
• Test Data Sets
• OADs

Science Algorithm Verification

• Correction requests
• Incomplete delivery
• Non-compliant products
• Failure Analysis

Phase 3 - IDPS IPT
Science to Operational Algorithm Migration

• Operational Algorithms
• Operational Algorithm Document
• Operational-grade code

• Science Discrepancy Reports
• Timeliness failure
• Quality failure
• EDR Test output

Launch
Phase 4 - IDPS, STE IPTs

• Operational Verification Test Reports
• Pass
• Fail
• - Timeliness failure
• - Quality failure

Operational Algorithm Performance Verification

• Verified Operational Algorithms
• Operational-grade code

Phase 5 - STE IPT

• Discrepancy reports
• New calibration coefficients

Operational Algorithm Cal/Val

• Calibrated/Validated Operational Algorithms
• Calibration Coefficients
• Operational-grade code

• Discrepancy Reports
• Operation
• Performance

Phase 6 - OS IPT
Long-Term Operational Algorithm Cal/Val