CalibrationValidation of the NPOESS NPP Instruments: Plan Overview National PolarOrbiting Operationa

1
Calibration/Validation of the NPOESS NPP
Instruments Plan OverviewNational
Polar-Orbiting Operational Environmental
Satellite SystemKaren St.Germain, NPOESS
Integrated Program OfficeDirect Readout Meeting,
October 3-6, 2005
2
(No Transcript)
3
Philosophy of Calibration/Validation
Cal/Val

• Centrals
• NWP
• Real-time tactical
• Non-tactical
• JTWC
• NHC
• JIC
• Science
• Others

Calibration
Validation
Users
Mission Success

• Absolute Accuracy
• Polarization Purity
• Geolocation Accuracy
• Instrument Stability
• Signal-to-Noise
• Antenna Pattern Correction

• Environmental Data Products (EDRs)
• Atmosphere
• Ocean
• Land
• Ice
• Space

Ensures

• Meet Specification
• Operational production of synoptic maps and
  profiles of critical atmospheric, oceanographic,
  land and space parameters
• Known Accuracy
• Quality Control

Calibration ensures that the Sensor Data (SDRs)
are usable Validation ensures that the
Environmental Data (EDRs) are usable
4
The Stakeholders
NGST
Driver Meet Spec
Resources Cal/Val infrastructure,
Payload subcontractors Manpower
IPO
NASA
DriverScience Quality
Driver Meet IORD
Success
Resources Cal/Val Heritage, BAA
Correlative Data Assets, MOUs
Resources Cal/Val Heritage, Manpower
Science Data Segment
Centrals
Driver Mission
Resources Real time Quality Assessment
5
NPOESS Calibration Verification Validation
Program- System Perspective
Prelaunch
Post-Launch
Long-Term Monitoring


Sensor Characterization and Calibration
Operations, Maintenance, and Upgrades
Calibration and characterization on-orbit
Heritage sensor data, design analysis
Calibration and characterization ground tests
Sustaining calibration and validation

Algorithm tuning and upgrades

RDR/SDR validation
Verification of science algorithm quality and
latency
Verification of operational algorithm quality and
latency
Validation of operational EDR quality and latency
Operational EDRs
RDR/SDR/EDR Validation
RDR/SDR/EDR Verification
6
Cal/Val Complexity

• 26 EDRs
• 4 New Instruments
• 3 Resource Management Centers
• Pre-launch tests occurring at 4 different sensor
  vendors
• How are we managing this?
• How do we know our plans are comprehensive?

7
Coordinated NPP Cal/Val Plan Baseline and Changes

• Coordinated NPP Cal/Val Plan Baseline
• The SSPR Prime contractor, the Integrated Program
  Office, and the NAS NPP Science team have a
  (mostly) common interest in executing a
  successful Cal/Val
• SDR/EDR Compliance-to-Cal/Val Requirement system
  engineering (with Science and Technical Advisors
  involvement) will identify tasks that are must,
  specific, realistic, and measurable. A Tasks
  Network will be used to explore schedule
  constraints and clearly define task
  responsibilities
• The CVMT and Science/Technical Advisors are
  responsible for constraint management
• Looking for synergistic tasks. Exploring parallel
  task execution options
• Identifying discrepancies in bottom-up schedule,
  budget and Goals
• Using priorities to explore trade-offs
• Using NPOESS SCB and NETS to resolve schedule and
  budget gaps
• From the Task Network the CVMT will establish
  roles and responsibilities among performing
  organizations
• The CVMT will manage execution of the Joint NPP
  Cal/Val Plan baseline
• Joint NPP Cal/Val Plan Baseline changes
• The CVCCB will manage baseline changes employing
  traditional CCB processes and documentation

8
NPOESS NPP Cal/Val Big Picture
Pre-Launch
Post-Launch
Long-Term Monitoring
Sensor Dgn
Parts
Subsys
Sys
IT
SDR/EDR Ingest - Performance Parameters
LUT - Geolocation - Cal Xfer -
Radiometry/Photometry
Perf. Budget
Compliance Review Board
Point Budget
Anomaly Resolution
Op Algorithm Change
Cal Budget
Performance Calibration Verification
SDR Validation
RDR Quality Selection
EDR Validation
Readiness Demo
Manufacturing, IT
Cal/Val Infrastructure Design
Infrastructure RDR Storage, Match-up Data,
Ground Truth, ICVS, LTA,, Quality Flags, Tools,
Op/Sci Algorithms
Infrastructure Req. Data Storage, Sci/Op
Algorithms, Tools, Ground Truth, Match-up Data
Geo-location
Cal Scenes Solar/Lunar Ground
EDR Match-up Data
X-Cal (Space Assets)
Airborne Campaign
Ground Campaign
Etc.
RDR Quality
Task Lead
Task Lead
Task Lead
Task Lead
Task Lead
Task Lead
Task Lead
Task Lead
Task Planning Execution
BaselineChange
Task Planning
Intensive Cal/Val
Sustaining Cal/Val
Cal/Val Plan Baseline (Task Network, Data Req.,
Algorithm Need, Infrastructure Req.)
L 7 mos
Baseline
Coordinated IPO-NASA-NGST SSPR Activity
Heritage Validation New Approaches (Doc, Data
Req, Implementation Support, Lessons Learned)
9
Bottom Up approach to defining Cal/Val

• Driven by diagnostic work that has to be done in
  the intensive post-launch phase

10

• Tasks are captured in a web-based relational
  database
• Attributes include Data, metadata, tools, entry
  and exit criteria, etc.

11
Once described, tasks are linked logically and
scheduled
Technical threads are rigorously developed and
reviewed by joint teams with individuals from
NGST, sensor vendors, Academia, Govt Labs, and
FFRDCs.
ATMS Thread
12
A technical library supports the distributed
Cal/Val Team

• Sensor data, analyses, algorithms, formats,
  tools, reports

13
The technical library includes the algorithms and
their supporting documentation

• ATBDs, code, test data, formats, results, etc.

14
All code, including algorithms and tools is under
configuration control for Cal/Val
15
Cal/Val Anomaly Resolution Ops Change

• The IPO/NASA/NGST SSPR Cal/Val Team will perform
  analysis and validation of calibration and
  SDR/EDR performances
• Cal/Val anomalies will be investigated by expert
  SSPR CV Anomaly Resolution Teams
• Anomaly findings and resolutions will be
  submitted to the CVCCB for consideration and
  subsequent recommendation to the ACCB and the OS
  CCB for operational implementation

16
Algorithms and Validation
Infrastructure
Validation Data Sources
Data Quality Subsystem
Validation Data Tools
Cal/Val Database
Cal/Val Activities Today
Internal Govt Studies
Quality Flags/ Intermediate Products
NPP Science Team
OATs Interface
Analysis Tools
MOUs/MOAs
Long Term Monitoring Requirements and Tools
Pre-launch Testing
S/C Attitude Maneuvers
Sensor Algorithms (SDRs)
Transition to OS
Cal Coefficients/Look-up Tables
OPSCON Scenarios
NPP Cal/Val Plan
Sensor Calibration
Operational Issues
17
Two Questions and an Opportunity

• Are there Cal/Val concerns specific to the Direct
  Readout community?
• Global look-up tables
• Radiometric calibration consistency
• Cross-instrument geolocation
• What can the direct readout community bring to
  the Cal/Val program?
• Validation concepts
• http//ipo.noaa.gov
• Internal Government Studies Program Announcement

18
NPOESS Calibration Verification Validation
Program Participants
Development Activities
Performance Advisory Activities
Exploration Exploitation Activities

• Integrated Product Teams (IPTs)
• Systems Engineering
• (SE, SI, STE)
• Payloads
• IDPS
• Operations and Support
• IPO Cal/Val Team

• NPOESS Operational
• Algorithm Team (NOAT)
• Science
• Algorithms
• Sensors

NPOESS Internal Government Studies
NASA NPP Science Team

• Integrated Product Teams (IPTs)
• Systems Engineering
• (SE, SI, STE, Cal/Val)
• Payloads
• IDPS
• Operations Support
• NGST Cal/Val Team

• NGST Science
• Advisory Team (SAT)
• Science

NGST SE IPT Science Team
NPOESS Customer Forum
NOESS P3I
Calibration/Validation Working Group
(CVWG) Calibration/Validation Teams
(Participation from Govt Labs, Universities,
FFRDCs, Centrals)