Data Archiving and Distribution

1

Science Operations Center
Data Archiving and Distribution
Leslie A. Young Payload Science Coordinator
Deputy Project Scientist 303-546-6057 layoung_at_bou
lder.swri.edu
2
Presentation Outline

• Overview
• Requirements
• Function and design
• Receivables and Deliverables
• Longevity
• Risk identification and mitigation

3
SOC Archive and Distribution wiring diagram (big
picture)

4
SOC Archive and Distribution wiring diagram
(close-up)

SOC DataProcessing Station
All telemetry
5
Archive and Distribution functions

• Mission Science Team (MST) access to science data
  and ancillary data
• Pre-event products supplied by instrument teams
  (calibration files, pipeline code, documentation)
• Products supplied by MOC (telemetry, nav files,
  command loads)
• Products produced by SOC pipeline (raw Level 1b
  and provisional calibrated Level 2)
• Archival Level 2 data supplied by instrument
  teams
• Higher-level products supplied by science theme
  teams
• Responsible for archiving Level 1b data to PDS
• Assist in archiving Instrument Descriptions and
  Level 2 data to PDS

6
Archive and Distribution Requirements

• SOC shall provide telemetry, uncalibrated science
  data (Level 1b), and provisional science data
  (Level 2) to Mission Science Team and E/PO
• SOC shall get calibrated data (archival Level 2)
  from Mission Science Team
• SOC shall deliver Level 1b Jupiter data to PDS by
  ground receipt 3 mo
• SOC shall deliver Level 1b Group 1 data to PDS by
  ground receipt 4 mo
• SOC shall deliver Level 1b Group 23 data to PDS
  by ground receipt 10 mo

7
Science Operations Center Archive and
DistributionDesign Details

• The Science Team will get data from the SOC,
  isolating the MOC from data retrieval requests
• The data will be stored and accessed from a
  pre-defined directory structure
• We baseline no database development until after
  Jupiter encounter
• Design for an eventual port to database
• Single NH PDS liaison planned for archiving Level
  1b, assisting instrument teams to archive Level 2
• PDS small-bodies node
• Off-site back-up (possibly at CSOC)
• Baseline visualization done outside of SOC
  computers

8
Science Operations Center Archive and
DistributionReceivables

• From Instrument Teams via SOC Data Analysis
  Station
• Calibration files, pipeline code, and
  documentation
• From MOC via SOC Data Analysis Station
• Science telemetry, housekeeping, and ancillary
  data
• From SOC Data Analysis Station
• Uncalibrated (Level 1b) science data
• Calibrated (provisional Level 2) science data
• From Instrument Teams
• Calibrated (archival Level 2) science data
• Instrument Descriptions
• From Science Theme Teams
• Higher-level (Level 3) science products

9
Science Operations Center Archive and
DistributionDeliverables

• To PDS
• PDS Software Interface Specification
• PDS Memorandum of understanding
• Level 1b data
• Level 2 data
• To SOC
• New Horizons Data Management Plan, including
  archive directory structure
• Archive and Distribution sections of SOC Users
  Guide, including instructions for accessing data
• To Mission Science Team and E/PO
• Pipeline code and files
• Raw telemetry and ancillary data
• Uncalibrated, calibrated, and higher-level
  science data

10
Longevity

• Long-life
• Obtain long-term hardware and software
  maintenance contracts
• Plan migration of data storage media types
• Document pipeline processing algorithms
• Preserve pedigree of all archived files
• Avoid proprietary data formats
• Formal internal reviews of users manuals, logs,
  and other documentation

11
Science Operations Center Risk Identification
and Mitigation

• Longevity of hardware, software
• Security
• Stability of PDS
• Long-term usefulness of archived data formats