TES GDS

1
TES GDS Instrument Team Ground Data System
Reports Doug Shepard Jet Propulsion Laboratory
California Institute of Technology
Aura DSWG October 27, 2008
2
Overview

• Instrument status
• Current State of Data Production
• Upcoming Releases
• Issues and Other Items

3
Instrument Status

• The TES instrument is operating normally
• Global Survey scheduled every other day
• Special Observations scheduled during off days
• Over-velocity fault June 08
• GS revised in response
• One Hundred Forty Global Surveys gathered YTD
• Eight Hundred Twenty Global Surveys since launch
• Five Hundred Eighty One Special Observations
  gathered YTD
• ARCTAS, OP3, WAVE 2008, Megacities (Tokyo, Lagos,
  Dhaka, Mumbai), China/Beijing Transects, Muana
  Loa (H20 isotope measurement campaign)
• One Thousand Six Hundred Fifty Five Special
  Observations since launch
• Instrument downtime this year
• De-ice cycle commanded once on May 28 -30th
• ICS only safe mode following an Over-velocity
  fault trip, June 9th. Normal operation resumed
  June 13th.

4
ICS GS Average Motor Current
5
Instrument Status over-velocity fault

• Prior to June 08 TES ICS motor current in
  steadily increasing
• Over-current events frequent
• Over-velocity events started Dec 07, culminating
  in over-velocity fault June 08
• Modifications made to Global Survey ops
• Removed all long scans (1/orbit, intended for
  lube distribution)
• Removed observations below -60 south latitude
• Removed observations above 70 north latitude and
  -50 south latitude (total of about 30 reduction)
• Peak current much lower, average lower..
• Idle motor current now higher thought related to
  removal of long scans

6
Instrument Status summary

• Every effort is being made to maximize instrument
  life-time while providing high science return
• Extended science team has stated that sustaining
  the regular base of temporal sampling is vital,
  spatial modifications to the Global Survey are
  acceptable
• TES is operating well within limits

7
Data Production

• Three processing centers
• SIPS processes Global Survey and Special
  Observations
• SPC special processing full filter, larger
  scale science investigations
• SCF supports development and small scale
  investigations
• SIPS 260 nodes, 90 TB data storage major
  upgrade scheduled
• SPC 40 nodes, 10 TB data storage
• SCF 40 nodes, 60 TB data storage node
  upgraded this year

8
Current State of Data Production

• TES GDS software version R10 completed
  reprocessing November 07
• TES GDS software version R11.2, active at SIPS
  from late August 08 all ESDTs incremented
• L1B ESDT Version 3
• L2 ESDT Version 4
• L3 ESDT Version 2
• Forward processed data from Sept 3rd uses GMAO
  5.2, data prior to Sept 3rd 5.10
• File format designator on L2 HDF files
  incremented to indicate GMAO version

9
SIPS R10 Reprocessing Completed
10
Projected SIPS R11 Reprocessing
11
TES Level 2 Data Version 4

• The Version 4 TES L2 data will include
• Limb profiles valid into the upper troposphere
• Improvements to the temperature retrievals
  (updated CO2 spectroscopy)
• Improvements to the methane retrievals
• Species dependent quality control information
• Use of GMAO GEOS-5 products in L2 retrievals
• F05_05 in filename if GMAO GEOS-5.1.0
• F05_06 in filename if GMAO GEOS-5.2.0
• Data production began September 2008 (forward
  processing)
• Full reprocessing expected by mid-2009
• Preliminary validation analyses are underway
• ( from Greg Ostermans Validation slides)

12
Current Validation Status V03
13
Expected Validation Status V04 Mid-2009
14
Upcoming Releases

• Concentrate on Senior Review validation tasks
• Develop a general read tool for atmospheric sonde
  data to assist in validation efforts
• Update Ocean/Ice emissivity algorithm to
  accurately determine whether water is frozen or
  not
• Updates to Surface Temperature algorithm for
  cases when a scene is a freshwater target
  surrounded by land.
• Updates to daily and monthly Level 3 plots to
  help differentiation based on pressure levels and
  color scales

15
TES Web Page Redesign

• New Functionality
• New look and feel using interactive links to
  scientific content
• Direct access to link for TES data ordering
• TES Level 3 daily plots mapped using Google Earth
• Update Science team bios
• Access to all publications, presentations and
  posters generated since launch

16
TES L2 Time Trends
TES Species Trend Plot - Tropospheric Ozone for
Northern-Central China (Jan 05 June 08)
This new TES web page provides access to pressure
level vs time curtain plots for TES species (i.e.
0 O3, CO, ) in a given region via a clickable
world map. Each profile on a curtain plot is the
average of the profiles from either a Global
Survey (lt 26 hrs) or a Special Observation
(minutes) over the defined geolocation area.
(http//tes/visualization/SCIENCE_PLOTS/Trends/wor
ld_map_clickable.html)
17
Accessing TES data

• Documentation IDL data readers available from
• http//eosweb.larc.nasa.gov/PRODOCS/tes/table_tes.
  html
• IDL readers provided early in each release, and
  are backward compatible
• L1B
• L2
• L3
• Documentation provided
• Data Product Specification
• Level 2 Users Guide
• Data Quality Statement
• Data Versioning
• Validation Reports
• ATBDs

18
Issues Other Items

• ESDT version for early R11 L1B L3 data
  incorrect redelivering data now
• Modified Global Survey twice in 2008 to reduce
  ICS usage
• 6/2008 Eliminated observation south of 60
  degrees south
• 7/2008 Nadir observation bounded by 50 degrees
  south and 70 degrees north
• Future modification possible determined by
  instrument performance

19
Backup Slides
20
TES SIPS Hardware Diagram
HiNet
25 TB Tape Library Primary
SIPS Core
SIPS DB
SIPS Test
SIPS DEV
SIPS DB Monitor
SIPS Backup
SIPS HSIP
SPC Core
20 TB RAID
6 TB RAID
3 TB RAID
20 TB RAID
3 TB RAID
3 TB RAID
3 TB RAID
3 TB RAID
3 TB RAID
3 TB RAID
3 TB RAID
3 TB RAID
15 TB Tape Library Secondary
2.5 TB RAID
3 TB RAID
SIPS DEV2
SPC FS2
SPC FS1
1000/T switches
1.5TB FS
1.5TB FS
1.5TB FS
1.5TB FS
3TB FS
1.5TB FS
1.5TB FS
1.5TB FS
1.5TB FS
1000/T
SIPS Production Clusters
OPS2 30 Nodes (2OPT242 4GB RAM 2250GB) Dual
1000/T Switches
OPS0 38 Nodes (2OPT242 4GB RAM 2250GB) Dual
1000/T Switches
OPS1 38 Nodes (2OPT242 4GB RAM 2250GB) Dual
1000/T Switches
OPS4 40 Nodes (2OPT242 4GB RAM 2250GB) Dual
1000/T Switches
OPS6 80 Nodes (2OPT250 4GB RAM 2250GB) Dual
1000/T Switches
OPS5 80 Nodes (2OPT250 4GB RAM 2250GB) Dual
1000/T Switches
SPC3 38 Nodes (2OPT242 4GB RAM 2250GB) Dual
1000/T Switches
OPS7 30 Nodes (2OPT250 4GB RAM 2250GB) Dual
1000/T Switches
21
TES SCF Hardware Diagram
HiNet
SIPS Core (Sun 280)
Dev Server (E4000)
Dev Server (E4500)
VIS Server (Sun 280)
DB Server (2Opt)
TB Server (4Opt)
CC Server (2Opt)
7 TB LTO Library
3 TB RAID
0.3TB RAID
4 TB RAID
4 TB RAID
0.7TB RAID
OPT Cluster (pre-deliv test) 20
Nodes 2Opt242 4GB RAM 2250GB 1000/T Switch
4 TB RAID
TB Cluster (Dev and Test) 15 Nodes (8_at_2Opt242 4GB
,2250GB 6_at_2Ath2600 2GB,2200GB 1_at_2P4/2.4G 4GB,3
140GB) 1000/T Switch
3 TB RAID
3 TB RAID
4 TB RAID
Local Mirror Server
3 TB RAID
Gig-E Fiber Switch
3 TB RAID
TBNet
4 TB RAID
4 TB RAID
3 TB RAID
4 TB RAID
3 TB RAID
4 TB RAID
22
Level 3 ESDTs