Data Management Workshop

1
More Data Center Tools

• Chad Trabant and Rick Benson
• IRIS DMC

2
SHAPE SoftwareSEED Header Assembly and
Preparation Engine

• SHAPE - Build dataless SEED files from SEED RESP
  and other info
• Controlled with a Header Assembly Template (HAT)
  file in XML format wherein SHAPE finds the needed
  details for building a SEED file including names
  of RESP files and blockette field values
• Easily used in scripts, good for batch creation
  of dataless SEED, complimentary to PDCC at this
  point
• Good for templating (common components defined
  once)
• Java, runs anywhere a JVM is available
• Available from http//www.isti.com/sid/shape/

3
SHAPE HAT Examples

• SHAPE Header Assembly Template examples

Field substitution
Very simple example
4
Portable SEED File Reading

• Jrdseed - Java port of the IRIS-DMCs rdseed
• Reads full SEED, dataless SEED and
  Mini-SEEDdataless
• Writes SEED, SAC, AH, CSS, SEED RESP
• Time-window and other output selection possible
• Runs anywhere a JVM is available
• Based on generic JavaSeed classes available
  separately

5
libmseed - Mini-SEED Library

• Allows reading and writing of Mini-SEED records.
• Written in C.
• Supports all structures of SEED 2.4 with a few
  minor caveats (blockette 2000 and blockette 405).
• Supports all valid record lengths.
• Supports ASCII, int-16, int-32, float-32,
  float-64, Steim-1 and Steim-2 encoding formats.
• Tested on Solaris, Linux, Mac OSX and MS-Windows.
• Supports big or little endian data records, all
  data read on a given machine will be in the local
  byte order.
• Manages arbitrarily long continuous trace
  segments and groups of continuous trace segments
  composed, for example, of many Mini-SEED records.
  Writing of traces or trace groups to Mini-SEED.
• Design to be used in multiple ways from very
  detailed oriented handling to hiding all the
  details of the SEED data format.
• Able to read full SEED volumes by skipping the
  non data records.
• Available from http//www.iris.edu/pub/programs/

6
Example libmseed programs

• msi - Mini-SEED Inspector
• Parse and print useful information about
  Mini-SEED in one or many files. Including
  continuous segment construction, data sample
  printing, etc.
• msstat - Calculate minimum, maximum, arithmetic
  mean, standard deviation and RMS for Mini-SEED in
  one or many files.
• msrouter - Sort Mini-SEED records based on one or
  many format details (network, station, location,
  start time, sample rate, quality, etc.)
• PQLII/PQLX - Data visualization/analysis program
  using libmseed.

7
Example converters

• seisan2mseed - SeisAn to Mini-SEED converter
• mars2mseed - MARS 88/lite to Mini-SEED converter
• gse2mseed - GSE 2.0/2.1 or IMS 1.0 to Mini-SEED
  converter, supports both INT and CM6 data
  encoding
• sac2mseed - SAC to Mini-SEED converter
• mseed2sac - Mini-SEED converter to SAC converter
• All run on Linux, Solaris, Mac OSX and MS-Windows
• Available from http//www.iris.edu/pub/programs/c
  onverters/
• Many other converters are available at the
  IRIS-DMC, IRIS-PASSCAL, ORFEUS, etc.

8
PQLII/PQLX/PQLY Software

• The evolution of the PASSCAL Quick Look software
  for data viewing and analysis
• Key new features
• - Data display organized as continuous time
  series (by channel), large data sets
• - Read event hypocenter information and phase
  picks
• - Sorting by distance from user-specified
  location or known event
• - Compute and display predicted arrivals based on
  hypocenter event info
• - User-defined filters
• - Trace alignment based on picks
• - Compute cross-correlation coefficient between
  selected traces
• - Integrate and differentiate time series
• - Read "RESP" format metadata
• - Remove mean from trace
• - PSD and PDF plots
• - Remove instrument response
• PQLII available from http//www.passcal.nmt.edu/s
  oftware/software.html

9
Real-time Data Exchange

• A number of open-source and commercial data
  exchange systems exist, the bridges between them
  are illustrated below.

10
Content

• SHAPE - Build dataless from RESP
• - Easily used in scripts, good for batch
  creation of dataless, complimentary to PDCC at
  this point.
• - Good for templating with common SEED.
• - Java, runs anywhere.
• Libmseed overview - more than simple record
  reading
• Libmseed based tools msi, msrouter, msstat
• Libmseed based converters seisan2mseed,
  gse2mseed, sac2mseed, mseed2sac, mars2mseed
• Mention a number of internal DMC data fixing
  tools are available upon request, some similar to
  what PASSCAL uses.
• PQLII/PQLX/ILL
• Jrdseed
• Real-time systems and bridges
• Verseed usage? (need more?, already illustrated
  in QC portion)
• JPlotResp/JEvalResp (maybe done at end of PDCC
  lab?)