ISOOS Data and Communications Infrastructure

1
ISOOS Data and Communications Infrastructure

• Dean A. Dunn, Ph.D.
• NOAA/NESDIS/NCDDC
• Stennis Space Center, MS

2
(No Transcript)
3
(No Transcript)
4
Ocean.US Appoints

• Data and Communications Steering Committee
• Expert Teams (4)
• Virtual Outreach Teams (2)

5
DAC Expert Teams

• Data Transport
• Lead Peter Cornillon, URI (NVODS)
• Data Discovery/Metadata Management
• Lead Susan Starke, NOAA/NCDDC
• Applications
• Lead David Legler, CLIVAR
• Data Archival
• Lead Steve Worley, UCAR

6
DAC Virtual Outreach Teams

• Data Facilities Management
• Lead Landry Bernard, NOAA/NDBC
• User Outreach
• Lead Phil Mundy, Exxon Valdez Oil Spill
  Trustee Council

7
General Concerns for DAC

• Sensitive (classified, proprietary) data may
  require special management
• Standards within ISOOS framework should be
  consistent with those of international elements
  of GOOS
• Need for Metrics/System Performance assessments

8
DACSC Responsibilities

• Oversight of planning process, pilot projects
• Oversight and guidance to Expert and Outreach
  Teams
• Consideration of cross-cutting issues
• Design, write, and circulate Draft Plan modify
  based on public feedback
• Final Plan to Ocean.US by December 2002

9
DAC Expert Teams

• Data Transport
• Lead Peter Cornillon, University of Rhode
  Island (NVODS), Narragansett, RI
• Data Discovery/Metadata Management
• Applications
• Data Archival

10
Data Transport Team Issues

• Server functionality, subsetting, aggregation
• Diversity of data types, interoperability of
  scientific information systems with GIS
• Special data types (video, acoustic, complex
  data)
• Metrics for system usage and subsystem
  performance ongoing tracking specifications
• One or more data transport protocols,
  multi-protocol interoperability gateways

11
Data Transport Team Guidance

• XML recommended for metadata transport
• Initial data transport via NVODS/OBIS
• Interoperability with OGIS data transport
• Need for operational data push capability
• DAC subsystem is shore-based not used for
  platform-specific sensor telemetry

12
Data Transport Team Pilot Projects

• Recommend an NVODS and OBIS/GBIF exchange
  standard
• NCDDC Portal transporting data from NDBC Hub via
  NVODS providing metadata access and data
  discovery

13
DAC Expert Teams

• Data Transport
• Data Discovery/Metadata Management
• Lead Susan Starke, NOAA/NCDDC, Stennis Space
  Center, MS
• Applications
• Data Archival

14
Data Discovery/Metadata Management Team Issues

• Controlled vocabulary between disciplines
  semantic keywords and data dictionaries
• Portal concept and system maintainability
• Adaptive metadata (e.g., merged data)
• Metadata for non-traditional data types (e.g.,
  video)
• Metadata as data

15
Data Discovery/Metadata Management Team

• Guidance
• Ocean.US recommends FGDC-compliant metadata
  standard
• ISOOS metadata requirements for data providers
  must be clear and simple
• Pilot Project
• Development of a catalog and data access portal
  at NCDDC

16
DAC Expert Teams

• Data Transport
• Data Discovery/Metadata Management
• Applications
• Lead David Legler, Climatic Variability and
  Predictability, Washington, DC
• Data Archival

17
Applications Team Issues

• Quality Control Quality requirements for each
  data type, data maps, user feedback, online data
  entry forms
• Data Assembly Software interfaces to assist
  assembly, version control for data collections,
  parallel data format and quality in different
  locations
• Product Generation Metadata, data procedures,
  processes, and standards are related to DAC
  operations technical products are not they are
  part of the ISOOS Application Subsystem

18
Applications Team Guidance

• DAC system delivers input data for models to
  users, and model output data to users.
• It is not responsible for running models or
  producing numerical data products
• QC procedures must be developed in partnership
  between the DAC and the operations

19
Applications Team Pilot Project

• Assembly of real-time observations for
  operational modeling by Global Ocean Data
  Assimilation Experiment server at US Navy Fleet
  Numerical Meteorology and Oceanography Center,
  Monterey, CA

20
DAC Expert Teams

• Data Transport
• Data Discovery/Metadata Management
• Applications
• Data Archival
• Lead Steve Worley, University Corporation for
  Atmospheric Research, Boulder, CO

21
Data Archival Team Issues

• Metadata completeness
• Data duplication within and between centers
  complete disciplinary archives
• Incentives for users to submit data
• Archeology and mining of external data
• Operational resources and capability for
  real-time acquisition

22
Data Archival Team

• Guidance
• Dont look back! (Define metadata for new data
  sets, then work on migrating old datasets into
  metadata framework)
• Pilot Projects
• To be defined at archive centers after ISOOS
  standards are defined

23
DAC Virtual Outreach Teams

• Data Facilities Management
• Lead Landry Bernard, NOAA/National Data Buoy
  Center, Stennis Space Center, MS
• User Outreach
• Lead Phil Mundy, Exxon Valdez Oil Spill Trustee
  Council, Anchorage, AK

24
Data Facilities Management and Outreach Teams

• Virtual teams no scheduled meetings Team
  Leads communicate to constituencies by E-mail and
  telephone
• Issues
• Solicit and provide input to technical teams from
  user community
• Consider pilot projects to implement Plan

25
Summary

• Key issue is the need to develop standards
• Standard interface for gateways
• Use of XML for data transport
• Consensus-based QA/QC standards for data
• Need for FGDC-compliant metadata catalog
  (facilitates search for relevant data)
• ISOOS emphasis on operational systems (sustained
  observations)

26
(No Transcript)