Access to Oceanographic Data from the NODC Ocean Archive System

1
Access to Oceanographic Data from the NODC Ocean
Archive System

• Donald W. Collins
• National Oceanic and Atmospheric Administration
  (NOAA)
• National Oceanographic Data Center (NODC)

2
NOAA/National Oceanographic Data
Centerwww.nodc.noaa.gov

• Long term archive for gt30,000 digital and analog
  originator in situ and satellite oceanographic
  data collections and products
• Virtually all digital collections discoverable
• 95 directly accessible online
• Small staff to provide metadata and reference
  services other staff develop products

3
Office of Ocean Explorationoceanexplorer.noaa.gov

• Mission support expeditions of ocean discovery
  and enhance science literacy through exploration
  of the oceans.
• 4 - 10 Signature Expeditions/yearManned and
  unmanned submersibles operations
• Surveying and marine archaeology
• Technology development and enhancement
• Coordinate with NOAA Teacher at Sea Program,
  Public Affairs, and science teams

4
At Sea Operations I

• Close quarters and coordination with web
  coordinator, science party, ships crew
• Create records of science activities, make copies
  of tapes, photos, deck logs, underway data,
  transits, media visits

5
At Sea Operations II

• Every dive is like Christmas morning
• Lab activities can go 24/7
• Interesting discoveries are just around the corner

6
At Sea Operations III
7
At Sea Operations IV

• Keep track of all science, media, and other
  activities
• Typical work day from 6 am to midnight

Try to not get sick
8
Back at the (land) Office

• Inventory of data, video, still images, reports
• Metadata and cataloging at collection and item
  levels
• Multiple access points
• Library online catalog
• NODC Ocean Archive System
• NCDDC Digital Atlas
• Ocean Explorer web site
• OE/Library Video Data Management System
• Extending data management principles to other
  NOAA Programs
• Coral Reef Conservation Program
• National Marine Sanctuaries Program

9
NODC AMS Components

• ATDB
• Unique identifier
• Brief Access Record
• Archive File Mgmt
• Canonical directory
• Checksum validation
• Metadata Repository
• FGDC metadata
• Ocean Archive System
• Access to ATDB metadata
• Access to originator data

10
NODC Accession Tracking Data Base (atdb)

• Brief Access Record
• Who, what, when, where, how
• Controlled vocabularies
• Open source tools
• postgreSQL RDBMS
• Perl/cgi scripts
• Linux OS on generic HW
• Passes information to Metadata Repository

11
FGDC Metadata Repository

• FGDC metadata standard database
• Oracle database
• Blue Angel Technologies, Inc. MetaStar tools
• I/O XML files
• Exports metadata to GCMD, IOC/MEDI, other
  clearinghouses

12
Archive File Management

• Canonical structure for every accession
• about/ directory contains NODC-created
  information
• data/0-data directory contains exact copy of
  original data files
• data/1-data directory contains NODC translations
  of original data files
• md5 checksum validations created for file
  management
• Manages multiple versions of the same dataset

13
Ocean Archive SystemData Discovery and Retrieval

• Browser based search and retrieval of ATDB
  metadata and originator data
• Direct access to part/all of originator data in
  an accession

14
Archive Management SystemAdvantages

• Open source software tools
• Rapid inclusion into NODC archives
• Improved validation of contents during media
  migrations
• Easier, distributed process for creating and
  managing accessions
• http//www.nodc.noaa.gov/Archive/Search
• Internal AMS interface

15
Acknowledgements

• NODC Management and colleagues
• NOAA Central Library colleagues
• Ocean Exploration colleagues
• Video credits
• Sixgill shark footage - Widder, et al., HBOI, and
  NOAA Ocean Exploration, 2004.
• Teacher at Sea, Mola mola footage - Brooke, et
  al., HBOI, and NOAA Ocean Exploration, 2005.
• Charlie the Crab - , et al., NOAA Ocean
  Exploration, 200

16
Contact Information

• NODC
• www.nodc.noaa.gov
• NODC.Services_at_noaa.gov (help w/finding data)
• NODC.DataOfficer_at_noaa.gov (help w submitting
  data)
• NOAA Central Library
• www.lib.noaa.gov
• NCDDC
• www.ncddc.noaa.gov

• Ocean Exploration
• www.oceanexplorer.noaa.gov
• Teacher at Sea Program
• teacheratsea.noaa.gov