The SAFARI 2000 Data Distribution System

1
The SAFARI 2000 Data Distribution System

• Jeffrey L. Privette
• NASAs Goddard Space Flight Center
• Many others from NASA, Wits, NDMC, ORNL
• 28 August 2001

2
SAFARI 2000 Data Group

• Ad hoc, voluntary
• Objective Develop and implement a system to
• Allow registered participants to access data in
  timely fashion
• Protect rights of data collectors/providers and
  students
• Including appropriate acknowledgement
• Ensure complete SAFARI data archive is
  permanently housed in southern Africa
• Participants
• University of Witwatersrand
• National Disaster Management Center
• NASAs Goddard Space Flight Center
• Oak Ridge National Laboratorys DAAC
• University of Virginia

3
Registered SAFARI User

• Full participation is available to anyone who
  conducts relevant research and who agrees to the
  terms of the Data Policy
• Registration via official SAFARI WWW site
• SAFARI Steering Committee confirms that applicant
  meets above requirements
• Approved registrant is provided with accounts on
  SAFARI data systems (Regional Data Centre and a
  Mercury host center)
• Added to email list server (Newsletters,
  meeting information, invititations to publish,
  project information)

4
Data System Components

• ORNL DAAC
• Mercury Metadata Editor Host
• Mercury Host

• NASAs GSFC
• Remote Sensing DataAcquisition
• CD-ROM Production

• Regional Data Centre
• (National Disaster Management Centre)
• Participant Registration
• Mercury Metadata Editor Host
• Permanent Archive

5
Regional Data Centre (RDC)

• Core of SAFARI Data System
• Cooperative effort of the University of the
  Witwatersrand and the National Disaster
  Management Centre
• NDMV provides hardware and software
  infrastructure to host and distribute data
• Wits provides research input, strategic guidance
  and management assistance

6
RDC Support of SAFARI

• Host official SAFARI 2000 WWW site
• Up-to-date project information
• Downloadable software tools
• Provide participant registration system
• Host Mercury Metadata Editor
• Host remote sensing data sets
• NASAs EOS Terra, Aircraft, etc.
• Final repository for all SAFARI data

7
RDC Resources

• Hardware
• Main web application server
• IBM 4xPentium III 750 MHz, 5x18 GB HDD RAID, 750
  MB RAM, Windows NT
• Database server
• Compaq Pro-Liant 5500, 2x Pentium III 650 MHz,
  4x18GB HDD RAID, 780 MB RAM, with HP Intelligent
  RAID Rack 1.3 TB HDD system, Windows NT
• GIS server
• Compaq Pro-Liant 5500, 2x pentium III
• 650 MHz, 4x18GB HDD RAID, 780 MB RAM, Windows NT
• Maths / Statistical server, Compaq Pro-Liant
  5500,
• 2x pentium III 650 MHz, 4x18GB HDD RAID, 780 MB
  RAM,
• Red Hat Linux 6.2 (7.1)
• E-mail server, Compaq Pro-Liant 5500, pentium III
• 200 MHz, 2x18GB HDD, 512 MB RAM
• Personal Computers (6)

8
Data System Components

• ORNL DAAC
• Mercury Metadata Editor Host
• Mercury Host

• NASAs GSFC
• Remote Sensing DataAcquisition
• CD-ROM Production

• Regional Data Centre
• (National Disaster Management Centre)
• Participant Registration
• Mercury Metadata Editor Host
• Permanent Archive

9
ORNL DAAC Whats That?

• Oak Ridge National Laboratorys
  (ORNL)Distributed Active Archive Center (DAAC)
• Located in Oak Ridge, Tennessee (near Knoxville)
• 1 of 7 DAACs created in the U.S. to provide data
  management for NASAs Earth Observing System
  (EOS)
• ORNL DAACs Focus Biogeochemical Cycles
• Provides strong support of the EOS Validation
  Program and major field campaigns (e.g., SAFARI,
  LBA)

10
ORNL DAAC Support of SAFARI

• Support Mercury Metadata Editor
• Software to allow easy metadata submission
• Internet online and standalone MELite
• Host Mercury to allow SAFARI participants to
  search and access data
• Harvests metadata from RDC and ORNL to create
  comprehensive SAFARI data catalog
• Single best starting point to find any/all SAFARI
  data
• Ground, aircraft, satellite, climatological,
  historical
• Provides information and pointer (URL,
  name/email) for each data set

11
Mercury Overview
1.
2.
Data provider uses Metadata Editor to create file
containing general information and links to the
data and documentation
ORNL
Mercury collects the metadata file and
adds to SAFARI Catalog
SAFARI Metadata Catalog
Data Provider
Data and documentation
4.
5.
User links to dataproviders server
Data and documentation are downloaded
directly from data provider
3.
Participants query the Catalog and retrieve full
metadata, including WWW links to data provider
Participant
12
Mercury Data Pathways
13
(No Transcript)
14
1. Fielded Search (choose from list
of parameters, persons, etc.)
2. Spatial Search
3. Temporal Search
15
Data System Components

• ORNL DAAC
• Mercury Metadata Editor Host
• Mercury Host

• NASAs GSFC
• Remote Sensing DataAcquisition
• CD-ROM Production

• Regional Data Centre
• (National Disaster Management Centre)
• Participant Registration
• Mercury Metadata Editor Host
• Permanent Archive

16
NASAs GSFC Support of SAFARI

• Edit SAFARI Newsletter
• Create and publish CD-ROMs
• Stream MODLAND Product subsets to RDC in
  real-time
• Manage requests for tasked NASA satellite data
• e.g., Landsat 7, IKONOS

17
Associated Data CentersThe Landsat 7 Example
Request
NASAs GSFC SAFARI Team (Maryland)
SAFARI 2000 Participant
Task
Landsat 7 Science Team/ EROS Data Center (South
Dakota)
Acquire
Archive/ Distribute
18
Associated Data CentersThe Landsat 7 Example
Request
NASAs GSFC SAFARI Team (Maryland)
SAFARI 2000 Participant
Task
Landsat 7 Science Team/ EROS Data Center (South
Dakota)
Acquire
Archive/ Distribute
TRFIC Data Center (Michigan State Univ.)
19
Associated Data CentersThe Landsat 7 Example
Request
NASAs GSFC SAFARI Team (Maryland)
SAFARI 2000 Participant
Task
Landsat 7 Science Team/ EROS Data Center (South
Dakota)
Acquire
Archive/ Distribute
TRFIC Data Center (Michigan State Univ.)
Regional Data Centre (S. Africa)
20
SAFARI Remote Sensing Data Pathways to Region
Current
Landsat, IKONOS
MODLAND Products (Core Sites)
Investigator Data Site
Internet Connection
Internet or Air Mail, direct to user
Start your data search in the ORNL DAAC Mercury
System
21
SAFARI Remote Sensing Data Pathways to Region
Current
Landsat, IKONOS
CD-ROMs
MODLAND Products (Core Sites)
Investigator Data Site
Internet Connection
Internet or Air Mail, direct to user
Start your data search in the ORNL DAAC Mercury
System
22
SAFARI 2000 CD-ROM SeriesSiavonga Volume 1
Release Party!
CD-ROM Architect Dave Landis, NASAs GSFC
23
The CD-ROM's HTML Interface

• Uses an HTML/Web-browser interface that works the
  same on all computers (Windows, UNIX, Macintosh)
• Allows access to data, documentation, and WWW
  links to additional resources.
• Can automatically copy and decompress the image
  files from the CD-ROMs to the users hard drive
• Help available through on-disc tutorials

24
Data Contents of Volume 1

• Stratification by data type and volume
• Hydrology Data (5 data sets) -- 2 megs
• Land Cover Data (5 data sets) -- 32 megs
• Meteorological Data (4 data sets) -- 30 megs
• Satellite Images (6 data sets) -- 860 megs
• Vegetation Soils Data (4 data sets) -- 0.5 megs
• Documents and Software -- 190 megs

25
(No Transcript)
26
CD-ROM Satellite Images
AVHRR Parameters -- Day, LST, NDVI, PHI, R1,
R2, TS, TV
27
(No Transcript)
28
(No Transcript)
29
CD-ROM Documents and Software
30
(No Transcript)
31
Next Step Involves You

• Volume 1 first in a series
• Satellite and climatological data were ready now
• Forthcoming volume(s) will host participants
  data sets
• Opportunity to branch out, collaborate, coauthor
• Honor the Data Policy
• CD-ROM includes many reminders of required
  acknowledgements
• To be included You must provide your metadata
  to the SAFARI Data Catalog!
• Mercury Metadata Editor (online or
  standalone/email)

32
Thanks

• Received from publisher last Wednesday
• 140 CD-ROMs brought to Siavonga by
• Tom Eck
• Michael King
• Steve Platnick
• Tim Suttles
• Jeff Privette