Presentation of Margarita Conkright NOAA CCSP. From "Climate Quality Data Management Systems," Break

1
Purpose of Climate Quality Data Management
Systems Breakout Session

• Present overview of the relevant parts of
  Chapters 3
• and 12 in draft Plan
• Opportunity for prepared comments by invited
• reviewers of the draft Plan
• Opportunity for verbal questions, comments, and
• discussion from workshop attendees
• IMPORTANT Reminder
• To be effective in improving the Strategic Plan,
  comments should be submitted electronically
  according to instructions on the website
• (www.climatescience.gov follow links to
  Strategic Plan)

2
Strategic Plan for the Climate Change Science
Program Data and Information Management Chapter 3
and 12 Presented by Margarita Conkright
NOAA In collaboration with the Data and
Information Working Group (DIWG) Wanda Ferrell
DOE, Chris Carlson USGS Howard Diamond NOAA,
Vanessa Griffin NASA Les Meredith DIWG, Lola
Olsen NASA
3
The CCRI Chapter 3. Climate Quality
Observations, Monitoring and Data
ManagementQuestion 5. How accessible is the
climate record?
Importance of Data Management every element in
the Strategic Plan has specific needs for data
sets related to large regional problems,
large-impact processes, field campaigns, analyses
that combine in situ and remotely sensed data,
process studies, and model output. Challenge
provide seamless access to quality data and
information needed by researchers, planners, and
decision makers.
4
Data Management Challenges

• Management of large and diverse data
• Storage, access, quality, documentation,
  associated costs
• Preservation of historical records
• Data policy (database protection legislation)
  ensure full and open access
• Emerging new technology bridging the digital
  divide
• Incorporate additional types of information from
  Federal and non-Federal sources

5
Data and Information Vision

• Collect and manage data in multiple locations,
  including Federal, state, and local agencies,
  academic institutions, non-governmental
  organizations, and private companies
• Enable users to find and access these data via
  the Internet, utilizing sophisticated systems for
  data search and retrieval and
• Facilitate integrated applications related to
  environmental and resource management, disaster
  mitigation and emergency response, and other
  data-dependent activities

6
CCRI GOALS

• The basic goal is to provide quality data and
  information across disciplines, integrating data
  products from different sources, time frames, and
  with collected using different methods.
• Establish framework for providing data
• Provide defined key elements for data management
  planning
• Develop cross-agency mechanism to coordinate
  implementation of the climate observing system
• Catalog of information systems and services

Success will rely on national and international
partnerships
7
Many data and information activities

• GCMD descriptions of and pointers to data sets
  and services relevant to GC research
• GCRIO delivers printed and digital information
  through multiple channels
• USGCRP DIWG coordinates distributed agency
  activities

8
NASAs Earth Science Enterprise Data and
Information Systems and Services

• NASAs Earth Science Enterprise has over 65
  funded data management projects and activities.
• Eight Distributed Active Archives Centers (DAACs)
  comprise the Earth Observing System Data and
  Information System (EOSDIS)
• The NASA-sponsored Earth Science Information
  Partner (ESIP) Federation has over 42 members
• ESE is currently managing over 2 pedabytes of
  Earth science data and information
• Over 2 Terabytes of science data from NASAs
  Earth observing satellites are added to the
  archives each day
• In FY 2002, ESE provided data and information
  products to more than 2.5 million customers

9
Evolving NASAs Data and Information Systems and
Services

• NASA is planning for the evolution of the current
  EOS-era data systems and services
• Systems must evolve to respond to ESEs science
  research and applications goals and objectives
  and to leverage new technology
• NASA envisions a more distributed and
  heterogeneous data management framework than the
  current EOSDIS
• SEEDS, the Strategic Evolution of ESE Data
  Systems, is currently in formulation by the
  Goddard Space Flight Center in concert with the
  Earth science community
• The next public workshop for SEEDS will be in
  Spring of 2003

10
ESE Data Management Timeline



Heritage Missions T/P, UARS, TOMS, ERBE
Science Missions Supported
Landsat 7 QuikSCAT
Terra ACRIMSat
Aqua GRACE
SAGE III JASON
SeaWiFS Radarsat
TRMM
ECS System EDOS System
SEEDS Formulation Started
EOSDIS Version 0
EOSDIS Version 1
ESIP Federation
Milestones
Data Pools
2 Petabytes
Archive Volume has doubled each year for the past
three years
Archive Growth
15 Million
Products Distributed
FY94/95 FY96 FY97 FY98
FY99 FY00 FY01 FY02
11
Cumulative Major Systems Archive Growth
(not including backup)
12
Evolutionary
NOAA Scientific Data Stewardship
Providing management tools for an end-to-end
systematic observing program for remote sensing
systems, atmospheric in-situ networks, and
oceanic observations

• Monitor observing system performance
• Establish a system for climate
• Provide basic IT hardware/software support
• Develop climate processing system for satellite
• measurements and in situ validation
• Document Earth system variability
• Water vapor, clouds, precipitation
• Ocean data
• Compare models/data in radiances
• Maximize data availability to users via Web
  access

13
Archive, access and distribution system for
NOAAs large array data setsCLASS Goals

• Provide one stop shopping and access capability
  for NOAA environmental data and products
• Provide a common look and feel for accessing NOAA
  environmental data and products
• Provide an efficient architecture for archival
  and distribution of current and future NOAA
  environmental data and products
• Reduce implementation costs by using
  reengineering, evolutionary effort, not a
  completely new development

14
DOE Data and Information

• Goal to analyze and communicate the best
  possible information concerning global change and
  other topics between the DOE GCRP, other research
  programs, and diverse user communities

Data analysis, quality-assurance, documentation,
archival, and distribution
Communicating on the Information Superhighway and
other media
15
DOE Data Centers

• The Carbon Dioxide Information Analysis Center
  providing a wide variety of data and information
  products to the global-change community since
  1982 (http//cdiac.ornl.gov)
• World Data Center for Atmospheric Trace Gases a
  component of the World Data Center System of the
  International Council of Scientific Unions
• Data management for AmeriFlux, a network of
  research sites quantifying flows of carbon
  between the atmosphere and the terrestrial
  ecosystems
• Data management for FACE (Free-Air CO2
  Enrichment) large-scale studies of the effects
  of elevated CO2 on vegetation
• ARM archive providing data on atmospheric
  radiation balance and cloud feedback processes
  (www.archive.arm.gov/)

16
The USGCRP Chapter 12. Grand Challenges in
Modeling, Observations, and Information
Systems3. Data and Information Management

• Expand on current data management
  infrastructure
• partnership between federal agencies and
  international
• data providers
• Continue to develop framework for integration
  of
• data
• Identify the data requirements of the program
  on a
• regular basis
• Identify and rescue data at risk of being lost

17
Focus for the USGCRP

• Continue to enhance and improve interoperability
  and usability of agency data sets
• Targeted data products taken at different times
  and using different methods required by the
  various CCSP working groups
• Implement the national climate observing
• architecture developed under CCRI