NDIIPP: Future Directions and Relevance to Other Countries

1
NDIIPP Future Directions and Relevance to Other
Countries

• Beth Dulabahn
• Office of Strategic Initiatives
• Library of Congress
• November 7, 2004

2
NDIIPP Legislation and Funding

• Created by federal legislation (PL 106-554) in
  December 2000
• 100 million in appropriated funds
• Up to 175 million potentially invested
• 75 million of the appropriated funds subject to
  for match from non-federal sources

3
NDIIPP Goals

• Develop a national digital collection and
  preservation strategy
• Work with government agencies, libraries,
  archives, and other stakeholders to establish
  partnerships and form networks
• Help identify and preserve at-risk digital
  content
• Support development of tools, models, and methods
  for digital preservation

4
Whos Included?

• Key federal agencies (including NARA, NLM, NAL,
  Commerce)
• Libraries, archives, and other cultural
  institutions
• Non-profit entities (e.g., RLG, OCLC, CLIR)
• Non-federal and commercial sectors (e.g., motion
  picture studios, record labels, publishers)

5
Initial Activities

• Established the NDSAB in Spring 2001
• Representation from federal agencies, industry,
  research libraries and foundations
• Convened Stakeholder Meetings in Fall 2001
• 3 workshops including representatives from the
  commercial sector
• Commissioned environmental scans
• Conducted Scenario Planning sessions
• Defined preservation architecture space
• Facilitated a National Science Foundation
  research agenda
• Developed Plan presented to Congress 2003

6
NDIIPP Strategy

• Iterative approach
• Learn by doing

7
NDIIPP Focus Areas

• Preservation architecture
• Digital preservation research
• Network of preservation partners

8
Preservation Architecture

• Architecture is a conceptual framework to guide
  development of national preservation network
• Build upon current work
• Provide basis for communication about the problem
  space

9
(No Transcript)
10
Archive Ingest and Handling Test

• Document steps taken to ingest heterogeneous set
  of digital content
• Testers have digital preservation capabilities
  Johns Hopkins, Old Dominion, Harvard, Stanford
• Each to work with GMU 9/11 Archive
• 12gb with 57,000 objects associated metadata
• Diverse file formats
• Identify metrics for ensuring preservation of
  data integrity/document logical integrity

11
Archive Test Activities

• Accept archive as-is
• Generate metadata
• Ingest content into the archive
• Migrate/emulate content as applicable to each
  archive
• Export content/metadata out of the archive

12
Archive Test Outcomes

• List of logical candidate architectures for
  future work
• Understanding of the strengths and weaknesses of
  each
• Rough dollar cost figures for each solution
• Grasp of the possibilities and challenges of
  federating

13
Research Program

• Joint LC/National Science Foundation (NSF)
  digital preservation research grants program
• NSF administers
• Agenda shaped by Its About Time report
• Looking to fund cutting edge research to address
  major needs
• Proposals due 9/14/2004 peer review panels
  evaluating submissions
• Grants to be announced early 2005

14
NDIIPP Partnerships

• Agreements finalized Sept. 2004
• Eight consortia involving over 30 partners
• State government entities
• Universities
• Cultural heritage institutions
• Private not-for-profit
• Awards totaling 15 million
• Projects expected to last 3 years
• Aim is to spur collaboration in selecting and
  preserving at-risk content

15
Diversity of Content

• Funded projects will work with diverse and
  challenging content, including
• TV broadcasts and digital video
• Web sites
• State and local government information
• Geospatial data
• Social science data

16
NDIIPP Partner Projects with Web Harvesting
Components

• The Web at Risk A Distributed Approach to
  Preserving Our Nations Political Cultural
  Heritage
• California Digital Library, lead
• University of North Texas, New York University
• State local govt publications, political
  campaigns, labor history, former federal agency
  sites
• Develop tools for selection and acquisition

17
NDIIPP Partner Projects with Web Harvesting
Components (Cont.)

• Exploring Collaborations to Harness Objects with
  a Digital Environment for Preservation
• University of Illinois at Urbana-Champaign, lead
• OCLC Tufts University Michigan State, Arizona,
  Connecticut, Illinois, North Carolina, and
  Wisconsin State libraries
• Collect Web-based state govt agency publications
• Develop tools for selection, acquisition, and
  access
• Test existing repository architectures (Dspace,
  Greenstone, FEDORA, Eprints)

18
The Next NDIIPP Area of Investment

• State and Local Governments
• Currently in planning phase
• Plan to award to states through IMLS

19
Achievements at End of 5 Years

• A network of 50-75 partners
• Vast archive of at-risk content
• Recommendations to Congress on long-term
  governance of a national digital preservation

20
(No Transcript)