Web Archives Are Forever: defining workflows for long term preservation of web archives

1
Web Archives Are Forever defining workflows for
long term preservation of web archives

• Maureen PennockWeb Archive Preservation Project
  Manager
• IIPC Active Solutions Conference (San Francisco,
  Sept 2009)

2
From Humble Beginnings
The first webpage (Source W3C)
3
(No Transcript)
4
IIPC Digital Preservation Working Group

• Supports the mission of the International
  Internet Preservation Consortium (IIPC)
• to acquire, preserve and make accessible
  knowledge and information from the Internet for
  future generations everywhere, promoting global
  exchange and international relations.

5
What is a Workflow?
6
Workflow Definition

• The automation of business processes during
  which documents and tasks are passed among
  participants according to a set of procedural
  rules and assigned roles.
• Workflow Management Coalition

7
Why Workflows for Preservation?

• Coordination, Continuity Consistency
• Authenticity Provenance
• Automation

8
Workflows Project filling the gaps
Source joefutrelle, Flickr
9
Workflows Project Aims Objectives

• Aims
• Establish the activities required to support long
  term preservation across the entire web archiving
  and preservation workflow
• Deliver series of workflow diagrams to illustrate
  these activities and actions
• Objective
• Enable web archiving community to better
  understand the activities and interventions
  required for long term preservation of web
  archives, and how these may be embedded in
  existing workflows.

10

• Part I Analysis of Existing Workflows

11
Part I The Generic Workflow
12

• Part II Tools Survey Use Cases

13
Part II Tools survey
14
Part III Use Cases
15
Part III Use Cases Web Curator System

• Web Curator Use Cases
• 1.Generate Submission Information Package
• 2. Submit Submission Information Package to
  Archive
• System Use Cases
• 1. Validate SIP
• 2. Virus check
• 3. Preservation watch/monitor technology
• 4. Validate AIP
• 5. Bit monitoring

16
Part III Use Cases Digital Preservation Manager

• Digital Preservation Manager Use Cases
• 1. Create preservation policy
• 2. Establish ongoing preservation
  planning/support service
• 3. Identify initial preservation workflow
• 4. Produce preservation strategy
• 5. Generate AIP
• 6. Develop audit procedures
• 7. Test preservation options
• 8. Carry out preservation
• 9. Generate replacement AIP
• 10. Refresh media storage

17
Part IV Workflow models

• Seven models in all
• 1. High level overview
• 2. Generate SIP
• 3. Submit SIP to repository
• 4. Ingest SIP
• 5. Generate AIP from SIP
• 6. Preservation Planning process
• 7. Generate replacement AIP
• (DIPs and access out of scope)

18
Workflow models

• Web Archiving Preservation Workflow models
• (presented separately)

19

• Thank You Questions
• Maureen Pennock maureen.pennock_at_bl.uk