ets t st Nordic Web Archive Toolset

1
   ???e????t?s? t?? ?st??Nordic Web Archive
Toolset    

• ??e?t?????? d?µ?s?e?s?
• ??d?s???te? S. ?ap?d???? , ?. Ge??ats????? 
•   ?a???a ??µp???t?
• ?a???? e??µ??? 2003/2004
• ????? ??????S?????
• ????? ???????????S ??????T????????S
• ?????aµµa ?etapt???a??? Sp??d?? st?? ?p?st?µ? t??
  ?????f???a?
• "??????s? ??????s? ??ß???????? µe ?µfas? st??
  ??e? ?e???????e? t?? ?????f???a?"
•  
•  

2
?e??e??µe?a

• Web archiving st?? S?a?d??aß???? ???e?
• Nordic Web Archive
• NWA project
• NWA Toolset

3
Web archiving st?? S?a?d??aß???? ???e? (1)

• ??af??a?? t?? p???t?st???? ???????µ???
• ??????? ??ß??????e? (?a??a, S???d?a, F???a?d?a,
  ???ß???a, ?s?a?d?a)
• ??????µµata
• S??e??at???
• NORDINFO
• Nordic Web Index
• ??????
• Kulturarw-project (S???d?a)
• Paradigma project (???ß???a)

4
Web archiving st?? S?a?d??aß???? ???e? (2)

• Harvesting
• ??? p?????µµata s????µ?d?? (NEDLIB, Combine)
• ???e ???a a??e???ete? ?a? ap????e?e? t? ????? p??
  t?? af???
• ?e? e??a? d??at? ? d?a?e???s? a??e??? ?p?? p.?.
  ???te?
• ?? s??????? pe????????ta? sta p??t?????a http ?a?
  ftp

5
Nordic web archive (1)

• 1997 Forum a?ta??a??? eµpe????? ?a? s??e??as?a?
• 1998 ?????aµµa
• ?a????sµ?? e?d???? ?e?t???????? ?a? te??????
  p??d?a??af?? ??a t?? a??e????t?s? ?a? t??
  p??sßas?.
• S??e??as?a ßas???µe?? sta ?d? ?p?????ta e?????
  p?????µµata.
• ?a e?ta??e? ? s??e??as?a t?? S?a?d??aß???? ?????
  se µ?a e???te?? ????pa??? s??e??as?a

6
Nordic web archive (1)

• St????
• S????µ?d?
• ???e????t?s?
• ???sßas? sta a??e?a

7
NWA project (1)

• 2000-2002
• S??p?? ????? e??a?e?? a?a??t?s?? ?a? p?????s??
  st? a??e???et?µ??? ?????
• ?????
• ?? ß?se?? µetaded?µ???? t?? s????µ?d?? de?
  ?a??pt??? a????e? a?a??t?s?? ???st??
• ?e? e??a? d??at? ? a?a??t?s? se p???e? ?e?µe??
• ???a?e?a e??et???as?? ??a ?p???d?p?te
• p????aµµa s????µ?d??
• ??????? p?????s? t?? ???st?
• ??a??t?s? µe t? URL

8
NWA project (2)

• ?p?t??esµa t? NWA toolset
• ???s?
• ??????? ??ß??????e?
• ?d??µata / ???a??sµ??
• ?d??te?
• ????p???se??
• ?pa??? a??e???et?µ???? ??????
• ?etaded?µ??a (URL , ??????? st??µ?)
• ???a?? a?a??t?s??

9
NWA project 2 (2)

• 2002-2004
• St????
• ?e?t??s? t?? e??a?e???
• ??s?µ?t?s? d?af??et???? ????sµ???? e??et???as??
• ?a ???e? t? NWA Toolset a????t? ????sµ???
• ???s???? ???? ?e?t???????
• ????????s? ???st??

10
NWA Toolset

• Document Retriever
• ??epaf? t?? Web a??e???
• Exporter
• ???et??µ??e? ta a?t??e?µe?a ??a e??et???as?
• Access Module
• ???at?t?ta d?epaf?? ??a a?a??t?s? ?a? p?????s?

11
Exporter
12
?etaded?µ??a

• lt?xml version"1.0" ?gt
• ltmetadatagt
• urlgtlt!CDATAhttp//www.nb.no80/katkom/frbr/4nbmk
  ap1.htmgtlt/urlgt
• lttimegt20010808082501lt/timegt
• lthttp-headergtlt!CDATA
• HTTP/1.1 200 OK
• Date Thu, 05 Sep 2002 073553 GMT
• Server Apache/1.3.26 (Unix) PHP/4.1.2
• Last-Modified Wed, 08 Aug 2001 082501 GMT
• ETag "17fb4-b38a-3b70f75d"
• Accept-Ranges bytes
• Content-Length 45962
• Connection close
• Content-Type text/htmlgt
• lt/http-headergt
• lt/metadatagt

13
NWA Document Format

• lt?xml version"1.0" encoding"UTF-8" ?gt
• ltnwaDocumentCollection xmlns"http//www.nb.no/nwa
  /export/1.0/"
• xmlnsdc"http//nwaDocumentCollection.xsd"gt
• ltdocumentgt
• ltcollectiongtnolt/collectiongt
• ltarchiveidentifiergt/var/hepp/2001-9-
• 25_1_539210b1c4b0ce5e9b9fd76d296b91balt/archiveiden
  tifiergt
• ltmultimedialinksgt
• ltlinkgthttp//www.su.no80/oslo/sulogo.giflt/linkgt
• lt/multimedialinksgt
• ltlinksgt
• ltlinkgthttp//www.su.no80/oslo/default.htmlt/linkgt
• ltlinkgthttp//www.su.no80/oslo/aktivist.htmlt/linkgt
  
• lt/linksgt
• ltteasergtOslo SU støtter Streik på Akerlt/teasergt
• ltdctitlegtStreik på D/S Louiselt/dctitlegt
• ltdcformatgttext/htmllt/dcformatgt
• ltdcidentifiergthttp//www.su.no/oslo/dslouise.htmlt
  /dcidentifiergt
• ltdcdategt20010924133519lt/dcdategt

14
Access module
15
??µ? t?? NWA Toolset
INDEXES
COMMON FORMAT
SEARCH ENGINE
INDEXER
XML
WEB INTERFACE
FIND_ID (URL,TIME)
URN
FIND_DOCUMENT(URN)
DOCUMENT
ARCHIVE
ARCHIVE ACCESS
16
Web browser (1)

• ? a?a??t?s? µp??e? ?a ???e? e?te µe ???e?? e?te
  µe t? a??e?t??? URL

17
Web browser (2)

• ?? e???af?? p?? ep?st??f??? a?af????? t?? t?t??
  t?? se??da? , t? URI t?? a??e???, t?? d?a??s?µe?
  e?d?se?? ?a? d????? d?? d??at?t?te? p??s????s??
  timeline ? overview.

18
Web browser (3)

• Timeline

19
Web browser (4)

• Overview