Interoperability of Retrieval

1
Interoperability of Retrieval

• HARVEST as Search Engine

Kerstin Zimmermann Oldenburg University Hamburg
August 2000
2
Retrieval
public
WWW
Workstation
Server / Archive
PC
private
3
Server Structure in Science
University page Department / Facultiy working
groups members Publications
4
Kind of Archives / Sources
For Documents a) lists (name, title, date,
link) b) additional with abstracts c) only
fulltext d) metadata and fulltext
5
Formats indexed

• sgml x
• xml x
• html X
• ps X Text, attention do not use graficmode
  ASCII required
• pdf X Text, Destiller-Options
  asciipdfon, commpressed text off
  exchange do not use optimize
• doc X
• rtf X
• tex X
• dvi X

6
Harvest
WWW Browser
HARVEST
WWW-SERVER
N
BROKER
Result
Result .......... ............. ............
http//www.physik...
Internal Area
Request
Dissertation
GATHERER
User
7
Dublin Core MetaData
Title Creator Subject Desciption Date Publisher Co
ntributer Type
Format Identifier Relation Source Language Coverag
e Rights
15 Elements
http//purl.org/DC/
8
Source Code
ltMETA NAME"DC.Subject" CONTENT"(SCHEMEMathNet)
People.Faculty/Staff"gt ltMETA NAME"DC.Format"
CONTENT"text/html"gt ltMETA NAME"DC.Creator.Person
.Name" CONTENT"Zimmermann, Kerstin"gt ltMETA
NAME"DC.Creator.Person.Address" CONTENT"(Email)
kerstin_at_merlin.physik.uni-oldenburg.de"gt ltMETA
NAME"DC.Creator.Person.Address" CONTENT"(Phone)
49 (0) 441 798 3465"gt ltMETA NAME"DC.Creator.Per
son.Address" CONTENT"(Fax) 49 (0) 441 798
5649"gt ltMETA NAME"DC.Creator.Person.Address"
CONTENT"(Postal) Fachbereich Physik Carl von
Ossietzky Universitaet D-26111 Oldenburg"gt ltMETA
NAME"DC.Creator.Person.IsMemberOf"
CONTENT"DPG"gt ltMETA NAME"DC.Creator.Person"
CONTENT"(Keywords) Dipl.Phys., Wiss.Mit."gt ltMETA
NAME"DC.Subject" CONTENT""gt ltMETA
NAME"DC.Relation" CONTENT"(SCHEMEurl) "gt ltMETA
NAME"DC.Relation.References" CONTENT"(SCHEMEurl
) "gt ltMETA NAME"DC.Date" CONTENT"1999-03-8"gt ltME
TA NAME"DC.Type" CONTENT"Text.Homepage"gt ltMETA
NAME"DC.Rights" CONTENT"These personal data may
not be used for any commercial purpose or
incorporated in mailing lists without written
permission by the author. They are free for
information and communication services of learned
societies."gt ltLINK REL"SCHEMA.dc"
HREF"http//purl.org/DC/"gt
9
Existent Gatherers and Brokers
www.iuk-initiative.org/ iwi/TheO/
www.physik.uni-oldenburg.de/ EPS/PhysNet/
www.mathnet.de
10
Search results
How they look like - list of results -
link to the index-file - link to the fulltext
(- link to the word in text)
11
(No Transcript)
12
inhomogeneous
13
(No Transcript)
14
with Metadata
15
How to create MetaData? Using an online tool
16
Global Harvest Serverstructure
global national Learned field Europewide
17
Harvest - Configuration
Provider
Gatherer
gmb
Broker
Provider
Gatherer
SOIF
HTTP
Provider
Broker
Provider
Provider
18
SOIF Example
_at_FILE http//www.physik.uni-oldenburg.de/Docs/TH
EO3/publications/metadocs/ebs.shell.structure.html
update-time9 938935362 url-references208
http//www.physik.uni-oldenburg.de/Docs/THEO3/pub
lications/ebs.shell.structure.pdf mailtohilf_at_merl
in.physik.uni-oldenburg.de http//www.physik.uni-o
ldenburg.de/Docs/THEO3/publications/ebs.shell.stru
cture.pdf title59 Shell Structure and
Stability of Very Neutron-Rich Isotopes keywords9
7 and author date eberhard ebs files hilf
isotopes neutron pdf rich shell stability
structure very head16 -Version 1.0
--gt dc.type59 InProceedings (SCHEMEFreetext
)publication-statuspublished dc.title59
Shell Structure and Stability of Very
Neutron-Rich Isotopes dc.publisher18
IKDA, TH Darmstadt dc.language18
(SCHEMEZ39.53)ENG dc.format15
application/pdf dc.date75
(SCHEMEANSI.X3.30-1985)1975 (SCHEMEANSI.X3.30-19
85)(TYPEcurrent)19990408 dc.creator126
Eberhard R. Hilf (TYPEemail)hilf_at_merlin.physik.un
i-oldenburg.de (TYPEphone)49-(0)441-798-2543 (TY
PEfax)49-(0)441-798-3201 body190
4gtShell Structure and Stability of Very
Neutron-Rich Isotopes Author Eberhard R. Hilf
Phone [phone] Fax [phone]
201 Files ebs.shell.structure.pdf Date
1975 md532 bc1f2750a042a8175cce710030c60
d76 file-size4 2440 type4
HTML gatherer-version6 1.5.19 gatherer-host
31 egoiste.physik.uni-oldenburg.de gatherer
-name17 Physics Oldenburg refresh-rate5
86400 time-to-live7
3888000 last-modification-time9
928224570 description186 4gtShell
Structure and Stability of Very Neutron-Rich
Isotopes Author Eberhard R. Hilf Phone
49-(0)441-798-2543 Fax [phone] Fil
es ebs.shell.structure.pdf Date 1975
19
lttagsgt and Metadata
HTML Element SOIF-Element ltA HREFgt url-referenc
e ltADDRESSgt address ltH1 ...
H6gt headings ltTITLEgt title ... Metadaten
SOIF-Element DC.title dc.title DC.author dc
.author ...
20
Harvest links
Harvest-Sources ftp//ftp.tardis.ed.ac.uk/pub/h
arvest/develop/snapshots/
More infos http//www.dissonline.org/harvest.htm
l
21
Port-Numbers

• Harvest 8500
• Webserver http 80
• ftp 21 tcp
• telnet 23
• smtp (email) 25
• pop3 110
• time-server 123

22
Why Harvest?

• set up portals for specific needs
• heterogeneous archives
• runs on different platforms
• Software public domain (lower costs)
• open sourcecode
• world wide community

23
runtime and pack of data
DFN-Net 3 Docs pro
Minute connecting time see Browser index
ms memory 9 MB PhysDis (Jan.00) 306 real
links 1475 Documents 112 Server Gatherer
2h 4min
24
Legal Aspects

• searching a database - look for robot.txt
• Discussion in DC.Rights - rights of the
  resource (un-)restricted access / use
  - rights of Metadata

25
Topics of Discussion

• Search depth
• fulltext vs metadata abstract
• integration of old archives
• access
• Questions, Commtents
• -gt kerstin_at_physik.org