Now That Weve Found the Hidden Web, What Can We Do With It

1
Now That Weve Found the Hidden Web, What Can We
Do With It?

• The Illinois Open Archives Initiative Metadata
  Harvesting Experience
• Supported by a research grant of the
• Andrew W. Mellon Foundation

Museums and the Web 2002
Tim Cole, Joanne Kaczmarek, Beth Sandore, Paul
Marty, Chris Prom, and Sarah Shreeves (present
ers)
2
What is the hidden web and how did we find it?

• Open Archives Initiative Protocol for Metadata
  Harvesting (OAI-PMH)
• Illinois OAI Metadata Harvesting Project
• OAI Tools
• Cultural Heritage Repository

3
What Can We Do With It?

• http//oai.grainger.uiuc.edu/search/

4
Illinois Experience

• Metadata authoring/mapping practices
• Aggregation issues
• Context for content
• Normalization
• Interface design

5
Metadata Authoring and Mapping

• Mapping decisions
• Item level vs. collection level
• http//oai.grainger.uiuc.edu/ead/search

6
(No Transcript)
7
Mapping Variance
8
Metadata Authoring and Mapping

• Mapping decisions
• Item level and collection level
• http//oai.grainger.uiuc.edu/ead/search

9
Context for Content

• Collection level context
• Collocation issues

10
Normalization

• Analyzing metadata
• Building and applying a vocabulary

11
Designing the Interface

• Leading users to richness of the hidden web (and
  back)
• Serving different communities

12
Next Steps

• Further analysis of metadata
• Community specific metadata
• Focus on educator communities

13
Conclusion

• OAI is easy, metadata is hard
• Aggregation issues impact effective searching
• Visit the Illinois project website at
• http//oai.grainger.uiuc.edu