One Size Does Not Fit All: MultiComponent Federated Search

1
One Size Does Not Fit All Multi-Component
Federated Search

• Danielle Cunniff PlumerTexas State Library and
  Archives
• Serhiy PolyakovTexas Center for Digital
  Knowledge University of North Texas
• Mark PhillipsUniversity of North Texas Libraries
• LITA Forum 2006 ? Nashville, TN

2
Outline

• Danielle Cunniff Plumer
• THDI and the Texas Heritage Online Interface
• Serhiy Polyakov
• Using Z39.50 and SRW/U for Resource Discovery
• Mark Phillips
• Implementing an OAI Harvester and Metadata
  Repository

3
Statewide Digitization

• Exemplars
• American Memory (LoC)
• Making of America
• Colorado Digitization Program
• Components
• Multiple Institutions
• Libraries
• Archives
• Museums?
• Multiple Formats
• Images
• Documents
• Oral Histories

4
Common Approaches

• Single Repository
• One vs. many data entry points
• Harvested Content
• Multiple repositories contributing metadata to a
  central site
• OAI-PMH
• Federated Search
• Multiple repositories with a single search
  interface
• Z39.50

5
Web Search
6
Metasearch
Protocol OAI-PMH
7
Federated Search
2
Protocols Z39.50 SRU/SRW
8
Digitization in Texas

• Existing Projects
• Texas Archival Resources Online
• Portal to Texas History
• Texas Beyond History
• Texas Tides
• Texas Historic Sites Atlas
• Funding Sources
• TexTreasures
• Texas Infrastructure Fund
• Regional/Local Foundations

9
THDI Vision

• To offer unified online access to cultural
  heritage resources held by Texas institutions

10
THDI Architecture

• Build indexes
• OAI Harvest
• Query Z39.50/SRU

11
THDI IMLS Grant

• Purposes
• To enhance interoperability among disparate
  collections of digital assets
• To provide seamless access to digital assets
  through a federated search engine
• To demonstrate the feasibility of using open
  source software in support of international
  standards

12
THDI Strategy

• Develop Standards
• Develop Interface
• Develop Search Targets
• Usability Testing
• Repeat

13
Technical Specifications

• Full support for Z39.50
• SRW/U bonus
• Metadata normalization
• Dublin Core
• MARC
• Support for thumbnail images
• Open Source
• Standards-Compliant
• Including Accessibility

14
Product Details

• Vendor Index Data
• Product Keystone DLS (TKL)
• Also used in
• Library of Texas
• Portal to Texas History
• Features
• Content Management System
• Digital Asset Management System
• Metadata Harvester
• Link Resolver
• Federated Search

15
Texas Heritage Online
16
(No Transcript)
17
Search Results
18
Search Results
19
THDI Challenges

• Interoperability
• Metadata Schemas
• Collection Granularity
• Thumbnail Images

20
Target
21
Interoperability

• OAI-PMH to be provided via Z39.50
• Possible additional target types
• REST (e.g., Yahoo! Image Search API)
• OpenSearch (e.g., Amazon A9)

22
Metadata Schemas

• Supported syntaxes
• MARC21 and Dublin Core XML
• Possible additional schemas
• XML-based MODS, METS, EAD, etc.

23
Collection Granularity

• Pre-Query Filter
• Allows creation of virtual collections
• Possible additional uses
• Development of virtual controlled vocabulary

24
Search Results
25
Collection Granularity

• Pre-Query Filter
• Allows creation of virtual collections
• Possible additional uses
• Development of virtual controlled vocabulary

26
Thumbnail Images

• Thumbnail support checkbox
• THDI Best Practices for thumbnails
• MARC 856 41 3 Thumbnail image
• Dublin Core dcrelation
• Additional development
• Substitution algorithm (RegEx) for specifying
  thumbnail locations

27
Future Work

• Second phase of interface development Spring
  2007
• Usability testing
• Browse functionality
• Additional search types
• Map-based
• Name-based
• Next round of funding
• Ranked search
• Personalized collections
• Citation management

28
Contacts

• Danielle Cunniff Plumer, CoordinatorTexas
  Heritage Digitization InitiativeTexas State
  Library and Archives CommissionPO Box 12927,
  Austin, TX 78711512-463-5852
  dplumer_at_tsl.state.tx.us
• http//www.thdi.org

29
Image Credits

• Texas Declaration of Independence, Prints and
  Photographs Collection, Texas State Library and
  Archives Commission.
• Daguerrotype of Sam Houston in white duster coat,
  c. 1859. Prints and Photographs Collection, Texas
  State Library and Archives Commission.
• Bruce, Henry. Life of General Houston, 1793-1863.
  New York Dodd, Mead, Co., 1891. Available on
  the Portal to Texas History, University of North
  Texas.
• Sam Houstons title to land in Nacodoches County,
  05 May 1835. Texas General Land Office patent no.
  315, vol. 18.
• Sam Houstons jaguar-skin vest. Sam Houston
  Memorial Museum Collection, Texas Tides, Stephen
  F. Austin State University.
• Sam Houston's Inaugural Address. Center for
  American History, The University of Texas at
  Austin.
• Toy John Deere wagon. From the collections of the
  George Ranch Historical Park, Richmond, Texas.
  Available on the Portal to Texas History,
  University of North Texas
• Correct Map of Texas. St. Louis Woodward,
  Tiernan Hale, 1878. Courtesy of Special
  Collections, University of Texas at Arlington.
• Lida Senkel in chicken yard. Fort Bend Museum
  Collection. Available on the Portal to Texas
  History, University of North Texas.
• Texas Rangers taken at Railroad Station in Ft.
  Worth, Texas during a railroad strike in April,
  1886. ETRC Photograph Collection. Texas Tides,
  Stephen F. Austin State University.
• Oil near Ranger going over the top, circa 1917.
  W.D. Hornaday Collection, Prints and Photographs
  Collection, Texas State Library and Archives
  Commission.
• Jim, Joe, and Lillian Goin. About 1910. From the
  private collection of Bouncer Goin, Aubrey,
  Texas. Available on the Portal to Texas History,
  University of North Texas.
• Launch of the USS Houston (CA-30), Newport News,
  Virginia, September 7, 1929. Cruiser Houston
  Collection. Courtesy of Special Collections,
  University of Houston Libraries.
• Boy in a charro costume, Casasola Studio
  Photographs, PH041-01-00007, Special Collections
  Department, University of Texas at El Paso
  Library.