Teragrid Indexing

1
Teragrid Indexing

Master1
File Paths
SRB (Web Crawl)
File PathN
File Path1
Object1
ObjectN
Slave1
SlaveN
GPFS Temp Storage
Extracted Data1
Extracted DataN
2
Teragrid Indexing Slave

Master1
SRB (Web Crawl)
Slave1
SlaveN
GPFS Temp Storage
3
Teragrid Indexing2

Master1
SRB (Indexes)
Sort/Load Request
Sort/Load Request
Merged Data
Merged Data
Slave1
SlaveN
GPFS Temp Storage
Extracted Data
Extracted Data
4
Search Phase

Search Request
SRB (Indexes)
Web Interface
Multivalent Browser
Index Sections
SRB URIs
5
Search Phase2

SRB URI of Object
SRB (Web Crawl)
Multivalent Browser
Original Object