Data Cataloguing

1
Data Cataloguing

• thoughts, plans, discussions for the
• Belle Analysis Data Grid
• Lyle Winton winton_at_physics.unimelb.edu.au

2
Replica Catalog

• Currently implemented using LDAP, central service
• Looks like development is moving away from this!

3
LDAP Advantages - Referrals
4
LDAP Advantages - Master/Slave
5
An RLS model for data cataloguing
6
Meta-Data Repository
Data, Simulation, Skim, Histogram
7
Meta-Data Structure
High Level
Name, Version
8
Meta-Data Structure

• Data oriented queries
• List the files resulting from job X.
• Retrieve the list of all simulation data of X
  type of event.
• How can file X be regenerated? (if lost or
  expired)
• Other queries that we can imagine
• What is the status of job X ?
• What analyses similar to X have been undertaken?
• What tools are being used for X analysis?
• Who else is doing analysis X or using tool Y ?
• What are the typical parameters used for tool X
  ?And for analysis Y ?
• Search for data skims (filtered sets) that are
  supersets of my analysis criteria.
• Do we have enough information so that future apps
  agents could propose data, tools, and
  parameters given a high level job/analysis
  description?