Status%20of%20Data%20Handling

1
Status of Data Handling

• At the June 2003 collaboration meeting there were
  two options presented for handling the MINOS data
• Invent our own system
• Use SAM (Sequential Access with Metadata) which
  was developed for Run II and is used by CDF and
  D0
• Given our limited manpower (part of Liz
  Buckley-Geer and 50 of a programmer) we have
  decided to go with the SAM option which we think
  will meet our needs
• There are a number of advantages such as
  extensive experience and help from the SAM team
  which we have already made heavy use of -
  support for the product.
• These advantages far outweigh the minor
  inconveniences such as use of ups/upd to install
  the product.

2
Work so far

• We (Liz Buckley-Geer and Bruce Greenway) have
  installed the SAM software on a Linux PC and have
  a data server (station) running.
• We have a SAM schema created for MINOS in the D0
  development ORACLE database.
• We have populated the schema with the necessary
  startup data and have added a few files by hand.
  Bruce is working on some scripts to populate the
  file info for September 2003 so we can make more
  extensive tests. This information is extracted
  from the DBUSUBRUNSUMMARY tables in the offline
  database plus info from the PNFS entries.
• We have successfully defined a SAM dataset that
  consists of a few files and run SAM projects
  using this dataset. We have configured the
  station to use both local disk cache and DCache
  disk a mode that CDF uses.
• The client software has been installed on desktop
  PC and successfully used to run SAM projects
  using Dcache disk need to try with locally
  configured SAM cache.

3
Upcoming work

• So far all we can do is deliver the files from a
  SAM project to a SAM disk cache
• We want to be able to deliver the files into the
  loon job.
• This requires an input module that makes calls to
  SAM to obtain the next file in the project. We
  have started looking at this. When this is
  available we will ask for some initial offsite
  testers.
• A number of improvements are in the works for SAM
  and we would like these to be available before we
  go into production.
• Also we need to purchase the MINOS ORACLE
  database machine so that we can setup our own SAM
  database.
• We will need to work on things like installation
  instructions, customizing the web query tools