Data Flow Diagram

1
10/9/2004
1
2
Data Flow Diagram
Event Builder
1-15MB/s 1500-2000Hz
ALL RAWFILTREC
FILTRAWFILTREC
Data Handling
ALLFILTREC
Transient Buffer
Online Analysis
Rec/Filt Data
Online Analysis
Tape
Online Analysis
Recon Monitor
3
Data Handling Tasks

• Data movement, archive and transfer from the
  South Pole
• South Pole computing system
• Winter-Over operations
• Networks and security
• Data warehouse
• CPU resources

4
Data Volume
Data rates in GB per day
5
Data Handling Status

• South Pole Test System operational
• Data movement software operational
• Winter-Over staff hired
• Basic warehouse and CPU resource available
• South Pole System on track for shipping October
  25
• Almost at full staffing levels

6
Data Filtering (PF Server)

• Provide a software system for
• Receiving events from DAQ
• Performing online reconstruction
• Apply filtering cuts
• Pass data to data handling
• Robust design based on system in operation at
  Milagro (at LANL)

7
Processing and Filtering - Design
8
Processing and Filtering Prototype Performance
9
Software Tasks

• Offline production software
• Processing and Filtering South Pole System
• Data Warehouse
• Simulation
• Physicists desktop
• This includes software for
• South Pole processing/filtering farm
• Software framework
• Database tools
• Visualization tools

10
Philosophy

• Provide a single framework for analysis of
  IceCube data
• New analysis and reconstruction modules can move
  transparently between
• Development work on a physicists desk
• Testing with simulation data
• Production processing at Data Warehouse
• South Pole reconstruction/filtering

11
Production Processing Software

• Offline software for production environments
• IceTray software framework
• Dataclass storage containers
• Input/Output modules
• V1.0 release to collaboration
• Under active development now.

12
Visualization Tools

• Provide tools for offline software for
  visualization (3-D event view, histograms) of
  event data.
• Event viewer tool
• Tree/ntuple creation tools
• Much of this functionality comes from extensions
  to ROOT.

13
3-D Event Viewer
14
Current Status

• Prototype PF software system deployed and tested
  on SPTS.
• First version of offline software released to
  collaboration.
• Geometry database in place with access tools.
• Event Viewer first release
• Root Browser release

15
Simulation Planning
v0.1 November ? Development version
v0.2 December ? First version for production
(test) running
v1.0 March '05 ? For simulating actual '05
setup to improve understanding of detector and
simulation
Currently Running data Sets with AMASIM version
16
Simulation Data Sets

• Common Datasets
• Code development checking
• Verification planning
• Reconstruction testing
• I4Amanda, I16Amanda, I80
• Pat Toale, Paolo Desiati, Mike Walter

17
Summary

• Good progress in all categories
• Ready for Pole
• Software moved past language discussions and
  frameworks
• Real work beginning
• Reconstruction
• Verification

http//www4.tsl.uu.se/botner/Ice3_AII_agenda.htm
l