RecoCert

1
RecoCert
D0 Collaboration Meeting October 2003

• The Offline Shifter contribution to Data Quality
  monitoring
• Shifter Statistics and Results
• Changes in the next version
• Discussion

Tom Diehl
2
Description

• Part of the Offline-of-defense for data
  quality. Developed by Harry M., Sarah E., Erich
  V. , Daria Z., Anne-Catherine Le B. others .
• A Framework Package presently used to determine
  stability/suitability of the event reconstruction
  software.
• Runs on DSTs (TMBs recently). Produces
  Root-Tuples.
• I run it on CAB through clued0. It takes about
  an hour to process 25,000 events. Longer for a
  whole run.
• VerifyRecoCert produces comparison plots. The
  plots are documented, with examples, but not
  including a discussion of the comparisons.

http//www-d0.fnal.gov/computing/data_quality/ how
to/OfflineRecoCert.txt
3
How RecoCert is Used

• Shifters Do
• Look for recentDataInSam which shows the runs
  analyzed by Reco in the past few days OR check
  the punchlist for requests
• Select a run and execute runRecoCert on it
• Execute verifyRecoCert and look at comparison
  histograms
• Note discrepencies and document results in the
  logbook
• Doing this well and logbook technical issues
• Email to runQualityCoordinator on discrepencies.
• runQualityCoordinator Does
• Looks at results, particularly at notes on the
  possible problems, and decides whether to
  initiate an inquiry by experts
• Maintains the punchlist of inquiries.

4
Statistics

• RecoCert has been completed 61 times by 18 people
  (Offline shifters HTD) since July 1st, 2003.
• Job results are stored on clued0 at
  /rooms/greatlakes/michigan/dataquality/jobs
• Sometimes it is found to be helpful to select a
  particular run as the comparison (as opposed to
  one provided in the example).
• It is possible that a RecoCert browser will soon
  be made available on the data quality web page.

5
PunchList

• A List of inquiries related to Data Quality
• Sources Include
• Offline Shifter Data Quality Monitoring
• Captain Shift Summaries
• Current Topics
• 22 Items since March 2003
• 5 active, 12 finished, 5 moribund
• 7 Calorimeter, 9 Tracking or Trackers, 3
  RecoCert, 2 Muon
• Detailed Reports at the ADM

http//www-d0.fnal.gov/computing/data_quality/ pun
ch/punchlist.txt
6
RecoCert Plots
www-d0.fnal.gov/computing/data_quality/figures

• Follow Plots and Figures on the DQ web page
• So far
• An item is one page of plots one txt file
  of description
• Considerable help has already been received from
  experts.

7
RecoCert Plot Additions

• Particles and Resonances
• Tracking Effy In Jets

8
RecoCert Plot Changes

• Plots of Jets and calorimeter quantities for
  events with MET gt 20 GeV
• I dont know of any removals.

Struggling to get the plots out of recent version.
We will use the next version as soon as it
settles down and is documented. I believe that
will be before we start taking data again.
9
Comments

• Run RecoCert on every run.
• Has potential benefits but might have to run on
  TMBs for this.
• It could not be a shifter task to run it on every
  run.
• Almost ALL of the value of the offline shifter
  work comes from looking at the results as opposed
  to the act of running the jobs.
• Maybe shifters could look at more RecoCert
  outputs
• Logbook
• We are using Stus logbook interface but this
  doesnt provide a mechanism for including
  plots/histos.
• Difficult to access the results in the logbook.
• Thumbnails
• I like being able to look at the detail provided
  by DSTs
• Doing more is better, true.

10
Comments (more)

• Calorimeter
• Sanders, Merritt Theres some calorimeter
  information going into the Reco whos source is
  some Online analysis. We should look out for
  that.
• I suppose that would be visible in calorimeter
  occupancies and missing ET.
• Zieminska Its especially interesting to note
  the correspondance between hot cells and jets.
• Which runs to analyze
• Lyon It may make sense to analyze some short
  runs (probably especially those labeled bad in
  the control room) to see how they look in Reco.
  Those as well as the longer good runs.
• Scripts
• Nunneman The recocert stuff can be put in a
  script so we dont have to cut/paste those simple
  commands.

11
Summary

• RecoCert
• Description
• How it is used by Offline Shifters
• Punchlist
• Statistics
• New plots available
• Comments and Suggestions

12
End of Presentation

• My talk ended here.
• Anything that follows is a backup slide.

13
Points of Monitoring Quality Control
Good Runs List Detector

• Could be

Recorded Data Online
Alarms SES
Data- Taking
Reco Farms
Examine
Recorded Data Offline
Analysis Samples
Event Check And Marking
Good Runs List Reco Version Dep.