Process Management

1
Process Management Monitoring WG

• Quarterly Report
• February 21, 2002

2
Components

• Process Management
• Process Manager
• Checkpoint Manager
• Data Migration
• Monitoring
• Job Monitor
• System Monitors
• Meta Monitoring

3
Next StepsFrom November 2001

• XML discussions nearly complete
• Clarify policy/mechanism boundaries
• Define the remaining PM requests
• Define Monitoring data
• Could use input from the entire center here

4
Group Progress

• XML is now a secondary issue
• Prototyping will iron out uncertainties
• Refined our boundaries with RMWG
• RMWG provided their requirements
• Resurrected the Job Manager
• Influencing Monitoring discussion
• Continue with weekly conference calls

5
Job Manager

• Resurrected from Als Meatball Diagram
• Collects PM steps into jobs
• System Prologue
• Data In-Staging
• User Job Script
• Data Out-Staging
• System Epilogue

6
Process Manager

• Distinguished from the Job Manager
• Prototyped by ANL as Python wrapper (for parsing
  XML) around MPD
• Can actually start jobs on Chiba City
• ANL also has a stub Job Manager
• PM Interface work ongoing
• Have a complete set of interfaces
• Need to refine them

7
Checkpoint Manager

• Will be a separate component
• Five entry points presented in Nov 01
• Migration interface is now two-phase
• Requirements document (LBNL)
• Publication as a tech report is pending
• Your comments are desired

8
Monitors

• Two basic query types
• Was reduced from 3 at Nov 01 meeting
• NCSA studying implementation issues
• SGIs PCP for prototype implementation
• Monitoring capabilities match the requirements
  produced by RMWG

9
Data Migration

• No interface work yet
• Would be invoked by the Job Manager
• Could invoke Process Manager

10
Next Steps

• Continue to work with the RMWG
• Continue the interface work for
• Process Manager
• Checkpoint Manager
• Begin the interface work for
• Job Manager
• Monitors
• Prototyping and refinement