Real Work

1
Real Work!
2
Higher level Components

• Big Box 1
• LEAD Translator/ App manager
• Performance Model
• Mapper/ vgDL Resource Negotiator
• Big Box 2
• vgES
• Slot Manager
• Batch Queue Prediction

3
Overall Timeline

• Development Stages
• vgES new features (June 30)
• Integration stages
• Use LEAD DAG and see if we can do sequence of
  find and bind (July 3-7)
• Use LEAD DAG with dummy jobs with same time (Jul
  24-28)
• Use LEAD DAG with real applications !!! (Aug 7
  -21)
• Refining techniques
• Performance model
• Scheduler
• Batch queue and slot management

4
Logistics

• Regular demo discussion
• half hour before regular telecon
• Propose an integration work shop
• Jul/Aug?

5
vgES Slot Manager(Yang-Suk, Gurmeet)

• Language extensions slots
• Design of slot manager
• Batch queue support
• Dynamic attributes, head node exposure, new
  schema for cluster, state
• Modularized vgLaunch mechanism
• Slot manager for GRAM/PBS, Condor, BatchQ
  prediction

6
LEAD Translator/ App manager(Lavanya)

• DAG parser annotation
• Performance model data collection
• Run Job interface
• Driver code
• Work with Suresh to make sure LEAD software stack
  is on target machines

7
Mapper/vgDL Resource Negotiator (Ryan)

• New interface with vgDL
• Scheduler heuristics
• kickstart
• iterations
• Interface with app manager/performance model

8
Batch Queue Prediction (Dan)

• Experiment
• Run lots of tests
• Tricks to reserve slots
• Interfaces to resources exist
• GRAM, GridFTP, etc etc etc etc

9
Known Schedules, etc

• HPDC Jun 18-24 (Dan, Yang-Suk)
• DefCON Aug 3-7 (Dan)
• CCGrid Vacation May 16 Jun 16 (Ryan)
• Lavanya Jul 5,