Scheduling

1
Scheduling Resource Management Area

• co-directors Jennifer Schopf, Argonne National
  Lab Bill Nitzberg, PBS/Veridian Systems
• www.mcs.anl.gov/jms/ggf-sched/
• sched-wg_at_gridforum.org
• GGF4 Intro Session
• Toronto, Ontario
• 17 February 2002

2
Scheduling on the Grid
Run My Job
PBS
LSF
Globus (over anything)
3
High-level OverviewSolve Grid Resource
Management

• Who? Developers, users
• What? -- Agreements / standards
• Capabilities, general protocols, APIs
• Why? -- Interoperability
• Reserving, allocating, using resources
• Managing resources (owners pt-of-view)
• Support co-scheduling diverse resources
• Enable "better" "use of" resources

4
Active Groups at GGF-4

• Standardizing Run my job API
• Distributed Resource Management Application API
  (DRMAA) WG
• Standardizing Run my job Protocol
• Grid Resource Management Protocol BOF
• Language
• Scheduling Dictionary WG

5
Distributed Resource Management Application API WG

• Co-leads
• John Tollefsrud,john.tollefsrud_at_eng.sun.com
• Hrabri Rajic, hrabri.rajic_at_intel.com
• Charter
• Develop an API specification for the submission
  and control of jobs to one or more Distributed
  Resource Management (DRM) systems.
• The scope of this specification is all the high
  level functionality which is necessary for an
  application to consign a job to a DRM system
  including common operations on jobs like
  termination or suspension.

6
At this meeting
7
At this meeting

• Three sessions-
• one overview, 2 working sessions
• Discussion of two proposed possible APIs, and how
  to combine them

8
Next Steps

• Will agree on a combined draft for GGF-5
• Possible reference implementations of the API
  shortly thereafter (outside the scope of the WG,
  possible follow-on activity)

9
Next Steps
10
Grid RM Protocol BOF

• Lead
• Volker Sander, Jon MacLaren, Wolfgang Ziegler
• Child of Advance Reservation API work
• Current charter expanded from Advance
  Reservation to Resource Management
• GGF-2 consensus you basically have to do most of
  a general RM protocol to do Advance Reservations
  anyway
• Start with Requirements

11
Discussion at this meeting

• Standardize the basic building blocks required to
  implement a super-scheduler
• Advance Reservation, Co-Allocation
• Create a set of documents describing the protocol
  it uses
• Could be a WDSL document and a description of the
  operational semantics (OGSI)
• Add binding specification for particular
  lower-level protocols
• Focus the work on existing sub-sets
• Where is AR available and how to interface it

12
Next Steps

• Charter settlement
• Will be redefined more precisely by E-Mail in
  short term
• Focus on available services
• Identify people willing in participating in the
  documentation process
• We identified a significant(!) set of people
  willing to work actively on the set of documents
• It is worthwhile to pursue the effort
• Document series will start with requirements
• Milestones
• Set together with the charter
• First circled around the group, then forward to SG

13
Scheduling Dictionary

• Leads
• Mary Roehrig, mroehr_at_sandia.gov
• Wolfgang Ziegler, wolfgang.ziegler_at_scai.fraunhofer
  .de
• Whats the point
• If a user wants 2 CPUs there is an agreed on
  way (between schedulers) that this is defined

14
At this meeting

• Discussion of initial set of proposed terms and
  their definitions
• Additional terms added
• Clarification of scope and cross references that
  are needed

15
Next Steps

• Rename to Grid Scheduling Dictionary
• Incorporate references to data access/updates
  (database/datagrid related scheduling terms)
• Add a general section for background,
  clarification
• Add text about relationship and definition of the
  context terms
• New draft coming soon

16
Other Scheduling Efforts

• In Review
• 10 Actions for Superscheduling
• Advance Reservation API
• Scheduler Attributes
• BOF at GGF-3, under discussion for GGF-5
• Scheduling Optimization RG
• Vincenzo DiMartino vincenzo.dimartino_at_caspur.it
• Uniform Job Submission Script Syntax WG
• Joe Werne werne_at_co-ra.com

17
How to Participate

• Come to the sessions
• Visit our web page
• www.mcs.anl.gov/jms/ggf-sched/
• Join our mailing list
• sched-wg_at_gridforum.org
• Talk to the Area Leads
• Jennifer Schopf, jms_at_mcs.anl.gov
• Bill Nitzberg, bill_at_computer.org