Resource Discovery on TeraGrid with MDS4

1
Resource Discovery on TeraGrid with MDS4

• Laura Pearlman
• USC Information Sciences Institute

2
To be Covered

• MDS4 Overview
• MDS4 in TeraGrid
• Getting Information Out of MDS4
• Getting Information Into MDS4

3
MDS4 Overview

• Monitoring and Discovery System
• Components
• Index Service aggregates information and
  provides a query interface
• Trigger Service aggregates information and
  takes actions when conditions are met
• Information provider APIs provide an interface
  for adding data to an Index or Trigger Server
• APIs, command-line clients, and web clients for
  querying
• Web Services-based, part of the Globus Toolkit

4
The MDS4 Hourglass
Information Users Schedulers, Portals, Warning
Systems, etc.
WS standard interfaces for subscription,
registration, notification
Schemas
Queueing Systems (PBS, Torque, etc.)
5
MDS4 in TeraGrid
Resource Provider Site
Resource Provider Site
IP
IP
IP
IP
MDS4 Index Server
MDS4 Index Server
IP
IP
Mds.teragrid.org
Web browser
MDS4 Index Server
WebMDS
client
Web browser
client
6
General Resource Information
7
General Service Information
8
CTSS Kit Registration
9
CTSS Kit Monitoring with Inca
Inca uses MDS4 to set the paths it uses for tests
at each site.
10
MDS and the TeraGrid User Portal (TGUP)

• GPIR (the information repository used by TGUP)
  queries MDS4 for load and job data.
• The MDS servers that provide this data are
  access-controlled.
• Previously, this data was collected by user-level
  scripts run by GPIR.
• Using MDS4 instead allows site administrators to
  manage the information provider scripts.

11
Getting Informationout of MDS4

• WebMDS
• Web-based GUI
• Users can see raw XML or formatted data.
• Users can specify XPath queries
• Wsrf-query
• Command-line client
• Returns raw data
• Users can specify XPath queries
• Java API
• C API

12
Getting Information Into MDS4

• In some cases, you can use standard MDS4
  components
• Static data in files
• Data advertised as resource properties by another
  service
• For relatively simple data, you can write a
  program/script (in any language) or a java class
• For more complex applications, use the
  usefulrp/rpprovider interface.
• You may also want to write your own xslt
  transforms and configure MDS to use them.

13
Acknowledgements

• Eric Blau
• Jason Brechin
• Mike DArcy
• Maytal Dahan
• Kate Ericson
• Lee Liming
• Neill Miller
• Robert Miller
• JP Navarro
• Eric Roberts
• Laura Pearlman
• Jen Schopf

14
For More Information

• TeraGrid MDS page http//mds.teragrid.org
• Globus Documentation http//www.globus.org/toolk
  it