The Gridbus Toolkit for Service-Oriented [Cluster/Grid] Computing

1
The Gridbus Toolkit for Service-Oriented
Cluster/Grid Computing
Economic Paradigm for Clusters and Grids-based
Utility Computing

• Rajkumar Buyya

Grid Computing and Distributed Systems (GRIDS)
Lab. The University of MelbourneMelbourne,
Australiawww.gridbus.org
Collaboration Nimrod-G Project
2
Nimrod-G Resource Broker
Virtual Lab
Collaborations
3
Collaborations
Yuko Mizuno-Matsumoto3
Susumu Date
4
Acknowledgements Co-authors

• Nimrod-G
• David Abramson, Monash
• Jon Giddy, DSTC
• Slavisa Garic (nirmod 1.1 update)
• GridSim
• Manzur Murshed, Monash (GridSim core 1.0)
• Virtual Lab
• Kim Branson, WEHI for Structural Biology
• NeuroGrid
• Susumu Date, Osaka University
• Industry Collaborator
• Wolfgang Gentzsch, Sun Microsystems
• Gridbus Project Members
• Srikumar Venugopal (Data Grid Scheduler)
• Jia Yu (Grid Market Directory)
• Martin Placek (Web-based Monitoring and Control
  Station)
• Shoaib Burq (Visual Tool for Parameter Sweep
  Application Creation)
• Alex Burmouta (Grid Bank)
• Anthony Sulistio (GridSim 2.0 Visual modeller)

5
Agenda

• Grid Challenges and The Project Vision
• Grid Architecture for Computational Economy
• Gridbus and Nimrod-G Technologies
• Scheduling Experiments on the World Wide Grid
  testbed
• New Gridbus Tools
• Conclusion

6
A Sample Grid Computing Environment Resource
Sharing Aggregation
Grid Information Service
Grid Resource Broker
Application
R2
R3
2
R4
R5
RN
Grid Resource Broker
R6
R1
Resource Broker
Grid Information Service
7
Why Grids ? Large Scale Exploration needs
themKiller Applications.

• Solving grand challenge applications using
  computer modeling, simulation and analysis

Aerospace
Internet Ecommerce
Life Sciences
Digital Biology
CAD/CAM
Military Applications
Military Applications
Military Applications
8
Grid Characteristics and Challenges
Grid Information Service
Grid Resource Broker
Application
R2
R3
2
R4
R5
RN
Grid Resource Broker
R6
R1
Resource Broker
Grid Information Service
challenges
Resource Management Application Construction
9
Grid Challenges and Technologies
10
Some Grid Projects Technologies

• Australia
• Nimrod-G
• Gridbus
• GridSim
• Virtual Lab
• DISCWorld
• GrangeNet
• ..new coming up
• Europe
• UNICORE
• Cactus
• UK eScience
• EU Data Grid
• EuroGrid
• MetaMPI
• XtremeWeb
• and many more.
• India
• I-Grid

• USA
• Globus
• Legion
• OGSA
• Sun Grid Engine
• AppLeS
• NASA IPG
• Condor-G
• Jxta
• NetSolve
• AccessGrid
• and many more...
• Cycle Stealing .com Initiatives
• Distributed.net
• SETI_at_Home, .
• Entropia, UD, Parabon,.
• Public Forums
• Global Grid Forum
• Australian Grid Forum

http//www.gridcomputing.com
11
mix-and-match
Object-oriented
Internet/partial-P2P
Grid Computing Approaches
Network enabled Solvers
Economic-based Utility Computing
Nimrod-G
12
The Gridbus Vision To Enable Service Oriented
Grid Computing Bus iness!
WW Grid
Gridbus
World Wide Grid! marketplace for Service-Oriente
d Computing
13
Gridbus Vision Scales Breaks Administrative
Barriers
PERFORMANCE Q o S
Administrative Barriers

• Individual
• Group
• Department
• Campus
• State
• National
• Globe
• Inter Planet
• Universe

Personal Device
SMPs or SuperComputers
Local Cluster
Global Grid
Inter Planet Grid
Enterprise Cluster/Grid
14
GRIDS Lab _at_ the U. of Melbourne, The Gridbus
Project www.gridbus.org

• R D in Distributed Computational Economy and
  end-to-end infrastructure for Service-Oriented/Uti
  lity Computing
• Architecture, Specification, and Open Source
  Reference Implementation in Collaboration with
  interested Global Peers.
• Platform Cluster, Grid, P2P for diverse
  applications.
• Visual Tools for Creation of Distributed
  Applications
• Grid Economy Scheduling (via Nimrod-G Broker)
• GridSim Toolkit Grid Modeling and Simulation
  (Java based)
• Libra Economic Cluster Scheduler
• Grid Bank Accounting and Transaction Management
• Grid Market Directory and Web Services
• World Wide Grid (WWG) A Global Grid Testbed
• Jxta-based P2P Compute Power Market (CPM)
• Application Enabler Projects
• Virtual Laboratory Toolset for Drug Design
• High-Energy Physics and the Grid Network
  (HEPGrid)
• Brain Activity Analysis on the Grid (NeuroGrid)
• Future GridEmail for Spam Managementread only
  if sender pays!

15
Gridbus Towards Building a Grid Economy for
Sustained Resource Sharing
Offers Incentive and Enable the Creation and
Promotion of Grid Marketplace (competitive) ASP S
ervice Oriented Computing . . . And let users
focus on their own work (science, engineering, or
commerce)!
16
Grid Economy Incentive, Resource Allocation and
Regulation
17
New challenges of Computational Economy

• Resource Owners
• How do I decide prices ? (economic models?)
• How do I specify them ?
• How do I enforce them ?
• How do I advertise attract consumers ?
• How do I do accounting and handle payments?
• ..
• Resource Consumers
• How do I decide expenses ?
• How do I express QoS requirements ?
• How I trade between timeframe cost ?
• .
• Grids need to support the automation of the
  process.

18
GRACE A Reference Grid Economy Services
Architecture

• GRid Architecture for Computational Economy
  (GRACE)

19
GRACE A ReferenceService-Oriented Grid
Architecture for Computational Economies
Data Catalogue
Grid Bank
Information Service
Grid Market Services
Sign-on
HealthMonitor
Info ?
Grid Node N

Grid Explorer

Secure
ProgrammingEnvironments
Job Control Agent
Grid Node1
Applications
Schedule Advisor
QoS
Pricing Algorithms
Trade Server
Trading
Trade Manager
Accounting
Resource Reservation
Misc. services

Deployment Agent
JobExec
Resource Allocation
Storage
Grid Resource Broker

R1
R2
Rm
Grid Middleware Services
Grid Consumer
Grid Service Providers
20
Realizing the GRACE Vision Development
Methodology Used
Applications
Grid Apps.

Science
Engineering
Commerce
Portals
ActiveSheet
High-level Services and Tools

Visual Paramteric Modeller
Grid Tools
MPI-G
CC
Parameter Specification
Nimrod-G
Gridbus Scheduler
Higher Level Resource Aggregators
Core Services
Grid Middleware
GRAM
GASS
GTS
GARA
GBank
GMD
Jxta
MDS
PKI-based Grid Security Interface (GSI)
Grid Fabric
Local Services
JVM
TCP
UDP
Libra
Condor
Solaris
Irix
Linux
SGE
LSF
PBS
21
Using Gridbus Nimrod-GBrokering and On Demand
Assembly of Grids
Data Source
(Instruments/distributed sources)
Cluster Scheduler
PE
Grid Service Provider (GSP) (e.g., CERN)
22
Gridbus Tools Enabling Utility Computing for
Distributed Data Intensive Applications

• Visual Environment for Parameter Application
  Creation
• Grid Market Directory (Portal for GSPs
  Webservices for GRBs)
• Gridbus Data Grid Scheduler (built on
  Nimrod-Farming Engine)
• Gridbus Monitoring and Control Station
  (Web-based)
• GridBank Grid Accounting Services Architecture
• GridSim Toolkit 2.0
• Libra Cluster Economy Scheduler

23
Sample P-Sweep/Task/Data Farming Grid Applications
Bioinformatics Drug Design / Brain Activity
Analysis
Combinatorial Optimization Meta-heuristic
parameter estimation
Ecological Modelling Control Strategies for
Cattle Tick
Neuroscience
Data Mining
Electronic CAD Field Programmable Gate Arrays
High Energy Physics Searching for Rare Events
Computer Graphics Ray Tracing
Finance Investment Risk Analysis
VLSI Design SPICE Simulations
Civil Engineering Building Design
Network Simulation
Automobile Crash Simulation
Aerospace Wing Design
astrophysics
24
Drug Design Data Intensive Computing on Grid
Chemical Databases (legacy, in .MOL2 format)

• It involves screening millions of chemical
  compounds (molecules) in the Chemical DataBase
  (CDB) to identify those having potential to serve
  as drug candidates.

Collaboration with WEHI for Medical Science,
Melbourne
25
Gridbus Visual Tool for Parametric Application
Creation (e.g., Docking)
26
NeuroGrid QoS Requirements driven MEG Data
(Brain Activity) Analysis on the Grid
Analysis All pairs (64x64) of MEG data by
shifting the temporal region of MEG data over
time 0 to 29750 64x64x29750 jobs
64 sensors MEG
2
3
Data Analysis
1
5
Grid Resource Broker (Nimrod-GGridbus)
4
Life-electronics laboratory, AIST
World-Wide Grid

• Provision of MEG (MagnetohyEncephaloGraphy)
  analysis

Collaboration with Osaka University, Japan
27
The Grid Market Directory for Service Publication
and Discovery
28
Nimrod-G A Grid Resource Broker

• A resource broker for managing, steering, and
  executing task farming (parameter sweep/SPMD
  model) applications on the Grid based on deadline
  and computational economy.
• Based on users QoS requirements, our Broker
  dynamically leases services at runtime depending
  on their quality, cost, and availability.
• Key Features
• A single window to manage control experiment
• Persistent and Programmable Task Farming Engine
• Resource Discovery
• Resource Trading
• Scheduling Predications
• Generic Dispatcher Grid Agents
• Transportation of data results
• Steering data management
• Accounting

29
Nimrod-G and Gridbus Scheduler
Nimrod/G Client
Gridbus Client
Nimrod/G Client
(Default Scheduler or Gridbus Scheduler)
Nimrod/G Engine
Schedule Advisor
Trading Manager
Grid Store
Grid Dispatcher
Grid Explorer
Grid Middleware
TM TS
Globus, Legion, Condor, etc.
GE GIS
Grid Information Server(s)
RM TS
RM TS
RM TS
G
C
L
G
Legion enabled node.
Globus enabled node.
L
G
C
L
RM Local Resource Manager, TS Trade Server
Condor enabled node.
30
A Nimrod-G Monitor
Deadline
Legion hosts
Globus Hosts
Bezek is in both Globus and Legion Domains
31
G-monitor Web-based Station
32
Deadline and Budget Constrained Scheduling
Algorithms
33
Scheduling Experiments on the World Wide Grid
34
The World Wide Grid Sites
Cardiff/UK Portsmoth/UK Manchester, UK Cambridge,
UK
TI-Tech/Tokyo ETL/Tsukuba AIST/Tsukuba
EUROPE ZIB/Germany PC2/Germany AEI/Germany
Lecce/Italy CNR/Italy Calabria/Italy Pozman/Poland
Lund/Sweden CERN/Swiss CUNI/Czech R. Vrije
Netherlands
ANL/Chicago USC-ISC/LA UTK/Tennessee UVa/Virginia
Dartmouth/NH BU/Boston UCSD/San Diego
Kasetsart/Bangkok
Singapore
U. Of Melbourne Monash U. VPAC/Melbourne U. Of
Sydney
Santiago/Chile
35
Experiment Setup

• Workload
• 165 jobs, each need 5 minute of CPU time
• Deadline 2 hrs. and budget 396000 G
• Strategies 1. Minimise cost 2. Minimise time
• Execution
• Optimise Cost 115200 (G) (finished in 2hrs.)
• Optimise Time 237000 (G) (finished in 1.25 hr.)
• In this experiment Time-optimised scheduling run
  costs double that of Cost-optimised.
• Users can now trade-off between Time Vs. Cost.

36
Resources Selected Price/CPU-sec.
37
G-monitor Usage HPC Challenge Demo _at_ SC 2002
Australia
North America
GMonitor
MelbourneMonash U VPAC, Physics
ANL SGI/Sun/SP2 NCSA Cluster Wisc
PC/cluster NRC, Canada Many others
GridbusNimrod-G
MEG Visualisation
Solaris WS
Internet
_at_ SC 2002/Baltimore
Europe
Grid MarketDirectory
ZIB T3E/Onyx AEI Onyx CNR Cluster CUNI/CZ
Onyx Pozman SGI/SP2 Vrije U Cluster Cardiff
Sun E6500 Portsmouth Linux PC Manchester
O3K Cambridge SGI Many others
Asia
AIST, Japan Solaris Cluster Osaka University
Cluster Doshia Linux cluster Korea Linux cluster
38
Resource Scheduling for DBC Time Optimization
39
Resource Scheduling for DBC Cost Optimization
40
The GridSim ToolkitA Java based tool for Grid
Scheduling Simulations
Application, User, Grid Scenarios Input and
Results
. . .
Application Configuration
Resource Configuration
User Requirements
Grid Scenario
Output
Grid Resource Brokers or Schedulers
GridSim Toolkit
Application Modeling
Information Services
Resource Allocation
Statistics
Job Management
Resource Entities
Resource Modeling and Simulation (with Time and
Space shared schedulers)
Clusters
Single CPU
Reservation
SMPs
Load Pattern
Network
Basic Discrete Event Simulation Infrastructure
SimJava
Distributed SimJava
Virtual Machine (Java, cJVM, RMI)
Distributed Resources
PCs
Workstations
Clusters
SMPs
41
Selected GridSim Users!
42
Libra Economic-based cluster scheduler
deadline, budget
43
CPM P2P Market-Maker Technology(Jxta based
Implementation)

• Discovery
• - Membership

User (Consumer)
Trader
Job Management
Resources (Provider)
Accounting
44
Summary and Conclusion

• Grid Computing is emerging as a next generation
  computing platform for solving large scale
  problems.
• Resource management is a complex undertaking as
  systems need to be adaptive, scalable,
  competitive,, and driven by QoS.
• Scheduling experiments on the World Wide Grid
  demonstrate our brokers ability to dynamically
  lease services at runtime based on their quality,
  cost, and availability and consumers QoS
  requirements.
• Gridbus tools allow Creation/Composition of Grid
  Applications with minimal or no effort. Grids
  fail if we ask biologists to create applications
  using Globus/MPIassembly language of grid
  computing).
• Economic-based resource management and scheduling
  is essential for pushing Grids into mainstream
  computing and creating the World-Wide Grid
  Marketplace.

45
The End, Thank You!
For further info

• Visit our home in cyberspace _at_
• http//www.gridbus.org
• Visit our Research Exhibit _at_ SC 2002 for a live
  demo.
• Visit our home on planet earth _at_ Melbourne,
  Australia!
• W are happy to collaborate with anybody in the
  universe.
• PS When we deploy our Economic-based GridEmail
  application, our Inbox accepts only paid or
  bartered emails and the rest will be sent to junk
  box automatically. This helps in handling
  Nigerian emails!