The Grid the united computing power

1
The Gridthe united computing power
Jian He Amit Karnik
2
Outline

• History and vision
• Motivation
• Application scenarios
• Architecture
• Challenges
• Approaches
• Language-related
• Object-based
• Toolkit Globus
• Future directions
• References

3
History and Vision

• History
• Late 1980s, metacomputing was coined.
• Early 1990s, Gigabit Testbeds, from
  bandwidth-oriented to application-oriented.
• 1995, network computing at SC95
• 1998, NCSA, NSF, NASA, DOE, Al Gore
• Vision (analogy to Electric Power Grid)
• Dependable performance guarantees.
• Consistent uniform interfaces.
• Pervasive plug-in from everywhere.

From http//dast.nlanr.net/Articles/GridandGlobus/
Grids.html
4
Motivation

• Resource sharing
• Episodic
• Low utilization
• Coordinated PSEs
• Emerging tools and
• techniques

From http//courses.cs.vt.edu/cs5204
5
Application Scenarios

• Distributed supercomputing
• High-throughput computing
• On-demand computing
• Data-intensive computing
• Collaborative computing

Grid high-performance sharing computational
power
Web sharing documents
6
Application Scenarios (cont.)

• High-throughput computing
• A computing environment that delivers large
  amounts of computational power over a long period
  of time. (example NEOS Condor)

UNIX COW
Submit jobs

• Condor GW
• matchmaker
• scheduler
• monitor
• protector

NEOS Solver library
NEOS Server
Internet Client
Return results
7
Architecture
From http//www.cs.utk.edu/dongarra/WEB-PAGES/SPR
ING-2001/lect-grid.pdf
8
Challenges

• The nature of applications
• Programming models and tools
• System architecture
• Problem-solving methods
• Resource management
• Security
• End systems
• Instrumentation and performance analysis
• Network protocols and infrastructure

9
Approaches

• Languages, compilers and libraries
• MPICH-G2 (a grid-enabled MPI - message passing
  interface)
• Object-based approaches
• Legion
• Commodity Computing (Three-tier, CORBA,
  Java/Jini)
• Toolkit
• Application-specified toolkit (NetSolve)
• Service-oriented toolkit (Globus)

10
Approaches (cont.)

• Language-related MPICH-G2Globus services MPI
  (message passing interface)
• Distributed memory message passing
• Portability
• Heterogeneity

Application
FORTRAN or C
M
M
M
MPI
P
P
P
IBM SP2
Cray T3D/E
SUN.
Communication Network
11
Approaches (cont.)

• Object-based Legion - Architecture object
  model

• Everything is an object
• Classes manages their instances
• Users can provide their own classes
• Core objects implement common services

From http//legion.virginia.edu/
12
Approaches (cont.)

• Object-based Commodity computing
• Example CORBA fits within the Grid Architecture

From http//phase.hpcc.jp/mirrors/globus/cog/docum
entation/papers/corba-cog.pdf
13
Approaches (cont.)

• Application-specified toolkit NetSolve

PSEs and Applications
Matlab
Custom
NetSolve
Resource Discovery
Fault Tolerance
Middleware
System Management
Resource Scheduling
Globus proxy
Ninf proxy
Legion proxy
NetSolve proxy
Metacomputing resources
Globus
Ninf
Legion
NetSolve
From http//www.cs.utk.edu/netsolve
14
References

• Book
• I. Foster and C. Kesselman, The Grid Blueprint
  for a New Comuputing Infrastructure, Morgan
  Kaufmann, 1999.
• Papers
• Michael C. Ferris, Michael P. Mesnier, Jorge J.
  More, NEOS and Condor Solving optimization
  problems over the Internet, April, 1998
• David Henty, The Grid - A Critical Review of
  Current Status and Future Directions in Grid
  Technology , Oct., 2000 http//www.epcc.ed.ac.uk/
  DIRECT/grid.pdf.