Grid, Globus Toolkit, and OGSA

1
(No Transcript)
2
McKean
Kevin

• CEO Editorial Director
• InfoWorld Media Group

3
(No Transcript)
4

• Platinum Sponsors

Gold Sponsors
5
(No Transcript)
6
Foster
Ian

• Professor, Computer ScienceUniversity of Chicago
• Assoc. Director, Mathematics Computer Science
  DivisionArgonne National Laboratory

7
The Grid in Your Future
8
Three Questions

• What is the Grid?
• Where is it today, and where is it going?
• Why should you care?

9
The Grid Is

• A collaboration resource sharing infrastructure
  for scientific applications
• A distributed service integration and management
  technology
• A disruptive technology that enables a
  virtualized, collaborative, distributed world
• An open source technology community
• A marketing slogan
• All of the above

10
Grid Past, Present, Future

• Past
• Origins and broad adoption in eScience, fueled by
  open source Globus Toolkit
• Present
• Rapidly growing commercial adoption
• Open Grid Services Architecture (OGSA)
• Future
• Key enabler of new applications industries
  based on resource virtualization and distributed
  service integration

11
Why You Should Care

• 1) Grids address pain points now, e.g.
• Cost of provisioning for peak demand
• Data federation and integration
• 2) Grids are a disruptive technology
• Usher in (or solve problems of) a virtualized,
  collaborative, distributed world
• Potentially significant competitive advantages
• 3) An open Grid is to your advantage
• Insist that your suppliers embrace OGSA, refuse
  proprietary solutions!

12
Overview

• The power grid analogy its limitations
• Grid past From eScience to eBusiness
• Grid present OGSA
• Grid future virtualization ubiquitization
• Summary

13
The Power Grid
Quality, economies of scale
Time
14
By Analogy, A Computing Grid

• Decouple production and consumption
• Enable on-demand access
• Achieve economies of scale
• Enhance consumer flexibility
• Enable new devices
• On a variety of scales
• Department
• Campus
• Enterprise
• Internet

15
Not Exactly a New Idea

• The time-sharing computer system can unite a
  group of investigators . one can conceive of
  such a facility as an intellectual public
  utility.
• Fernando Corbato and Robert Fano, 1966
• We will perhaps see the spread of computer
  utilities, which, like present electric and
  telephone utilities, will service individual
  homes and offices across the country.
• Len Kleinrock, 1967

16
But, Things are Different Now

• Networks are far faster (and cheaper)
• Faster than computer backplanes
• Computing is very different than pre-Net
• Our computers have already disintegrated
• E-commerce increases size of demand peaks
• Entirely new applications social structures
• Weve learned a few things about software

17
But Wait A Minute Computing isnt Really Like
Electricity!

• I import electricity but must export data
• Computing is not interchangeable but highly
  heterogeneous
• Computers, data, sensors, services,
• Ok, so the story is more complicated
• But more significantly, the sum can be greater
  than the parts
• Real opportunity Construct new capabilities
  dynamically from distributed services
• Virtualization distributed service mgmt

18
Virtualization Distributed Service Management
Larger, more integrated More connected Dynamically
provisioned
Less capable, integrated Less connected User
service locus
Device Continuum
19
The Fundamental Questions

• Can I build effective virtualized services?
• Can I achieve QoS across services?
• Can I achieve economies of scale?
• Can I identify applications that yield real
  competitive advantage?

20
Overview

• The power grid analogy its limitations
• Grid past From eScience to eBusiness
• Grid present OGSA
• Grid future virtualization ubiquitization
• Summary

21
Origins Revolution in Science

• Pre-Internet
• Theorize /or experiment, aloneor in small
  teams publish paper
• Post-Internet
• Construct and mine large databases of
  observational or simulation data
• Develop simulations analyses
• Access specialized devices remotely
• Exchange information within distributed
  multidisciplinary teams

22
Science Grids
23
(No Transcript)
24
NSF TeraGrid

• NCSA, SDSC, Argonne, Caltech
• Unprecedented capability
• 13.6 trillion flop/s
• 600 terabytes of data
• 40 gigabits per second
• Accessible to thousandsof scientists working
  onadvanced research
• www.teragrid.org

25
Data Grids for Physics

• Enable international community of 1000s to access
  analyze petabytes of data
• Harness computing storage worldwide
• Virtual data conceptsmanage programs, data,
  workflow
• Distributed system management

26
NEESgrid Earthquake Engineering Collaboratory
U.Nevada Reno
www.neesgrid.org
27
NASA Aviation Safety
Wing Models

• Lift Capabilities
• Drag Capabilities
• Responsiveness

Stabilizer Models
Airframe Models

• Deflection capabilities
• Responsiveness

Crew Capabilities - accuracy - perception -
stamina - re-action times - SOPs
Engine Models

• Braking performance
• Steering capabilities
• Traction
• Dampening capabilities

• Thrust performance
• Reverse Thrust performance
• Responsiveness
• Fuel Consumption

Landing Gear Models
28
Access Grid Collaboration

• Enable collaborative work at dozens of sites
  worldwide, with strong sense of shared presence
• Combination of commodity audio/video tech Grid
  technologies for security, discovery, etc.
• 150 sites worldwide, number rising rapidly

29
The Need for New Technology

• Resource sharing coordinated problem solving
  in dynamic, multi-institutional virtual
  organizations

30
The Grid/eScience World Status

• Dozens of major Grid projects in scientific
  technical computing/research education
• Deployment, application, technology
• www.mcs.anl.gov/foster/grid-projects
• Globus Toolkit broadly adopted as de facto
  standard for major protocols services
• Global Grid Forum a significant force for
  community building and standardization
• GGF8 Tokyo, March 2003, 850 people
• www.gridforum.org 200 organizations Boeing,
  Merck, Ford, JJ, IBM, Platform,

31
Revolution in Business

• Pre-Internet
• Central data processing facility
• Post-Internet
• Enterprise computing is highly distributed,
  heterogeneous, inter-enterprise (B2B)
• Business processes increasingly computing-
  data-rich
• Outsourcing becomes feasible gt service
  providers of various sorts

32
The New EnterpriseComputing Environment
33
eScience/eBusiness Vision

• Link dynamically acquired resources
• From collaborators, customers, eUtilities,
  (members of evolving virtual organization)
• Into a virtual computing system
• Dynamic, multi-faceted system spanning
  institutions and industries
• Configured to meet instantaneous needs, for
• Multi-faceted QoS for demanding workloads
• Security, performance, reliability,

34
Overview

• The power grid analogy its limitations
• Grid past From eScience to eBusiness
• Grid present OGSA
• Grid future virtualization ubiquitization
• Summary

35
Grids and Open Standards
App-specific Services
Increased functionality, standardization
Custom solutions
Time
36
Open Grid Services Architecture

• Service-oriented architecture
• Key to virtualization, discovery, composition,
  local-remote transparency
• Leverage industry standards
• Internet, Web services
• Distributed service management
• A component model for Web services
• A framework for the definition of composable,
  interoperable services

The Physiology of the Grid An Open Grid
Services Architecture for Distributed Systems
Integration, Foster, Kesselman, Nick, Tuecke,
2002
37
Transient Service Instances

• Web services address discovery invocation of
  persistent services
• Interface to persistent state of entire
  enterprise
• In Grids, must also support transient service
  instances, created/destroyed dynamically
• Interfaces to the states of distributed
  activities
• E.g. workflow, video conf., dist. data analysis
• Significant implications for how services are
  managed, named, discovered, and used
• In fact, much of Grid is concerned with the
  management of service instances

38
OGSA Structure

• A standard substrate the Grid service
• Standard interfaces and behaviors that address
  key distributed system issues
• A refactoring and extension of the Globus Toolkit
  protocol suite
• supports standard service specifications
• Resource management, databases, workflow,
  security, diagnostics, etc., etc.
• Target of current planned GGF efforts
• and arbitrary application-specific services
  based on these other definitions

39
Open Grid Services Infrastructure

• Lifetime management
• Explicit destruction
• Soft-state lifetime

Data access
Implementation
Hosting environment/runtime (C, J2EE, .NET, )
40
Open Grid Services Infrastructure
GWD-R (draft-ggf-ogsi- gridservice-23)
Editors Open Grid Services Infrastructure
(OGSI) S. Tuecke, ANL http//www.ggf.org/ogsi-wg
K. Czajkowski, USC/ISI I. Foster,
ANL J. Frey, IBM S. Graham,
IBM C. Kesselman, USC/ISI D.
Snelling, Fujitsu Labs P. Vanderbilt,
NASA February 17, 2003 Open Grid Services
Infrastructure (OGSI)
41
The OGSA Platform
OGSI
GWD-R (draft-ggf-ogsa-platform-3)
Editors Open Grid Services
Architecture Platform I.
Foster, Argonne U.Chicago http//www.ggf.org/ogs
a-wg D.
Gannon, Indiana U.
42
OGSA Next Steps

• Technical specifications
• Open Grid Services Infrastructure is complete
• Security, data access, Java binding, common
  resource models, etc., etc., in the pipeline
• Implementations and compliant products
• Here OGSA-based Globus Toolkit v3,
• Announced IBM, Avaki, Platform, Sun, NEC, HP,
  Oracle, UD, Entropia, Insors, ,
• Rich set of service defns implementations

43
Globus Toolkit v3 (GT3)

• Implement core OGSI interfaces
• Support primary GT2 interfaces
• High degree of backward compatibility
• Multiple platforms hosting environments
• J2EE, Java, C, .NET, Python
• New services
• SLA negotiation (GRAM-2), registry, replica
  location, community authorization, data,
• Growing external contributions adoption

44
Globus Toolkit History
Only Globus.Org not downloads from NMI UK
eScience EU DataGrid IBM Platform etc.
GT 2.0 Released
GT 2.2 Released
Physiology of the Grid Paper Released
GT 2.0 beta Released
NSF GRIDS CenterInitiated
Anatomy of the Grid Paper Released
Significant Commercial Interest in Grids
GT 1.1.4 and MPICH-G2 Released
The Grid Blueprint for a New Computing Infrastruc
ture published
NSF European Commission Initiate Many New Grid
Projects
First EuroGlobus Conference Held in Lecce
GT 1.1.3 Released
MPICH-G released
Early Application Successes Reported
GT 1.1.2 Released
Globus Project wins Global Information
Infrastructure Award
GT 1.0.0 Released
GT 1.1.1 Released
NASA initiatesInformation Power Grid
45
Overview

• The power grid analogy its limitations
• Grid past From eScience to eBusiness
• Grid present OGSA
• Grid future virtualization ubiquitization
• Summary

46
Virtualization Ubiquitization
47
Converging onStandards-Based Grids
OGSA-based Grids
Industrial Grid Deployments
Complexity of Workload
Scientific Grid Deployments
Department Enterprise Collaboration
Internet
48
What I Expect from OGSA

• True open source/industry partnership
• Globus Toolkit 3.0 provides common Grid
  middleware framework
• Industry adds value in services platforms
• New applications (and industries?)
• Grid middleware will create virtual services,
  servers, and storage from pools of services,
  servers, clients storage dispersed throughout
  the Internet
• Grid computing utilities will emerge and become
  like power utilities

49
Platform Symphony
Applications Delivery
Application Services Distribution
Servers Execution
50
Platform Symphony
Applications Delivery

• Automatically connect applications to
  services
• Dynamic intelligent
• provisioning

Application Virtualization
Application Services Distribution
Servers Execution
51
Platform Symphony
Applications Delivery

• Automatically connect applications to
  services
• Dynamic intelligent
• provisioning

Application Virtualization
Application Services Distribution
Infrastructure Virtualization

• Dynamic intelligent
• provisioning
• Automatic failover

Servers Execution
52
A Cross-Institutional Grid
NY Financial Institution Insurance Group
UK Financial Institution
NY Financial Institution Capital Markets Group
53
Overview

• The power grid analogy its limitations
• Grid past From eScience to eBusiness
• Grid present OGSA
• Grid future virtualization ubiquitization
• Summary

54
Recap The Grid Is

• A collaboration resource sharing infrastructure
  for scientific applications
• A distributed service integration and management
  technology
• A disruptive technology that enables a
  virtualized, collaborative, distributed world
• An open source technology community
• A marketing slogan
• All of the above

55
Grid Past, Present, Future

• Past
• Origins and broad adoption in eScience, fueled by
  open source Globus Toolkit
• Present
• Rapidly growing commercial adoption
• Open Grid Services Architecture (OGSA)
• Future
• Key enabler of new applications industries
  based on resource virtualization and distributed
  service integration

56
Why You Should Care

• 1) Grids address pain points now, e.g.
• Cost of provisioning for peak demand
• Data federation and integration
• 2) Grids are a disruptive technology
• Usher in (or solve problems of) a virtualized,
  collaborative, distributed world
• Potentially significant competitive advantages
• 3) An open Grid is to your advantage
• Insist that your suppliers embrace OGSA, refuse
  proprietary solutions!

57
Summary

• Grids Enabling resource sharing coordinated
  problem solving in dynamic, multi-institutional
  virtual organizations
• Major relevance not to eScience but also
  eBusiness, as an enabler of computing on demand,
  eUtilities, B2B communities,
• Open Grid Services Architecture defines standards
  for distributed system integration
• Globus Toolkit as open source, open architecture
  solution to key Grid problems

58
For More Information

• The Globus Project
• www.globus.org
• Global Grid Forum
• www.gridforum.org
• Background information
• www.mcs.anl.gov/foster
• foster_at_mcs.anl.gov

59
(No Transcript)
60
(No Transcript)
61
(No Transcript)