Super Networking Evolution of the Grid

1
Super Networking Evolution of the Grid

• SC2003
• swallach_at_chiaro.com

2
Speakers

• Dan Blumenthal
• Larry Smarr
• Andrew Chien
• Jason Leigh
• Rick Stevens

3
Grid Day 0 Circa 1975
Timesharing
Device Drivers
DISK
RS- 232
4
Grid Day 1 Circa 1982
DISK
Network Stack
Ethernet Layer 2 (TCP/IP)
Workstations
5
Grid Day 2 - Circa 1987 (client/server)
LAN Switch
Workstations
6
Node Topology Change
SMP
SMP
AKA Router
Storage
Storage
.Separate Addressing Domains for LAN and WAN
References. .Separate Switches Layer 2 Layer
3 .Dynamic Routing Protocols (BGP, OSPF,
etc) .Optical Transmission for Wide Area Network
(Bandwidth the same for local or wide-area)
7
AMPLIFIER TECHNOLOGY
(WDM)
8
Grid Day 3 Networked (Early 90s)
SMP
SMP
SMP
SMP
Storage
Storage
Storage
Storage
Long Haul T1/OC3-12
9
Grid Day 4 (today) Grid Enabled - TeraGrid
A Cluster is a LOCAL GRID
Clusters
Clusters
SMP
SMP
LAN Switch
LAN Switch
LAN Switch
WAN Switch
WAN Switch
WAN Switch
Storage
Storage
Storage
Storage
Storage
Storage
.Optics is the Enabler
Long Haul OC48/192 (Sonet)
.Homogeneous Development Environments .Multiple
Lambdas (4)
10
Grid Day 5 (Future) Layer 3 IPv4/6
Clusters
SMP
Integrated LAN/WAN Switch
Storage
Storage
.Layer 3 Switching and Addressing is inherently
Global in Nature. .New Transport Protocols
(Reliable UDP, XCP, SABLE, etc) .Global view of
the Grid to support (design _at_1, execute _at_2, store
_at_3) .DWDW Multiple Optical Channels -
Terabits/sec (Multiple Lambdas) .Cluster/SMP
has integrated Grid Support
11
The OptIPuter 2003
Experimental Network Wide Array of Vendors
12
Global Architecture of a 2009 COTS PetaFLOPS
System
128 Die/Box 4 CPU/Die

• meters
• 50 nanosec Delay

3
4
...
5
2
16
1
17
64
ALL-OPTICAL SWITCH
18
63
...
...
32
49
48
Multi-Die Multi-Processor
...
33
47
46
I/O
Systems Become GRID Enabled
LAN/WAN
Source Steve Wallach, Supercomputing 2000 Keynote