Joint Techs Workshop InfiniBand Now and Tomorrow

1
Joint Techs WorkshopInfiniBand Now and Tomorrow

• Minneapolis, MN
• February 12, 2007

Steve Lyness Sr. Director, HPC Systems
Engineering QLogic
2
LARGE InfiniBand Ecosystem and growing
Silicon Providers
IB Systems Providers
IB Solutions Providers
3
InfiniBand Today
4
Adapters in multiple form-factors
5
Linux Software Stacks Standards
AcceleratedStacks
StandardStack
OpenFabrics StacksOFED
Proprietary Stacks
Intel MPI
QLogic MPICH
Open MPI
HP-MPI
Scali MPI
MVAPICH
MVAPICH2
Sockets Storage uDAPL RDS
Standard Linux TCP/IP Stack

• MPI (Vendor
• And Commercial)
• MVAPICH
• EVIC
• FVIC / SRP
• FastFabric Tools
• Subnet Manager
• Oracle-RDS

MVAPICH
Lustre
IPTransport
OpenFabrics Verbs
PSM API
QS vpd
mthca
ipath Driver
InfiniPathAdapters
QuickSilverAdapters
6
Switches and Gateways

• 24 port Edge Switches
• SDR and DDR
• Director Class Switches
• 24 to 288 ports
• SDR and DDR
• Virtual IO Gateways and Routers
• 10GbE and 4 Gb Fibre Channel VIO gateways
• InfiniBand, GigE and 2 Gb FC routers

14U
288 Ports
144 Ports
7U
7U
96 Ports
4U
48 Ports
24 Ports
2U
19 rack
7
InfiniBand Attached Storage using SRP
8
End to End InfiniBand Solutions for HPC and more
Adapters
Servers
10-20Gb/s
IB Edge Fabric Switch
10-60Gb/s
IB Multi-Protocol Director
One Wire
Fibre Channel Gateway
Ethernet Gateway
Storage
Fibre Channel SAN
Ethernet Network
Native InfiniBand
9
OpenFabrics SCinet at SC06
SCinet NOC 1545
DDN S2A9500
Cisco 4948-10GE
Fujitsu XG1200
LSI/Engenio 6498
QLogic 9120
Voltaire ISR 9096
Panta Matrix
IB 4X DDR 20Gigabits, MPO Fiber
Cisco SFS 7000D
IB 4X SDR 10 Gigabits, MPO Fiber
QLogic 9024
10 Gig Ethernet, SM Fiber
1 Gig Ethernet
Voltaire ISR 9024
XNet 1848
Qlogic 9024
QLogic 9024
Qlogic 9024
QLogic 9024
IB Exhibitors Ames Lab 217 Appro 1634 ASUS
612 Cisco 1035 HLRS - 239 Intel 1523
Mellanox 1535 NNSA-ASC - 1217 Pittsburgh SC
1049 QLogic 1024 SilverStorm 216 Sun
Microsystems 605 Tyan - 240 Voltaire - 942
PANTAmatrix and Storage
10
Advances to the InfiniBand Ecosystem
Coming Soon!
11
Innovation at the host .

• Increased number of IB Down motherboards and
  blades
• DDR cards for HTX bus
• Increased message rates and decreased latency
  for DDR
• Cards that can be configured to InfiniBand or
  10GigE
• Quad Data Rate (QDR) 40
• New Cabling solutions including
• Fiber that is cost competitive with copper
• Active copper
• QSFP connectors (vs. CX4 today)

12
Merged Linux Standards Stack
AcceleratedStack
StdStack
OpenFabrics StackOFED
QuickSilverStack
QLogic MPICH
Open MPI
HP MPI
Scali MPI
MVAPICH
MVAPICH2
NFS
Oracle
GPFS
QuickSilver IB Stack
Std TCP/IP
Std SCSI
Std SCSI
Std TCP/IP
Std Sock


HP MPI
Intel MPI
Open MPI
MVAPICH MPI
MPICH2 MPI
HP MPI
Intel MPI
Std TCP/IP
QuickSilver SM
Fast Fabric
MVAPICH
MVAPICH2
Open MPI
QuickSilver MPI
Scali MPI
Lustre
Lustre
Scali MPI
RDS
SDP
IPoIB
SRP
VNIC
VAPI
IPoIB
VNIC
SRP
uDAPL
uDAPL
iPath Ether
OpenFabrics Stack
PSM API
ipath Driver
TavorVpd
mthca
ArbelVpd
InfiniPathAdapters
QSAdapters
13
and fully certified support for Windows Server
Applications
User
WSD SAN Provider
Management Tools
VNIC
Kernel
14
Hardware Innovation Staying steps ahead of other
Interconnects

• QDR switch chips
• Enabling QDR to the host (40 GB/s)
• Enabling up to 120 Gb/s (12X QDR)
  switch-to-switch
• Higher port count switches
• Switch port count maximum is realistically
  limited to n2 / 2
• Example 32 port chip would be 3216 512 ports
• Mainstream InfiniBand Routers
• Mainstream Long Haul InfiniBand
• Refresh of Ethernet and Fibre Channel gateways

15
Software Innovation Enterprise Ready!

• New Enterprise Features and Functions
• QOS
• Multi-path
• Adaptive Routing
• Partitioning
• Server Boot Options
• Enhanced Security
• Congestion Avoidance
• And then even more Robust Management and
  Diagnostics?
• GUI and Log based event notification
• Fabric Health Monitoring
• Automated Problem Resolution
• Congestion Management

16
Thank you!

• Steve Lyness
• QLogic Corp.
• steve.lyness_at_qlogic.com
• [phone] (Office)
• [phone] (Cell)