Gigabyte Bandwidth Enables Global Co-Laboratories

1
Gigabyte Bandwidth Enables Global Co-Laboratories

• Prof. Harvey Newman, Caltech
• Jim Gray, Microsoft
• Presented at Windows Hardware Engineering
  Conference
• Seattle, WA, 2 May 2004

2
Challenges Faced by Global Science Experiments
Today 500 Physicists 100 Institutes 35
Countries

• Analysis and development
• Global
• Distributed
• Cooperative
• Massive amounts of data
• 1 Gigabytes per second
• 20 Petabytes per year
• Gigabyte bandwidth required

2007 5,000 Physicists 250 Institutes 60 Coun
tries
CMS
Atlas
3
LHC Datal Grid Hierarchy Developed at Caltech
PBps
1 GBps
Experiment
5 GBps

1 GBps
1 GBps
Physics data cache
30 Petabytes by 20081 Exabyte by 2014
.1 GBps
Workstations
4
Global Integrated Systemshttp//ultralight.caltec
h.edu
OC192 9.9 Gbps
5
Internet2 Land Speed Records

• Send data from CERN to Caltech Fast
• Use standard TCP/IP
• Rules set by Internet2 _at_ http//lsr.internet2.edu/

64 bit

• New speed record, multiple parallel streams

6.8 gbps 850 mBps
6.2 gbps 800 mBps
7,000
6,000
5,000
4,000
mbps per second
3,000
2,000
1,000
0
2000
2001
2002
2003
2004
2005
6
442 AM
6.8 Gbps
7
Windows Disk IO Bandwidth
Workstation Server
2 x AMD Opteron 4 x AMD Opteron
Tyan motherboard Newisys system
SATA NTFS sequential SATA NTFS sequential
20 disks 48 disks
1.0 GBps read/write 2.0 GBps read/write
Details at http//research.microsoft.com/peteku/
8
Futures

• Beyond TCP/IP
• Predictable stability
• Better error and congestion control
• Hybrid networks with dynamic optical paths
• Higher speed links
• Truly global collaboration and virtual
  organizations