MB-NG Meeting UCL 17 Jan 02

1
Discussion of Methodology forMPLS QoS High
Performance High throughput Investigations
2
MB NG SuperJANET4 Development Network
Gigabit Ethernet 2.5 Gbit POS Access 2.5 Gbit
POS core MPLS Admin. Domains
RAL/ UKERNA OSM-4GE-WAN-GBIC
Dark Fiber (SSE)
3
High Performance High Throughput Show and Tell
Deliverables

• Bringing Gigabit throughput to the Grid
  applications
• Show and tell demos
• TCP streams operating
• GridFTP operation
• 100 Mbit long transfers
• 500 Mbit long transfers
• 1 Gbit long transfers
• Multiple host-host Host-striping
• High Throughput operations between multi-MPLS
  domains
• High Throughput QoS Realtime (EF - spq) /
  best-effort / Scavenger (qbss)
• Deliverables - Reports
• PC Lab tests
• Protocol monitoring tools
• Gigabit WAN tests
• Enhanced TCP stacks
• Non TCP
• Best practice for TCP GridFTP in Grid
  Middleware and Applications

4
High Performance High Throughput Show and Tell
Deliverables

• Bringing Gigabit throughput to the Grid
  applications
• Show and tell demos
• TCP streams operating
• GridFTP operation
• 100 Mbit long transfers
• 500 Mbit long transfers
• 1 Gbit long transfers
• Multiple host-host Host-striping
• High Throughput operations between multi-MPLS
  domains
• High Throughput QoS Realtime (EF - spq) /
  best-effort / Scavenger (qbss)
• Deliverables - Reports
• PC Lab tests
• Protocol monitoring tools
• Gigabit WAN tests
• Enhanced TCP stacks
• Non TCP
• Best practice for TCP GridFTP in Grid
  Middleware and Applications

5
Defining Background Traffic

• Regular traffic - constant size packet, regular
  spaced in time
• Poisson traffic - constant size, exponential
  spacing to form transient queues
• IETF traffic mix - different sizes and different
  probability of each size sent
• Play back of real traffic patterns generated from
  packet headers pre-recorded from suitable points
  of the production network. This might include
• Video Conference traffic -gt play back -
  rude/crude tools
• General traffic captured at edge of a site, e.g.
  Manchester
• Web-bursty traffic web mirror wget

6
High Performance High Throughput Tests on
Intermediate Systems

• Understand the management configuration of
  routers
• IP operation
• MPLS
• QoS/Diffserv management configuration
• Understand the performance of routers and (LAN)
  interconnects
• Latency vs frame size
• Throughput vs message size
• Link framing overheads
• The effect of load on switch/router thoughput
• Offered vs achieved thoughput

7
High Performance High Throughput Tests on the
WAN 1

• TCP/IP Throughput vs rtt
• Throughput vs window-size
• Dependency of Latency Throughput on end system
  hardware
• Throughput using multiple TCP streams, and effect
  on the Network- how does the background
  throughput change?
• The effect of background traffic loads
• Effect of different TCP stacks and TCP tuning
• Reno
• New Reno
• Vegas
• Enhanced TCP algorithms Sally Floyd
• Delayed-Ack, SACK,
• ECN

8
High Performance High Throughput Tests on the
WAN 2

• TCP Behaviour in QoS environment
• Marking
• Rate / Congestion Control CAR RED ECN
• Configurable Scheduling
• WFQ weighted fair queuing
• Priority / realtime
• WRR weighted round robin / DRR
• Bringing Gigabit throughput to the Grid
  applications
• GridFTP at Gigabit
• BBftp and BBscp at Gigabit
• Data Replication GDMP
• Use of non-TCP protocols, and effect on the
  Network
• UDP Blast
• via

9
High Performance High Throughput Time-Lines (1)

• Month1 NOW
• Investigate NICs End System behaviour
• Investigate Monitoring techniques Code
  modifications ?
• Purchase end systems monitoring tools !
• Define test traffic
• Month 2
• Install / configure End systems at sites
• Set up GridFTP between sites minimum Globus
  RH7.1? K2.4.14?
• Set up BBftp BBscp
• Test on SJ4 at 100 Mbit
• Investigate TCP/IP Stacks Tuning Agreement on
  Kernel / details of tests /..
• Define MPLS needs multi-loop to extend the rtt
• Month 3
• Delivery installation of routers and access
  links (TM1)
• Understand configuration of 7600s IP only and
  MPLS
• Understand LAN and blade performance of routers
  Lab tests
• Configuration of Development GSRs at PoPs

Discussion!
Time
10
High Performance High Throughput Time-Lines (2)

• Month4
• Gigabit WAN tests e.g. UDP and TCP mem mem
  streams
• End-to-end IP only 2 sites / no background / with
  background
• 1 MPLS domain / n MPLS domains
• Test with QoS Realtime (EF - pf) / best-effort
  / Scavenger (qbss)
• Think about results!
• Month 5
• Simple Test GridFTP / BBscp BBftp over the
  development network
• Transfers with QoS Realtime (EF - spq) /
  best-effort / Scavenger (qbss)

Discussion!
Time
11
High Performance High Throughput Time-Lines (3)

• Month 6
• Initial demo of sustained throughput for
  different traffic classes (TM1)
• Establish connection between systems with real
  data e.g. BaBar HEP
• Month 9
• Demonstration of GridFTP operation
• 100 Mbit long transfers, 500 Mbit long transfers
  (TP1)
• Month 12
• Initial demo report of end-to-end guaranteed BW
  Qos (TM2)
• Month18
• Advanced demos including use of Qos Techniques
  (TM2)
• Demo of reliable transport at gt 1Gbit/s -
  including with QoS (TP1)
• Grid Data Replication GDMP
• Month 24
• Final report on High throughput transport across
  the WAN (TP1)
• Final report on end-to-end traffic management
  over multiple MPLS domains (TM2)

Discussion!
Time
12
Next Steps

• Draft document on High Performance Throughput
  Investigations to be circulated.
• Technical bitsbytes meetings to discuss
  workplans and doc

Discussion!
Time
13
Hardware Software Tools
High Bandwidth High Throughput Protocol
Investigations (mainly)

• Optical splitter or opto-electrical tap
• opto-electrical tap constructed for logic
  analyser
• Software use of
• tcpdump tcptrace