DataTAG - WP3

1
DataTAG - WP3

• Objectives, activities and progress
• by
• UvA Wim Sjouw, Hans Blom, Jason Lee, Cees de
  Laat
• INRIA Mathieu Goutelle
• CERN tbd

2
Contents

• Objectives
• Tasks
• Activities
• Experiences with SURFnet Lambda
• Pointers

3
WP3 objectives

• Bulk data transfer and application performance
  monitoring
• innovative monitoring tools are required to
  measure and understand the performance of high
  speed intercontinental networks and their
  potential on real Grid application.

4
Tasks in WP3

• Task 3.1. Performance validation (month 1-12)
• Create, collect, test network-tools to cope with
  the extreme Lambda environment (high RTT, BW)
• measure basic properties and establish a baseline
  performance benchmark
• Task 3.2 End user performance validation/monitorin
  g/optimization (month 6-24)
• Use out of band tools to measure and monitor
  what performance a user in principle should be
  able to reach
• Task 3.3 Application performance validation,
  monitoring and optimization (month 6-24)
• Use diagnostic libraries and tools to monitor and
  optimize real applications to compare their
  performance with task 3.2 outcome.

5
Task 3.1 Performance validation

• Performance Test Tools
• http//carol.wins.uva.nl/jblom/datatag/wp3_1/
• Lambda's are a Layer 1-2 environment
• use end to end traffic generating tools
• not ICMP based tools since those need routers in
  the path
• tools must work in Gigabit environment
• Netperf
• TCP bulk transfer, UDP unusable (no shaping)
• modifications made to enhance IPv6 support
• Iperf
• TCP and UDP shaped bulk transfer
• lightweight multiple streams test support
• IPv6 support
• modifications made to introduce TCP shaping,
  debugging

6
Task 3.1 Performance validation (contd)

• UDPmon (by Richard Hughes-Jones)
• each packet contains seq. / time stampinfo
  receiver can deduce
• packets lost
• packets out-of-order
• UDP bandwidth
• very precise timing
• not intrusive
• tool is in continuous development

7
Task 3.1 Performance validation (contd)

• Tools under investigation which are either not
  released yet or incomplete
• Pathload estimate available bandwidth
• Magnet network software performance
• Netprobe one way delay variance, jitter

8
Task 3.1 experiences usingNetherlight SURFnet
Lambda AMS-CHI full duplex GE ? 2.5 Gbps SDH ,
100 ms RTT

• single stream TCP max. throughput 80 - 150 Mbps,
  dependent on stream duration
• similar for BSD and Linux and different adaptors
• UDP measurements show effects of hardware
  buffer-size in ONS equipment when assigning lower
  SDH bandwidths,see
• www.science.uva.nl/wsjouw/datatag/lambdaperf.htm
  l

9
Task 3.2 End user performance validation/monitorin
g/optimization

• Toolset for monitoring
• Re-use as much as possible WP7 stuff
• rTPL(end user performance monitoring)
• http//195.169.124.55/rtpl/netherlight/table/
• MRTG (to monitor router interfaces)
• http//195.169.124.55/mrtg/
• SmokePing (history and statistics of rtts)
• http//195.169.124.55/smokeping/smokeping.cgi?targ
  etSARA
• Not so ideal tools (for the time being)
• Cricket (to monitor large number of router
  interfaces)
• http//195.169.124.55/cricket/grapher.cgi?target
  2Fssr-interfaces

10
Task 3.2 and 3.3

• set up tool RTPL for end user performance check,
  can be expanded when DataTAG lambda becomes
  available. Seehttp//195.169.124.55/rtpl/netherl
  ight/table/
• task 3.3 will most probably use netlogger, did
  not yet start.
• all info can also be found viawww.datatag.org

11
Summary of status

• Tools have been investigated, selected and where
  necessary adapted to benchmark and characterize
  Lambda networks
• http//carol.wins.uva.nl/jblom/datatag/wp3_1/
• New tools appear and need to be studied to add to
  the set
• Influence layer 1 and 2 infrastructure properties
  on TCP throughput is under study on SURFnet
  Lambda testbed and NetherLight
• Monitoring setup is underway, inclusion of WP7
  toolset is next step
• Application performance monitoring and
  optimization should start soon
• Preparation for iGrid2002 which also gives us
• a 2.5 gig connection Amsterdam-CERN
• for duration of iGrid2002 10 Gbit/s connection
  Starlight-Amsterdam by Level3!
• WWW.IGRID2002.ORG in Amsterdam 23-26 september