Networking for HEP in the UK

1
Networking for HEP in the UK

• Introduction to the PPNCG
• Network Topologies
• Monitoring Activities
• Peering to the US and Canada
• Grid Work
• SuperJANET4

2
Introduction to the PPNCG

• Membership includes HEP and Astronomy users
• Ensure the community has the required networking
  facilities
• Monitor end-to-end performance
• Investigate new network applications /
  technologies
• Provide advice on kit / facilities
• URL icfamon.rl.ac.uk/ppncg/title.html
• Acts as an Interface between HEP and UKERNA
• Collaboration Multicast, H.323, QoS tests,
  SuperJANET4
• Active Network Monitoring
• Uses the ICFA monitoring tools and the PPNCG
  traceping and ftp
• Monitor MANs / SuperJANET the networks to CERN,
  DESY, US
• Report problems to UKERNA

3
SuperJANET Connections in the UK
4
SuperJANET Connections in London

• 4 155 Mbit links to SuperJANET

• 2 155 Mbit transatlantic links
• 3rd link in use 18 Jul 00
• 4th planned by End of 00

5
UK to Europe TEN-155 April 2000
Peering with CANARIE made in London, uses 10 Mbit
of the Dante US line for all Europe
6
Europe and ESnet in the US
7
Monitoring US Traffic

• UKERNA Traffic data Kbit/s. Blue Traffic from US
  Maroon Traffic to US
• 10 Nov 1999 17 Jul 2000
• 10 minute averages 10 minute averages

• Last 7 days 1 hour averages Last 7 days 1
  hour averages

8
Monitoring US Traffic - Trends
UKERNA US Traffic Daily totals Mbytes

• Traffic Kbit/s. Blue Traffic from US Maroon
  Traffic to US
• 10 Nov 1999 9 Jul 2000
• 10 minute averages

From US To US
Weekday
Weekend
Xmas 99
9
Monitoring ping plots UK - US

• Ping average round trip time Lost packet for
  100 byte packets
• icfamon.dl.ac.uk ns2.slac.stanford.edu

13 Oct 99 27 Jun 00
10
Monitoring traceping UK - US Mar 99
John Macallister PPNCG Oxford
11
Monitoring traceping UK - US Oct 99
12
Monitoring traceping UK - US Jul 2000
13
Monitoring ping plots UK - CERN DESY

• Ping average round trip time Lost packet for
  100 byte packets
• icfamon.dl.ac.uk rsplus.cern.ch
  icfamon.dl.ac.uk x4u2.desy.de

27 Jun 00 27 Jun 00
14
Peering with ESnet

• Used CAR and WRED to give priority to Esnet
  traffic into JANET.
• Rtt and packet loss for 100 byte packets.
• Tests DL to SLAC
• Start 21 Feb 00

Normal Priority
CARWRED enabled
High Priority
Config changes to CAR and WRED
Further config changes
Robin Tasker PPNCG DL
15
Peering with ESnet and Abilene

• rtt and packet loss for 100 byte packets
• Plot start 16 May 00

ESnet High Priority DL - SLAC
Further config changes
Change in bandwidth restrictions from
Abilene into JANET
Abilene High Priority DL - Stanford
16
The Grid

• Government has discussed 165M pounds to develop
  Computing Grid Infrastructure.
• Across Research Councils Initiative not just
  HEP
• Setting up management structure to co-ordinate
  PPARC activities.
• Have run Globus workshop so US developers could
  inform the community.
• Several sites now working with Globus toolkit.
• Web site www.datagrid.org.uk

17
The Grid

• Keen Interest in the EU DataGrid (CERN)
  middleware proposal.
• HEP experiments will need world Grid access.
• Grid Networking interests include
• High throughput, reliable, very large data
  transfers
• QoS issues diffserv, RSVP and packet marking
• Monitoring, Metrics, and prediction accuracy
• Modelling
• Physics Applications

18
The Grid PAW with Globus
BaBar Tau Analysis

• Next Steps
• Working on root
• Brokers
• Data Location
• Security Global farms

Andrew McNab Manchester
19
The GridMeasurements on SuperJANET
Latency Mancester - DL

• ATM MAN
• 7 routers 0.8ms / router
• Routerlink 0.4 ms/byte
• DL-Liverpool 10 ms rtt - agreement

Richard Hughes-Jones PPNCG Manchester
20
The Grid Latency on SuperJANET
Pink LAN Blue MAN-SJ CORE Pink
Man-RAL MB Blue Man-RAL ? 5 ?s nice
exponential ? 2 ms
? 4.5 -gt 6.7 ms
21
The Grid Throughput on SuperJANET
Manc UCL 10 Mbit Manc Glasgow
Manc RAL 24 Mbit link Manc RAL 2
Mbit Managed BW
22
The Grid Multi-stream ftp Oxford to SLAC
Single stream 8 ftp streams 0.8 single
stream
John Macallister PPNCG Oxford
23
The Grid Multi-stream ftp SLAC to Oxford

24
The Grid Multi-stream ftp SLAC to Oxford

25 min
25
SuperJANET4

• SuperJANET4 Topology based on Worldcom Trident
  Network
• Backbone initially SDH based
• 2.5 Gbit (STM-16)
• Upgrade to 10 Gbit in 2001,
• 20 Gbit in 2002
• Migration from SDH to DWDM
• Technology review in 2003

26
SuperJANET4 Backbone and Access links

• Worldcom supply the transmission
• UKERNA layer the IP
• Core PoP IP router at Worldcom
• Backbone Access Router at MANs
• Access Links
• Large MAN 2.5 Gbit -gt 10-20 Gbit
• Medium MAN 622 Mbit -gt 2.5 Gbit
• 4 node DWDM development net
• Deployment
• Backbone delivery Oct 00
• Routers acceptance Nov 00
• Manc-ULCC traffic end Dec 00
• All sites Mar 01

27
Conclusion Status

• Network Links to US and Europe are OK (at the
  moment !)
• Peering with Abilene, ESnet and CANARIE OK,
  interesting effects with CAR WRED !
• Considerable UK interest in the Internet2 tests
• Grid active in several areas including networks
• SuperJANET4 rollout is very promising