Connecting the World: Pacific Wave

1
Connecting the WorldPacific Wave
International Peering

• Dave McGaugh, PNWGP
• CENIC Conference 2006

2
Introduction

• A joint project between Corporation for Education
  Network Initiatives in California (CENIC),
  Pacific Northwest Gigapop (PNWGP), University of
  Southern California (USC), and University of
  Washington (UW)
• A distributed Internet Exchange Point (IXP)
  running the length of the entire United States
  Pacific Coast
• Supports high-end networking and protocols,
  including IPv4 (ucast/mcast), IPv6 (ucast/mcast),
  Jumbo Frames

3
What is a Distributed IXP?

• A switching fabric that extends beyond the
  confines of a small geographic region which
  Internet exchange points typically operate
• Capable of providing direct connectivity between
  entities which do not share common, physical
  presences due to financial, operational, or
  logistical constraints
• An architecture which does not define any central
  or primary point in the infrastructure

4
Overview

• 3 Metropolitan Node Sites
• Seattle
• Bay Area (Sunnyvale Palo Alto)
• Los Angeles
• FastE through TenGigE available
• Based on shared (public) VLANs
• Separate Jumbo and Standard MTU
• Private VLANs available

5
The VLAN Architecture
6
Underlying Infrastructure

• Exclusively Cisco 7600 and 6500 class devices
  with Sup720
• Redundant supervisor modules at critical points
• All linecards are 67xx series fabric enabled
• Strategic termination of TenGigE links based on
  fabric utilization
• PIM-SM snooping used to contain multicast traffic

7
Wide Area Connectivity

• TenGigabit Ethernet LAN-PHY circuit provisioned
  via NLR, Seattle to Sunnyvale
• TenGigabit Ethernet LAN-PHY circuit provisioned
  via CENIC , Sunnyvale to LA

8
Network Topology
9
NLR Enables Pacific Wave
10
International Participation
11
Pacific Northwest Participation
12
Examples of Collaborations

• WIDE/TLEX-PNWGP (IEEAF Tokyo - Seattle) Data
  Reservoir HD Video
• AARNet (SX-Transport Sydney to Seattle) Huygens
  Data Transfer
• CANet4 Data Reservoir and Huygens Data Transfer
• ESNet/UltraScienceNet SuperComputing 2005
• National LambdaRail SuperComputing 2005, iGrid
  2005
• OptiPuter Chicago - Seattle - San Diego
  iGrid2005, HD Video
• Abilene HD Video
• KREONet2 (GLORIAD Daejon - Seattle) HD Video

13
How Does Experimental Networking Fit In?

• Work with the demo participants to carefully
  understand traffic characteristics
• Where possible work with production
  configurations and infrastructure
• Augment the infrastructure with additional wide
  area links when necessary

14
iGrid 2005, San Diego Sept. 2005

• iGrid 2005, Over 10 Gbps bidirectional traffic
  coexisted with production exchange traffic
  without detriment
• 4k line interactive Super-HD between Keio
  University and UCSD
• Live HD from the sea floor 100 miles off the
  Pacific Coast
• N-way uncompressed multicast HD video conferencing

15
ResearchChannel N-Way HD Multicast Video
Conferencing
16
Does it Really Perform in Practice? Yes!

• 7.5 Gbps of unicast HDTV over IP traffic (10 750
  Mbps flows)
• 3 Gbps of multicast replicated in Seattle switch
  node using PIM snooping
• Traffic test performed in Cisco POC lab before
  the event

17
An Amazing Feat at SC05
18
47 10 Gbps Lambdas to be Exact
19
HDTV Conferencing Spanning Two Oceans Enabled by
Pacific Wave
20
Traffic Flows at Supercomputing

• Among other things, 1-gt5 multicast replication of
  3 Gbps, over 12 Gbps total traffic across the
  switch backplanes

21
Thank You

• http//www.pacificwave.net
• info_at_pacificwave.net
• http//www.pnw-gigapop.net
• http//www.cenic.org
• http//www.usc.edu
• http//www.washington.edu