10 Gigabit Ethernet: Standards Update

1
10 Gigabit EthernetStandards Update
Applications

• Randall Atkinson
• rja_at_extremenetworks.com

Apricot 2002 Bangkok
2
Outline

• 10 Gigabit Ethernet Standards Update
• 10 Gigabit Ethernet Technology Comparison
• Applications Enterprise/Education
• Applications Service Provider

3
Progress in Ethernet Standardizations
10 Gigabit Ethernet IEEE 802.3ae 2000 - First
half, 2002
10/100/1000 Mbps Ethernet Link Aggregation
IEEE 802.3ad, 2000
1000 Mbps Ethernet IEEE 802.3z, 802.3ab, 1995-1999
100 Mbps Ethernet IEEE 802.3u, 1993-1995
10 Mbps Ethernet IEEE 802.3 - 1980s
4
IEEE 802 Standards Committee Structure
Approval Process
802.3ae 10 GbE Task Force
Chair, Jonathan Thatcher, World Wide
Packets Vice-Chair, Steve Haddock, Extreme
Networks Secretary, Jeff Warren, Extreme Networks

5
Why 10GE? Why now?

• Motivation
• Leverage the success and scalability of Ethernet.
• Opportunity to converge Ethernet with Optical
  Networking.
• Technology
• Proven 10 Gbps bandwidth capability in switching
  systems.
• OC-192 optical systems are available (although
  expensive).
• Industry efforts to cost reduce serial optics and
  WWDM.
• Market
• Local Area Network (LAN)
• Aggregate the 30M GigE ports installed by 2002.
• Metropolitan Area Network (MAN)
• Huge deployment of new high BW access networks.
• Wide Area Network (WAN)
• Intra-POP connectivity between core/access
  routers, SDH/SONET ADMs, and DWDM transponders.

6
The LAN PHY vs WAN PHY Debate

• The huge interest in using Ethernet as a MAN and
  WAN technology has sparked an intense debate over
  using SDH/SONET as a Physical Layer
• Traditional WAN vendors argue that leveraging the
  installed SDH/SONET infrastructure justifies a
  SDH/SONET-friendly physical layer.
• Traditional LAN vendors argue that the success of
  Ethernet, and its appeal as a WAN solution, is
  derived from being simple and low cost.
  SDH/SONET is too complex.
• Advantages of a LAN PHY
• Ethernet-style coding techniques are simpler and
  lower cost than SDH/SONET framing.
• Maximise compatibility with 10, 100, and 1000
  Mbps operation.
• Full 10.000 Gbps data rate.
• No OAMP.

7
The WAN PHY SONETising Ethernet

• Advantages of being SDH/SONET friendly
• Enables using SONET infrastructure for layer-1
  transport
• SONET ADMs, DWDM Transponders, Optical
  Regenerators
• Requires some SONET features
• OC-192 link speed, SONET framing, minimal
  Path/Section/ Line Overhead processing
• but not SDH/SONET compliant
• Connects to SDH/SONET access devices, but not
  directly into SDH/SONET infrastructure.
• Avoids most costly aspects of SDH/SONET
• No TDM support (concatenated OC-192c/STM-64c
  only).
• Does not require meeting SDH/SONET grid laser
  specifications, jitter requirements, stratum
  clocking
• Minimal OAMP support

8
802.3ae 10GE Objectives -- Compatibility

• Objectives for Ethernet compatibility
• Preserve the Ethernet/802.3 frame format at the
  MAC Client Interface.
• Preserve the minimum and maximum frame size of
  the current 802.3 standard.
• Support full duplex operation only.
• Support star-wired local area networks using
  point-to-point links and structured cabling
  topologies.
• Support 802.3ad Link Aggregation.
• In other words
• Ensure compatibility with previous generations of
  Ethernet by preserving the MAC interface, frame
  format, and frame size.
• Target topology is full-duplex point-to-point
  links between Ethernet switches.

9
802.3ae 10GE Objectives -- Physical Layer

• Objectives for native-Ethernet and
  SDH/SONET-friendly physical layers
• Support an optional Media Independent Interface
  (MII).
• Support a speed of 10.000 Gb/s at the MAC/PLS
  service interface.
• Define two families of PHYs
• A LAN PHY operating at a data rate of 10.000
  Gb/s.
• A WAN PHY operating at a data rate compatible
  with the payload rate of OC-192c / SDH
  VC-4-64c.
• Define a mechanism to adapt the MAC/PLS data rate
  to the data rate of the WAN PHY.
• Acknowledges that the objectives for the LAN PHY
  and WAN PHY are sufficiently different to justify
  separate solutions.

10
802.3ae 10GE Objectives -- Optics

• Objectives for fiber types and distances
• Provide Physical Layer specifications that
  support link distances of
• At least 100m over installed MMF.
• At least 300m over MMF.
• At least 2km over SMF.
• At least 10km over SMF.
• At least 40km over SMF.
• Support fiber media selected from the second
  edition of ISO/IEC 11801.
• All distance objectives apply to both LAN and WAN
  PHY
• Early market for LAN PHY is 40km dark fiber links
  in the MAN.
• Largest market for WAN PHY is intra-POP links
  (

11
10GbE Technical Highlights

• Its just Ethernet, but faster!!
• No change to MAC protocol, frame size or frame
  format
• Yet another 10x speed increase
• Supports 802.3ad Link Aggregation, QoS, etc.
• Topology restricted to full duplex point-to-point
  links
• Support full duplex operation only
• Completes evolution from shared bus to switched
  networks
• Extends Ethernet standards into the MAN
• Includes optics for 40km 4x distance of standard
  1 Gbps Ethernet
• Fiber ONLY no twisted pair support
• Facilitates migration from SDH/SONET networks
• LAN PHY Ethernet over Fiber (at 10Gbps data
  rate)
• WAN PHY Same data stream in SDH/SONET frames
  (at 9.29 Gbps)
• Think of WAN PHY as SDH Lite or SONET Lite
• Enables use of legacy SDH equipment for
  physical layer transport

12
Ethernet Quality of Service (QoS)

• Ethernet QoS (IEEE 802.1P, now in 802.1D)
• Defines bits in Ethernet frame header to mark
  frames
• IETF Differentiated Services (DiffServ)
• Defines how ToS bits in IP header to mark IP
  packets
• Many products use ACLs to mark IP packets or
  Ethernet frames
• Many products can map between 802.1P and IP ToS
  bits
• Switches/routers queue or traffic-shape based on
  markings
• DiffServ and Ethernet can use same queuing
  algorithms
• Common queuing algorithms
• Weighted Fair Queuing (WFQ)
• Random Early Drop (RED)
• Weighted RED (WRED)
• Can work with any speed of switched Ethernet
• Switches need to include specific support for QoS
  features

13
10GbE Interface Nomenclature

• Three part suffix
• Medium type
• S Short wavelength (850nm)
• L Long wavelength (1310nm)
• E Extra long wavelength (1550nm)
• Coding Scheme
• X 8B/10B coding (LAN PHY)
• R 64B/66B coding (LAN PHY)
• W 64B/66B Simplified SONET encapsulation
  (WAN PHY)
• Wavelengths
• 1 Serial (not required as serial is implied)
• N number of wavelengths (4 for WWDM)
• Examples
• 10GBASE- LX4 Long wavelength, 8B/10B coding
  (LAN PHY), 4 wavelengths
• 10GBASE-EW Extra long wavelength, WAN PHY, 1
  wavelength (serial)

14
10GbE Standard Interfaces
Assumes 50µm, 500MHZkm MMF
15
MMF Distance Considerations
Based on Draft 3.2 of IEEE 802.3ae standard
1 FDDI grade fiber 2 Common MMF type in Japan and
Germany 3 New specialized MMF that is largely
uninstalled
16
XENPAK Optical Modules

• XENPAK is GBIC-like optical insert for 10 Gig
  Ethernet
• XENPAK is the leading Multi Source Agreement
  (MSA)
• Industry Consortium lead by Agere and Agilent
• Xenpak inserts likely wont be available until
  Mid 2002
• Highlights of the Xenpak pluggable optics
• Supports all IEEE 802.3ae optical interfaces
• Four wide XAUI interface
• Hot Pluggable
• Dual SC fiber optic connector
• Industry standard 70 pin electrical connector
• www.xenpak.org

17
802.3ae 10GbE Schedule
Task Force Formed
LMSC Sponsor Ballot
WG Ballot
TF Review
STD??
Study Group Formed
Project Authorization Request Approved
1999
2000
2001
JULY
SEPT
NOV
JAN
MAR
SEPT
MAR
JUN
MAR
MAY
JULY
SEPT
NOV
JAN
MAR
MAY
MAY
JULY
NOV
JAN
AUG
Draft 1
Draft 2
Draft 3
Draft 4
Objectives Drafted
Par Drafted
Last Technical Change
Last Feature
Adopt Core Proposals
18
10Gbs Ethernet Interoperability Demo

• Held September 11th - 14th, 2001
• Held at Interop in Atlanta, USA
• Sponsored by 10 Gigabit Ethernet Alliance (10GEA)
• 5 Ethernet switch vendors (18 total companies
  most component vendors) participated, in
  alphabetical order
• Avaya
• Cisco Systems
• Extreme Networks
• Foundry Networks
• Nortel Networks
• Several vendors had partial interoperability with
  10 GigE
• 2 vendors had 100 interoperability Extreme
  Cisco
• BlackDiamond with a 10GBASE-LR module passed
  bi-directional video traffic over a 10GBASE-LR
  link with a Catalyst 6500 switch

19
10 Gbps Ethernet Standards Summary

• 10 Gig Ethernet is designed for the LAN and MAN.
• 10 Gbps Ethernet standard supports up to 40Km
• 1 Gbps Ethernet standard was limited to 10Km.
• 10 Gig Ethernet compatible with DWDM/SONET
• Requires WAN PHY
• 10 Gig Ethernet standard essentially final.
• Technical specifications have been stable for
  many months.
• Minor edits to Test Procedure portion likely
  during Mar/Apr 2002
• Interoperability coming along nicely.
• 2 fully interoperable vendors at Interop/Atlanta
  in Sept 2001
• Several more partially interoperable vendors
• Full IEEE approval of final text expected 3Q2002
  
• June - August 2002

20
10GbE Benefits

• Brings Ethernet cost model to 10 Gbps networks
• Scales LAN backbones upwards
• Aggregates 1 Gb Ethernet
• Leverages 250 million Ethernet ports
• Supports all services (voice, video, and data)
• Supports LAN, MAN and WAN in one seamless network
  
• Compatible with the installed base of SONET/SDH
  OC-192 transmission equipment and with many WDM
  systems.

21
Outline

• 10 Gigabit Ethernet Standards Update
• 10 Gigabit Ethernet Technology Comparison
• Applications Enterprise/Educational
• Applications Service Provider

22
Comparison 1 Gbps to 10Gbs Ethernet
23
Comparison SDH to 10 Gig Ethernet
24
10 GigE Short-Term Pricing Estimate

• Why is it SO expensive today ?
• Borrowing from SONET optics in short term (they
  are expensive!)
• No critical mass of volume yet to drive component
  costs down
• Vendors still experimenting with design and
  manufacturing processes
• High pin-count for current optics. Xenpak will
  reduce pin count.
• What about Longer-term Pricing ?
• Once volume ramps up, component costs should
  start to drop
• Ultimate target is 3-4 times 1 Gbps Ethernet (on
  price-per-port basis)

No major vendors for these optics at this time
25
Outline

• 10 Gigabit Ethernet Standards Update
• 10 Gigabit Ethernet Technology Comparison
• Applications Enterprise/Education
• Applications Service Provider

26
10GigE Applications Enterprise

• Aggregation of existing 1 Gig Ethernet links
• High-speed links
• Enterprise campus MAN supporting multiple sites
  within a city
• Enterprise backbone between floors/buildings of a
  single campus
• Interconnecting with existing WDM systems using
  WAN PHY
• Specialised high-bandwidth applications
• Imaging, Real-time Video, ASIC design, CAD/CAM,
  etc.
• Server farms
• Web farms, Mail servers, File servers, etc.
• Super-Computing
• Linux Beowulf cluster uplinks
• Other supercomputing applications

27
10GbE in the Enterprise LAN/MAN
Campus B
Campus A

• 10GbE Links
• Between buildings
• Between floors
• Switch to switch
• Switch to server
• Supercomputer cluster to core
• Uplink to ISP

10GbE
10GbE
Supercomputer Cluster
10GbE
10GbE
Internet Extranet
10GbE
10GbE
Server Farm
Data Center
28
Outline

• 10 Gigabit Ethernet Standards Update
• 10 Gigabit Ethernet Technology Comparison
• Applications Enterprise/Education
• Applications Service Provider

29
10 GigE Applications Service Provider

• Metropolitan Area Network (MAN) application
• Interconnect Points-of-Presence (PoPs) in a
  single metro area
• Eliminates need for GbE link aggregation
• Helps relieve fiber exhaustion
• Scales network capacity to the next level
• Each link can be up to 40 Km using 10 Gig
  Ethernet standards
• Uplink connection to DWDM systems
• For ultra-high bandwidth needs (e.g. 40 Gbps)
• For ultra-long-distance (e.g. 40 Km) link
  distances
• Leverages the WAN PHY of 10 Gig Ethernet for DWDM
  interfacing
• Adds new product opportunities
• Can offer 1 Gbps links to each customer site
• Increases transmission distance while remaining
  standards-compliant
• Lowers service-provider costs / Improves margins
• 10 Gig Ethernet much less expensive than
  SDH/SONET alternative

30
10GbE MAN/WAN Over DWDM
10GBASE-LR/LW or ER/EW(Metro Link)
Campus X
10GBASE-LR or ER(Inter Campus)
DWDM Optical Network
10GBASE-LR(Inter Building)
10GBASE-LR/ LW or ER/EW(Metro Link)
Campus Y
Enterprise B
10GBASE-SR/SW(Fibre Jumper)
Enterprise A
10GBASE-SR(Fibre Jumper)
Server Farm
Enterprise C
31
10GbE MAN over Dark Fiber
32
For More Info about 10GbE

• 10 Gigabit Ethernet Alliance (10GEA)
• White Paper

www.10gea.org/Tech-whitepapers.htm
33
Thank you !
www.extremenetworks.com