Authors:

1
Terminology for BenchmarkingCore Router
Accelerated Life Testing(draft-ietf-bmwg-acc-benc
h-term-00.txt)

• Authors
• Scott Poretsky, Avici Systems
• Shankar Rao, Qwest Communications
• Ray Piatt, Cable and Wireless

57th IETF Meeting Vienna
2
Status Update

• draft-ietf-bmwg-acc-bench-term-00.txt posted as
  official BMWG work item.
• Only change from previous draft is inclusion of
  appendix to show interesting White Box benchmarks
  
• Minimum Available Memory
• Maximum CPU Utilization
• Now working draft-ietf-bmwg-acc-bench-meth-00.txt
  
• Startup and In-situ methodologies covered
• May drive changes to Terminology draft

3
Test Setup

• Router Configuration
• Data Plane
• Line Cards/Interfaces
• Security Plane
• Traffic Forwarding with and without ACLs
• Control Plane
• Routing
• BGP
• IGP
• MPLS
• TE
• L2/L3 VPNs
• Management Plane
• User Access
• SNMP
• Logging/Debug
• Packet Statistics
• Collection

BGP
Security Plane Module
Management Plane Module
OSPF
ControlPlane Module
Data Plane Module
LDP
PIM-SM

• Instability Conditions
• Interface Shutdown Cycling Rate
• BGP Route Flap Rate
• IGP Route Flap Rate
• Route Convergence Due to Better Next-Hop
• LSP Reroute Rate

. . .
4
General Methodology

• Enable and scale all features simultaneously
• Monitor all Planes
• Accelerate stress on Control Plane via
  Instability Conditions
• all features - including feature monitored
• Failure when
• Control Plane Session Lost
• Data Plane Misrouted, lost, or reordered packet
• Management Plane Denial of Access
• Security Plane Incorrect permitted/denied
  packet
• Pass when Success Threshold reached and no
  failures observed
• Reporting format to be provided
• Features enabled
• Scaling values
• Stress rates

5
Next Steps

• Submit Methodology Draft 00
• Include Reporting Format
• Include Procedures
• Submit Terminology Draft 01
• Add new terms including
• Success Threshold
• Control Plane Failure
• Data Plane Failure
• Management Plan Failure
• Security Plane Failure
• Incorporate comments from mailing list