Benchmarking Methodology WG bmwg 60th IETF San Diego, CA

1
Benchmarking Methodology WG (bmwg)60th IETF
San Diego, CA

• Thursday, August 5, 2004, 1300-1500
• Chairs
• Kevin Dubray (kdubray_at_juniper.net)
• Al Morton (acmorton_at_att.com)
• If you are not subscribed to the BMWG mailing
  list and would like to be, put an asterisk () by
  your name when you sign the blue attendance
  sheet.  

2
BMWG Agenda

• Note-Taker(s) and Blue Sheets
• WG Status (Chairs, 10 min)
• Milestones (Chairs, 5 min)
• Comments on the Active Review Template Experiment
  (Chairs, 10 min)
• IGP Dataplane Convergence I-Ds. (Poretsky, 15
  min)
• Core Router Accelerated Life Testing (Poretsky,
  10 min)

3
BMWG Agenda (New Work)

• Hash and Stuffing (Newman, 15 min)
• Short discussion on plug-in Drafts (Chairs, 5
  min)
• LDP Convergence (Poretsky, 10 min)
• Automatic Protection Switching (Poretsky, 15
  min)
• Terminology (comments, 5 min)
• MPLS Protection Methodology (Poretsky, 5 min)
• Discussion
• Wrap-up/Conclusion (Chairs, 10 min)

4
BMWG Activity

• AD/IESG Review
• ltdraft-ietf-bmwg-conterm-06.txtgt, revised, IESG
  done?
• ltdraft-ietf-bmwg-ospfconv-term-10.txtgt, Revised
  on IESG comments
• ltdraft-ietf-bmwg-ospfconv-intraarea-10.txtgt, same
• ltdraft-ietf-bmwg-ospfconv-applicability-07.txtgt,
  same
• WG Last Call
• ltdraft-ietf-bmwg-fib-meth-01.txtgt, Draft
  expired. New Editors, but...
• ltdraft-ietf-bmwg-dsmterm-09.txtgt, Call ended
  w/editorials, new editor?
• I-Ds
• ltdraft-ietf-bmwg-ipsec-term-03.txtgt, draft 7/04,
  some list comments
• ltdraft-ietf-bmwg-benchres-term-04.txtgt, back in
  WG, LC soon, READ
• ltdraft-ietf-bmwg-acc-bench-term-03.txtgt Revised
• ltdraft-ietf-bmwg-acc-bench-meth-00.txtgt New _at_
  IETF 60
• ltdraft-ietf-bmwg-igp-dataplane-conv-term-03.txtgt
  Revised on WGLC
• ltdraft-ietf-bmwg-igp-dataplane-conv-meth-03.txtgt
  Revised
• ltdraft-ietf-bmwg-igp-dataplane-conv-app-03.txtgt
  Revised

5
BMWG Activity

• Expired BMWG I-Ds
• ltdraft-ietf-bmwg-bgpbas-01.txtgt, Pending term.
  progress
• ltdraft-ietf-bmwg-benchres-method-00.txtgt Pending
  term progress
• New Work proposals.
• Protection benchmarking - need to clarify ...
  See meeting notes from IETF-58, IETF-57 and
  earlier...
• Considerations for Measuring Network Convergence,
  is BMWG the home for this?
• Suggestion for MPLS-LDP convergence benchmarking
• RFC Editor
• ltdraft-ietf-bmwg-mcastm-14.txtgt
• Charter Update
• Revising Milestones.
• New RFC

6
(Actual 8/3/04) BMWG Charter Milestones

• Done Resource Reservation Benchmarking
  Terminology to AD Review
• Apr 03 Net Traffic Control Benchmarking
  Terminology to AD Review
• Apr 03 Methodology for FIB related Router
  Performance Benchmarking to AD review.
• Done EGP Convergence Benchmarking Terminology to
  AD Review
• NOT Done Resource Reservation Benchmarking
  Methodology to AD Review
• Jul 03 Basic BGP Convergence Benchmarking
  Methodology to AD Review.
• Dec 03 Net Traffic Control Benchmarking
  Methodology to AD Review.
• Dec 03 IPsec Device Benchmarking Terminology to
  AD Review

7
Reviewers in BMWG Last Call

• Situation Visible, initial WG interest on a
  topic invisible, non-editor support thereafter.
• Motivation
• Provide deterministic, directed, and visible
  input to review of BMWG I-Ds.
• Provide BMWG guidelines to help assure quality of
  output.
• Meant to complement, not replace, feedback from
  the general BMWG community.

8
Proposed Milestones

• Revise/Add
• Aug 04 Resource Reservation Benchmarking
  Terminology to AD Review
• Aug 04 Net Traffic Control Benchmarking
  Terminology to AD Review
• Aug 04 Support EGP Convergence Benchmarking
  Terminology through AD Review
• Nov 04 Support OSPF Convergence Benchmarking
  Drafts through AD Review
• Dec 04 Methodology for FIB related Router
  Performance Benchmarking to AD review.
• Aug 04 IPsec Device Benchmarking Terminology to
  AD Review
• New
• Jul 05 Net Traffic Control Benchmarking
  Methodology to AD Review.
• Jul 05 IPsec Device Benchmarking Methodology to
  AD Review
• Aug 04 IGP/Data-Plane Terminology I-D to AD
  Review
• Dec 04 IGP/Data-Plane Methodology and
  Considerations I-Ds to AD Review
• Dec 04 Router Accelerated Test Terminology I-D
  to AD Review
• Aug 05 Router Accelerated Test Method. and
  Considerations I-Ds to AD Review

9
Reviewer Guidelines Areas

• Technical Content
• Soundness, accuracy, completeness.
• Utility Clarity
• Would you use?
• Able to use in current form?
• Caveats?

• General
• Conformance to BMWG charter.
• Regard for general BMWG tenets.
• Consistency to other BMWG other WGs RFCs.
• Nits
• Readability, conformance to I-D guidelines