Re: [bmwg] Comments on draft-ietf-bmwg-mcastm-12.txt

Scott Poretsky <sporetsky@avici.com> Sat, 17 May 2003 13:44 UTC

Received: from www1.ietf.org (ietf.org [132.151.1.19] (may be forged)) by ietf.org (8.9.1a/8.9.1a) with ESMTP id JAA07445 for <bmwg-archive@odin.ietf.org>; Sat, 17 May 2003 09:44:28 -0400 (EDT)
Received: (from mailnull@localhost) by www1.ietf.org (8.11.6/8.11.6) id h4HDCQO14899 for bmwg-archive@odin.ietf.org; Sat, 17 May 2003 09:12:26 -0400
Received: from www1.ietf.org (localhost.localdomain [127.0.0.1]) by www1.ietf.org (8.11.6/8.11.6) with ESMTP id h4HDC2B14892; Sat, 17 May 2003 09:12:02 -0400
Received: from ietf.org (odin.ietf.org [132.151.1.176]) by www1.ietf.org (8.11.6/8.11.6) with ESMTP id h4HDBlB14862 for <bmwg@optimus.ietf.org>; Sat, 17 May 2003 09:11:47 -0400
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id JAA07308 for <bmwg@ietf.org>; Sat, 17 May 2003 09:43:18 -0400 (EDT)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 19H1zp-0006pu-00 for bmwg@ietf.org; Sat, 17 May 2003 09:45:09 -0400
Received: from [12.38.212.174] (helo=mailhost.avici.com) by ietf-mx with esmtp (Exim 4.12) id 19H1zo-0006pW-00 for bmwg@ietf.org; Sat, 17 May 2003 09:45:08 -0400
Received: from sporetsky-lt.avici.com ([10.2.103.155]) by mailhost.avici.com (8.11.0/8.11.0) with ESMTP id h4HDjDD20629; Sat, 17 May 2003 09:45:13 -0400 (EDT)
Message-Id: <5.0.2.1.2.20030517090228.027fbdb8@pop.avici.com>
X-Sender: sporetsky@pop.avici.com (Unverified)
X-Mailer: QUALCOMM Windows Eudora Version 5.0.2
Date: Sat, 17 May 2003 09:31:41 -0400
To: "Perser, Jerry" <jerry.perser@spirentcom.com>, "BMWG (E-mail)" <bmwg@ietf.org>
From: Scott Poretsky <sporetsky@avici.com>
Subject: Re: [bmwg] Comments on draft-ietf-bmwg-mcastm-12.txt
In-Reply-To: <629E717C12A8694A88FAA6BEF9FFCD441E54DC@brigadoon.spirentco m.com>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"; format="flowed"
Sender: bmwg-admin@ietf.org
Errors-To: bmwg-admin@ietf.org
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.0.12
Precedence: bulk
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>

BMWG-ers,

A lot of people have worked hard on this for a long time, including a 
recent team that was assembled to address the final issues to complete the 
draft.   (I have to confess that I was not one of them).  This team and the 
authors have addressed most of the significant technical and documentation 
issues.  My recommendations to progress this draft are as follow:

In 4.1,  change 'The DUT/SUT MUST learn the appropriate unicast
addresses' to 'The DUT/SUT MUST learn the appropriate unicast and multicast
addresses' as Jerry recommended.

In 4.1, state it is "unweighted" round-robin.

In 5.2, report min, max, and average latency for each multicast 
group.  Eliminate "set of all latencies".

In 6.1, create two separate tests as Jerry recommended:  6.1.1 'Initial 
Group Join Delay' and '6.1.2 Primed Group Join Delay'.

I recommend that upon incorporating these changes that this draft be 
forwarded to the Area Directors for consideration in progressing the draft 
to an Informational RFC.

Scott

At 10:09 AM 5/14/2003 -0700, Perser, Jerry wrote:
>Here are a few comments:
>
>4.1. Mixed Class Throughput
>
>- Suggest changing 'multicast class frames' to either 'multicast class' or
>'multicast frames'.  I could not find in RFC2432 (or elsewhere) the use of
>'multicast class frames'.  What is the difference between 'multicast class
>frames' and 'multicast frames' ?  Same applies to 'unicast class frames'.
>
>- Suggest changing 'The DUT/SUT MUST learn the appropriate unicast
>addresses' to 'The DUT/SUT MUST learn the appropriate unicast and multicast
>addresses'.  My experience with DUT is that they DO NOT populate the
>forwarding table based on IGMP or ARP messages.  They go from slow path to
>fast past after reception of a frame that requires forwarding.
>
>- The search algorithm use to determine the Mixed Class Throughput.  Does it
>maintain the multicast to unicast ratio, or can you change the load on one
>class only?  My opinion is that you MUST change both classes.  Please
>clarity in the I-D.
>
>- When the unicast frames 'transmit in a round-robin fashion', are they to
>be in the pattern specified in RFC2889, or ANY round-robin fashion?  There
>are several different patterns that fall under 'round-robin'.  Mr.
>Mandeville used the one in RFC2889.
>
>- Consider changing 'Total number of multicast groups' to 'Total number of
>ingress multicast groups'.  In reporting the 'Total number of multicast
>groups', do you sum up the ingress address, or the egress address?  I am
>concerned that someone may multiple the groups by the number of egress ports
>to get a bigger number.  Other test has this same issues.
>
>4.2. Scaled Group Forwarding Matrix
>
>- Suggest changing 'The recommended granularity of additional groups to join
>per iteration is 10, although the tester MAY choose a finer granularity.' to
>'The recommended granularity of additional groups to join per iteration is
>10, although the tester MAY choose a different granularity.'  If my DUT has
>a capacity of 65K to 512K, I do not want to step by 10 or smaller.  I may
>want to step by a 'different' amount.
>
>4.4. Encapsulation/Decapsulation (Tunneling) Throughput
>
>- Suggest changing 'DUT/SUT or a set of DUTs' to 'DUT/SUT'.  A SUT is a set
>of DUTs.
>
>5.1. Multicast Latency
>
>- The paragraph starting with 'End-to-end reachability' is missing.  The
>paragraph offered some insight on determining the intent of the
>characterization.  Instead of deleting this information, can you change the
>first sentence to 'The test monitor MUST verify the correct forwarding of
>test traffic by the DUT/SUT prior to the engagement of a test trial.'
>End-to-end wording sounded like a network test, not a DUT/SUT test.
>
>5.2. Min/Max Multicast Latency
>
>- In the reporting format, why MUST the 'set of all latencies' be reflected
>in the test report?  I can build hardware to determine this number.  There
>may not be an actual 'set of all latencies' stored in the FPGA.  The
>hardware will discard the latency values as quickly as it does that actual
>frames.  The min/max will be to the procedure, but there will be no 'set of
>all latencies'.
>
>6.1 Group Join Delay
>
>- Please put the objective in chronological order.  Consider changing to 'To
>determine the time duration it takes from when the DUT/SUT receives an IGMP
>group membership report on an interface, to when the DUT/SUT starts
>forwarding multicast frames out the same interface.'
>
>- The relationship between state and method is not clear.  I am guessing
>that state 0 maps to ONLY method A and state 1 maps to ONLY method B.  This
>section looks like two tests jammed under one heading.
>
>One suggestion would be to divide this into two different tests.  Put state
>0 and method A under '6.1.1 Initial Group Join Delay'.  Then put state 1 and
>method B under '6.1.2 Primed Group Join Delay'.  If there are better
>prefixes than 'initial' and 'primed', use them.  This is the best I could
>come up with in this short amount of time.
>
>6.2. Group Leave Delay
>
>- Please put the objective in chronological order.  Consider changing to 'To
>determine the time duration it takes from when the DUT/SUT receives an IGMP
>Leave Group message on an interface, to when the DUT/SUT stops forwarding
>multicast frames on the same interface.
>
>8.1. Forwarding Burdened Multicast Latency
>
>- Why 'Perform a baseline measurement of Multicast Latency'?  It is not used
>in determining the Forwarding Burdened Multicast Latency.  You can run both
>tests for comparison.  The burdened test is a separate test.  Suggest to
>remove this.
>
>- Suggest removing 'Similar to Section 5.1, ' in the reporting format.  You
>do not need to read Section 5.1 to implement this test.  Everything needed
>is already documented here.
>
>8.2. Forwarding Burdened Group Join Delay
>
>- Why 'Perform a baseline measurement of Group Join Delay'?  It is not used
>in determining the Forwarding Burdened Group Join Delay.  You can run both
>tests for comparison.  The burdened test is a separate test.  Suggest to
>remove this.
>
>- Suggest removing 'Similar to Section 6.1, ' in the reporting format.  You
>do not need to read Section 5.1 to implement this test.  Everything needed
>is already documented here.
>
>
>Jerry.
>_______________________________________________________
>Jerry Perser                         Spirent Communications
>Director of Test Methodology         SmartBits Division
>Phone: 818.676.2320                  26750 Agoura Road
>Lab:   818.676.2337                  Calabasas, CA, 91302
>Cell:  818.292.6457                  Corp:  818.676.2300
>
>
>_______________________________________________
>bmwg mailing list
>bmwg@ietf.org
>https://www1.ietf.org/mailman/listinfo/bmwg


_______________________________________________
bmwg mailing list
bmwg@ietf.org
https://www1.ietf.org/mailman/listinfo/bmwg