Re: [bmwg] FW: WGLC: draft-ietf-bmwg-reset-00

"Rajiv Asati (rajiva)" <rajiva@cisco.com> Tue, 20 July 2010 21:17 UTC

Return-Path: <rajiva@cisco.com>
X-Original-To: bmwg@core3.amsl.com
Delivered-To: bmwg@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 9F30E3A6B6C for <bmwg@core3.amsl.com>; Tue, 20 Jul 2010 14:17:28 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -10.599
X-Spam-Level:
X-Spam-Status: No, score=-10.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id eYlMGCj5RGtY for <bmwg@core3.amsl.com>; Tue, 20 Jul 2010 14:17:27 -0700 (PDT)
Received: from rtp-iport-2.cisco.com (rtp-iport-2.cisco.com [64.102.122.149]) by core3.amsl.com (Postfix) with ESMTP id 4F43E3A6809 for <bmwg@ietf.org>; Tue, 20 Jul 2010 14:17:27 -0700 (PDT)
Authentication-Results: rtp-iport-2.cisco.com; dkim=neutral (message not signed) header.i=none
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: AvsEACqvRUytJV2a/2dsb2JhbACfc3GmSpsRhTIEhACHDg
Received: from rcdn-core-3.cisco.com ([173.37.93.154]) by rtp-iport-2.cisco.com with ESMTP; 20 Jul 2010 21:17:42 +0000
Received: from xbh-rcd-101.cisco.com (xbh-rcd-101.cisco.com [72.163.62.138]) by rcdn-core-3.cisco.com (8.14.3/8.14.3) with ESMTP id o6KLHgNu014215; Tue, 20 Jul 2010 21:17:42 GMT
Received: from xmb-rcd-111.cisco.com ([72.163.62.153]) by xbh-rcd-101.cisco.com with Microsoft SMTPSVC(6.0.3790.4675); Tue, 20 Jul 2010 16:17:42 -0500
X-MimeOLE: Produced By Microsoft Exchange V6.5
Content-class: urn:content-classes:message
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Date: Tue, 20 Jul 2010 16:17:40 -0500
Message-ID: <067E6CE33034954AAC05C9EC85E2577C0254E426@XMB-RCD-111.cisco.com>
In-Reply-To: <4C45AFE6.9020502@monkeyplayground.net>
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
Thread-Topic: [bmwg] FW: WGLC: draft-ietf-bmwg-reset-00
Thread-Index: AcsoFkyEduMmQPzqQcKpfgSme/Z+LAAJRIrA
References: <7F298ACC76CC154F832B6D02852D169F02262C93@XMB-RCD-101.cisco.com> <4C445B56.7040704@monkeyplayground.net> <7F298ACC76CC154F832B6D02852D169F02262D57@XMB-RCD-101.cisco.com> <4C4474FF.5060001@monkeyplayground.net> <7F298ACC76CC154F832B6D02852D169F02262FF7@XMB-RCD-101.cisco.com> <4C45A835.3060103@monkeyplayground.net><7F298ACC76CC154F832B6D02852D169F022631F2@XMB-RCD-101.cisco.com> <4C45AFE6.9020502@monkeyplayground.net>
From: "Rajiv Asati (rajiva)" <rajiva@cisco.com>
To: "Timmons C. Player" <timmons@monkeyplayground.net>, "Fernando Calabria (fcalabri)" <fcalabri@cisco.com>
X-OriginalArrivalTime: 20 Jul 2010 21:17:42.0400 (UTC) FILETIME=[FD65E800:01CB2850]
Cc: bmwg@ietf.org
Subject: Re: [bmwg] FW: WGLC: draft-ietf-bmwg-reset-00
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/bmwg>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 20 Jul 2010 21:17:28 -0000

Timmons,

Thanks for the feedback, please see inline,

> This states I need to provide the frame loss counters, which is fine,
> But if my test tool
> 	
> a) only counts transmitted test frames as trasmitted
> -and-
> b) uses a non-frame loss based method to measure the recovery time
> 
> then providing the frame loss counters seems not entirely useful.


Then, such a test tool is not compliant with RFC2544 (please see section
26.3 for frame loss rate calculation).

Also, the test tool will be out of sync with other upcoming BMWG
specifications such as IGP convergence benchmarking. Please see 2nd para
of section 1.
http://datatracker.ietf.org/doc/draft-ietf-bmwg-igp-dataplane-conv-meth/

<...
   IGP convergence time is measured on the data plane at the Tester by
   observing packet loss through the DUT.  All factors contributing to
   convergence time are accounted for by measuring on the data plane, as
...>



Please note that draft-ietf-bmwg-reset document does recommend the test
tool to report the frame-loss for each testcase.


Cheers,
Rajiv


> -----Original Message-----
> From: bmwg-bounces@ietf.org [mailto:bmwg-bounces@ietf.org] On Behalf
Of
> Timmons C. Player
> Sent: Tuesday, July 20, 2010 10:17 AM
> To: Fernando Calabria (fcalabri)
> Cc: bmwg@ietf.org
> Subject: Re: [bmwg] FW: WGLC: draft-ietf-bmwg-reset-00
> 
> On 7/20/2010 10:01 AM, Fernando Calabria (fcalabri) wrote:
> > Timmons,
> >
> > It's a MAY, not a MUST anymore so we are not saying that this is the
> > only available one ,..
> >
> > Fer,
> >
> 
> I was referring to this particular part of the text:
> ---
> Finally, the characterization is completed by providing  the  frame
> loss
> counters (reported by the Test Apparatus)  and recovery time from the
> moment the RP is re-initialized or reinserted and all traffic
recovered
> (stop time).
> ---
> 
> This states I need to provide the frame loss counters, which is fine,
> But if my test tool
> 	
> a) only counts transmitted test frames as trasmitted
> -and-
> b) uses a non-frame loss based method to measure the recovery time
> 
> then providing the frame loss counters seems not entirely useful.
> 
> Additionally, in this case I MAY NOT use the formula to approximate
> recovery time.
> 
> So, it seems we're back to having the test tool behave a certain way
> instead of measuring a specific event.
> 
> Timmons
> 
> > -----Original Message-----
> > From: Timmons C. Player [mailto:timmons@monkeyplayground.net]
> > Sent: Tuesday, July 20, 2010 9:44 AM
> > To: Fernando Calabria (fcalabri)
> > Cc: bmwg@ietf.org
> > Subject: Re: [bmwg] FW: WGLC: draft-ietf-bmwg-reset-00
> >
> 
> >>
> >>
> >> Third, perform the Route Processor (RP) hardware reset at this
point
> >> (start time) . This entails for example physically removing the RP
> to
> >> later re-insert it, or triggering a hardware reset by other means
> > (e.g.,
> >> command line interface, physical switch, etc.)....
> >>
> >>
> >> Finally, the characterization is completed by providing  the  frame
> > loss
> >> counters (reported by the Test Apparatus)  and recovery time from
> the
> >> moment the RP is re-initialized or reinserted and all traffic
> > recovered
> >> (stop time) . The tester / operator MAY use the following formula
> for
> >> reporting and characterization proposes:
> >>
> >> Recovery_time = Packet_loss (packets)/Offered_rate (packets per
> > second).
> >>
> >> ...........
> >>
> >
> _______________________________________________
> bmwg mailing list
> bmwg@ietf.org
> https://www.ietf.org/mailman/listinfo/bmwg