Re: [bmwg] New Charter Paragraphs

"MORTON, ALFRED C (AL)" <acmorton@att.com> Fri, 18 April 2014 16:39 UTC

Return-Path: <acmorton@att.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 669EB1A03F7 for <bmwg@ietfa.amsl.com>; Fri, 18 Apr 2014 09:39:04 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.173
X-Spam-Level:
X-Spam-Status: No, score=-2.173 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RP_MATCHES_RCVD=-0.272, SPF_HELO_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ko9KETX68gOa for <bmwg@ietfa.amsl.com>; Fri, 18 Apr 2014 09:38:59 -0700 (PDT)
Received: from mail-red.research.att.com (mail-red.research.att.com [204.178.8.23]) by ietfa.amsl.com (Postfix) with ESMTP id B72BE1A01CD for <bmwg@ietf.org>; Fri, 18 Apr 2014 09:38:59 -0700 (PDT)
Received: from mail-blue.research.att.com (unknown [135.207.178.11]) by mail-red.research.att.com (Postfix) with ESMTP id 9E172554B26; Fri, 18 Apr 2014 12:39:06 -0400 (EDT)
Received: from njfpsrvexg8.research.att.com (unknown [135.207.255.242]) by mail-blue.research.att.com (Postfix) with ESMTP id 828ADF0380; Fri, 18 Apr 2014 12:38:55 -0400 (EDT)
Received: from NJFPSRVEXG8.research.att.com ([fe80::cdea:b3f6:3efa:1841]) by njfpsrvexg8.research.att.com ([fe80::cdea:b3f6:3efa:1841%13]) with mapi; Fri, 18 Apr 2014 12:38:55 -0400
From: "MORTON, ALFRED C (AL)" <acmorton@att.com>
To: "Lucien Avramov (lavramov)" <lavramov@cisco.com>, "bmwg@ietf.org" <bmwg@ietf.org>
Date: Fri, 18 Apr 2014 12:36:35 -0400
Thread-Topic: [bmwg] New Charter Paragraphs
Thread-Index: Ac9Xrgl3jjqsziZsSvGGqMspxyCgEgDdlOyO
Message-ID: <2845723087023D4CB5114223779FA9C80178E0CD46@njfpsrvexg8.research.att.com>
References: <2845723087023D4CB5114223779FA9C8017910D8A2@njfpsrvexg8.research.att.com>, <534B85FD.8050102@cisco.com>
In-Reply-To: <534B85FD.8050102@cisco.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Archived-At: http://mailarchive.ietf.org/arch/msg/bmwg/OAG7IN76ql2X4nDDuhHdaQflaZQ
Subject: Re: [bmwg] New Charter Paragraphs
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 18 Apr 2014 16:39:04 -0000

How about this combined version?

Data Center Benchmarking:

This work will define additional terms, benchmarks, and methods 
applicable to data center performance evaluations. This includes data center 
specific congestion scenarios, switch buffer analysis, microburst,
head of line blocking, while also using a wide mix of traffic 
conditions. Some aspects from BMWG's past work are not meaningful when testing
switches that implement new IEEE specifications in the area of data
center bridging. For example, throughput as defined in RFC 1242 
cannot be measured when testing devices that implement three new IEEE
specifications: priority-based flow control (802.1Qbb); priority groups
(802.1Qaz); and congestion notification (802.1Qau).
This work will update RFC 2544 and exchange periodic
Liaisons with relevant SDOs, especially at WG Last Call.


________________________________________
From: Lucien Avramov (lavramov) [lavramov@cisco.com]
Sent: Monday, April 14, 2014 2:53 AM
To: MORTON, ALFRED C (AL); bmwg@ietf.org
Subject: Re: [bmwg] New Charter Paragraphs

Hello BMWG!

Suggesting some edits for the DC portion of the charter to include the
benchmarking we have been talking and presenting at IEFT for the last
year with Jacob Rapp:

Data Center:

-Bridging
Some key concepts from BMWG's past work are not meaningful when testing
     switches that implement new IEEE specifications in the area of data
     center bridging. For example, throughput as defined in RFC 1242
cannot be measured when testing devices that implement three new IEEE
     specifications: priority-based flow control (802.1Qbb); priority groups
     (802.1Qaz); and congestion notification (802.1Qau).
     Since devices that implement these new congestion-management
     specifications should never drop frames, and since the metric of
     throughput distinguishes between non-zero and zero drop rates, no
     throughput measurement is possible using the existing methodology.
     The current emphasis is on the Priority Flow Control aspects of
     Data Center Bridging, and the work will include an investigation
     into whether TRILL RBridges require any specific treatment in the
     methodology. This work will update RFC 2544 and exchange periodic
     Liaisons with IEEE 802.1 DCB Task Group, especially at WG Last Call.

-Benchmarking Data Center DUT:
The purpose of this informational document is to establish definitions,
discussion and measurement techniques specific to data center
environments. It is also to introduce definition terminologies
applicable to data center performance evaluations. With these
established, a methodology and measurement techniques for network
equipement in the data center are covered. This includes data center
specific congestion scenarios, switch buffer analysis, microburst,
head of line blocking, while also using a wide mix of traffic
conditions. This complements the existing benchmarking RFCs by
specifying data center centric benchmarking.

Cheers,
Lucien

On 3/27/14, 12:53 PM, MORTON, ALFRED C (AL) wrote:
> BMWG,
>
> As we close in on the re-charter text, we decided at our IETF-89 session
> to keep Datacenter and VNF paragraphs separate.
>
> To that end, we already have a Datacenter-oriented paragraph in our charter,
> but it needs editing -- please make suggestions!
>
> * Data Center Bridging Devices:
>      Some key concepts from BMWG's past work are not meaningful when testing
>      switches that implement new IEEE specifications in the area of data
>      center bridging. For example, throughput as defined in RFC 1242 cannot
>      be measured when testing devices that implement three new IEEE
>      specifications: priority-based flow control (802.1Qbb); priority groups
>      (802.1Qaz); and congestion notification (802.1Qau).
>      Since devices that implement these new congestion-management
>      specifications should never drop frames, and since the metric of
>      throughput distinguishes between non-zero and zero drop rates, no
>      throughput measurement is possible using the existing methodology.
>      The current emphasis is on the Priority Flow Control aspects of
>      Data Center Bridging, and the work will include an investigation
>      into whether TRILL RBridges require any specific treatment in the
>      methodology. This work will update RFC 2544 and exchange periodic
>      Liaisons with IEEE 802.1 DCB Task Group, especially at WG Last Call.
>
>
> Also, here's the (slightly modified) text for VNF activity:
>
> * VNF and related Infrastructure Benchmarking
>
> Benchmarking Methodologies have reliably characterized many physical devices.
> This work item extends and enhances the methods to virtual network functions (VNF)
> and their unique supporting infrastructure. First, the new task space will be
> considered to ensure that common issues are considered  from the start.
> Virtual routers, switches and platform capacity and performance characteristics
> will follow, including comparisons between physical and virtual functions.
>
> Finally, I'll leave it to the authors to say more, but I noticed a new draft
> on our tools page:
>
> http://tools.ietf.org/html/draft-bhuvan-bmwg-of-controller-benchmarking-00
>
> take a look, is this something we should consider including on our ride?
>
> Comments by April 14th, please.
>
> regards,
> Al/Sarah
> bmwg co-chairs
>
> _______________________________________________
> bmwg mailing list
> bmwg@ietf.org
> https://www.ietf.org/mailman/listinfo/bmwg
>