Re: [bmwg] 3rd WGLC for https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

Qin Wu <bill.wu@huawei.com> Mon, 16 September 2019 03:13 UTC

Return-Path: <bill.wu@huawei.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6FDF81200E9 for <bmwg@ietfa.amsl.com>; Sun, 15 Sep 2019 20:13:43 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.201
X-Spam-Level:
X-Spam-Status: No, score=-4.201 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id WR3QpQi1E8-c for <bmwg@ietfa.amsl.com>; Sun, 15 Sep 2019 20:13:40 -0700 (PDT)
Received: from huawei.com (lhrrgout.huawei.com [185.176.76.210]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C261B12008D for <bmwg@ietf.org>; Sun, 15 Sep 2019 20:13:40 -0700 (PDT)
Received: from lhreml705-cah.china.huawei.com (unknown [172.18.7.108]) by Forcepoint Email with ESMTP id 0BE41BD7CC27E7CFE74B for <bmwg@ietf.org>; Mon, 16 Sep 2019 04:13:39 +0100 (IST)
Received: from lhreml713-chm.china.huawei.com (10.201.108.64) by lhreml705-cah.china.huawei.com (10.201.108.46) with Microsoft SMTP Server (TLS) id 14.3.408.0; Mon, 16 Sep 2019 04:13:38 +0100
Received: from lhreml713-chm.china.huawei.com (10.201.108.64) by lhreml713-chm.china.huawei.com (10.201.108.64) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.1713.5; Mon, 16 Sep 2019 04:13:38 +0100
Received: from DGGEML402-HUB.china.huawei.com (10.3.17.38) by lhreml713-chm.china.huawei.com (10.201.108.64) with Microsoft SMTP Server (version=TLS1_0, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA) id 15.1.1713.5 via Frontend Transport; Mon, 16 Sep 2019 04:13:38 +0100
Received: from DGGEML511-MBX.china.huawei.com ([169.254.1.20]) by DGGEML402-HUB.china.huawei.com ([fe80::fca6:7568:4ee3:c776%31]) with mapi id 14.03.0439.000; Mon, 16 Sep 2019 11:12:52 +0800
From: Qin Wu <bill.wu@huawei.com>
To: Sarah Banks <sbanks@encrypted.net>, "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: [bmwg] 3rd WGLC for https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/
Thread-Index: AdVsOomQxfdtwQELRpOL+AsLb1hVYg==
Date: Mon, 16 Sep 2019 03:12:52 +0000
Message-ID: <B8F9A780D330094D99AF023C5877DABAA92FDE18@dggeml511-mbx.china.huawei.com>
Accept-Language: zh-CN, en-US
Content-Language: zh-CN
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [10.134.31.203]
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-CFilter-Loop: Reflected
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/G0WM4oYaWGXrwIn9aNIgmBvbOmc>
Subject: Re: [bmwg] 3rd WGLC for https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 16 Sep 2019 03:13:44 -0000

Hi, folks:
I am not sure the scope of this draft is clear enough.
The methodologies defined in this draft is used to benchmark EVPN/PBB-EVPN convergence, data plane
performance, and control plane performance. What a broad scope!

But Basic BGP Convergence Benchmarking Methodology for Data-Plane Convergence has already been specified in RFC7747
Benchmarking Methodology for Basic BGP Device Convergence has already been specified in draft-ietf-bmwg-bgpbas-01
Methodology for Benchmarking Accelerated Stress with Operational EBGP Instabilities has already been specified in draft-ietf-bmwg-acc-bench-meth-ebgp-00
Although the last two drafts have been expired, I think draft-ietf-bmwg-evpntest still need to clarify the relationship with these existing work.

Secondly according to this draft, the methodologies defined in this draft is used to benchmark both RFC 7432 and RFC 7623 solutions, however it is not clear to me
which function of RFC7432 and RFC7623 is covered, which is not. It looks this draft only focuses on single active mode based on Test setup described in section 2, but what about all-active model, how they are different?

The last sentence of introduction said:
"
Further, this draft provides methodologies for benchmarking the performance of
EVPN data and control planes, MAC learning, MAC flushing, MAC ageing,
convergence, high availability, and scale.
"
How MAC learning, MAC flushing, MAC aging is related to EVPN data planes?

Would it be great for this draft to clarify the scope and narrow down scope.

-Qin Wu
-----Original Message-----
From: bmwg [mailto:bmwg-bounces@ietf.org] On Behalf Of Sarah Banks
Sent: Thursday, September 5, 2019 8:20 PM
To: bmwg@ietf.org
Subject: [bmwg] 3rd WGLC for https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

Hello BMWG,
	The authors of the evpntest drafts have been hard at work since our last (second) WGLC on this draft, consolidating feedback, working with other authors on related topics, and at IETF105 in Montreal, I took an action to kick off the WGLC for this draft. Here it is. 

	A Working Group Last Call (WGLC) period for the Internet-Draft describing benchmarking of EVPN and PBB-EVPN:
	https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

	will be open for 6 weeks from today, closing on October 17, 2019. Please weigh in on whether or not you feel this Internet-Draft should be given to the Area Directors for consideration to progressing as an Informational RFC. Send your comments to this list, bmwg@ietf.org. Your prompt and timely feedback is greatly appreciated.

Kind regards,
Sarah Banks
BMWG Co-Chair
_______________________________________________
bmwg mailing list
bmwg@ietf.org
https://www.ietf.org/mailman/listinfo/bmwg

_______________________________________________
bmwg mailing list
bmwg@ietf.org
https://www.ietf.org/mailman/listinfo/bmwg