Re: [bmwg] 3rd WGLC for https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

Sudhin Jacob <sjacob@juniper.net> Mon, 16 September 2019 08:37 UTC

Return-Path: <sjacob@juniper.net>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 439F3120033 for <bmwg@ietfa.amsl.com>; Mon, 16 Sep 2019 01:37:21 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.7
X-Spam-Level:
X-Spam-Status: No, score=-2.7 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=juniper.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id MTxjXkDGFSRD for <bmwg@ietfa.amsl.com>; Mon, 16 Sep 2019 01:37:19 -0700 (PDT)
Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 423AF12002E for <bmwg@ietf.org>; Mon, 16 Sep 2019 01:37:19 -0700 (PDT)
Received: from pps.filterd (m0108161.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id x8G8Yrtc029085; Mon, 16 Sep 2019 01:37:09 -0700
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : content-type : mime-version; s=PPS1017; bh=PwxPJ7B/c6RzhpbusHcBX1UHU3ULSGvbqJMOcbAb8Vc=; b=sxxrq/WVdbEZFxfSmbK737/CpeyL8ixACkmutuodHBGdJ6gIFeCrgncV7pQinf9ANk/Y FwqLAlBWtE3CphYiK21WVNPF74QhFbZFr3kRmsr/xFJ3lhF5h281padVnjIjxGeYtAcs qC7TRqwxVmvjJQXfm8um7NBvNpwb1TWHFEgFjiQv+gTov6vDqvOqJBSyxWyO8+XH4N+s 3cbNvzsZ4f1ZZ7ExTqY+VFx28rMC1FjdGbMwmsCe0YD/6DT9UOAFIBlQNuz8pWgsvTaE EbaOh0Bx7s7f3uJKC/l0dxehQD1uZQ27hZDivDvXkVhZBAHeRwm72SFojAnhS+VSM7Ab hg==
Received: from nam04-bn3-obe.outbound.protection.outlook.com (mail-bn3nam04lp2058.outbound.protection.outlook.com [104.47.46.58]) by mx0b-00273201.pphosted.com with ESMTP id 2v1sdkruae-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 16 Sep 2019 01:37:09 -0700
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=ehu4qnMKFeRAWpBn2Udp+Ph+TvnGJmzJK+cPTHB+sJcRCDimRXtK5hYBy6tmmm0ygwFJLqbSwmeiWqW8iqycVefTphQ8hPGAmueIaEN50UynUlAaaMn5v4GqvpQ8PK5tii/9lXAdHY7eRtuhKyS+l5oaPnVBoOztJN0eY5Fq4oCjHpHKMtEuU73Ghww8dLssZlOMdmSUsb6JxCKC92iab9klzkYijonkcVITrKbcRqYG/tKDY7bf3TtC7I9tCe220atY7fYjjiOlF7HpJsjh4xomJWCB273Jd26767dpMXlGTEtOGk6eA35JHkWNrSHHB1+cBufcaGBw1lZcMYzcVQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=PwxPJ7B/c6RzhpbusHcBX1UHU3ULSGvbqJMOcbAb8Vc=; b=EHoV1RckTUtwohFLm0UPntnmbHTnrZPBwSr18DbMEaL3EUpawl6NYw90Fd2oQJND0hvh/gjp41rDSICj2p0a+JctcIW9SZ/5hEIm3UYkH7MXdTTBNckMrCa8D6B1X+x3G2C1HwIr2omKLYmcTx+2vV9+InJMk+y+tJ744cBBWFehjC907KqCNRGJJOevqgBk87UfNkB+4f/sSmV8Ou629Kz0h7RTY1dcJu/4DIzeDpyowOob9J+ruj+6AjYV1EsbtLRUcNc6kRomJo/zeBrIKJzk7DLssyUeCRoeqLmLTxW+B6R9tYeJqgqN+pjX/vJEjosLyw0Pl8jSBSOxm2xEHA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none
Received: from MN2PR05MB6208.namprd05.prod.outlook.com (20.178.241.91) by MN2PR05MB6112.namprd05.prod.outlook.com (20.178.241.155) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2284.14; Mon, 16 Sep 2019 08:37:07 +0000
Received: from MN2PR05MB6208.namprd05.prod.outlook.com ([fe80::65e9:304e:e667:54e9]) by MN2PR05MB6208.namprd05.prod.outlook.com ([fe80::65e9:304e:e667:54e9%5]) with mapi id 15.20.2263.023; Mon, 16 Sep 2019 08:37:07 +0000
From: Sudhin Jacob <sjacob@juniper.net>
To: "bill.wu@huawei.com" <bill.wu@huawei.com>
CC: "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: Re: [bmwg] 3rd WGLC for https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/
Thread-Index: AdVsZ3EcVHo81FyETWuRG7O+A8Y9bA==
Content-Class:
Date: Mon, 16 Sep 2019 08:37:07 +0000
Message-ID: <MN2PR05MB6208F6A6802336288997EF4AC28C0@MN2PR05MB6208.namprd05.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=True; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Owner=sjacob@juniper.net; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2019-09-16T08:37:04.3660524Z; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Name=Juniper Business Use Only; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Application=Microsoft Azure Information Protection; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ActionId=64215ede-0c96-4ffe-b5be-0f5916afb663; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Extended_MSFT_Method=Automatic
dlp-product: dlpe-windows
dlp-version: 11.2.0.14
dlp-reaction: no-action
x-originating-ip: [116.197.184.13]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 5f8cc59e-8a2b-40b2-a9fa-08d73a810f00
x-ms-office365-filtering-ht: Tenant
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(5600167)(711020)(4605104)(1401327)(4618075)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7193020); SRVR:MN2PR05MB6112;
x-ms-traffictypediagnostic: MN2PR05MB6112:
x-ms-exchange-purlcount: 1
x-microsoft-antispam-prvs: <MN2PR05MB61120A7CAEDF028861D10C4BC28C0@MN2PR05MB6112.namprd05.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-forefront-prvs: 0162ACCC24
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(4636009)(376002)(346002)(39860400002)(366004)(396003)(136003)(189003)(199004)(51914003)(478600001)(6506007)(2351001)(8676002)(33656002)(81156014)(66556008)(64756008)(26005)(66446008)(81166006)(8936002)(53936002)(102836004)(186003)(76116006)(6246003)(66476007)(66946007)(86362001)(5660300002)(2501003)(66066001)(99286004)(229853002)(256004)(316002)(6116002)(3846002)(2906002)(6916009)(25786009)(966005)(14454004)(74316002)(14444005)(5640700003)(7736002)(305945005)(71200400001)(71190400001)(55016002)(6306002)(486006)(52536014)(9686003)(30864003)(476003)(4326008)(6436002)(7696005); DIR:OUT; SFP:1102; SCL:1; SRVR:MN2PR05MB6112; H:MN2PR05MB6208.namprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: juniper.net does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: /t+5RVu+Xi4qvE9G0k1GZxOZpDv5C9D1MkTL0LLgLt1n9PeQrPpYcmOLZNUAvE6Z+8b5JhIZHlwEHAPNN04izTghom/Dzq4XHGbjdKocXAUkDyGfbnf/WFVDIG/4eDtxfoYYwKVEH6fu0CMwZJTsx7oT8CL4bH/+TZEevW0mzNUXl0G8MfvwCEZLPfxtbbyo9g7W83vMP5vPm03EZJiPlebHmsI4JGiviPaRQT3gVue0d5Mzb7cLcJWZakqGR8OM0Gc13lPXTDXJjLlycxh0EKKWki8pSHCQ2Mypt2LJd6vL58HpbBcIy/67IJKyBtpp7AphlC1Fren/Bxa8YEWMLFn6ezLAylBbAIevzQoqcjQ65avT9crGuEqBzikVyzmTVAeo9y0ycnJCRKq+9NtQm1CprnIryEHS+43oyefaNW4=
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_MN2PR05MB6208F6A6802336288997EF4AC28C0MN2PR05MB6208namp_"
MIME-Version: 1.0
X-OriginatorOrg: juniper.net
X-MS-Exchange-CrossTenant-Network-Message-Id: 5f8cc59e-8a2b-40b2-a9fa-08d73a810f00
X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Sep 2019 08:37:07.2109 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: rXDP8Y7eiUF3A13DSAHWf0X/O+1347LjbEIuoB9ei3iq4HJcvhNfsfGy87ChhIZz+9x7Ae52Z6qjra0b0viRyg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR05MB6112
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.70,1.0.8 definitions=2019-09-16_04:2019-09-11,2019-09-16 signatures=0
X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 mlxlogscore=830 lowpriorityscore=0 suspectscore=0 priorityscore=1501 mlxscore=0 malwarescore=0 phishscore=0 clxscore=1011 bulkscore=0 impostorscore=0 spamscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-1908290000 definitions=main-1909160094
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/JzRu6nzQsxA_dtV0I3Ogs32UUiQ>
Subject: Re: [bmwg] 3rd WGLC for https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 16 Sep 2019 08:37:21 -0000

Hi Bill,

Kindly find the answers inline. Thanks for the comments.

Regards,
Sudhin

Hi, folks:
I am not sure the scope of this draft is clear enough.
The methodologies defined in this draft is used to benchmark EVPN/PBB-EVPN convergence, data plane
performance, and control plane performance. What a broad scope!

Sudhin>> As mentioned the in scope of the document this is used to benchmark the evpn and pbb evpn services. Currently there is no mechanism to differentiate the above services.
We are defining a set of parameters for the same. The EVPN services consists of 2 components one is a data plane learning and another is control plane learning. Please
Refer the section 9.1 of RFC 7432.

But Basic BGP Convergence Benchmarking Methodology for Data-Plane Convergence has already been specified in RFC7747
Benchmarking Methodology for Basic BGP Device Convergence has already been specified in draft-ietf-bmwg-bgpbas-01
Methodology for Benchmarking Accelerated Stress with Operational EBGP Instabilities has already been specified in draft-ietf-bmwg-acc-bench-meth-ebgp-00
Although the last two drafts have been expired, I think draft-ietf-bmwg-evpntest still need to clarify the relationship with these existing work.

Sudhin>>>>>>>>>> This is different from the drafts and RFC mentioned above. Our draft talks about the control plane learned mac from remote end and then it is programed in forwarding table.That is the crux of the issue. The above drafts and RFC is not covering that, due to this reasons we don't think we need to.

Secondly according to this draft, the methodologies defined in this draft is used to benchmark both RFC 7432 and RFC 7623 solutions, however it is not clear to me
which function of RFC7432 and RFC7623 is covered, which is not. It looks this draft only focuses on single active mode based on Test setup described in section 2, but what about all-active model, how they are different?

Sudhin>>>> We cant do the testing on AA due to the fact of LAG in CE. The has push the mac to different PE due to this reason accurate measurement is not possible.
That is the reason behind using SA.

The last sentence of introduction said:
"
Further, this draft provides methodologies for benchmarking the performance of
EVPN data and control planes, MAC learning, MAC flushing, MAC ageing,
convergence, high availability, and scale.
"
How MAC learning, MAC flushing, MAC aging is related to EVPN data planes?

Sudhin>>>>>> As mentioned above please refer RFC 7432 section 9.1

Would it be great for this draft to clarify the scope and narrow down scope.

Sudhin>>>>>>>>>>>>>> As I mentioned above we have narrowed a list of parameters, which can be tested in lab in order to bench mark various devices which support this services.
-Qin Wu


Juniper Business Use Only