Re: [bmwg] [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

Sudhin Jacob <sjacob@juniper.net> Wed, 21 August 2019 14:29 UTC

Return-Path: <sjacob@juniper.net>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8AA9D12025D; Wed, 21 Aug 2019 07:29:58 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.699
X-Spam-Level:
X-Spam-Status: No, score=-2.699 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=juniper.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 56dz88giCIsY; Wed, 21 Aug 2019 07:29:56 -0700 (PDT)
Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 10950120058; Wed, 21 Aug 2019 07:29:55 -0700 (PDT)
Received: from pps.filterd (m0108160.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.16.0.27/8.16.0.27) with SMTP id x7LEOL85021735; Wed, 21 Aug 2019 07:29:54 -0700
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=wNxiyAeME6NHs7w7n/IHnWKyVCfCN1SW7UgPYWiHm10=; b=oqLtmngVPpp3TkkXPtPXpvmXAKbMQ6ffcQIrVDRtoAd89dEd8a2WlaqY//w1666FWdsb ET0Bq4UOOg5DQ9cihlXjO6Aj+h3KBQfEyrvmAonHfT7LU9+qRWLxMRL2HqoatNJC6LiQ OkQkXIAch9HHEk5EIpZ43rtL4fDfrXSCjjF43YykzB9ujpGhbm75NyzKBN2EqUs17xe0 EcV8cKbBlvE0Z/mIbZEkB98+iO5CZ8bk/lR9s4pb+4BYiDb+XtErHhSzIH2cguouQ1qa KVghx9Ul3x1iJomaWAx3BY6OamuCJJJgaGW1u8DEuN2kae0+U6lQVd7bQC4hMr4BTWFr fg==
Received: from nam04-sn1-obe.outbound.protection.outlook.com (mail-sn1nam04lp2050.outbound.protection.outlook.com [104.47.44.50]) by mx0b-00273201.pphosted.com with ESMTP id 2uh4gd0bp7-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Wed, 21 Aug 2019 07:29:54 -0700
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=mr960/PrxSE9Afulwo+HJtlFyFs85QpO2kmt4/6y+PnQHTDGB/n/v1O9uqe8XV5sGLHL/Rg2Cm7h5fGuetVUIfwQI5mptKpP3gv2hDiF8yzwoulmO+nwbNsYfwoFSGnOrQb67m6zfujQK13WYX9CKgFA/U5Xg8EUcs8kXue4iqFESW7KLvWNAWE3binAENDrE1f6KjtxKaXEJU45FJ56QNFSHLRs7ysSfNLN+u5Rana5xxLetQmFqMxq3M7/URTyLG7yHjPCWfCeYQ7Hxx3XbT7X+jCYLhe7UH2YxPSX/g9fyfp0c0MZwNWhOfQtN1xtG/nn50oDmhgIwLH4AngeRg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=wNxiyAeME6NHs7w7n/IHnWKyVCfCN1SW7UgPYWiHm10=; b=OHJmnmvlQl/M02agdv0pd+OnRFKaB8Uii4z6yB3lKh6lmXiWj9q1l7bEHfW9SklxymrJ3KP1nnXhspgdo+iBuN82jvBeMIPXY9uvSGtFKd5S2P9dErodlJOHBcKbVrdJsyMu7cQw2ryLDv3fkJWNuWiif3tf/m/+w9Hws3H41K3OvGQtuGKtDVVDaJZr6m1oHpCby1PXdPHPYuZ/Rd29YAYk2piCXlvrSOrY2iD7vgixPTHVZsX4CEC0J+OiKzyDkKromlSglgDAeqHuijzY8z+2i3QSxITcTcjVlW6J26KqH81WYQwm77qwSk9FwSyGWO7P5hh3mANh9jA6JzJLBQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none
Received: from MN2PR05MB6208.namprd05.prod.outlook.com (20.178.241.91) by MN2PR05MB7005.namprd05.prod.outlook.com (52.135.38.147) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2199.11; Wed, 21 Aug 2019 14:29:52 +0000
Received: from MN2PR05MB6208.namprd05.prod.outlook.com ([fe80::8cef:cdcf:dcf8:9f1a]) by MN2PR05MB6208.namprd05.prod.outlook.com ([fe80::8cef:cdcf:dcf8:9f1a%6]) with mapi id 15.20.2199.011; Wed, 21 Aug 2019 14:29:52 +0000
From: Sudhin Jacob <sjacob@juniper.net>
To: =?iso-8859-1?Q?Luc_Andr=E9_Burdet?= <laburdet.ietf@gmail.com>
CC: "bess@ietf.org" <bess@ietf.org>, "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/
Thread-Index: AQHVTTL9H6lTfy2Jz0mXIuR1lZ0ERKbyLooAgBOQsAA=
Date: Wed, 21 Aug 2019 14:29:51 +0000
Message-ID: <MN2PR05MB6208156B84D20885F1E12957C2AA0@MN2PR05MB6208.namprd05.prod.outlook.com>
References: <MN2PR12MB32298891F426865769D8496EAFD40@MN2PR12MB3229.namprd12.prod.outlook.com> <MN2PR05MB6208CC260D6CE28C1F485AA9C2D60@MN2PR05MB6208.namprd05.prod.outlook.com>
In-Reply-To: <MN2PR05MB6208CC260D6CE28C1F485AA9C2D60@MN2PR05MB6208.namprd05.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
dlp-product: dlpe-windows
dlp-version: 11.2.0.14
dlp-reaction: no-action
msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=True; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Owner=sjacob@juniper.net; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2019-08-09T03:53:13.8844441Z; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Name=Juniper Business Use Only; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Application=Microsoft Azure Information Protection; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ActionId=1125efc9-c79e-4a48-9c48-30fe688de287; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Extended_MSFT_Method=Automatic
x-originating-ip: [45.127.46.75]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 4369f42d-9ed8-482c-e6b0-08d726440768
x-ms-office365-filtering-ht: Tenant
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(5600148)(711020)(4605104)(1401327)(4618075)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7193020); SRVR:MN2PR05MB7005;
x-ms-traffictypediagnostic: MN2PR05MB7005:
x-ms-exchange-purlcount: 7
x-microsoft-antispam-prvs: <MN2PR05MB70053FDF799205576FFE4D43C2AA0@MN2PR05MB7005.namprd05.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:8882;
x-forefront-prvs: 0136C1DDA4
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(4636009)(376002)(39860400002)(346002)(366004)(396003)(136003)(51914003)(189003)(199004)(53754006)(4326008)(6916009)(11346002)(6436002)(71190400001)(71200400001)(55016002)(53936002)(6306002)(9686003)(236005)(54896002)(186003)(66066001)(102836004)(76176011)(446003)(316002)(25786009)(53546011)(6506007)(26005)(7696005)(229853002)(8676002)(81156014)(81166006)(52536014)(8936002)(99286004)(3846002)(606006)(14454004)(966005)(33656002)(9326002)(478600001)(5660300002)(76116006)(54906003)(6246003)(86362001)(486006)(476003)(14444005)(256004)(7736002)(66446008)(66946007)(790700001)(6116002)(66556008)(2906002)(66476007)(64756008)(74316002); DIR:OUT; SFP:1102; SCL:1; SRVR:MN2PR05MB7005; H:MN2PR05MB6208.namprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: juniper.net does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: 5NqWG0HBKQbHg0TPn0asnPZXa8OPLsQW0VkAARVhNIJMRpN4lMN8Nl6MddF43qKZohrWn4Sv1z5aDjqz6ZpQ5/0aK8Im49RLnH8FPot7JXRQaix9JuvWjxiqu9BSuCK0g9/CZCyKt+SPcqI66IQxgt+391lEv2z4+OwYSJi6fG/ZCcWvT1FKx6jthhd1CMBf2THZbCUpIYbSkWlstkBJwal3mTZtxHk7/ladQIiuJuiuV3cADarVJ8IGuUpLgkjOpui6cyPbBlyuo2kQAY0QukOrldQ6H7zqi9NgauFN3nnJbgqAR7KBIP2nZk1sAouS9QwodXAO7STpIIBBGHEoD1Kr3a/UYVUiyKEU0W7AIDpkweTZWaKoCgs1Q9n5f3tMXfomJ9rrCJkiOaM2ws4HXIinjYSNGM4NVYEqj9URDsc=
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_MN2PR05MB6208156B84D20885F1E12957C2AA0MN2PR05MB6208namp_"
MIME-Version: 1.0
X-OriginatorOrg: juniper.net
X-MS-Exchange-CrossTenant-Network-Message-Id: 4369f42d-9ed8-482c-e6b0-08d726440768
X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Aug 2019 14:29:51.4084 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: GkfWMpV+ROYwhFAapRWS4Kb/cHpOAkykq/iwIkHlKBBPVZ7+ZGA9VlCxQQ6gldGPHjE/FBQS8QxAmS4Zxm54bg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR05MB7005
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2019-08-21_05:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1906280000 definitions=main-1908210158
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/ImzZP3inAGTTWP7WQJ5UZrM2SeU>
Subject: Re: [bmwg] [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 21 Aug 2019 14:29:59 -0000

Hi Luc,

I addressed your comments. Kindly find the latest draft.

https://www.ietf.org/id/draft-ietf-bmwg-evpntest-03.txt

Regards,
Sudhin



Juniper Business Use Only
From: Sudhin Jacob
Sent: Friday, August 9, 2019 9:23 AM
To: Luc André Burdet <laburdet.ietf@gmail.com>;
Cc: bess@ietf.org; bmwg@ietf.org
Subject: RE: [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

Hi Luc,

Kindly find the answers inline. Appreciate your comments.

Regards,
Sudhin



Juniper Business Use Only
From: Luc André Burdet <laburdet.ietf@gmail.com<mailto:laburdet.ietf@gmail.com>>
Sent: Wednesday, August 7, 2019 8:46 PM
To: Sudhin Jacob <sjacob@juniper.net<mailto:sjacob@juniper.net>>; bess@ietf.org<mailto:bess@ietf.org>; bmwg@ietf.org<mailto:bmwg@ietf.org>
Subject: Re: [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

Thanks for the head's up Sudhin.

I got as far as the TOC and associated document flow. I would suggest this needs work before WGLC.
A few suggestions based on cursory reading.



  1.  Section 2, Test topologies   (Nit: plural since you define 3...)

Sudhin>>>>>>>>>  We will change it.

  *   Looks like you are defining only Single-Active?    (Nit:SHPE3 appears twice in its/box)

Sudhin>>>>>>>>>>> we will remove it.

  *   You have only Figure1 and there are 3 topologies in there. Why not define 3 figures, one per topology ?

Sudhin>>>>>>>>> Sure will make it 3 figures and 3 topologies.

  *   The paging makes this section hard to read. Consider shrinking your diagrams.

Sudhin>>>>>>>>  Sure

  *   In fact, these are all the SAME Topology. All you are changing is the traffic pattern. Putting the details of traffic flow "per topology" and especially hiding those details in a one-liner behind "Traffic Generator" is not clear & concise.

Sudhin>>> Traffic generator in the context means either IXIA or Spirent, we cant name one. We have to follow a generic naming pattern.

  *   I would suggest:
     *   1 Figure detailing the physical network diagram defining node names, DUT, etc. ;
     *   A section defining "Test Topologies" overlayed onto that shared network diagram:

Sudhin>>>> Sure we noted this point.


        *   Nit: by "different VLANs" do you mean "Multiple" here or that CE and SHPE3 have different VLANS from one another?)

Sudhin>>>>>> yes multiple vlans. We will address as multiple vlans.

        *   All-Active,  traffic SHPE3 -> CE direction
        *   All-Active,  traffic CE -> SHPE3 direction
        *   All-Active,  traffic SHPE3 <-> CE bidirectional
        *   Single-Active,  traffic SHPE3 -> CE direction
        *   Single-Active,  traffic CE -> SHPE3 direction
        *   Single-Active,  traffic SHPE3 <-> CE bidirectional
     *   That could fit nicely in a Table...

Sudhin>>>> thanks for the comment. Sure will address this in table format under topologies section.


  1.  Repeating "How long it takes to learn" is redundant and makes the TOC needlessly unreadable.
This is a benchmarking draft, isn't timing and timing-verification implied?
Sudhin>>>>>>>> Measuring the duration for learning the macs. You are correct, it is the timing measurement.

If you MUST then just add a simple section/sentence at the top of document specifying that and do away with the repetition and long titles

Sudhin>>>>> we will address it in the next version.


  1.  You have PBB-EVPN in titles that basically repeat the previous one (presumably for EVPN?)
Maybe just have one section, and unnumbered subsections for EVPN and PBB-EVPN ?
or better yet: Section 3 EVPN, Section 4 PBB-EVPN and repeat same TCs concisely per technology. Context switching as one reads through the document hinders readability and flow.

Sudhin>>>>>>>>> Sure


   3<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf..org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=NKvru-PiLhvvEAuqtcnC7TMWxb6UCSx-orKOo4qMAH4&e=>;.  EVPN Test Cases

     3.1<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf.org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3.1&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=2NavS2cWAMnbCRNGfoOuY-NgQIw81CusOZyFmcHCWs4&e=>;.  Local MAC learning

     3.2<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf.org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3.3&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=1FWoMqMdKZszJzPU9kXBGNITrTAsbf8wY35AhfaZ1Yw&e=>;.  Remote MAC learning

     3.3.  Local MAC Flush, due to PE-CE link flap

        3.3.1 MAC Re-learning rate

     3.4.  Remote MAC Flush, due to remote link failure

   4<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf..org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=NKvru-PiLhvvEAuqtcnC7TMWxb6UCSx-orKOo4qMAH4&e=>;.  PBB-EVPN Test Cases

     4.1<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf.org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3.1&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=2NavS2cWAMnbCRNGfoOuY-NgQIw81CusOZyFmcHCWs4&e=>;.  Local MAC learning

     4.2<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf.org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3.3&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=1FWoMqMdKZszJzPU9kXBGNITrTAsbf8wY35AhfaZ1Yw&e=>;.  Remote MAC learning

     4.3.  Local MAC Flush, due to PE-CE link flap

        4.3.1 MAC Re-learning rate

     4.4.  Remote MAC Flush, due to remote link failure



Regards,
Luc André

Luc André Burdet |  Cisco  |  laburdet.ietf@gmail.com<mailto:laburdet.ietf@gmail.com>  |  Tel: +1 613 254 4814


From: BESS <bess-bounces@ietf.org<mailto:bess-bounces@ietf.org>> on behalf of Sudhin Jacob <sjacob=40juniper.net@dmarc.ietf.org<mailto:sjacob=40juniper.net@dmarc.ietf.org>>
Date: Wednesday, August 7, 2019 at 02:01
To: "bess@ietf.org<mailto:bess@ietf.org>" <bess@ietf.org<mailto:bess@ietf.org>>, "bmwg@ietf..org<mailto:bmwg@ietf..org>" <bmwg@ietf.org<mailto:bmwg@ietf.org>>
Subject: [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

Hi All,

Our draft is going to be WGLC in BMWG workgroup. Could you please let us know any comments.

Regards,
Sudhin

Juniper Business Use Only