Re: [bmwg] [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

Sudhin Jacob <sjacob@juniper.net> Fri, 09 August 2019 03:53 UTC

Return-Path: <sjacob@juniper.net>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 948841200F8; Thu, 8 Aug 2019 20:53:24 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.7
X-Spam-Level:
X-Spam-Status: No, score=-2.7 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=juniper.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id iatFtsEBoJcT; Thu, 8 Aug 2019 20:53:21 -0700 (PDT)
Received: from mx0a-00273201.pphosted.com (mx0a-00273201.pphosted.com [208.84.65.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3C7CC1200F4; Thu, 8 Aug 2019 20:53:21 -0700 (PDT)
Received: from pps.filterd (m0108156.ppops.net [127.0.0.1]) by mx0a-00273201.pphosted.com (8.16.0.27/8.16.0.27) with SMTP id x793nlqP005761; Thu, 8 Aug 2019 20:53:19 -0700
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=2F+6XsDczFSSszjBy38o75DRa+Gp2kc0luptaFl4Yq8=; b=d7LsEuP9UAcYIyUqjyOF5MDABIN7O6VfDc/uBBo0WwimQQzApa5y+oo7sVB78ZgTt2fI m9YJivQ+McCB6vD2A8QQjFlo6i9GcNYuNMo2K5lvCXzduIgg4RVMh6f9vSojb//8dAN4 hlGYWm2Sk7tedC6btVa84XVKT2dZdzn1QeW3SBSssE9bjOUxipLmKAqikFox3zNx+WlA DHWJM8l25DzSeJRAZfrmHnziO3yRD4s2RNjxgXW8m7tNGkXgXaAJYCdl9SNKBC17oxTO xPiS1gd7Hl2JJXTZhSpSgvLz7ZCo/NsCJhc6gH6FpUPJxugmHeEns+vGwoma23XMqcdF kw==
Received: from nam04-sn1-obe.outbound.protection.outlook.com (mail-sn1nam04lp2052.outbound.protection.outlook.com [104.47.44.52]) by mx0a-00273201.pphosted.com with ESMTP id 2u8shfrnp1-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Thu, 08 Aug 2019 20:53:18 -0700
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Ug38btTu85y9tPTtfivZQytX7RiGmqzR0yJWfw6v3dov5oTMxAV/3e7zrMW0yFmC0dtyLSpj4swY48z0uDDT45FfWpvimHKB6dtJ3qf/WSyMC0rL7hVoCV6sH4Dhl1vne1Y4PQrASOLnOaMy3J//8Vk0ks9UMKDniaZegiooEOyUnqRlyDwHGMQieZkUGYCt0r1BQdupYs2l+WTfVqGuvebjcjfEqRW7tZwXKhiM/GrbuLb3JXfgo8C7iN0SkMf5rF5CPLxvLl+KswTv+qBYu49IjxprwOzQ4ZFK4sZlp4CI3xh8OIWPDuIALsD3Pac5Fs2Z95FsweV3v+4v7e9Ypg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=2F+6XsDczFSSszjBy38o75DRa+Gp2kc0luptaFl4Yq8=; b=F3S7sKFmqUe3jzj2UCDz/krKpuy3z5JUzG8WoogQgTEUAYQg/QtCKFDQxQgtevRJbp5l6VnQBl5gzKCqcxj07STRjZc07HkDHijXjZoJaG4B72AbkwxtmtNxVvvDNQ6NdCqUDraRqgvAM3eDhnVGSJa4Q1vwPgo1bzxZULpEkxEjp+EUAyLWncVRDrvNVguXW/D+yFJdAJC7v+l3x0W9xbmDLp10QLsfRjlmUsfs1nvGw1wb0S1MWqwmwZxTVsQFqov0rTc32kreQg1zqhL0WOAhpecRXnXQWbDlTmvu7MLvh/8/4u8EskIi+ZdjzZUYOkf0U/CIFxWTTHA4TJLRgg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none
Received: from MN2PR05MB6208.namprd05.prod.outlook.com (20.178.241.91) by MN2PR05MB6493.namprd05.prod.outlook.com (20.178.247.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2157.11; Fri, 9 Aug 2019 03:53:16 +0000
Received: from MN2PR05MB6208.namprd05.prod.outlook.com ([fe80::8423:fb36:c429:c069]) by MN2PR05MB6208.namprd05.prod.outlook.com ([fe80::8423:fb36:c429:c069%7]) with mapi id 15.20.2157.011; Fri, 9 Aug 2019 03:53:16 +0000
From: Sudhin Jacob <sjacob@juniper.net>
To: =?iso-8859-1?Q?Luc_Andr=E9_Burdet?= <laburdet.ietf@gmail.com>
CC: "bess@ietf.org" <bess@ietf.org>, "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/
Thread-Index: AQHVTTL9H6lTfy2Jz0mXIuR1lZ0ERKbyLooA
Content-Class:
Date: Fri, 9 Aug 2019 03:53:16 +0000
Message-ID: <MN2PR05MB6208CC260D6CE28C1F485AA9C2D60@MN2PR05MB6208.namprd05.prod.outlook.com>
References: <MN2PR12MB32298891F426865769D8496EAFD40@MN2PR12MB3229.namprd12.prod.outlook.com>
In-Reply-To: <MN2PR12MB32298891F426865769D8496EAFD40@MN2PR12MB3229.namprd12.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
dlp-product: dlpe-windows
dlp-version: 11.2.0.14
dlp-reaction: no-action
msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=True; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Owner=sjacob@juniper.net; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2019-08-09T03:53:13.8844441Z; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Name=Juniper Business Use Only; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Application=Microsoft Azure Information Protection; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ActionId=1125efc9-c79e-4a48-9c48-30fe688de287; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Extended_MSFT_Method=Automatic
x-originating-ip: [116.197.184.10]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: c27d6ebe-9f52-4df4-c765-08d71c7d1c37
x-ms-office365-filtering-ht: Tenant
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600148)(711020)(4605104)(1401327)(4618075)(2017052603328)(7193020); SRVR:MN2PR05MB6493;
x-ms-traffictypediagnostic: MN2PR05MB6493:
x-ms-exchange-purlcount: 6
x-microsoft-antispam-prvs: <MN2PR05MB649372BBCCF7BC2327A67B82C2D60@MN2PR05MB6493.namprd05.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-forefront-prvs: 01244308DF
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(4636009)(376002)(136003)(366004)(396003)(346002)(39860400002)(199004)(189003)(53754006)(51914003)(54896002)(6306002)(9686003)(102836004)(478600001)(966005)(236005)(229853002)(606006)(4326008)(14444005)(256004)(55016002)(14454004)(25786009)(6436002)(54906003)(316002)(66066001)(53546011)(53936002)(6506007)(6246003)(99286004)(86362001)(76176011)(7696005)(476003)(71200400001)(66446008)(64756008)(66556008)(66476007)(66946007)(790700001)(76116006)(2906002)(52536014)(186003)(26005)(3846002)(6116002)(7736002)(6916009)(9326002)(74316002)(8936002)(8676002)(81156014)(33656002)(71190400001)(81166006)(5660300002)(446003)(11346002)(486006); DIR:OUT; SFP:1102; SCL:1; SRVR:MN2PR05MB6493; H:MN2PR05MB6208.namprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1;
received-spf: None (protection.outlook.com: juniper.net does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: /s4WoMjBc41M52WhzVJ/mwagvKpTnjD312k86IkV+fYx7gFAIZbpy1ccNmSjSyMpf2gyd+7RQBPiXaO1QL6SE8Pag2iw8Sz2y2OqxohVsb38DBzuUsM9zdT9hEXDl+dX6XCB5cYkcJv1nMG4+Mo0FTi7KfgmWE56s6g0c2BFwgxeTYh1RWMxQeoakHBZ5uvohEm6RUfLydh8UfjeQbK32czETA1CibGuQPN+8YuP5PYj6jLGKC+1/MoPz3l5f3dnEVdvExx1g+gQPoWKhb5+9qM3Juy1IMc6O6QpyCM/vReyRk6/6epvPs3U9G3vtxF03rhrwQzJ9jrlO8Pt+hLofZBrcRGPZBejayBOJ3cd9K8p0aUc29fJC/qz4pAlIzxZMHABi/AqCH/Vb9p6mf5i1r9Z/Ia6qT51zNAnEoQFWiU=
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_MN2PR05MB6208CC260D6CE28C1F485AA9C2D60MN2PR05MB6208namp_"
MIME-Version: 1.0
X-OriginatorOrg: juniper.net
X-MS-Exchange-CrossTenant-Network-Message-Id: c27d6ebe-9f52-4df4-c765-08d71c7d1c37
X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Aug 2019 03:53:16.4782 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: wEEvKiUk0T2wGhARWoILAj8kVW97SdEcsVotL+L355yNwX5q2tNoIPCtI80LnTuijuu6DEIWS8wtzdqOi9sj8A==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR05MB6493
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2019-08-09_01:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1906280000 definitions=main-1908090040
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/MhMRCiX-XZJDsQaMd7oNrnknbTY>
Subject: Re: [bmwg] [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 09 Aug 2019 03:53:25 -0000

Hi Luc,

Kindly find the answers inline. Appreciate your comments.

Regards,
Sudhin



Juniper Business Use Only
From: Luc André Burdet <laburdet.ietf@gmail.com>;
Sent: Wednesday, August 7, 2019 8:46 PM
To: Sudhin Jacob <sjacob@juniper.net>;; bess@ietf.org; bmwg@ietf.org
Subject: Re: [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

Thanks for the head's up Sudhin.

I got as far as the TOC and associated document flow. I would suggest this needs work before WGLC.
A few suggestions based on cursory reading.



  1.  Section 2, Test topologies   (Nit: plural since you define 3...)

Sudhin>>>>>>>>>  We will change it.

  *   Looks like you are defining only Single-Active?    (Nit:SHPE3 appears twice in its/box)

Sudhin>>>>>>>>>>> we will remove it.

  *   You have only Figure1 and there are 3 topologies in there. Why not define 3 figures, one per topology ?

Sudhin>>>>>>>>> Sure will make it 3 figures and 3 topologies.

  *   The paging makes this section hard to read. Consider shrinking your diagrams.

Sudhin>>>>>>>>  Sure

  *   In fact, these are all the SAME Topology. All you are changing is the traffic pattern. Putting the details of traffic flow "per topology" and especially hiding those details in a one-liner behind "Traffic Generator" is not clear & concise.

Sudhin>>> Traffic generator in the context means either IXIA or Spirent, we cant name one. We have to follow a generic naming pattern.

  *   I would suggest:
     *   1 Figure detailing the physical network diagram defining node names, DUT, etc. ;
     *   A section defining "Test Topologies" overlayed onto that shared network diagram:

Sudhin>>>> Sure we noted this point.


        *   Nit: by "different VLANs" do you mean "Multiple" here or that CE and SHPE3 have different VLANS from one another?)

Sudhin>>>>>> yes multiple vlans. We will address as multiple vlans.

        *   All-Active,  traffic SHPE3 -> CE direction
        *   All-Active,  traffic CE -> SHPE3 direction
        *   All-Active,  traffic SHPE3 <-> CE bidirectional
        *   Single-Active,  traffic SHPE3 -> CE direction
        *   Single-Active,  traffic CE -> SHPE3 direction
        *   Single-Active,  traffic SHPE3 <-> CE bidirectional
     *   That could fit nicely in a Table...

Sudhin>>>> thanks for the comment. Sure will address this in table format under topologies section.


  1.  Repeating "How long it takes to learn" is redundant and makes the TOC needlessly unreadable.
This is a benchmarking draft, isn't timing and timing-verification implied?
Sudhin>>>>>>>> Measuring the duration for learning the macs. You are correct, it is the timing measurement.

If you MUST then just add a simple section/sentence at the top of document specifying that and do away with the repetition and long titles

Sudhin>>>>> we will address it in the next version.


  1.  You have PBB-EVPN in titles that basically repeat the previous one (presumably for EVPN?)
Maybe just have one section, and unnumbered subsections for EVPN and PBB-EVPN ?
or better yet: Section 3 EVPN, Section 4 PBB-EVPN and repeat same TCs concisely per technology. Context switching as one reads through the document hinders readability and flow.

Sudhin>>>>>>>>> Sure


   3<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf..org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=NKvru-PiLhvvEAuqtcnC7TMWxb6UCSx-orKOo4qMAH4&e=>;.  EVPN Test Cases

     3.1<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf.org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3.1&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=2NavS2cWAMnbCRNGfoOuY-NgQIw81CusOZyFmcHCWs4&e=>;.  Local MAC learning

     3.2<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf.org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3.3&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=1FWoMqMdKZszJzPU9kXBGNITrTAsbf8wY35AhfaZ1Yw&e=>;.  Remote MAC learning

     3.3.  Local MAC Flush, due to PE-CE link flap

        3.3.1 MAC Re-learning rate

     3.4.  Remote MAC Flush, due to remote link failure

   4<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf..org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=NKvru-PiLhvvEAuqtcnC7TMWxb6UCSx-orKOo4qMAH4&e=>;.  PBB-EVPN Test Cases

     4.1<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf.org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3.1&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=2NavS2cWAMnbCRNGfoOuY-NgQIw81CusOZyFmcHCWs4&e=>;.  Local MAC learning

     4.2<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf.org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3.3&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=1FWoMqMdKZszJzPU9kXBGNITrTAsbf8wY35AhfaZ1Yw&e=>;.  Remote MAC learning

     4.3.  Local MAC Flush, due to PE-CE link flap

        4.3.1 MAC Re-learning rate

     4.4.  Remote MAC Flush, due to remote link failure



Regards,
Luc André

Luc André Burdet |  Cisco  |  laburdet.ietf@gmail.com<mailto:laburdet.ietf@gmail.com>  |  Tel: +1 613 254 4814


From: BESS <bess-bounces@ietf.org<mailto:bess-bounces@ietf.org>> on behalf of Sudhin Jacob <sjacob=40juniper.net@dmarc.ietf.org<mailto:sjacob=40juniper.net@dmarc.ietf.org>>
Date: Wednesday, August 7, 2019 at 02:01
To: "bess@ietf.org<mailto:bess@ietf.org>" <bess@ietf.org<mailto:bess@ietf.org>>, "bmwg@ietf..org<mailto:bmwg@ietf..org>" <bmwg@ietf.org<mailto:bmwg@ietf.org>>
Subject: [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

Hi All,

Our draft is going to be WGLC in BMWG workgroup. Could you please let us know any comments.

Regards,
Sudhin

Juniper Business Use Only