Re: [bmwg] [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

Sudhin Jacob <sjacob@juniper.net> Thu, 08 August 2019 03:45 UTC

Return-Path: <sjacob@juniper.net>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8217C12000E; Wed, 7 Aug 2019 20:45:03 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.699
X-Spam-Level:
X-Spam-Status: No, score=-2.699 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=juniper.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id nHuUczC-UGNH; Wed, 7 Aug 2019 20:44:59 -0700 (PDT)
Received: from mx0b-00273201.pphosted.com (mx0a-00273201.pphosted.com [208.84.65.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7F8061206C4; Wed, 7 Aug 2019 20:44:59 -0700 (PDT)
Received: from pps.filterd (m0108157.ppops.net [127.0.0.1]) by mx0a-00273201.pphosted.com (8.16.0.27/8.16.0.27) with SMTP id x783iWtP001661; Wed, 7 Aug 2019 20:44:54 -0700
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=Nkp1WXa5hMILHRnby0o91C5bHsXLVbrgPeAxukGlLds=; b=0P0Qlt9JK/gH0N7pbPzYDuJSTuFwm2fnUFKgeCZVP8KXzrfjnMGipWawS1pUomKZBMFv rDbeLCnEr8WqLdq6KH6wMYZzry0rrWrCNzXHi2XfUU4Zv11EFfM872Et4cv0NaFkFz4X pU7ki01EwAt2XDoDW+d0AVTwIY+CiNrF2kIJW/D8E4Px0/YbOc7+MgpGf5ohH/xFYB7g UQweFBKlZSND0Jk6OatYc94S6WQueXvmL7/ssEz4aaYQef6qisL4j315F+eO9rxv18m9 9p4L7TB924BeJDZAQ8+FuPT/jG32AorMZvXx/FD6WY0qafMwwbOxpxdbhUFekokWUAhi dw==
Received: from nam04-sn1-obe.outbound.protection.outlook.com (mail-sn1nam04lp2056.outbound.protection.outlook.com [104.47.44.56]) by mx0a-00273201.pphosted.com with ESMTP id 2u85d70hqw-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 07 Aug 2019 20:44:52 -0700
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Vy4dMWZPT1Rxqm9rhLvju39dj8WYyecCf2wazXH43lMJdJBVEilPIGF07Vlg3xaKJemYsVp97ioObuZcnVdg1Id05YNALdI/v1J2KqKo+nEMCMUq1hzt16jgd85gD5G938HHmW86bRxWfdlhM/EOilfC12Fj00YeawizYxEs89GaPurihNG9UQlUvVuZxKbFq5WvT+II8NVFk63rQQmGp3vjOLVRp85xTwAbCY+fNCe5MHrgAwzx7WVJjA+HfhBYGU30MuGnzkDMkltg4txP6diaWy5fGqJTna6JxYj1r5Wn7tc7/O8XfD86fb8+RVrDfCyttxOSX24JERSffKFSVQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Nkp1WXa5hMILHRnby0o91C5bHsXLVbrgPeAxukGlLds=; b=Ig6oyaShjRy0QoFR9i7q63W111AX7qTZ+1tP8AVNmnf6vN+bq4Yty2+bUm3KuS2hM5VXgdV3BbTBm7t74JDBSmsfBTHMiCecvjl3ObzApVOUR8B+aPbzCtIQh7IAXINy1hAuIji9HHJz68I+9tmrlKP/7zouS6Ku3AT1epGKhgkl136+TYLrFHUEdaJTluE8xe/CpEccOw/b4o4bcfxRy/iSc3qM0Br5nf9dC98SWsfJ3DXHKd00DI4wT2/QDbuLR2Kk5ztkqgB9Csk40si02ASoBjJmJr8Elf8GWvJUuXAvwQJm2T0z5q6GSmGpQfg/lUVjvAyWYnNxZY0X7sYsfQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none
Received: from MN2PR05MB6208.namprd05.prod.outlook.com (20.178.241.91) by MN2PR05MB6974.namprd05.prod.outlook.com (52.135.39.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2157.14; Thu, 8 Aug 2019 03:44:47 +0000
Received: from MN2PR05MB6208.namprd05.prod.outlook.com ([fe80::8423:fb36:c429:c069]) by MN2PR05MB6208.namprd05.prod.outlook.com ([fe80::8423:fb36:c429:c069%7]) with mapi id 15.20.2157.011; Thu, 8 Aug 2019 03:44:47 +0000
From: Sudhin Jacob <sjacob@juniper.net>
To: Luc André Burdet <laburdet.ietf@gmail.com>
CC: "bess@ietf.org" <bess@ietf.org>, "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/
Thread-Index: AQHVTTL9H6lTfy2Jz0mXIuR1lZ0ERKbwnHmA
Content-Class:
Date: Thu, 08 Aug 2019 03:44:47 +0000
Message-ID: <MN2PR05MB62084442573B2F1870E10A7BC2D70@MN2PR05MB6208.namprd05.prod.outlook.com>
References: <MN2PR12MB32298891F426865769D8496EAFD40@MN2PR12MB3229.namprd12.prod.outlook.com>
In-Reply-To: <MN2PR12MB32298891F426865769D8496EAFD40@MN2PR12MB3229.namprd12.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
dlp-product: dlpe-windows
dlp-version: 11.2.0.14
dlp-reaction: no-action
msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=True; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Owner=sjacob@juniper.net; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2019-08-08T03:44:45.4509743Z; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Name=Juniper Business Use Only; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Application=Microsoft Azure Information Protection; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ActionId=cf777365-3c5b-4d59-ac33-267a3a8613c8; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Extended_MSFT_Method=Automatic
x-originating-ip: [116.197.184.12]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 1b2ad16c-d521-4e58-de30-08d71bb2c266
x-ms-office365-filtering-ht: Tenant
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600148)(711020)(4605104)(1401327)(4618075)(2017052603328)(7193020); SRVR:MN2PR05MB6974;
x-ms-traffictypediagnostic: MN2PR05MB6974:
x-ms-exchange-purlcount: 6
x-microsoft-antispam-prvs: <MN2PR05MB6974AC2528CDFCC6CE9B1B12C2D70@MN2PR05MB6974.namprd05.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-forefront-prvs: 012349AD1C
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(4636009)(136003)(396003)(346002)(366004)(376002)(39860400002)(199004)(53754006)(189003)(51914003)(6246003)(6506007)(53546011)(236005)(186003)(6306002)(76176011)(9686003)(86362001)(102836004)(6116002)(4326008)(790700001)(6436002)(54896002)(3846002)(6916009)(99286004)(55016002)(606006)(53936002)(7696005)(33656002)(8676002)(26005)(54906003)(478600001)(446003)(14444005)(316002)(25786009)(66066001)(256004)(2906002)(66446008)(7736002)(5660300002)(66556008)(66476007)(66946007)(486006)(71190400001)(14454004)(64756008)(76116006)(71200400001)(81156014)(8936002)(9326002)(52536014)(476003)(11346002)(229853002)(74316002)(81166006)(966005); DIR:OUT; SFP:1102; SCL:1; SRVR:MN2PR05MB6974; H:MN2PR05MB6208.namprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1;
received-spf: None (protection.outlook.com: juniper.net does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: QJp+9WcgGlGZ+W5h18Vrx6suqp4XRdvqJOlytOkSaJB4JTAawpcK2WAZwwiGBaFEU31RLKKismS09WOwuEZVtkP+y3pql9ir3jrlpddakyWxTmIFzV5SWlW9eaEWO/u1amDSc2x8JyvAlRiz34RymkB5JNtN2KF+yIt3MfanNPgTpQM6dotZQUshlOH6fMCFyGYgeU7s3EB9F2VbEARJurfv/N5Kkp2wrq52TnX9ueJJCBb6ZkFTo+MEQCPmQDgE36fRIpvI+al0cSehLs3br+flcgLpkqkQ3Z55XGIHoWQgsVsFNoD+Sb4NDeG/9CbvJ/EFphpXB1VeUUP+4keOv4GYo38P0vjAvwB7xTqeX2hm2VaWkdeCPUTQVnOXfx25ke/ebMho+O/zHLWeKvrYCjEFg8+xdL01wq3nvDRkxqI=
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_MN2PR05MB62084442573B2F1870E10A7BC2D70MN2PR05MB6208namp_"
MIME-Version: 1.0
X-OriginatorOrg: juniper.net
X-MS-Exchange-CrossTenant-Network-Message-Id: 1b2ad16c-d521-4e58-de30-08d71bb2c266
X-MS-Exchange-CrossTenant-originalarrivaltime: 08 Aug 2019 03:44:47.4065 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 68qiQ+blNxQDjgZx4v5b/ynm87XOond71sISpn7pca1ZRR5f3jfOoFb0gDr1J/FWT76JoEMUcgs+8K1rPJKAIA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR05MB6974
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2019-08-08_01:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1906280000 definitions=main-1908080038
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/Z5NL76rQCDJKaflOwEPUp0gaDYg>
Subject: Re: [bmwg] [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 08 Aug 2019 03:45:04 -0000

Hi Luc,

Thanks for the comments. Appreciate it. I will get back.

Regards,
Sudhin



Juniper Business Use Only
From: Luc André Burdet <laburdet.ietf@gmail.com>
Sent: Wednesday, August 7, 2019 8:46 PM
To: Sudhin Jacob <sjacob@juniper.net>; bess@ietf.org; bmwg@ietf.org
Subject: Re: [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

Thanks for the head's up Sudhin.

I got as far as the TOC and associated document flow. I would suggest this needs work before WGLC.
A few suggestions based on cursory reading.



  1.  Section 2, Test topologies   (Nit: plural since you define 3...)

  *   Looks like you are defining only Single-Active?    (Nit:SHPE3 appears twice in its/box)
  *   You have only Figure1 and there are 3 topologies in there. Why not define 3 figures, one per topology ?
  *   The paging makes this section hard to read. Consider shrinking your diagrams.
  *   In fact, these are all the SAME Topology. All you are changing is the traffic pattern. Putting the details of traffic flow "per topology" and especially hiding those details in a one-liner behind "Traffic Generator" is not clear & concise.
  *   I would suggest:
     *   1 Figure detailing the physical network diagram defining node names, DUT, etc. ;
     *   A section defining "Test Topologies" overlayed onto that shared network diagram:
        *   Nit: by "different VLANs" do you mean "Multiple" here or that CE and SHPE3 have different VLANS from one another?)
        *   All-Active,  traffic SHPE3 -> CE direction
        *   All-Active,  traffic CE -> SHPE3 direction
        *   All-Active,  traffic SHPE3 <-> CE bidirectional
        *   Single-Active,  traffic SHPE3 -> CE direction
        *   Single-Active,  traffic CE -> SHPE3 direction
        *   Single-Active,  traffic SHPE3 <-> CE bidirectional
     *   That could fit nicely in a Table...


  1.  Repeating "How long it takes to learn" is redundant and makes the TOC needlessly unreadable.
This is a benchmarking draft, isn't timing and timing-verification implied?
If you MUST then just add a simple section/sentence at the top of document specifying that and do away with the repetition and long titles


  1.  You have PBB-EVPN in titles that basically repeat the previous one (presumably for EVPN?)
Maybe just have one section, and unnumbered subsections for EVPN and PBB-EVPN ?
or better yet: Section 3 EVPN, Section 4 PBB-EVPN and repeat same TCs concisely per technology. Context switching as one reads through the document hinders readability and flow.


   3<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf..org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=NKvru-PiLhvvEAuqtcnC7TMWxb6UCSx-orKOo4qMAH4&e=>.  EVPN Test Cases

     3.1<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf.org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3.1&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=2NavS2cWAMnbCRNGfoOuY-NgQIw81CusOZyFmcHCWs4&e=>.  Local MAC learning

     3.2<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf.org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3.3&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=1FWoMqMdKZszJzPU9kXBGNITrTAsbf8wY35AhfaZ1Yw&e=>.  Remote MAC learning

     3.3.  Local MAC Flush, due to PE-CE link flap

        3.3.1 MAC Re-learning rate

     3.4.  Remote MAC Flush, due to remote link failure

   4<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf..org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=NKvru-PiLhvvEAuqtcnC7TMWxb6UCSx-orKOo4qMAH4&e=>.  PBB-EVPN Test Cases

     4.1<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf.org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3.1&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=2NavS2cWAMnbCRNGfoOuY-NgQIw81CusOZyFmcHCWs4&e=>.  Local MAC learning

     4.2<https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf.org_html_draft-2Dietf-2Dbmwg-2Devpntest-2D02-23section-2D3.3&d=DwMF-g&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=6467957JFOdmNjfKujkufIeAE-AdkLRewB-QhIU_Srw&m=KEdAQSnRSS33yC4oLGFN_oPFqpDbbKcDu7Mfvvk-DjI&s=1FWoMqMdKZszJzPU9kXBGNITrTAsbf8wY35AhfaZ1Yw&e=>.  Remote MAC learning

     4.3.  Local MAC Flush, due to PE-CE link flap

        4.3.1 MAC Re-learning rate

     4.4.  Remote MAC Flush, due to remote link failure



Regards,
Luc André

Luc André Burdet |  Cisco  |  laburdet.ietf@gmail.com<mailto:laburdet.ietf@gmail.com>  |  Tel: +1 613 254 4814


From: BESS <bess-bounces@ietf.org<mailto:bess-bounces@ietf.org>> on behalf of Sudhin Jacob <sjacob=40juniper.net@dmarc.ietf.org<mailto:sjacob=40juniper.net@dmarc.ietf.org>>
Date: Wednesday, August 7, 2019 at 02:01
To: "bess@ietf.org<mailto:bess@ietf.org>" <bess@ietf.org<mailto:bess@ietf.org>>, "bmwg@ietf..org<mailto:bmwg@ietf..org>" <bmwg@ietf.org<mailto:bmwg@ietf.org>>
Subject: [bess] REG: https://datatracker.ietf.org/doc/draft-ietf-bmwg-evpntest/

Hi All,

Our draft is going to be WGLC in BMWG workgroup. Could you please let us know any comments.

Regards,
Sudhin

Juniper Business Use Only