Re: [bmwg] draft-morton-bmwg-multihome-evpn-02.txt

Sudhin Jacob <sjacob@juniper.net> Tue, 05 November 2019 03:58 UTC

Return-Path: <sjacob@juniper.net>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 64F9512002F for <bmwg@ietfa.amsl.com>; Mon, 4 Nov 2019 19:58:32 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.699
X-Spam-Level:
X-Spam-Status: No, score=-2.699 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=juniper.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id A3RBqCKDOpjR for <bmwg@ietfa.amsl.com>; Mon, 4 Nov 2019 19:58:30 -0800 (PST)
Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1C78E120020 for <bmwg@ietf.org>; Mon, 4 Nov 2019 19:58:30 -0800 (PST)
Received: from pps.filterd (m0108160.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id xA53vPi1022587; Mon, 4 Nov 2019 19:58:24 -0800
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=tNUD/Gmmb/KfNlEpwFsGsmqHkaudA06NTc1RqdcV738=; b=E6xYbMiW5xqqUHVUK867TTOSePtOvrq0/izJyZ1q3lFzK6tdnEnSMKl3z87leqeByjmT A2QbCZT+3IkBj6RYUy+P9buPW4DNb/94RtYUFVxRlhgxeXa1BBsKGWA11PZwWB/GDQa6 GfvBkdLwBupgYrrJtlygnLQGbU3DPqLErRro++6tLm5ui1MdEaoLWz/rwHlGN+h7gQwc Sby2whEH1w4gvFQ8s3kIfHzU9w24o/TONOp4p1c8uExt3dHW6vWe2FrC4x3tCHuh7a39 bm8awNc9HsFD3u7FVPUeFryzZ+qIkdPuhqcQUrMecjwIDyddg5kSqU53Edz/5gwzL7kV 7w==
Received: from nam04-sn1-obe.outbound.protection.outlook.com (mail-sn1nam04lp2053.outbound.protection.outlook.com [104.47.44.53]) by mx0b-00273201.pphosted.com with ESMTP id 2w2xy8089v-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Mon, 04 Nov 2019 19:58:24 -0800
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=QYXvSb6nbxw/GnULQ8jzbEGsmhlhH+KX2ZcTM6prIIlkzO7KS/r4iE4YyeFfSP7ngIEvYLkXEEaa1cwqA2wI5Btr2LRQcKxya4KvllWY8+3DlvxeTG7X+NyHVsIp8IFfID/QAz5U0DO58ByyIGQzXW2NYV58Q0NdYxenBYFwICLbDO1bALTE1JVzanTKKxM7/WCORToPcHVLOwvA7yePVZ5AhXwI+4gg3SKwiDighOzui8l8hf24pr2Q584qNAm3vCUO/4vy6li1uXdt/WbOvS3Ie4BlBI3xarWFfnGq6O4JxefpxGpr4xmmxjCIpBsTD0veBPeZ/E9RWiHU0ojzCg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=tNUD/Gmmb/KfNlEpwFsGsmqHkaudA06NTc1RqdcV738=; b=NOBZ12P1GxCuRXaTNGU1NSHWWzkuefMvd3CfVyzaSGfskL/r2r9WPDo06DiIuwnAHgBg6No07kWlQMIRFnCIp1CU0M3A3HXfV3oJuDLxAoUyPoEPa/7XAPUBfOu8vR17e7IZ42b2MgxC+k1g/4HYRi/Lmjy1/KqJBVHS3UXsG4LjwtXYFXtmK5IB3WJPlV3DHygd4Xt3lSFTkB5uzbGuLAU+jIRu+z8VW6YagqkpiaXyE/UUIBydJdhVddMEPuU77hROfpqZ/g0GXvpqYIA50CQDzrajzorVQ5KCdaeup3IUNUp6ZRCcCVPuvLkBzAjUb0n67WOXDvYMaDce4rGYiQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none
Received: from MN2PR05MB6208.namprd05.prod.outlook.com (20.178.241.91) by MN2PR05MB6767.namprd05.prod.outlook.com (52.132.174.219) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2430.16; Tue, 5 Nov 2019 03:58:21 +0000
Received: from MN2PR05MB6208.namprd05.prod.outlook.com ([fe80::6071:9e6c:9d86:3510]) by MN2PR05MB6208.namprd05.prod.outlook.com ([fe80::6071:9e6c:9d86:3510%3]) with mapi id 15.20.2408.014; Tue, 5 Nov 2019 03:58:21 +0000
From: Sudhin Jacob <sjacob@juniper.net>
To: "MORTON, ALFRED C (AL)" <acm@research.att.com>
CC: "UTTARO, JAMES" <ju1738@att.com>, "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: draft-morton-bmwg-multihome-evpn-02.txt
Thread-Index: AQHVXAAbBp/UIuOpK0CFqanCgfwTdqcOvY6AgG0SIgCAAJKJcA==
Content-Class:
Date: Tue, 5 Nov 2019 03:58:21 +0000
Message-ID: <MN2PR05MB620865CE4DE9F8D145DC8545C27E0@MN2PR05MB6208.namprd05.prod.outlook.com>
References: <MN2PR05MB6208499395F2361D2A40CDBCC2A10@MN2PR05MB6208.namprd05.prod.outlook.com> <4D7F4AD313D3FC43A053B309F97543CFA0AEB18C@njmtexg5.research.att.com> <MN2PR05MB6208822D3422B6828B618856C2A00@MN2PR05MB6208.namprd05.prod.outlook.com> <4D7F4AD313D3FC43A053B309F97543CFA0B6BF19@njmtexg5.research.att.com>
In-Reply-To: <4D7F4AD313D3FC43A053B309F97543CFA0B6BF19@njmtexg5.research.att.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=True; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Owner=sjacob@juniper.net; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2019-11-05T03:58:17.8939880Z; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Name=Juniper Business Use Only; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Application=Microsoft Azure Information Protection; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ActionId=9d005a48-2af1-49ec-954a-12527f8849b3; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Extended_MSFT_Method=Automatic
dlp-product: dlpe-windows
dlp-version: 11.2.0.14
dlp-reaction: no-action
x-originating-ip: [116.197.184.14]
x-ms-publictraffictype: Email
x-ms-office365-filtering-ht: Tenant
x-ms-office365-filtering-correlation-id: 64004146-c6d9-4786-c362-08d761a46660
x-ms-traffictypediagnostic: MN2PR05MB6767:
x-ms-exchange-purlcount: 1
x-microsoft-antispam-prvs: <MN2PR05MB676782C04E1F954B1D51E6C1C27E0@MN2PR05MB6767.namprd05.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-forefront-prvs: 0212BDE3BE
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(396003)(136003)(346002)(39860400002)(366004)(376002)(43544003)(199004)(189003)(316002)(256004)(14454004)(186003)(99286004)(64756008)(6246003)(66556008)(33656002)(25786009)(14444005)(6306002)(54896002)(26005)(966005)(76176011)(66066001)(55016002)(8676002)(6436002)(66476007)(66446008)(229853002)(2906002)(71200400001)(66946007)(52536014)(102836004)(76116006)(11346002)(81156014)(236005)(9686003)(476003)(53546011)(71190400001)(6506007)(8936002)(446003)(54906003)(6116002)(790700001)(486006)(5660300002)(4326008)(6916009)(606006)(86362001)(478600001)(7696005)(7736002)(74316002)(81166006)(3846002); DIR:OUT; SFP:1102; SCL:1; SRVR:MN2PR05MB6767; H:MN2PR05MB6208.namprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1;
received-spf: None (protection.outlook.com: juniper.net does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: IzI9+Tyw0w8beZFUkX3FCrosfMWvygOiip4kKZ6jgrDl9zBR7nvrQ20uvMlNfO4IYawWNbAtj5Z5jCb9PbpiCv2x18I3J0VeJrQAvDrtLS9OyxnUiG8dgLHddf1HA4rAc9CtzHq7pJQ2sP5nJANeQCJXoMYu7ipOhdH3udQ9dJ1Vjf5b3nUfPjqTFeNRkqozCUSUKCyNT8cCqyPbF1o9UGj9Qrb7yDAIe6Guyp8MjG2Pq/EKg0IKxeDjpEavaztZeNq4h3m0V8nCfP89EW1ecCViiJXZ+t9Qw/S56gLoXeIBBwPLdujPT0gdq6ZIj+z6jOlqjM5jpP666Ncw5cNNlYQ4NKx8ehGWY6TMuBzCf/SLOcxsoIg4naSkBpUfIQTfWAFz7voL2dzbz1eMdJpRFZ/mvYCbw6KX9ttj+3hUTqLyevYHEc8FCEAB2mMHAGWjxn0YAnwnmMk5P9ySDb7vu1k55nOROJNXBdlRSSScypE=
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_MN2PR05MB620865CE4DE9F8D145DC8545C27E0MN2PR05MB6208namp_"
MIME-Version: 1.0
X-OriginatorOrg: juniper.net
X-MS-Exchange-CrossTenant-Network-Message-Id: 64004146-c6d9-4786-c362-08d761a46660
X-MS-Exchange-CrossTenant-originalarrivaltime: 05 Nov 2019 03:58:21.4733 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: UMTCPzSVVLcvcdw8WfqY5eOCZHQea+TTME5tfEq4whPCzY6Uvc0S4o3TY6bjNKvm6QcjcOCYzgVvu+iX8MEBwA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR05MB6767
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.95,1.0.8 definitions=2019-11-05_01:2019-11-04,2019-11-05 signatures=0
X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 impostorscore=0 malwarescore=0 priorityscore=1501 bulkscore=0 clxscore=1011 suspectscore=0 lowpriorityscore=0 spamscore=0 phishscore=0 mlxlogscore=999 adultscore=0 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-1908290000 definitions=main-1911050030
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/4AvUc3ruDxb5G2A04tWXEoBScos>
Subject: Re: [bmwg] draft-morton-bmwg-multihome-evpn-02.txt
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 05 Nov 2019 03:58:32 -0000

Hi Al and Jim,

Thank you for the reply. Let me go through it and I will get back.

Regards,
Sudhin



Juniper Business Use Only
From: MORTON, ALFRED C (AL) <acm@research.att.com>;
Sent: Tuesday, November 5, 2019 12:43 AM
To: Sudhin Jacob <sjacob@juniper.net>;
Cc: UTTARO, JAMES <ju1738@att.com>;; bmwg@ietf.org
Subject: RE: draft-morton-bmwg-multihome-evpn-02.txt

Hi Sudhin,
Thanks for your answers - we have updated the draft again
https://tools.ietf.org/html/draft-morton-bmwg-multihome-evpn-03

to reflect our replies to your comments below.
Al and Jim

From: Sudhin Jacob [mailto:sjacob@juniper.net]
Sent: Tuesday, August 27, 2019 5:38 AM
To: MORTON, ALFRED C (AL) <acm@research.att.com<mailto:acm@research.att.com>>
Cc: UTTARO, JAMES <ju1738@att.com<mailto:ju1738@att.com>>; bmwg@ietf.org<mailto:bmwg@ietf.org>
Subject: RE: draft-morton-bmwg-multihome-evpn-02.txt

Hi Al,

Kindly find the answers inline.

Regards,
Sudhin



Juniper Business Use Only
From: MORTON, ALFRED C (AL) <acm@research.att.com<mailto:acm@research.att.com>>
Sent: Monday, August 26, 2019 4:49 PM
To: Sudhin Jacob <sjacob@juniper.net<mailto:sjacob@juniper.net>>; bmwg@ietf.org<mailto:bmwg@ietf.org>
Cc: UTTARO, JAMES <ju1738@att.com<mailto:ju1738@att.com>>
Subject: RE: draft-morton-bmwg-multihome-evpn-02.txt

Hi Sudhin,

Thanks for your comments. Jim and I will prepare a reply soon.
You can expect some questions in response, such as:

- why do you believe Figure 1 is no longer required?

Sudhin>>>>>>> the figure 2 is a complete topology because of that Figure 1 is not required.
[acm]
That's true, but IIRC we also had an exchange about minimizing the
equipment necessary for lab testing, and Figure 1 accomplishes that.
We'll update section 5 to indicate that both setups are allowed.

- what are the specific areas/topics where you want more
   configuration details for the setup(s)?
Sudhin>>> base configuration along with service details. How many services are needed?, traffic per service would be great.
[acm]
We've clarified configuration in the figures, and added a new configuration section.

see below for more replies...

[acm] ...


From: Sudhin Jacob [mailto:sjacob@juniper.net]
Sent: Monday, August 26, 2019 5:53 AM
To: bmwg@ietf.org<mailto:bmwg@ietf.org>
Cc: MORTON, ALFRED C (AL) <acm@research.att.com<mailto:acm@research.att.com>>; UTTARO, JAMES <ju1738@att.com<mailto:ju1738@att.com>>
Subject: REG: draft-morton-bmwg-multihome-evpn-02.txt

Hi Al/Jim,

I had gone through the below draft. Could you please clarify the following.

1.       I think figure 1 is not required.[acm]  see above
2.       Figure 2 is perfect for the test.
3.       Please provide the configuration details of test setup.[acm]  see above
4.       Section 5.2. Please take care of the following, keep one as constant. In this flow and frame size as variables. This gives ambiguous results.  Request you to have clarity on flows.  Is it per vlan flows or 100k flows in one vlan.[acm]  the later, one vlan
5.       Request you to keep flow as constant change frame size from 64B to 1500.[acm]  That's  how these tests are run.
6.       It would be good to have a table for section 5.2 [acm]  it's sufficient to use the lists, we'll use tables later for the results.
7.       Could you please clarify on section 5.5 calculation part.[acm]  There are N tests with N Throughput results: For Average, Sum and divide by N. Each Statistic has their own equation, and there are no surprises.
8.       Could you please re consider section 6 based on point number 4.[acm]  Done.
9.       Could you please explain the calculation part in section 6.4[acm]  See reply to 7.
10.   Could you please explain the table mentioned in section 7.[acm]  [it's simply a way to summarize all results collected in sections 5 and 6.


Regards,
Sudhin



Juniper Business Use Only