Re: [bmwg] draft-morton-bmwg-multihome-evpn-02.txt

"MORTON, ALFRED C (AL)" <acm@research.att.com> Mon, 04 November 2019 19:13 UTC

Return-Path: <acm@research.att.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C22DD1208A7 for <bmwg@ietfa.amsl.com>; Mon, 4 Nov 2019 11:13:30 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.598
X-Spam-Level:
X-Spam-Status: No, score=-2.598 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id aICmRbzlmGrV for <bmwg@ietfa.amsl.com>; Mon, 4 Nov 2019 11:13:24 -0800 (PST)
Received: from mx0a-00191d01.pphosted.com (mx0a-00191d01.pphosted.com [67.231.149.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5E8BE120A60 for <bmwg@ietf.org>; Mon, 4 Nov 2019 11:13:16 -0800 (PST)
Received: from pps.filterd (m0048589.ppops.net [127.0.0.1]) by m0048589.ppops.net-00191d01. (8.16.0.42/8.16.0.42) with SMTP id xA4IwtwR047476; Mon, 4 Nov 2019 14:13:15 -0500
Received: from tlpd255.enaf.dadc.sbc.com (sbcsmtp3.sbc.com [144.160.112.28]) by m0048589.ppops.net-00191d01. with ESMTP id 2w2sk9rptf-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 04 Nov 2019 14:13:15 -0500
Received: from enaf.dadc.sbc.com (localhost [127.0.0.1]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id xA4JDEW8073246; Mon, 4 Nov 2019 13:13:14 -0600
Received: from zlp30495.vci.att.com (zlp30495.vci.att.com [135.46.181.158]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id xA4JD9JV073123 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 4 Nov 2019 13:13:09 -0600
Received: from zlp30495.vci.att.com (zlp30495.vci.att.com [127.0.0.1]) by zlp30495.vci.att.com (Service) with ESMTP id 754344005C2C; Mon, 4 Nov 2019 19:13:09 +0000 (GMT)
Received: from clpi183.sldc.sbc.com (unknown [135.41.1.46]) by zlp30495.vci.att.com (Service) with ESMTP id 502A64005C29; Mon, 4 Nov 2019 19:13:09 +0000 (GMT)
Received: from sldc.sbc.com (localhost [127.0.0.1]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id xA4JD9RH003885; Mon, 4 Nov 2019 13:13:09 -0600
Received: from mail-blue.research.att.com (mail-blue.research.att.com [135.207.178.11]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id xA4JD2Xx003405; Mon, 4 Nov 2019 13:13:03 -0600
Received: from exchange.research.att.com (njbdcas1.research.att.com [135.197.255.61]) by mail-blue.research.att.com (Postfix) with ESMTP id 7D630F0C3E; Mon, 4 Nov 2019 14:13:02 -0500 (EST)
Received: from njmtexg5.research.att.com ([fe80::b09c:ff13:4487:78b6]) by njbdcas1.research.att.com ([fe80::8c6b:4b77:618f:9a01%11]) with mapi id 14.03.0468.000; Mon, 4 Nov 2019 14:12:49 -0500
From: "MORTON, ALFRED C (AL)" <acm@research.att.com>
To: Sudhin Jacob <sjacob@juniper.net>
CC: "UTTARO, JAMES" <ju1738@att.com>, "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: draft-morton-bmwg-multihome-evpn-02.txt
Thread-Index: AdVb8h45fimLiJoATfqL5epyKyQLuwADNPYQADdtD4ANa41wsA==
Date: Mon, 4 Nov 2019 19:12:48 +0000
Message-ID: <4D7F4AD313D3FC43A053B309F97543CFA0B6BF19@njmtexg5.research.att.com>
References: <MN2PR05MB6208499395F2361D2A40CDBCC2A10@MN2PR05MB6208.namprd05.prod.outlook.com> <4D7F4AD313D3FC43A053B309F97543CFA0AEB18C@njmtexg5.research.att.com> <MN2PR05MB6208822D3422B6828B618856C2A00@MN2PR05MB6208.namprd05.prod.outlook.com>
In-Reply-To: <MN2PR05MB6208822D3422B6828B618856C2A00@MN2PR05MB6208.namprd05.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [65.74.234.205]
Content-Type: multipart/alternative; boundary="_000_4D7F4AD313D3FC43A053B309F97543CFA0B6BF19njmtexg5researc_"
MIME-Version: 1.0
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2019-11-04_10:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1908290000 definitions=main-1911040183
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/dCZtpqxjaHNecD_J_sM8J3A3ocY>
Subject: Re: [bmwg] draft-morton-bmwg-multihome-evpn-02.txt
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 04 Nov 2019 19:13:31 -0000

Hi Sudhin,
Thanks for your answers - we have updated the draft again
https://tools.ietf.org/html/draft-morton-bmwg-multihome-evpn-03

to reflect our replies to your comments below.
Al and Jim

From: Sudhin Jacob [mailto:sjacob@juniper.net]
Sent: Tuesday, August 27, 2019 5:38 AM
To: MORTON, ALFRED C (AL) <acm@research.att.com>;
Cc: UTTARO, JAMES <ju1738@att.com>;; bmwg@ietf.org
Subject: RE: draft-morton-bmwg-multihome-evpn-02.txt

Hi Al,

Kindly find the answers inline.

Regards,
Sudhin



Juniper Business Use Only
From: MORTON, ALFRED C (AL) <acm@research.att.com<mailto:acm@research.att.com>>
Sent: Monday, August 26, 2019 4:49 PM
To: Sudhin Jacob <sjacob@juniper.net<mailto:sjacob@juniper.net>>; bmwg@ietf.org<mailto:bmwg@ietf.org>
Cc: UTTARO, JAMES <ju1738@att.com<mailto:ju1738@att.com>>
Subject: RE: draft-morton-bmwg-multihome-evpn-02.txt

Hi Sudhin,

Thanks for your comments. Jim and I will prepare a reply soon.
You can expect some questions in response, such as:

- why do you believe Figure 1 is no longer required?

Sudhin>>>>>>> the figure 2 is a complete topology because of that Figure 1 is not required.
[acm]
That's true, but IIRC we also had an exchange about minimizing the
equipment necessary for lab testing, and Figure 1 accomplishes that.
We'll update section 5 to indicate that both setups are allowed.

- what are the specific areas/topics where you want more
   configuration details for the setup(s)?
Sudhin>>> base configuration along with service details. How many services are needed?, traffic per service would be great.
[acm]
We've clarified configuration in the figures, and added a new configuration section.

see below for more replies...

[acm] ...


From: Sudhin Jacob [mailto:sjacob@juniper.net]
Sent: Monday, August 26, 2019 5:53 AM
To: bmwg@ietf.org<mailto:bmwg@ietf.org>
Cc: MORTON, ALFRED C (AL) <acm@research.att.com<mailto:acm@research.att.com>>; UTTARO, JAMES <ju1738@att.com<mailto:ju1738@att.com>>
Subject: REG: draft-morton-bmwg-multihome-evpn-02.txt

Hi Al/Jim,

I had gone through the below draft. Could you please clarify the following.

1.      I think figure 1 is not required.[acm]  see above
2.      Figure 2 is perfect for the test.
3.      Please provide the configuration details of test setup.[acm]  see above
4.      Section 5.2. Please take care of the following, keep one as constant. In this flow and frame size as variables. This gives ambiguous results.  Request you to have clarity on flows.  Is it per vlan flows or 100k flows in one vlan.[acm]  the later, one vlan
5.      Request you to keep flow as constant change frame size from 64B to 1500.[acm]  That's  how these tests are run.
6.      It would be good to have a table for section 5.2 [acm]  it's sufficient to use the lists, we'll use tables later for the results.
7.      Could you please clarify on section 5.5 calculation part.[acm]  There are N tests with N Throughput results: For Average, Sum and divide by N. Each Statistic has their own equation, and there are no surprises.
8.      Could you please re consider section 6 based on point number 4.[acm]  Done.
9.      Could you please explain the calculation part in section 6.4[acm]  See reply to 7.
10.   Could you please explain the table mentioned in section 7.[acm]  [it's simply a way to summarize all results collected in sections 5 and 6.


Regards,
Sudhin



Juniper Business Use Only