Re: [bmwg] Zaheduzzaman Sarker's No Objection on draft-ietf-bmwg-ngfw-performance-13: (with COMMENT)

Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com> Thu, 03 February 2022 15:08 UTC

Return-Path: <zaheduzzaman.sarker@ericsson.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D99543A0770; Thu, 3 Feb 2022 07:08:41 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.676
X-Spam-Level:
X-Spam-Status: No, score=-7.676 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.576, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jSFNuNz0iZsE; Thu, 3 Feb 2022 07:08:36 -0800 (PST)
Received: from EUR03-DB5-obe.outbound.protection.outlook.com (mail-eopbgr40079.outbound.protection.outlook.com [40.107.4.79]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4FD7F3A076E; Thu, 3 Feb 2022 07:08:36 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=jPDtcclJcKJPhfmEuDj2wDHlAhe5KLwf8s4nQw+Y0zD8u7vYIqm+ICWPw1SEr8FKWFxEqUqG9Z+1caGPJfMnUNobgQ+RoGLiUZ9jeJCsUbfi6JX71m/fv4MX1seZeM+dkE7yR9SvyeHlupuSNo2gpsEBL3ZZef5tdsXHcYj0gpYu5qYMVLl8QVe1acEruhpE0Lnpspxe9PwNuOihpzQOSnXLhEWU+ECbvSRPBxnbSP1v6IgcFz/x94acMlWJT2/GuYh42APSTwZPJzmtby8TeMzfVmDxiTwDRuZHZuaL8VPuBngfe1OpnIq9ZJX9ekt0N1M3GKJLD2oHQUU3Y1L2tA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=GErs4m8F+Mhx70lqadQbWHgwoiXXhKd8XDsAeYbrynI=; b=ghoEQm4HJsWRPjdx1Af86bykodvX3VvSDG8aatRfZegOUYueuje2D05qVAVDpxOKBvjf5FQFe4Sr7+rrABNitibLv0g9BFD6g9zXTNvInmaLxFjPAda/049sZqAqk4dLkeX1W6YZn6KSq5S2lRCNMFCR3VGVFYS/a3NdnhwEMH3YpEOVF7BoyUWW6Dol/vzdaohdg3vF3xkXcIiupGtitdL6u2A9R9IMNvAlovnJZfCeLX1nLi/CZ075ZtQkvjdazUSqIqSuEJrzLbNvFa3FqHcYZP8DMCmHnUcG9aDOB5Xmh9oHjw+woTOBZ+NI7X+29XvR6cN3VKM3lUHAP6V7vA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=GErs4m8F+Mhx70lqadQbWHgwoiXXhKd8XDsAeYbrynI=; b=dCpy2LXoRfDBAUfVY8dca31fwoJpK76GJ7/xMaRq3L1qwYQXCWngJmn0syLKn/E2hnng2dexyHxkA9/tdJG24qN+Lh1CJub7ApHUncgaRlQTav14blHk2a6z1WbXcXg9WmKgxxC1BWXDJIsfagwJ4ANKRfPEUVCeLJY5VcVz+n0=
Received: from HE1PR07MB4187.eurprd07.prod.outlook.com (2603:10a6:7:98::23) by AM0PR07MB5394.eurprd07.prod.outlook.com (2603:10a6:208:10c::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4975.5; Thu, 3 Feb 2022 15:08:33 +0000
Received: from HE1PR07MB4187.eurprd07.prod.outlook.com ([fe80::b9ee:c838:1b7e:de61]) by HE1PR07MB4187.eurprd07.prod.outlook.com ([fe80::b9ee:c838:1b7e:de61%3]) with mapi id 15.20.4951.014; Thu, 3 Feb 2022 15:08:33 +0000
From: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>
To: "bmonkman@netsecopen.org" <bmonkman@netsecopen.org>
CC: Carsten Rossenhoevel <cross@eantc.de>, "bmwg@ietf.org" <bmwg@ietf.org>, The IESG <iesg@ietf.org>, "bmwg-chairs@ietf.org" <bmwg-chairs@ietf.org>, "draft-ietf-bmwg-ngfw-performance@ietf.org" <draft-ietf-bmwg-ngfw-performance@ietf.org>
Thread-Topic: [bmwg] Zaheduzzaman Sarker's No Objection on draft-ietf-bmwg-ngfw-performance-13: (with COMMENT)
Thread-Index: AQHYGPMwtxfM2DNxa0qjXKosPCZqkayB1HYAgAAVGgCAAACOgIAAA8wA
Date: Thu, 03 Feb 2022 15:08:32 +0000
Message-ID: <CF8FBB6E-B5C7-4E7A-8BBE-6293DA2F61C3@ericsson.com>
References: <164388856139.18110.3771380377193607609@ietfa.amsl.com> <d8129575-eac5-0851-3fad-f9bf7aff3841@eantc.de> <5C3678C5-7FBB-48FB-858B-D6F6B03315E6@ericsson.com> <2e2401d8190e$1084e110$318ea330$@netsecopen.org>
In-Reply-To: <2e2401d8190e$1084e110$318ea330$@netsecopen.org>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-mailer: Apple Mail (2.3654.120.0.1.13)
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=ericsson.com;
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 4976448c-f3f3-4760-f43b-08d9e7270b70
x-ms-traffictypediagnostic: AM0PR07MB5394:EE_
x-microsoft-antispam-prvs: <AM0PR07MB53942E5934D41EEAE821CA9F9F289@AM0PR07MB5394.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: B3sCcQziz0qW7wK7YtqfisYzLcPreFIdj2wyLc29Mrs1oi0ZwX2Fq9OJl14hLTleSQuRCRs54+qUNqSxIZRqHV99/6dOYpPkaGmTsAS7UprG7JaPZLyPORBIdQuXPLyhYleQqUqi3oZOErfBV46NtUfc4RFOSpl8NZ18dzIAlYCVixxjGk+M2e9vmme/BCxvldmaWqQ94tJ/Vnh8htWf46Hn/uOvA9xY4Gbdc2vQ77Pnkti4nxipH56BFS66/3Iq2Gjog2ZZ2vVWwrg1MS6Yr4kB44WJqkuqDq7MQ00DyBkRm6FLtD7rKn5hR/hjafSgXFTHIfi/OGjAGZYZK2sq23kJ5fts22WsA9RkOSWxshfuBAuL5KPCN0rB+PzvQFlY1uwU7VqBAZjdtYAa7ybhx+rPGzyEb5OEwLg1nJJnJp40FH9ZdzwwEysTdH+p9qSO8gv4BMyZvPWK/BhBvsGXMABzNT1zUufgsLuOE2ePHHmLPWtyKY3eCxMyIDpKtJnDocBcf3oA0d5k0cVNlPm4jYKwWlCFcYdzRch9DUvxXwtOmCyYj4y3Uoh4oMuOhvondJxKamKBLtHvMJyun0lWacgX1IQpW8OTqTLJcq3HhG7RbmtCmsLw6fBERV70fUIiR/qWRMa3Xm6FopDL4Lkpr0HunG7P2nGais5Sj2txGqvUMqKQB9Dd8Y5vGTozhwhq4cV5zWekxAk1z51nJggXHwP8VyQR+4X69ECFcNeaAvkbmkFOG/YIlhe3NdJEC0oyy48BtidaK6TzGvtOnTT7koz73bcTU+Q1Epm5+XvnfkwykfTLdjIlIV1bZAqOJmI1+LKdxSQBoA+WkmWan0ji3Wp4qyI+5kvgBZNqPLsw1bCryD7oWammTddkA/Oa7YNcoaGC3br4d/Za1I+90xF79gfGHt6BjmxKz7LhZVNUQb0=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:HE1PR07MB4187.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230001)(4636009)(366004)(53546011)(8936002)(8676002)(64756008)(5660300002)(76116006)(6512007)(91956017)(66446008)(71200400001)(316002)(4326008)(66946007)(6506007)(66556008)(66476007)(186003)(26005)(966005)(508600001)(6486002)(66574015)(83380400001)(36756003)(38100700002)(82960400001)(6916009)(38070700005)(33656002)(86362001)(122000001)(2906002)(54906003)(44832011)(2616005)(166002)(99936003)(45980500001); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: WLvxbcSNL8qLQD2m+yc/GjOPJcrrWXXuScObsSm4oBSD3/kiZSLKRyQnWmre0qVsd5vczqwM17TmWVDJcM5f8WwexKZNIdORjZoYksszpNPvWYfJTcnQlMPCdRuoATSYaDpQOvVXs8sWvkGZvijIEAHKeDw0I8eaFTQmeeOJ5tU6P+ItBQ+wvyqAbuysjxHaSW1mNT554Vsbk3JxEbKd1VitSwMEqKa42lI+yQMQTOjbV2JzP3SAvCKKJzNuU6k0FW3h848nkd1q0S6+tiDqNPBNr0F7tt2L58ayuo+vnInfpgGAkxAdF0s3nK4UwTDkMpLd5VQpRxS3la6NdZztNd9B8nFChC46jzusFSEy5hgpjRyLWwwATWSNylEVhK7TTF6Xxul7IS0bLBIcwPVa1AzUiWe96dPJUr05t+q+BJoaBWb95bNpaOEuTjUReYuboIKX8A0OFUabX7OgpLU0FC1bXQsQZdiIFpM1NyUgAkqhoTAYZ5h6bk/kIvRohtwH9kVSqva2kUJpJaXszBIlmMHqiJDzEt0elJ65rq+/zATURz2+svCYRYqkKFXVxntTrPJoBaRLkhckH90nTsGxrLlfisYgvmeKCdrx3R0aXQvA4p8CD3esK5ZvzNgBr4AlyACoQhhHr3+FhSjRrJYYbNCTWkUMBmyTDIX2Pw5Qu1lSEmHnJG/0sI3IoWH2f8Aui4SR+u8mpeamL54C2/OEWHGzpProXedT2N3bqL4LlmQy9R991eyFK/mzmsU5haRqeERH6YtxnfUbP7ecT39OG2fB3l6H/J73u68cowBHrLTpdBqaeOd+A6e00wLPWMvRn9RNsCy87dtxrksW8xeZsWeQVYesL+w32gzmCfNBwcboET2MHv1IuWqNRU8XFxzomVlBCu7frQ8i/BUeFjV7TnNtcuzppIlFcAL/UGqa2yTa+1CuDyJBIhKYszjmSuD1vQHW1vCd4iMkIjmWlwxOVUP+20YUaAWqTiQ/+l4d7ogYgPe1CTAJnt5agyWWXDV0RD08CC/XAyB40ZX1sl89/Va37v8NV232hszZbJoFupfYPe36nn7oGfkt/Vm38yemzreAPC3+kkG7EfrgQoxwO/VZ4NeHR0TSOjLjbzIBhs5k9HWYuWCJ1YgeMIT2+5nHj9chL5Kb+qnoQGNHvg58HUgJ0I0NlOFs2JiaZO4NJ9wHhU7us/Ly/Fl2l0v+eoAcY1IKEuRsNDcAS6UuLx0WuCbTKu1w/Gx/1Q2Wb43zn67R4QAdeLc+a01ouoImz626QQHMdKC4JuwhhucShED64Q/cH3KbFcTWCNCIGxGO/yIMO1dN2nggHUeUyskAKGJbQVFNSOU4OTgzJ4KVTXssyQZ+qtpRHZjiDj/m26BS6802CDH0j0ooiMRaI58LJV0fKAhqvHUaB48t1HyopgDlxKyzrSGuAeX/I3EDeTMSlt90/XUNv6GkGQGO43zkuvhkXV+g5QVbIJwTWauskVm8ixQzMI3EAezAX0sFaE+K7ETbOiPxIZq4ucLFaoWJj9gIQ39BMG6V6Jhb+AWRdy8GkGPAqi4IzCrrLDWFRXovAtpTBAk3EU3n+/peOoUnfEwo92j3u88GUUWQN4lSBG3TmO6CoITdxid1kBB1lNJPlKQFyUX/26hxB5mdEtM1A4gjYyavauX6pXc2OSj6DYbr6D2E2WnKiq2lUqKFGjWiwaQ4/7ck15w+zKdQUHpmVQ17MO4X3NHeyJxShCiM4Ia3BA==
Content-Type: multipart/signed; boundary="Apple-Mail=_BB9BF6D4-5489-4287-8952-C8878C8ACEA1"; protocol="application/pkcs7-signature"; micalg="sha-256"
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: HE1PR07MB4187.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 4976448c-f3f3-4760-f43b-08d9e7270b70
X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Feb 2022 15:08:32.9922 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: zXujLN1EckzkMKxK7OLKLAHkHyM3sRRsgxK7O5qB65yD/yBYOf1T3m0Qlmtyu7bWxCd3l+ifQJSWFObM4m2OWNbTSiMtuUujDVtKFjhpHOha++1NauPdcWLq7fg7/1X1
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR07MB5394
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/xgH5Vg8vT-34t9rknGYE0N0tcf8>
Subject: Re: [bmwg] Zaheduzzaman Sarker's No Objection on draft-ietf-bmwg-ngfw-performance-13: (with COMMENT)
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 03 Feb 2022 15:08:42 -0000

Thats a best case scenario and a fine request only. If you have immediate responses then will be great to respond as quickly as possible but does not need to resolve all the comments before the Telechat.

//Zahed

> On 3 Feb 2022, at 15:54, bmonkman@netsecopen.org wrote:
> 
> We were asked to respond to any and all comments as quickly as possible so our AD would be able to speak to comments/objections knowledgeably. This request made total sense. 
>  
> Brian
>  
> From: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com> 
> Sent: Thursday, February 3, 2022 9:53 AM
> To: Carsten Rossenhoevel <cross@eantc.de>
> Cc: bmwg@ietf.org; The IESG <iesg@ietf.org>; bmwg-chairs@ietf.org; draft-ietf-bmwg-ngfw-performance@ietf.org
> Subject: Re: [bmwg] Zaheduzzaman Sarker's No Objection on draft-ietf-bmwg-ngfw-performance-13: (with COMMENT)
>  
> Hi Carsten,
>  
> I think you already got the information about the process and link to attend the Telechat in conversation with other ADs. Anyway adding the link to the process https://www.ietf.org/about/groups/iesg/statements/handling-ballot-positions <https://www.ietf.org/about/groups/iesg/statements/handling-ballot-positions> 
>  
> No, it is not expected that you need to respond within minutes just before the Telechat. 
>  
> Take your time and let me know if you need further help on this matter.
>  
> BR
> Zahed
> 
> 
>> On 3 Feb 2022, at 14:37, Carsten Rossenhoevel <cross@eantc.de <mailto:cross@eantc.de>> wrote:
>>  
>> Dear Zaheduzzaman,
>> 
>> Thank you for your comments.  I am getting a bit confused by this process - is it really expected that AD/IESG reviewers post their major comments hours before a decision is going to be made, and the authors have to try and rush responding within minutes?  I apologize that I am unfamiliar with this process.  In other SDOs where I am active, there are typically well-defined, reasonable deadlines and review/response intervals.  This does not delay standardization but improves its quality from my point of view.
>> 
>> We will respond to your other comments soon.
>> 
>> Best regards, Carsten
>> 
>> 
>> 
>> Am 03.02.2022 um 12:42 schrieb Zaheduzzaman Sarker via Datatracker:
>> 
>>> Zaheduzzaman Sarker has entered the following ballot position for
>>> draft-ietf-bmwg-ngfw-performance-13: No Objection
>>> 
>>> When responding, please keep the subject line intact and reply to all
>>> email addresses included in the To and CC lines. (Feel free to cut this
>>> introductory paragraph, however.)
>>> 
>>> 
>>> Please refer to https://www.ietf.org/blog/handling-iesg-ballot-positions/ <https://www.ietf.org/blog/handling-iesg-ballot-positions/>
>>> for more information about how to handle DISCUSS and COMMENT positions.
>>> 
>>> 
>>> The document, along with other ballot positions, can be found here:
>>> https://datatracker.ietf.org/doc/draft-ietf-bmwg-ngfw-performance/ <https://datatracker.ietf.org/doc/draft-ietf-bmwg-ngfw-performance/>
>>> 
>>> 
>>> 
>>> ----------------------------------------------------------------------
>>> COMMENT:
>>> ----------------------------------------------------------------------
>>> 
>>> Thanks for the efforts on this specification. I have been part of writing two
>>> testcase documents for real-time congestion control algorithms and understand
>>> getting things in a reasonable shape is hard.
>>> 
>>> I have similar observation as Murray and Eric when it comes to obsoleting the
>>> previous specification. Hence supporting their discusses.
>>> 
>>> Some more comments/questions below -
>>> 
>>>   * Section 5 : what is "packet loss latency" metric? where is it defined? how
>>>   do I measure?
>>> 
>>>   * Traffic profile is missing in all the benchmark test which is a MUST to
>>>   have. If this is intentional then a rational need to be added.
>>> 
>>>   * Section 7.3 and 7.7 : The HTTP throughput will look different not only
>>>   because of object size but also how often the request are sent. If the
>>>   requests are sent all at once the resulted throughput may look like a long
>>>   file download and if they are sparse then they will look small downloads in a
>>>   sparse timeline. Here, it is not clear to me what is the intention. Again the
>>>   traffic profile is missing and I am started to think that Section 7.1.3.3
>>>   might be part of Section 7.1.3.2.
>>> 
>>>   * Section 7.4 and 7.8 : I can have similar view as per my comment on Section
>>>   7.3. This is not clear to me that only object size matter here on the latency.
>>> 
>>> 
>>> 
>>> _______________________________________________
>>> bmwg mailing list
>>> bmwg@ietf.org <mailto:bmwg@ietf.org>
>>> https://www.ietf.org/mailman/listinfo/bmwg <https://www.ietf.org/mailman/listinfo/bmwg>
>> -- 
>> Carsten Rossenhövel
>> Managing Director, EANTC AG (European Advanced Networking Test Center)
>> Salzufer 14, 10587 Berlin, Germany
>> office +49.30.3180595-21, fax +49.30.3180595-10, mobile +49.177.2505721
>> cross@eantc.de <mailto:cross@eantc.de>, https://protect2.fireeye.com/v1/url?k=31323334-501d5122-313273af-454445555731-5a55a80d61bce799&q=1&e=f53f20d7-64b0-45e4-bc0b-f671e58f8c68&u=https%3A%2F%2Fwww.eantc.de%2F <https://protect2.fireeye.com/v1/url?k=31323334-501d5122-313273af-454445555731-5a55a80d61bce799&q=1&e=f53f20d7-64b0-45e4-bc0b-f671e58f8c68&u=https%3A%2F%2Fwww.eantc.de%2F>
>> 
>> Place of Business/Sitz der Gesellschaft: Berlin, Germany
>> Chairman/Vorsitzender des Aufsichtsrats: Herbert Almus
>> Managing Directors/Vorstand: Carsten Rossenhövel, Gabriele Schrenk
>> Registered: HRB 73694, Amtsgericht Charlottenburg, Berlin, Germany
>> EU VAT No: DE812824025