Re: [tcpm] [EXTERNAL] Re: WGLC for draft-ietf-tcpm-hystartplusplus-04

Yi Huang <huanyi@microsoft.com> Tue, 17 May 2022 02:05 UTC

Return-Path: <huanyi@microsoft.com>
X-Original-To: tcpm@ietfa.amsl.com
Delivered-To: tcpm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 71E7DC079B58 for <tcpm@ietfa.amsl.com>; Mon, 16 May 2022 19:05:53 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.883
X-Spam-Level:
X-Spam-Status: No, score=-0.883 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.575, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, PDS_HP_HELO_NORDNS=0.998, RDNS_NONE=0.793, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=microsoft.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id QIsFKkAwzVdR for <tcpm@ietfa.amsl.com>; Mon, 16 May 2022 19:05:52 -0700 (PDT)
Received: from na01-obe.outbound.protection.outlook.com (unknown [52.101.56.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2631FC079B57 for <tcpm@ietf.org>; Mon, 16 May 2022 19:05:51 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Xs1JyU8Wlk3gYHXHjWtjr5BlgI3TK5iaZ/ngZzDT6UuN6oUHo8IQT2t5JdPXiR94NbDjcd437Jl/WqZKWLgelwI8jaDWW0Bw+6qNvIbLhJXE59TehGjEWUMSOepfEqrsvXR1TXBk06Q5En9mBjE7bxGft9aPUky0LwZTliyLi0GdRoWNdY71xI87a1U4c5ob86noz+fnLQ5/vvTd6uT3JKsM2sLtEdlRKrJE2qko8MvwYrWIebbpL1NBgcTF6jcr9yr5oyErRS9X9wlp6qmCmWyzgS5VglXUQG9ltBDkqVSipjjHoXiuF+WBbusTBxfp71Yx3bo7XLHT6yBgLNC6Ag==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=26uFf3XbeZPlEmdMtt1mMDSNWCQB0UKVYZquhBQ2+Js=; b=nH/dyJT9A3JQ3pqbG/MkZRdQ2NMim5kiEU8lEzMTJAsTqxNxNt/IC1tbcQn67fMnR3YPdaH86WKqwGJ+hZcLgxfLVIAFFFx7nq2FwzsL5DLj+eaZI6bT6u72hj661hzutVLfB/xbqutbOFbcOhkhRv26Sve4GI6uW69oXeloegJWyvh1zTadnfBN1pcd+wJNGM1e6XdW9+SK0Im70pQhcuYBe/93Y0WgkiZVwK2iYcgX1ha0d8rNBatQX8soY24i0Isr42DrGNmb7pplutaxfedReUV/EBLyeWpfpZpR+wa45EzA+/tDSG3motMncD+glbbMTHdlKk8KdQ86YONZeA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=microsoft.com; dmarc=pass action=none header.from=microsoft.com; dkim=pass header.d=microsoft.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=26uFf3XbeZPlEmdMtt1mMDSNWCQB0UKVYZquhBQ2+Js=; b=MlTep00ncKhDdJALS2Mbhjdjf2rJ/crkP8U7rIaN6u6USFUkf7WfAZse07b9aS6DNiFXyi4QiqSwpAiELQZ7upMKsFjDDOshhH4baS5S6GI7wBjcb2VXe68kNdAILBzyE8q/tMZaBr+NhC4LDDS763mV9xHptie6wUONgMA246U=
Received: from SJ0PR00MB1335.namprd00.prod.outlook.com (2603:10b6:a03:3ff::13) by DM6PR00MB0857.namprd00.prod.outlook.com (2603:10b6:5:21c::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5307.0; Tue, 17 May 2022 02:05:48 +0000
Received: from SJ0PR00MB1335.namprd00.prod.outlook.com ([fe80::b511:59a3:aecd:aa38]) by SJ0PR00MB1335.namprd00.prod.outlook.com ([fe80::b511:59a3:aecd:aa38%6]) with mapi id 15.20.5307.000; Tue, 17 May 2022 02:05:48 +0000
From: Yi Huang <huanyi@microsoft.com>
To: Reese Enghardt <ietf@tenghardt.net>, Michael Tuexen <tuexen@fh-muenster.de>, tcpm IETF list <tcpm@ietf.org>
Thread-Topic: [EXTERNAL] Re: [tcpm] WGLC for draft-ietf-tcpm-hystartplusplus-04
Thread-Index: AQHYWmNRpk+L+U9hbEa0wH1zDGGBLa0iSbtA
Date: Tue, 17 May 2022 02:05:48 +0000
Message-ID: <PH0PR00MB1330C5B35B4A423BC6803082C3CF9@PH0PR00MB1330.namprd00.prod.outlook.com>
References: <66261F55-7780-402B-954E-6D7A1AB3F3C5@fh-muenster.de> <d0f7da2b-6e93-c6f0-1418-f59053a14118@tenghardt.net>
In-Reply-To: <d0f7da2b-6e93-c6f0-1418-f59053a14118@tenghardt.net>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels: MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Enabled=True; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_SiteId=72f988bf-86f1-41af-91ab-2d7cd011db47; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_SetDate=2022-05-17T02:05:13.669Z; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Name=General; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_ContentBits=0; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Method=Standard;
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=microsoft.com;
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 80fef8a9-4d53-4934-1476-08da37a9c2c1
x-ms-traffictypediagnostic: DM6PR00MB0857:EE_
x-microsoft-antispam-prvs: <DM6PR00MB0857ED4D9589EF4D19C2D417C3CE9@DM6PR00MB0857.namprd00.prod.outlook.com>
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 2vUMhKQafHwxtEvcOahsOYLPGE52Tzc/H3rm41YVwB6OuJGCTiMGwzM5cjPe4xPFHUh1r7FGssBl0g59X706Qhz1Jf67L9KObF0MX8FGUb1HNmuW/gQ/1hDnci7YIzrJ62YkY/hTPBc+5mPAKxPFnfQvA7q1bcjdyhS/EyCn5kV3dBTJEkPLL5LmSNWuwdBLDxWzjiziMB3H7LRkRjqmQDww3FSgXSCcRiYC1SXEkovDlUL2XC1u9QeZ/Mjelybmo4fZUiAWKiqp5GEEHbAdBxMw6OKjO5yp5EjSL9t0xMYWVFBj4Snw/VkPlBrhypi90/et+N7ZVj8jnAfp+vsh1dFMRxGWl6Bs0Q9TCiJfUIpw8fA59seEIcVErffm6KETWI5ciTVan7Vf+Ao0qvGlX5aDFflGW+oAsBu+136d+n51856e7JKXVReOAMBk1SzQcpwVEdbUKCHkxeq8Twj08aNuCdODIioE9lAICJ8nEnLTqhMkkUQi5FVTgQJrCJ2IxOEDrQn05veB/5+QWQ8G/Xp06DYOfLBcFXEoApxFmpW8ZTKkbmN++0vcPzg1aLfSl/QbNjCJyeIdo0/oRWbEezN1TchNqQ3K2KqbjuwXt2HahYiB58hpVSgF4AE610+Zg92geFVzgUImzQp+THE7WWP74NvTcFUKbDue7DgC9mnb2IycQKlHCi9T1jg1DOEZw5JJTrnYYcr9xWKog9N8VchFizMRvBW2Brhkb98r9+DOnVQzUWXXGB2g3waA7TFF+4ARRHGBlvU2Qk6JbSkL5GllYtUTgVA6G5MAtYxL6DIIFVfUUTNMRoboOM3vBuNG+c01Li3U5yAPa7/QGun28A==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SJ0PR00MB1335.namprd00.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230001)(4636009)(366004)(451199009)(66446008)(186003)(6486002)(8936002)(19627405001)(66556008)(66476007)(76116006)(10290500003)(64756008)(52536014)(6512007)(9686003)(83380400001)(8676002)(33656002)(5660300002)(66946007)(6506007)(86362001)(53546011)(38070700005)(82960400001)(8990500004)(110136005)(508600001)(966005)(71200400001)(2906002)(82950400001)(166002)(38100700002)(122000001)(316002); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: 7LjKiu26MU9sYS0ms7Yzl7yDc9S1s5rA7pnf/VFV8onCNHwugJJKOX3y93vZaCXbp308KkdnjA49ZimO3iUUQhG5gSoA/sJzadrUMgb5kVQcd6JoVc2FLQsJa2p7OIUOJNfJllStNRJKM2787VFsFCY1MHYydqf17EahkW6ZwhCi3UrrwT13fGVaHmY0PUKJGRK64VojpFUCuSu9jNwcpw2TOAGOitZ1+t6jWSHLCgQejlyCr8dYjyYovEU2tF709kuXXOkppDgXZnnmcN6z3QQdNuKtTT453Fu0R/ijTbVQM6tN8JGp+UCcrJMNLZZ4EcwPS82tMLfwyxHTdUloAOe6vroe9x7d2elZpS1f9TJ2eQm6D64uytn9UbIUlgiXpoq/6koGQTestiYcV/9kPWrm17U+S4j3QsoH6QPB+OXbM7m+3cMeV4KDBKM2QnUeEfHXKo/TyU9vX2hz7FcAFpirs4VkVugqPipSozAxmj2f4iuLTLQmHV0rpnWzyuvx7/FJMn0wsgcs1WuloAuhDMVTW9mM5spVE1iviez9ODppsHTiUb9CRghL6/GtD/5GuamQkK+ESG8tDHGCTtt3zKa///JIfFRRU4YF4MQ6V3vcKgo4k1MAs0vQMddnhW0iQzgsn19n/oLOlPFK+AXZbAcPvg+XqWFAdEFrtLJb1LMI1sxWw6VMN+8h0MzFNf+znhe0In1yaKQiUjTwex5JL2OwcSvOJDpjgL6iYs2PAWaOnbgE3hFaSGK9/CPtlroTlK/2sJwPAmymkCGpiQ3kWRUCaKx0Br0Kymasvh8NDuayW7XtMmmMjemd4AFKPaKw3toJRe0xOjdEdLGp1E6A97jLNGKBRI6UZtUTWB6H7l5WVHmdxz3sfU9k5eD/tJy21IRTFF2Wvw6BZ8BytHetA4zG/KpgoOIigbkANFmC1Y0DOLbtkLWctIm4NUjj8IibjMJqPow7Yxnl3ngZ3ELA6PKXGhjogpxMIj4gh47IAFzq/rsL85UTFazvbx9j2SHcJ/yk3eBfouylaj5ehNZlU8Zu75szsSqovug+/qyLIM0amNKqtO8uImYeJ6CH7asRoWVgsqmdq1/L+oSlbyvL8OyCb/fDbi8gaLL9h+fKnjsBvkTcIMsUZfB4EhiMzNZYafF6tIO8CCtI1usk8a7f/42/z4oXH3eUnP3Jn0oFZ/ylv6l1k1x1VepzJt2+xm+dVRCT43dwX2YGq3IaQB1mqaFLq/IJcoMMCkxGV2cOQQQxcq/iwU/C71yKuXC5G4tzpaqEsWj75b4xV79ZMHPQ+hM+ENK9Wx39TQWsc8hcXU3qBGLpr/LMKjTrn3VNmT2EgwEUKqbq5XFmgi581t+rlZQnzJBhaExWyRbJmBywZua0tsccopJqiqOmdSpNbsZetqi/uIYfIFCRjen1O2AR4jnYN8jExI/SaeJ/Q5grajdTo9EVx/eJYRVoQ/nEMWwhueKlVNzakbRMFxdt/I9lqNVcwunRKD6iu9Ro8DNWdZtopHpIshq4y/N1igo3/dIAxIioIPeg0xPMSrUbHSsz0HQVdhi8q35QtYL74RnpZfEuEanrtl7WpDQIOT4D5xwwZgTTrkPO2ifNNtgqv/Sb2MnM3LD7L3uenPqWmA4O6T528p11r6PgX99PCcSD6PMv6KZ0b7WnaBPrIFLmsMGBBb3da0Hk5YZpMTlwTlKQZlDz8qz4KttsdGjmynzY5clQ2CXzQdx9RnNhOeeyZAfz7Q==
Content-Type: multipart/alternative; boundary="_000_PH0PR00MB1330C5B35B4A423BC6803082C3CF9PH0PR00MB1330namp_"
MIME-Version: 1.0
X-OriginatorOrg: microsoft.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: SJ0PR00MB1335.namprd00.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 80fef8a9-4d53-4934-1476-08da37a9c2c1
X-MS-Exchange-CrossTenant-originalarrivaltime: 17 May 2022 02:05:48.1931 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 1/9AC1Gv1MXCFjYUd40BC7gM4k1eiusGzCvEiQ+OlwUb9GTY60y/aURk3PsAT/41RjZGK/ubk2+/E7cPmzqAGw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR00MB0857
Archived-At: <https://mailarchive.ietf.org/arch/msg/tcpm/8_CB7YtrXxoF0srNJC8sb5fvSsU>
Subject: Re: [tcpm] [EXTERNAL] Re: WGLC for draft-ietf-tcpm-hystartplusplus-04
X-BeenThere: tcpm@ietf.org
X-Mailman-Version: 2.1.34
Precedence: list
List-Id: TCP Maintenance and Minor Extensions Working Group <tcpm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tcpm>, <mailto:tcpm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tcpm/>
List-Post: <mailto:tcpm@ietf.org>
List-Help: <mailto:tcpm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tcpm>, <mailto:tcpm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 17 May 2022 02:05:53 -0000

Hi Reese, thanks for the review! You can my answers inline (noted by [Yi]).

________________________________
From: tcpm <tcpm-bounces@ietf.org> on behalf of Reese Enghardt <ietf@tenghardt.net>
Sent: Wednesday, April 27, 2022 11:18 AM
To: Michael Tuexen <tuexen@fh-muenster.de>; tcpm IETF list <tcpm@ietf.org>
Subject: [EXTERNAL] Re: [tcpm] WGLC for draft-ietf-tcpm-hystartplusplus-04

Dear Michael, all,

I have done some testing of the FreeBSD implementation with NewReno, and
I have also read through draft-ietf-tcpm-hystartplusplus-04.

The document specifies Hystart++ precisely enough for me to understand
how it works, and I appreciate the brevity and clarity. I am in favor of
this document advancing.

I do have a couple of questions/comments, which I would appreciate to
see considered before publishing the document:

First of all, I realize this is TCPM, but is it still worth adding a
statement about the generality of the mechanism, as Hystart++ can also
be implemented for other transport protocols? Is Hystart++ expected to
be "compatible" with all congestion control algorithms? Please consider
adding a brief statement to the Abstract or Introduction.

[Yi]:
In my understanding, only the underlying congestion control algorithms matter.
If a CC has slow-start stage and it's window-based, then I don't see a problem
integrating Hystart. AFAIK, Hystart++ has been implemented by Quiche
(cloudfare's QUIC implementation). So, it at least works with QUIC.

In Section 1, it says "HyStart++ reduces packet loss and
retransmissions, and improves goodput in lab measurements and real world
deployments."
I think Hystart++ could potentially also help reduce queue delay for
some congestion controllers and a non-AQM bottleneck, is this correct?
If so, I think this point would be worth adding.
Are there any published testing results and/or more details on the
tested setup(s), network path conditions under which Hystart++ has been
tested, etc, that the authors are aware of, beyond the existing Section
5? If so, please add links to them here or in Section 5. Please also
consider adding a forward reference to Section 5 here.

[Yi]:
Hystart++ can potentially reduce queue delay because it mitigates
overshooting during slow-start. We tested Hystart++ with CSS (draft version 2-4)
on emulated networks that have latency jitters and from our lab resutls,
it outperformed Hystart++ without CSS (draft v1) and conventional slow-start.
We have not added this to the draft yet.

In Section 4.2, the document defines "windowEnd as a sequence number
initialized to SND.UNA". Why SND.UNA and not SND_MAX, i.e., the highest
sequence number that was sent? (I think the FreeBSD implementation
initializes it to tp->snd_max, which makes sense to me, therefore, I'm
wondering if the spec should say the same.)
I think initializing it to SND.UNA would still work, as SND.UNA would
probably be acked soon and then windowEnd would become SND.NXT. But in
my mind, it seems like this adds one very short round at the beginning,
perhaps unnecessarily. Please let me know if I'm missing anything here.

[Yi]:
Great catch. You are right and I double checked our code, and it turns out
we actually initialize windowEnd to SND.NXT. So, this is a typo.

For Section 5: Are there any particular network path characteristics for
which Hystart++ (with the recommended constants or others) is expected
to perform particularly well, or not so well? Are there any results for
higher capacity links such as 1 Gbps, any results specifically for
mobile links, etc? Please consider adding citations here.
If you are aware of any findings along these lines, or any guidance on
how to tune the constants in these cases, please consider adding a few
sentences here or in Section 4.3.

[Yi]:
Theoretically speaking, it tends to perform better when the bottleneck
buffer is deep. The algorithm relies on sensing RTT change, which is apparently
easier to build up on deep buffers. On shallow buffers, I'd expect Hystart++ to
perform as good as conventional slow-start. Regarding high capacity links, our lab
tests focus more on 100Mbps and below but we also tested 1Gbps and we saw
similar results. We will consider expanding Section 5 to include some lab results
for links with latency jitters and 1Gbps.



Thank you.

Best,
Reese


On 4/13/22 13:18, Michael Tuexen wrote:
> Dear all,
>
> this e-mail starts the working group last call for draft-ietf-tcpm-hystartplusplus-04.
>
> The WGLC runs until Friday, May 6th 2022.
>
> Please send any comments, including indications to support this document,
> to the TCMP mailing list by then.
>
> The ID is available at
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ietf.org%2Farchive%2Fid%2Fdraft-ietf-tcpm-hystartplusplus-04.html&amp;data=05%7C01%7Chuanyi%40microsoft.com%7C2a0c7cc616e345ad550708da287a6858%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637866803621871696%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=xlAH1SZUPdinz7tBBQ9%2Bhsf7d%2FVst8jDEWJb9BCeOy8%3D&amp;reserved=0
>
> Best regards
> Michael
>
>
>
> _______________________________________________
> tcpm mailing list
> tcpm@ietf.org
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ietf.org%2Fmailman%2Flistinfo%2Ftcpm&amp;data=05%7C01%7Chuanyi%40microsoft.com%7C2a0c7cc616e345ad550708da287a6858%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637866803621871696%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=xVSMw2YZI5TdiRbpjR4ybTUVFcoaT4ivZwsLBJP%2FPG8%3D&amp;reserved=0

_______________________________________________
tcpm mailing list
tcpm@ietf.org
https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ietf.org%2Fmailman%2Flistinfo%2Ftcpm&amp;data=05%7C01%7Chuanyi%40microsoft.com%7C2a0c7cc616e345ad550708da287a6858%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637866803621871696%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=xVSMw2YZI5TdiRbpjR4ybTUVFcoaT4ivZwsLBJP%2FPG8%3D&amp;reserved=0