Re: [tcpPrague] A Congestion Control Independent L4S Scheduler - TCP Prague preliminary results

"De Schepper, Koen (Nokia - BE/Antwerp)" <koen.de_schepper@nokia-bell-labs.com> Thu, 12 November 2020 09:35 UTC

Return-Path: <koen.de_schepper@nokia-bell-labs.com>
X-Original-To: tcpprague@ietfa.amsl.com
Delivered-To: tcpprague@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 995603A1531 for <tcpprague@ietfa.amsl.com>; Thu, 12 Nov 2020 01:35:01 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.901
X-Spam-Level:
X-Spam-Status: No, score=-1.901 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id rvFIW6HIJHJ3 for <tcpprague@ietfa.amsl.com>; Thu, 12 Nov 2020 01:35:00 -0800 (PST)
Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-eopbgr80107.outbound.protection.outlook.com [40.107.8.107]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 6EE283A152F for <tcpprague@ietf.org>; Thu, 12 Nov 2020 01:34:59 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=i++oZs7p3pUeh7sneDlC5GuFlokEUzZ6OZBkINHdYnYGjwZvRGW/jWtxq/ri8IRJEOxcCfXjbbtNVBLIN6Uc1Uudbq5L2IYpl8oPBJ3qDWM2ntXdYDuooXj4ZTLO3HtyNbquz4QbMitTIbj6zjqGNMDqRNeU1BTGshnMRqDxF497VamN3oXNiWAe1WHRIDb6yIbAninHLpeV6v+szPcrEMtka6NMjBYLAwkdhGFqvqz7shx65yEZFNiL0xpSjAII+SliPLcCjaHMnc0qP9MRJnfb8CT64TjbHIHVVBCoo7L8+01JwMlfAXCQYBTRRLbLG7Lw7ua5qoYv+vvOYNfefQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=yotiCwPl9ozylo2VHiv9Z2eGDWfbcfEwDJBNmyebOjQ=; b=kZfsol4cAUXLqACrxtwNJSrVr1rRLEmQj1bCR0OcX+ukg3I2DHo4TDhYi9sT3NBwFTvax95TicXClt51qOuAFrEDlW8IcQ7XINeluLRU9MfxypXMokaXcWaoSz/9UNKTNgRcDoq9+ECZfAUrdLx5/SOUblNTVl6W19BAu7pGnZxYruiz7RaNL9nDLrQXVNF4VRYDBCO2dsLaBSdbiI1cnxID986LXOYdoZ1x6M8NolDnXETSu3DRnxwyPltAfjfFvMURkFWn7ENjwdjQDf67XlHQbLtbhirITDab5D4DX7S8mDAa60ftEb4Lh7nFi8FG5EboiUQ5r+VAWAAGP3OtBA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nokia-bell-labs.com; dmarc=pass action=none header.from=nokia-bell-labs.com; dkim=pass header.d=nokia-bell-labs.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector1-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=yotiCwPl9ozylo2VHiv9Z2eGDWfbcfEwDJBNmyebOjQ=; b=C9JTF7I3FAVvES5LMoEkgxKRgxrOYygKZpYI3HF9aD5xD68h8HzniAVV77BMIdtpRs2xXgnkxdDf+t4C1/Rghl3uq8cprRR8TMvTdDuX0wBxYlZwBf9K5CYiJJ80VY4mdtnHKSJV3Sx4PTsN7IBlLD0Zljuy0U+JQovtNuPh+2g=
Received: from AM8PR07MB7476.eurprd07.prod.outlook.com (2603:10a6:20b:24e::12) by AM0PR07MB4227.eurprd07.prod.outlook.com (2603:10a6:208:b8::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3564.15; Thu, 12 Nov 2020 09:34:56 +0000
Received: from AM8PR07MB7476.eurprd07.prod.outlook.com ([fe80::e966:7a41:b22a:1560]) by AM8PR07MB7476.eurprd07.prod.outlook.com ([fe80::e966:7a41:b22a:1560%4]) with mapi id 15.20.3564.024; Thu, 12 Nov 2020 09:34:56 +0000
From: "De Schepper, Koen (Nokia - BE/Antwerp)" <koen.de_schepper@nokia-bell-labs.com>
To: Szilveszter Nadas <Szilveszter.Nadas=40ericsson.com@dmarc.ietf.org>, "tcpprague@ietf.org" <tcpprague@ietf.org>
CC: Ferenc Fejes <fejes@inf.elte.hu>, Gombos Gergo <ggombos@inf.elte.hu>, LAKI Sandor <lakis@inf.elte.hu>
Thread-Topic: [tcpPrague] A Congestion Control Independent L4S Scheduler - TCP Prague preliminary results
Thread-Index: AdayBknBddpo1c1ATr20xSsm+1eksgGzRlkA
Date: Thu, 12 Nov 2020 09:34:56 +0000
Message-ID: <AM8PR07MB7476F8110C025D0F8855B960B9E70@AM8PR07MB7476.eurprd07.prod.outlook.com>
References: <AM0PR07MB39533753D400A496BD46CB588B110@AM0PR07MB3953.eurprd07.prod.outlook.com>
In-Reply-To: <AM0PR07MB39533753D400A496BD46CB588B110@AM0PR07MB3953.eurprd07.prod.outlook.com>
Accept-Language: nl-BE, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: dmarc.ietf.org; dkim=none (message not signed) header.d=none;dmarc.ietf.org; dmarc=none action=none header.from=nokia-bell-labs.com;
x-originating-ip: [2a02:1810:1e00:cb00:210b:63c2:20dd:546d]
x-ms-publictraffictype: Email
x-ms-office365-filtering-ht: Tenant
x-ms-office365-filtering-correlation-id: 14d15210-7f4e-4471-74bd-08d886ee3753
x-ms-traffictypediagnostic: AM0PR07MB4227:
x-microsoft-antispam-prvs: <AM0PR07MB4227B75E4799F23586A41B56B9E70@AM0PR07MB4227.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: umlXaIcrYmMCxXXB15N3NhQicioWcyFTl4PKEJc7/iQGWrlnucP8h9i+hWgmQ2tRt8WnMaFjilrx+Kngh48hSaTd2UyWkkYt8MeFW/RHqnKaMnn9rMqdTJhKQGVlRPvZgNN0ihZLIzlGVLQ8Ws0JA1rcE8aUtAXaV9RFQMixhUHs/Fa/6AIeSeYJRSXb2HsrMMIriRvqSxh0am7NhDeu8vzXsHxadDsSDGvhwc4TY9ehex6GOm7Xly3L3aAcCzHjqOTPVmeEonBAAvyPIrzthoJmkh0Pg1fLsth6dh6/0dNA/uIFM2SzdW1rpNI/291h4Y1pC0OFSWsnEm8im1ati9BSL2N+f04W2BMIwyH0Aqob5dbN5hfZXR9kFSTUReYIq5/3b92SmLyiq/8fBE3McSElDK+VSCPMI2reYwgf5lLbjctpzVbgZO7/9wMpddEm/X/a3usQ4aPXaW6NXRdOMw==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM8PR07MB7476.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(39860400002)(136003)(346002)(396003)(376002)(366004)(33656002)(8676002)(66556008)(316002)(83080400002)(9686003)(66476007)(55016002)(7696005)(5660300002)(83380400001)(9326002)(4326008)(66946007)(166002)(76116006)(966005)(66446008)(6506007)(8936002)(186003)(52536014)(71200400001)(53546011)(2906002)(86362001)(478600001)(110136005)(54906003)(64756008); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?uPgHJV7RENxJYJtbLLWUMEvs/BcBkgeLyKgnpJoZ3EpMraWecddCTaOkUy?= =?iso-8859-1?Q?BZrioSmX/6xOGplT/ykbhygJc/upUBHb77nIha4eWQ5IKelealiFV0SVVF?= =?iso-8859-1?Q?xvL1ZeFNsraAFNNoHs64mHwZmtESgHOVO5boTAlyIw8vr63ch5djlThOG5?= =?iso-8859-1?Q?veROEObtQhLangzDMj7bz3++NiT2VyDbmDzYoMINeDADMqJ4M4tC0peTbE?= =?iso-8859-1?Q?EZjw0PKw96uhULY56bgEMncZ2pqM0qKlkM+TaAMVXd2lILZ93nZ35eeSbT?= =?iso-8859-1?Q?hY+OkDsiGNIrnDw9LZn2vyn9lp7x5A2hdSsHoJyOopDXGXChkQrcb7/XWY?= =?iso-8859-1?Q?VdJqXZd7LOWgcQ0/Nj7S001iURd3YnAECNZz4YDjhXtsg1lPp7JBkTNQwU?= =?iso-8859-1?Q?mtCcOEcucvpVv5afTslX525SEAHD59JXRtjqzT0vjP5cV8Fir+9MafznZi?= =?iso-8859-1?Q?3SnlJOzdVoliRw2qUfVt/Wk010GOGu5IULUwRODPmmumsFeoubjTrtKQKd?= =?iso-8859-1?Q?NU8vsWYY8HSebwcHMB+elE3tncmW1IGMsXa3lyDM8DQA1vmYvMATEVUOsU?= =?iso-8859-1?Q?9atze9qp+M5qqWbG1DlUfgy3SHtHSnBt4aqEqJfy/VoHnTJ+ryJAdnJAAk?= =?iso-8859-1?Q?IyEdjaI17/TaFztQGs1AM+u7JfKsBNIUaOopJ5UBxRU/3g6Ow3PjIUmYmL?= =?iso-8859-1?Q?jUaDRlr8dCwnGnTQ/MbBkCIZTSwkgzMHRTAcz5nHvT1B4WtkaTuKaUzBeI?= =?iso-8859-1?Q?9ExV77taQm56OGKSFSsz3ezE3yJXw48tF0bYeCm59PAU5X0dJFfSHVSR5U?= =?iso-8859-1?Q?dduoNliKMhDKlTjtIkybrFFUYwzD1FDY2mZn6CHbXO7rRWm4cEwy4Xpwrk?= =?iso-8859-1?Q?6gLX6JdH6z5j+Vstb0lA5iUiUEdF+k7nQwWQ7VVXSmp7q1Nf/oJwXCKU4N?= =?iso-8859-1?Q?WY498c/xn/WkF3KavDeAOGsMvmN7qvoMB2iNyQzb1UKVf03bWdQqiA=3D?= =?iso-8859-1?Q?=3D?=
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_AM8PR07MB7476F8110C025D0F8855B960B9E70AM8PR07MB7476eurp_"
MIME-Version: 1.0
X-OriginatorOrg: nokia-bell-labs.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM8PR07MB7476.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 14d15210-7f4e-4471-74bd-08d886ee3753
X-MS-Exchange-CrossTenant-originalarrivaltime: 12 Nov 2020 09:34:56.0324 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 2Z0DFKnrd+ALeOf0RXJFbzqVQorpNxY9xkpyZFVtly9FPB7VX9ydughSigZRy5CGFcHWogT4MY4IuCcJo0Sy9Spb+3HlNWSSpwLxjrxBnkRPhCxzIpLbFb2TxuX0FItP
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR07MB4227
Archived-At: <https://mailarchive.ietf.org/arch/msg/tcpprague/MAz-0NN2fAc_iQfnA1ZLLL6HjA4>
Subject: Re: [tcpPrague] A Congestion Control Independent L4S Scheduler - TCP Prague preliminary results
X-BeenThere: tcpprague@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "To coordinate implementation and standardisation of TCP Prague across platforms. TCP Prague will be an evolution of DCTCP designed to live alongside other TCP variants and derivatives." <tcpprague.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tcpprague/>
List-Post: <mailto:tcpprague@ietf.org>
List-Help: <mailto:tcpprague-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 12 Nov 2020 09:35:02 -0000

Hi Szilveszter,

Interesting work, thanks for sharing. There is indeed a very big difference between how DCTCP behaves today in recent kernels, than what we used in the original L4S work testing (Linux kernel 3.19). That original version was a "clean" DCTCP version that matched very well the theoretical equations: r=2/(p.RTT) for uniform stable random and r=2/(p².RTT) on/off marking. Due to many interactions, integer range constraints, pacing/GSO interactions and bugs, the performance really degraded in the recent Linux versions. These issues were fixed within the Linux Prague version, so that is why Prague should perform "better" in respect to matching the equations. It would be interesting to get an idea of the deviation from the r=2/(p.RTT) equation in your tests (relevant in DualPI2 as the coupling gives a smooth probability). Collecting the average RTT (base + queuing latency), marking probability, and rate would make it possible to evaluate this.

Main reasons why we saw deviations is when the probability varies a lot in time. As you might know DCTCP's (and Prague's) equation becomes r=2/(p².RTT) when it receives on/off marking episodes (on episodes in the order of 1 RTT, off in the order of multiple RTTs). Any not so stable marking probability results in a rate between those 2 boundaries. This is the theory, looking forward on how your practice matches this.

>From a first quick look at the results it might not deviate that much, I guess. The more aggressive part is probably due to the RTT unfairness: 1 to 5 rate ratio (with a 5ms base RTT, Classic gets a queue of 5ms+20ms target, so about 25ms and 5 times less throughput). Did you try to use the RTT independent version? If you set it to the f=max(15, RTT) mode, the minimum effective RTT becomes 15ms, so the rate ratio is 3 to 5 in that case.

Thanks and Regards,
Koen.

From: tcpPrague <tcpprague-bounces@ietf.org> On Behalf Of Szilveszter Nadas
Sent: Tuesday, November 3, 2020 6:30 PM
To: tcpprague@ietf.org
Cc: Ferenc Fejes <fejes@inf.elte.hu>hu>; Gombos Gergo <ggombos@inf.elte.hu>hu>; LAKI Sandor <lakis@inf.elte.hu>
Subject: [tcpPrague] A Congestion Control Independent L4S Scheduler - TCP Prague preliminary results

Hi all,

During the review of our article "A Congestion Control Independent L4S Scheduler" we received comments from one of the reviewers, on why we did not also evaluate TCP Prague. So now we rerun the test cases with replacing DCTCP to TCP Prague.

The results are at the below link. We are somewhat surprised by much increased aggressiveness of TCP Prague. Can you comment on it? The settings and setup we used are described in the pdf (and in the original article).
Results: http://ppv.elte.hu/tcp-prague/
Original article (including YouTube presentation): http://ppv.elte.hu/cc-independent-l4s/

Can you comment on the results and the settings we used?

Cheers,
Szilveszter