[tcpPrague] TCP Prague parameters?

Szilveszter Nadas <Szilveszter.Nadas@ericsson.com> Tue, 18 May 2021 14:33 UTC

Return-Path: <Szilveszter.Nadas@ericsson.com>
X-Original-To: tcpprague@ietfa.amsl.com
Delivered-To: tcpprague@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1B5453A14C4 for <tcpprague@ietfa.amsl.com>; Tue, 18 May 2021 07:33:22 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.798
X-Spam-Level:
X-Spam-Status: No, score=-2.798 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.698, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PtC0_29yFIvz for <tcpprague@ietfa.amsl.com>; Tue, 18 May 2021 07:33:17 -0700 (PDT)
Received: from EUR01-HE1-obe.outbound.protection.outlook.com (mail-eopbgr130089.outbound.protection.outlook.com [40.107.13.89]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id F23AF3A14C9 for <tcpprague@ietf.org>; Tue, 18 May 2021 07:33:14 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=AGEzL7SuM01/8hOkrcXs3vm/LUAicq55T0eJf2A1KVrJ/gZmo9QQq+IbKaXlqXVF9sCo6DrDuSXOKwSLGrhVqYyF4nG9cvOaZA5STIYy8kZaa3cUVNpcf3SkVEF8cg/xZ3esDVDqahoC602IvAC+hGMlyy8hWsaISRtFQ0ndXII9jCnQc9365KXII+/htgCePO9o9Ja5KSyvG7eczUTj7J3Q6PisDcaL9TJYfQdB+JMqaMajKCQZV2k77KD7fxunZxtob0IZT5QhG9Tm3pbFE6oBCLH9eY+8Q85P2JRU8KAD2f77Ev9qjI2SfBSeTclz+14C4wD+pCmCTAj4SLdsdw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=PNELQL/Ls4fjJ+5LT/EeKlOC4Mwc7LAYwgl0toVbEx8=; b=LjayijjeuECx4QnqoQsbTULkbfW9a+NqEFX7kn3ZYRECoARxuRXC6S0ne1awSFruiRNJqO8XBn4H8zXNGZHldxFnSoMLYlX1Ee+JBD7C72HMJrsCbY5NK6L3s866Zn6V6SPP7QUQKBZMDq+bobWGpWFPQlzB4J2s1eaNE2Pfk6mj1GyM1V9PTGqzzsVkcT5sHGJxmZIb7vevj9Qciwq3tLpiinza23WGXBU88fiE9iMzhYMtGC3yDj47oDXoEgh5pJAE3oBLxFyPtJ81P+PG44HVfOjGBqJXZbsry6RMa6kffEn6CxUY7Kj+LfLdT0FAJYF7WcVpiWcTWkTLWwVKuA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=PNELQL/Ls4fjJ+5LT/EeKlOC4Mwc7LAYwgl0toVbEx8=; b=Sq4dux3FcpxCRZY5L1OEfzm7MB+ZolMskZbtOW6QyydKpANbTGUgB8+8E+ylGQphypN/Ot9fPnnp5cQfAnpIq6ASwf0BW+DZXeNVvHFxQTFUxgXTbnjl+aGpIYPRkhIxI7qZ2gO0bzUE3oVs0oPNq+cY1itlC4ECAOKXe3zVZh8=
Received: from AM0PR07MB3953.eurprd07.prod.outlook.com (2603:10a6:208:42::26) by AM0PR07MB5636.eurprd07.prod.outlook.com (2603:10a6:208:fc::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4150.14; Tue, 18 May 2021 14:33:12 +0000
Received: from AM0PR07MB3953.eurprd07.prod.outlook.com ([fe80::c050:3237:fedf:5e37]) by AM0PR07MB3953.eurprd07.prod.outlook.com ([fe80::c050:3237:fedf:5e37%7]) with mapi id 15.20.4150.019; Tue, 18 May 2021 14:33:12 +0000
From: Szilveszter Nadas <Szilveszter.Nadas@ericsson.com>
To: "De Schepper, Koen (Nokia - BE/Antwerp)" <koen.de_schepper@nokia-bell-labs.com>, "tcpprague@ietf.org" <tcpprague@ietf.org>
CC: Ferenc Fejes <fejes@inf.elte.hu>, Gombos Gergo <ggombos@inf.elte.hu>, LAKI Sandor <lakis@inf.elte.hu>, "Tilmans, Olivier (Nokia - BE/Antwerp)" <olivier.tilmans@nokia-bell-labs.com>
Thread-Topic: TCP Prague parameters?
Thread-Index: AddL7KyBBGuGdjnfRcGjKpnVxiQgKw==
Date: Tue, 18 May 2021 14:33:11 +0000
Message-ID: <AM0PR07MB3953246D1737E65E34C939F68B2C9@AM0PR07MB3953.eurprd07.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
authentication-results: nokia-bell-labs.com; dkim=none (message not signed) header.d=none;nokia-bell-labs.com; dmarc=none action=none header.from=ericsson.com;
x-originating-ip: [78.131.74.38]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 762b25a0-a2cc-4bc1-3e53-08d91a09dd61
x-ms-traffictypediagnostic: AM0PR07MB5636:
x-ld-processed: 92e84ceb-fbfd-47ab-be52-080c6b87953f,ExtAddr
x-microsoft-antispam-prvs: <AM0PR07MB563606F03A3E18A2549DF54B8B2C9@AM0PR07MB5636.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: H3xZSnVcI9y1f0DOM1GpBo8hl1+moHdXoBFVUri+MjMYR3AjCJJIV3jiJ/bFpz2Xdt4u2tBgmLI7iEyTpFdsrzpiIFsw7Qp7+hEY6Go1+SihNmeUnI9tzw7GwzoJzyr0u/ArEzzB+FURRP9l3B8RbrEpQLtUnKlcqQpqQfzup8uR5uBSCa270kJOsJb5JZvZJn6RojBu8AfViPcAR5+1KZV7fg1r50JsNb3RRmdnc8d+1n3KyxEe9DXhTVVx/vbOVJFfrBJNNDmmxRWpyplCLA0ggJHm/sHFI83pQK6S4NGAngwYjocHDwua38OfGpQbCAcRq7tS9EuG6IbJjcD7Uw73M03B7e3qroOish8B3Ni9SGQOWS1mV9MfACuYvNZINDOUiCkgaU8zr6igHogGqw+ZnC9yL4/1WGgqlUsmbkQbIm2NYNcUR2iKjw455fgFcP9aGGVwseHzmwNdO+EmhCws/1D6dSlP4QPGZkBo3rqwavKR4+vAPYgIvKZH3kiUBRGiI9ACpplVjrTVU9IXiQk8GSPsSllfb8iZJurbNK5ut41dlwrd5v5Wlcm4FmGVqULlyzqOGLAVHlIl6y9eT4cmEBDKpBPRcGK7QKUwRc9TwR+me+J/Gd9Ny4Ii1daE3nyik8e/ZIjFFKKocKyj5KZgLQF880DJeMVpktxhqIWf7ULgFhHhBlj1LWU08r6l
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM0PR07MB3953.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(39860400002)(376002)(396003)(136003)(346002)(38100700002)(186003)(122000001)(4326008)(5660300002)(7116003)(76116006)(7696005)(2906002)(8676002)(6506007)(53546011)(26005)(54906003)(64756008)(55016002)(66476007)(66574015)(110136005)(52536014)(99936003)(966005)(66946007)(83380400001)(66446008)(66556008)(478600001)(316002)(33656002)(71200400001)(66576008)(3480700007)(8936002)(86362001)(9686003); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata: 2Hnyoau13oOwKhu5H3qI0/ME/ymTHUpD9Oyah34wP37ci7iKWaJACcy4MoM3F3j//X242ywfEmNgf7tNSVXVfxUSt9Ym0XF3tdIQ4TFgG31s5lDjOc9umWa5gr5YEb8vjaNAGyZu/aDmVxgAaTGYNgNTxVxL2g0+m/eIsmxR86mYWKjJZuNmqMHm8qzE6LzwHDI6apb5M6aDrvbl7Xv5racVTcOstRfBbU/uRhe3+Roh3wzO/JcYOh8Wfbajk/fyF5y14cQAZJSjf1/3zipJwcNdSi69ir+dUZUjZv5jvFWGSP5Pk0es1S52o755qagmwKaBiYUTCc+UHFrDUIxDqqi1pc3fLN/TSsLPImPW1lhkWbLEXxtlk+a1mPuZXAHaRsrlmT/LRzcB5FT8rjoPqqbJR55up4fcMiqyJ9wS60CRwaf8zOvIPfO5IFCz56/7a8GKbQDBw5XBjKl4xHFEgESurx7zx2s7jrg8LlYzgpjf0eeObVD6VTZg6OgsluZpOdtLHYC9y68a5QRfuOhO/eLc5PLfgSFZM46jVVurPwL9xhnfjAG8RyPxjjqtLlf6piW2Nbn/DPzawqFstrS7CUMTwctjdA2CMx3v484pRKNRKIWKPtL20X38x+fBgiqlLc1FZDx3Kep1GfhDTcCblGzoqQ7aHZyx2M8NbJ79y3hByJruZE7sPx5/ZTXIgbzA8We9ES7R9gF5mwVl5hRtwhqgKhZG8YcqSsgINLmyYQxkwkilR7HKCH4stI04yVJtCSodx7SfKr/oR9j5zdH9vCLaP3d9Suts+e2HSEboJdH8Bw/NLRIIRuNY+Dwu0keYknkQj/fWle6PmHM+r3ONM59WhzYNG7xZNLuQISkyuIHvo2QB0epxdK8nJs6QCUPrEfTLvhUvUaYyGZ8xQkbeF4ej50pgZliRgibTk1oCA8munWOeyaNUS7sL1ry9uuFxfyWcfc3pvwx4gecuh6CSRrFdFJ0GW82lzwO3V6MxWE4W5enOSpaLP+Zm3Q7C3L+8/W/hvVKAFYc2iki9633lg4j7mdpBgRyTq0N6+gq98p4DF6XVAKm21aB1EkdN3Uyg9NnOAmgN1pF5gkEuIYtP4rqxsHdA7nBn6lAMlIOOHIBBQKpeIfvX7kQBNWLDF0BNyYeXqBD+iAficETvyaiXpgEfRkEaWV/2x5CtVN3sWo+YeF+M9V2Pm9uoBG98eInsPKXa6PnpHSyzHauH7E2QkUdeNEzh5DsSX22Z+u0Fr8Qr5Vr43+0p3HNmqy24VykpRQ1ftgbzUTZZOCgJYO2PjO2vyUC/Elcoefgf88NVRKQ=
x-ms-exchange-transport-forked: True
Content-Type: multipart/mixed; boundary="_003_AM0PR07MB3953246D1737E65E34C939F68B2C9AM0PR07MB3953eurp_"
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM0PR07MB3953.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 762b25a0-a2cc-4bc1-3e53-08d91a09dd61
X-MS-Exchange-CrossTenant-originalarrivaltime: 18 May 2021 14:33:11.9412 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: J+paMmx9l9diYaioFhLMzsPdbIe9NcphoZrgXlJHVKXIb8LTG9gCFTxHSDKUVuokFvb96cSA+DeRkO7yNIp5doVD7I8CMf7dmKvMolqo+E4=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR07MB5636
Archived-At: <https://mailarchive.ietf.org/arch/msg/tcpprague/uQ3QMdOaXXWk9Oe2edWHIc1KPOI>
Subject: [tcpPrague] TCP Prague parameters?
X-BeenThere: tcpprague@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "To coordinate implementation and standardisation of TCP Prague across platforms. TCP Prague will be an evolution of DCTCP designed to live alongside other TCP variants and derivatives." <tcpprague.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tcpprague/>
List-Post: <mailto:tcpprague@ietf.org>
List-Help: <mailto:tcpprague-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 18 May 2021 14:33:22 -0000

Hi Koen,

Thank you for your guidance below.  We did not have resources in the end to investigate this further. 

However, now we are running an experiment where we plan to use TCP Prague as an example for scalable CC. We plan to use Prague, because DCTCP is considered to be flawed in the internet RTT regime, and our experience is that BBRv2 scalable mode is too aggressive.

We use the following code:
https://github.com/L4STeam/linux.git
2021 jan 11
66331636f0dd4930916ee142ad5f505ac8e53e25

We experienced very slow convergence with  prague_rtt_scaling = RTT_CONTROL_RATE so we set it to 0 (RTT_CONTROL_NONE). Other than that we plan to use the default parameters of Prague. Is that OK? Do you recommend to change anything else?

Best Regards,
Szilveszter

FYI - some preliminary results of our experiments are attached. We use a scheduler similar to the one in this article: http://ppv.elte.hu/cc-independent-l4s/ . The attached plots are analogous to Fig 3a, but it is Prague instead of dctcp, and 10 Gbps instead of 1 Gbps



---
From: De Schepper, Koen (Nokia - BE/Antwerp) <koen.de_schepper@nokia-bell-labs.com> 
Sent: December 2, 2020 22:22
To: Szilveszter Nadas <Szilveszter.Nadas@ericsson.com>; tcpprague@ietf.org
Cc: Ferenc Fejes <fejes@inf.elte.hu>; Gombos Gergo <ggombos@inf.elte.hu>; LAKI Sandor <lakis@inf.elte.hu>; Tilmans, Olivier (Nokia - BE/Antwerp) <olivier.tilmans@nokia-bell-labs.com>
Subject: RE: [tcpPrague] A Congestion Control Independent L4S Scheduler - TCP Prague preliminary results

Hi Szilveszter,

First thing is to check that you can reproduce our results. With the previous (non-RTT-independent) Prague, can you confirm you get the following results?

Normally with the right coupling (p_C = p'^2 and P_L = 2*p') and if their total RTT is the same, Cubic (in Reno mode) and Prague get about the same throughput (Prague might get up to twice the throughput max). Total RTT means base RTT + all Queuing delay for each flow's round trip path. Can you confirm this, or do you see a bigger difference?

One way to check this on an equal base RTT setup is to use a singleQ PI2 which is doing the  correct marking or dropping according to the above equations, because the single Q  gives both classes the same latency (single Q = same Q delay). Another way is to use a DualQ and compensate the 15ms Classic latency with a 15ms bigger base RTT for Prague. In both cases you would see them getting around the same throughput. If the BDP (rate and/or RTT) becomes bigger, Cubic will start to get a higher throughput than Prague.

Note that if you install the latest Prague version from our L4STeam git, the default is now to be RTT independent below 25ms. So any Prague with a lower than 25 ms throughput will behave as a 25ms RTT flow (effective after 500 RTTs), and will get the same throughput as a 25ms RTT flow. You could test this with Prague on a DualPi2, when competing with a Cubic flow with a base RTT of 10ms. All RTTs (you can try even a mix of different ones in parallel) below 25ms should now get the same throughput as the Cubic one (because it has also a total RTT of 25ms).

Any other effective RTT combinations different than the equal ones should follow the "throughput ratio equals the inverse RTT ratio" rule. One exception is when non-Rtt-independent Prague flows with different RTTs ares competing on a STEP AQM. In that case the difference is bigger than that ratio, because the lowest RTTs are getting on-off marking, and behave as 1/p², instead of 1/p as they will get a more stable marking probability over their (much bigger) RTTs.

Let me know if you can reproduce the above behavior. If not, maybe try using the Linux DualPI2, and if still not as expected, then we need to dive deeper to find the reason.

Thanks,
Koen.