Re: [tsvwg] Related to "Non-L4S traffic abusing the L-queue" discussion during the interim

"De Schepper, Koen (Nokia - BE/Antwerp)" <koen.de_schepper@nokia-bell-labs.com> Fri, 25 February 2022 18:04 UTC

Return-Path: <koen.de_schepper@nokia-bell-labs.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 24A833A07AA for <tsvwg@ietfa.amsl.com>; Fri, 25 Feb 2022 10:04:57 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.475
X-Spam-Level:
X-Spam-Status: No, score=-2.475 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.576, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id D_tI1aN-oBam for <tsvwg@ietfa.amsl.com>; Fri, 25 Feb 2022 10:04:50 -0800 (PST)
Received: from EUR05-DB8-obe.outbound.protection.outlook.com (mail-db8eur05on2072d.outbound.protection.outlook.com [IPv6:2a01:111:f400:7e1a::72d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3674B3A1221 for <tsvwg@ietf.org>; Fri, 25 Feb 2022 10:04:43 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=lvk0WMGE9B1a6DLj9puSgLCmtMpaAQujbErPa5Hp/u8XmsM1g0oDPotkw4HCQaTJJUV6mvK7WSWV1I3zkc8JPWPp9VlpaseLDApud5vImF6rXTFBdLssQg28ygDL33dSx4yzA8HoIVRdHV+Ixny884GgHNzhQsXZBd9x8GY6HwWuGXiJaq4Htv7xiHy0XPlTQbLtaz87jfEKe2On72ST8IUYFvv8m+7KpnrMXr6u15NrN8Q7pBKfq7G9lQT9D/E4uWBziO7vzvqqCLmjv4d6Hvg+ed2IUEfg1BuZ4FB5E2PY9A4da+mw3WgHrEzVVEbuQPAacsliem7Toa4e22rnTg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=nxd4rscVym8uF01T9eLDVUY7HB9asw/raEk3wpArSgI=; b=i9akGWw7NvMKuVU3ILG0HSEfIlGlsVTj/dpwYo1Q5ynsNgUGCFTM2S8hNyu3e0lH5fydVrShspPwOvIc5Gj6DDyMkek88/xPtZpet3II8Y5xsoeKajWvPjJUQUd+NJajnLTwFbPDUfhXxYZKzPXIEgr1z57ebF51HnnyE6tjEDf2bMti4EVR1e2v17/58zt9tSZWWqlqCw853qdsfFuuNhItIblJGbXErd1J4vR3ky4kCkHmfNMDNiWzTn5fc4vC05+hL/pFFdrfp8qlru2qbTykCtPnkqvye/L7G5CIKfzYGS0densSPRtM068MrKuOFoCRaZp8PLdOtBAyuXU/5A==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nokia-bell-labs.com; dmarc=pass action=none header.from=nokia-bell-labs.com; dkim=pass header.d=nokia-bell-labs.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector1-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=nxd4rscVym8uF01T9eLDVUY7HB9asw/raEk3wpArSgI=; b=YJcU4w1bHogWu0gdnkEyooadwHIpIub5MrvrCV1MfuiZH/yNDj2GasZGS/9LLs+b8aMZsCHjS0PvIAikcn+4LuJ6yDoI8xJnC7CtJitusGTiGkJGsF5UvhLOdzLvY8A9k8OdnHgQtDIYdhIq8zDbaAk8c/QBCSyYYJUofegP8eM=
Received: from AM9PR07MB7313.eurprd07.prod.outlook.com (2603:10a6:20b:2c6::19) by AM5PR0701MB2370.eurprd07.prod.outlook.com (2603:10a6:203:11::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5038.9; Fri, 25 Feb 2022 18:04:38 +0000
Received: from AM9PR07MB7313.eurprd07.prod.outlook.com ([fe80::91fc:61da:729c:d949]) by AM9PR07MB7313.eurprd07.prod.outlook.com ([fe80::91fc:61da:729c:d949%4]) with mapi id 15.20.5017.022; Fri, 25 Feb 2022 18:04:38 +0000
From: "De Schepper, Koen (Nokia - BE/Antwerp)" <koen.de_schepper@nokia-bell-labs.com>
To: "Black, David" <David.Black@dell.com>, tsvwg IETF list <tsvwg@ietf.org>, Jonathan Morton <chromatix99@gmail.com>
Thread-Topic: Related to "Non-L4S traffic abusing the L-queue" discussion during the interim
Thread-Index: AdgkJ2KkH3TNxxbjSbGmariabLxqmgGAY+aQAA/RmIAAAIjNEA==
Date: Fri, 25 Feb 2022 18:04:38 +0000
Message-ID: <AM9PR07MB7313CFC9D4087361E4EFF082B93E9@AM9PR07MB7313.eurprd07.prod.outlook.com>
References: <AM9PR07MB7313D5AAF6B9D66C74CC35A1B9369@AM9PR07MB7313.eurprd07.prod.outlook.com> <AM9PR07MB7313F1401B14F6F2DB72A2B2B93E9@AM9PR07MB7313.eurprd07.prod.outlook.com> <MN2PR19MB40454F60DEE5735EAD428465833E9@MN2PR19MB4045.namprd19.prod.outlook.com>
In-Reply-To: <MN2PR19MB40454F60DEE5735EAD428465833E9@MN2PR19MB4045.namprd19.prod.outlook.com>
Accept-Language: nl-BE, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels: MSIP_Label_34759c52-a6db-4813-b00f-5ea20e29646d_Enabled=true; MSIP_Label_34759c52-a6db-4813-b00f-5ea20e29646d_SetDate=2022-02-25T16:53:40Z; MSIP_Label_34759c52-a6db-4813-b00f-5ea20e29646d_Method=Privileged; MSIP_Label_34759c52-a6db-4813-b00f-5ea20e29646d_Name=Public; MSIP_Label_34759c52-a6db-4813-b00f-5ea20e29646d_SiteId=945c199a-83a2-4e80-9f8c-5a91be5752dd; MSIP_Label_34759c52-a6db-4813-b00f-5ea20e29646d_ActionId=88ad5329-b626-47c8-a52b-7dd4e8c788cd; MSIP_Label_34759c52-a6db-4813-b00f-5ea20e29646d_ContentBits=0
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nokia-bell-labs.com;
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: bef138c8-90ea-4f25-63b5-08d9f8894a19
x-ms-traffictypediagnostic: AM5PR0701MB2370:EE_
x-microsoft-antispam-prvs: <AM5PR0701MB237063F892481B4A9E554751B93E9@AM5PR0701MB2370.eurprd07.prod.outlook.com>
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: /WaRzdR382g84+yLEWck2I7f7X0tCqeAJF38xlek41B8TbXOZql2LUwIqThp7e1m/mQpUOvxZ2TG9TlAEoqII1QpuxeZIlNgoPH73kKZimbumN1JC1Y5PUEvspDckYCZbny9J+n3LEw+Ax2xjGKnOwXk15MthH0ogo8CURuCo1TVTVXYwXzBkujmfFQ39ggQ2dQ1l0ACXSBBBfulhAH8VAXiTHHNGlo0qzh2PbtMgTroFLH+V1kC1/yLbj10dNQWsu1McA5jZesBI3NjtFw0yt2+pjYX5BRwLN5TIPQwHzAfjbZft0Wc8/6CHehpQSYPv7mT+k3gXRCTIHJm9C6/qtpKxaaX1e8MZOnhY5Z3c/UEbXgjV5TzTEZ1CcxGEyAnP7hWRTGdjOquCU7grLKFV7OoeaEipqz6EPPjkIKIHf2f8TUVfkUnVxDNoBZX/bATDmLIbkFnJTDF4959ixaxrhoeUWRqAhe8Sg5XF/3LTx/v9IPqIvOajmelZGVJ+et+Bkdf6qxKRclyo0u4xTwjWE+ODHQXlf/IcEbqAw07OelY9yhPBXOF9jNZy6Svz9OAsXEjmmtMeA8di+4keoUd2sdTDX42Boa0haBG9YMOKdvBXqcZv7KwepH74P2KgPMhYvfnPZZ9g6Fz2Eb/Q76VvFuKuRAMwGMG7PjTPYJXv3VO7y4SAzFSxv3aCtvWpfNGPhtiwAeuakgMMNA7vJ81HEJ1xVr20KAAjAfB+1D4s5aoJcNdcGmxOLr7AwtxYjdw
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM9PR07MB7313.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230001)(4636009)(366004)(64756008)(76116006)(66556008)(9686003)(66476007)(8676002)(2906002)(38100700002)(66946007)(83380400001)(122000001)(53546011)(316002)(6506007)(33656002)(110136005)(82960400001)(8936002)(52536014)(55016003)(9326002)(7696005)(66446008)(5660300002)(71200400001)(38070700005)(186003)(508600001)(86362001); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 2
x-ms-exchange-antispam-messagedata-0: KNOHuhrdUWvXeJhIcjIhW0/27GsSQqPXv85o7nyukFPmTSfE6N+NHZ71o0tWZYlr4S8Zidgq3628741+I+2PNtT6iJxBsruy7NFz80xSa06Q2yX3ZiD/+NYuF0NCTgVv6QPe6S9HBvYnXHDKkejfyefVIJFK25f0xxHLc8ukEP6MFpYGeIMbo/sI1DdvfCQmIQo178/NZ5ZHVKplNlzSIf7Ae7Mu7TXEt9EIqhSerVStyMa6t2P5BEfc769BOVZYK8rebVbfedb7ak5nm+LEvXa4Kx7xLwrGLZnACHuZRAo64zkvTKGnrZb4CjkzYlsLJNlv5aMMPIGyLMoMe07OU8ajG3bJ1AVbZax6RsNS74wT7TmD0TqmhYu1BCmXvIYAUr91O7jF7hhO0Iv4bB1Py2KzxwSMXFdAzWlcQzfE0TQ7DuubltQZ2ZTuCzU4sxMT8kUTrENPpe46dLR6AKL3O2IcIASRVJEHnfzJqoPkZRlpvmKd+8MG6bSk+PfoMIWPAaZlz9ax2OfRtME+HNu0xKwvN9yGatcOldYbRYfm7iw0mz3r9BPtvPJWSCB1de/nIWfBh7US4BrtKNH4ynqu1U7QuLU7h1kcisVOraWPQVss4rFasc9OlDlViJGez8dS/4NlGMmvDM+PTAAphwG8TPQZDfE7yP0iEDAkOarLAOw++d4AlsM5DMN4w8wxe2QrRJEoiw1gUDNmst6Fst1m3Qn8jO8ZPwCALk/DDA2JorJSQabk20PtynO+z3vmZs3+lAAau08icUs+9SPufwr4JJJxttUskKZxrReroQv+tZTSWwsXc7l+HHH4AqYMQreiQly8/mcDLn8WwARvRzqV1dn2FiMNmMfZByLuisPe5XO5SEEOqihg9j7Ju/xuyOTn4s50xnunOGetzE+9w4FkGBBuUvuwuuyFpv5Xkteb+O7wbwyhJ/gHiUmI/yg3+JPU/KXhUpNuoJuJoQMScCCWgtFl/RCUdEAskVeMocT1KQxizx1c/W7FE6E+a1TfmZHXGBm9eb4aTCD/tWwp138DTHjomW/N4wsZHZqaL+8rCuj3FkwRKUSzK55uIdlmszwQC/GCL4eqJdFLBue1QCgcMnJ4MLpC1UNbmj3wSCWoAVcNEBSXtfI2YW8gXLA2jJc/DllOwy3zteQa8KLHRZ7GbQqMREgXcEuGOwMhBe92oPqAYQ3Xm2WOpEgwXAMLDE+C7Nfw2OqHkinj1lK1r2XNaG5RHeVvd4bhfivRKtw28ZFJEAHTY12oE5FjRLBrFaECsMSRgBYzojyTidsRYKUloT0NPHuTmYs1auHzG803rzo18WAIjeVu5CzGmS2cVn/6UNDNtlOHS9RuoEKkPm6IZKco+rwbW5c+gCXmo+C55EinAdW+sNMDXaTYcoBFkOzdiNmxmfc4uSJMxDGnoigW1qM7lrML1jM5igDaFknaFzOPi4l3X7V4PDULQv8UmAIVHa3DsmRzdbSBMI8VkDckoUki31jFnIgHA4jSA5HoZJxPWsNZ8NwID280Ch4PnfQnwxOvxKR/+O1NJZvBtfpPWO8NM666I+iIrNSmsAmZreRpQRIbGX5JWBHTWvOOBTV/IF3S6WQpTKWSQ/fXKbdr2Y040zZZHtne8/UOyAa63hD6XuTmVZJ1QY9o+S3nVkqAlcRdmLHC9Z3jg2pey+JroL6Rd7z+VyRlz4r4IlaOUc2s0+d1dETGWSo54q9/D90LRjUnlAR4i/Pd5g6NgQcb5rR9wtWS3sW17qGUGh7DjxvqTiTJuzHVwo3wrIz+8ZO9IAVK8Rh3
x-ms-exchange-antispam-messagedata-1: 9RiyRQW522MD2w==
Content-Type: multipart/alternative; boundary="_000_AM9PR07MB7313CFC9D4087361E4EFF082B93E9AM9PR07MB7313eurp_"
MIME-Version: 1.0
X-OriginatorOrg: nokia-bell-labs.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM9PR07MB7313.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: bef138c8-90ea-4f25-63b5-08d9f8894a19
X-MS-Exchange-CrossTenant-originalarrivaltime: 25 Feb 2022 18:04:38.5771 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: Rv/Vv1oeUDRWKvu1Tq9zeSiFoDazXN4ep9q2RCXeq3JbWb69oXPQhaNzwW33k9nNgaJk/mhZp6FdLOHMKBbkM8KLPsaa7Yiq+NcnUn+VL56+q15HTYLEOO/TLO78taOH
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM5PR0701MB2370
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/aV2wH8iCOwzbmCpcY0DLewc0x7M>
Subject: Re: [tsvwg] Related to "Non-L4S traffic abusing the L-queue" discussion during the interim
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 25 Feb 2022 18:04:58 -0000

Hi David,

The design goal of the DualQ is that the L queue is always empty as long as there is capacity seeking Classic traffic. If there is capacity seeking Classic traffic, it builds a Classic queue which is creating marks for the L4S flow too (don't forget the AQM coupling here!). If the sender is using falsely ECT(1) it would be marked even more than if it was using ECT(0), and back off even more if it was responsive. So this makes us conclude that the traffic in Jonathan's experiment was non-responsive (and not using Cubic) or CE marks were cleared or not echoed by the receiver, or ...?

One of the confusions is probably that the draft specifies only "starvation". As-is, it can be interpreted as being caused by senders, but in fact, the only starvation case we noticed is because of an implementation detail of how the classic queue measures the Classic delay. If the classic queue delay (or throughput measurement in combination with queue size) only happens when a classic packet is processed (scheduled), you need to use a WRR scheduler that processes a packet at least every update time (to get a new measurement value for the PI_update algorithm).

Another reason for using a WRR instead of a strict priority scheduler is that it improves responsiveness for sparse non-capacity seeking classic flows. You could call this a "temporary" starvation (in the order of 150ms which is how long the PI2 controller would need to reach the drop-ECN threshold, if the L4S flow has not responded based on the CE marks; BTW, it takes 240ms to reach 100% drop).

If you think it is useful/necessary we still can clarify this in the draft?

Koen.


From: Black, David <David.Black@dell.com>
Sent: Friday, February 25, 2022 5:56 PM
To: De Schepper, Koen (Nokia - BE/Antwerp) <koen.de_schepper@nokia-bell-labs.com>; tsvwg IETF list <tsvwg@ietf.org>; Jonathan Morton <chromatix99@gmail.com>
Cc: Black, David <David.Black@dell.com>
Subject: RE: Related to "Non-L4S traffic abusing the L-queue" discussion during the interim

Koen,


I'll observe that "traffic that is not responding at all to CE marks" is not necessary to achieve the reported results if the experimental setup "prevents the L queue from seeing any
need to apply congestion signals, because it is always empty" as there would be no CE marks for the traffic in the L queue to respond to.

Please give that further consideration.

Thanks, --David (as an individual)

From: tsvwg <tsvwg-bounces@ietf.org<mailto:tsvwg-bounces@ietf.org>> On Behalf Of De Schepper, Koen (Nokia - BE/Antwerp)
Sent: Friday, February 25, 2022 4:29 AM
To: tsvwg IETF list; Jonathan Morton
Subject: Re: [tsvwg] Related to "Non-L4S traffic abusing the L-queue" discussion during the interim


[EXTERNAL EMAIL]
Hi Jonathan,

Can you confirm that this test is done with "Cubic" traffic that is not responding at all to CE marks? So it is just like any other non-responding traffic (like UDP CBR). We don't see any other way to explain your results.

If so, we can/should remove this "issue" from the shepherd's write-up, as such unresponsive flows will get the same throughput on any single-Q bottleneck with or without AQM (taildrop/PI2/PIE/CoDel/STEP/RED/...) with a latency that matches the AQM strategy.

Koen.


From: tsvwg <tsvwg-bounces@ietf.org<mailto:tsvwg-bounces@ietf.org>> On Behalf Of De Schepper, Koen (Nokia - BE/Antwerp)
Sent: Thursday, February 17, 2022 7:01 PM
To: tsvwg IETF list <tsvwg@ietf.org<mailto:tsvwg@ietf.org>>; Jonathan Morton <chromatix99@gmail.com<mailto:chromatix99@gmail.com>>
Subject: [tsvwg] Related to "Non-L4S traffic abusing the L-queue" discussion during the interim

Hi Jonathan,

It seems that the following open issue identified by the chairs:

Non-L4S traffic abusing the L-queue
* 'DualQ gives a large throughput bonus to L queue traffic, ie. a "fast lane"'
* Is this a matter specific for DualQ that can be left for experimentation?

is based on the following experiment you performed:


>             simple two-flow competition test on a standard dumbbell topology,

>             with the bottleneck running a DualQ qdisc into a 50Mbps shaper.

>             Both flows were configured to use CUBIC congestion control with

>             ECN negotiated, but one was additionally tweaked to set ECT(1)

>             instead of ECT(0) on all data segments, and to pace its output at

>             40Mbps. This latter measure prevents the L queue from seeing any

>             need to apply congestion signals, because it is always empty.  These

>             tweaks allowed that flow to use 80% of the link capacity, gaining a

>             fourfold advantage over its competitor,

If there is capacity seeking traffic in the Classic queue, then it is even desired that the L4S queue does not add extra marks. The L4S marks should come only from the Classic coupling.
Before diving into details, can you first explain why in your experiment the coupling from the Classic Q has no effect on your paced and ECT(1) labeled Cubic flow?

I would expect that this ECT(1) labeled Cubic flow would get even less throughput than the Classic Cubic flow, as the first gets the doubled coupled CE marking probability (eg 2*10% = 20%) for L4S flows instead of the squared CE marking probability (10%^2 = 1%) which ECT(0) traffic would get.

Thanks,
Koen.