RE: Robustness to packet reordering

Ingemar Johansson S <ingemar.s.johansson@ericsson.com> Thu, 06 February 2025 06:51 UTC

Return-Path: <ingemar.s.johansson@ericsson.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 00028C14EB15 for <quic@ietfa.amsl.com>; Wed, 5 Feb 2025 22:51:43 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.25
X-Spam-Level:
X-Spam-Status: No, score=-2.25 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.148, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zaZyYJCpJvY3 for <quic@ietfa.amsl.com>; Wed, 5 Feb 2025 22:51:40 -0800 (PST)
Received: from AS8PR04CU009.outbound.protection.outlook.com (mail-westeuropeazon11011066.outbound.protection.outlook.com [52.101.70.66]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-384) server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 70C58C375691 for <quic@ietf.org>; Wed, 5 Feb 2025 22:50:52 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=K/XvR6TY7pQwfszUzbfNOPXJtWkzSwq5lmWq7G74USJl8EBUWaX/BH3NsAqSheO2UNNRm8GxY3yuqrQ2SpDEbH1+IHfqXteGjqNRJIEZBESjcEG07ZiohYRU1XM1vD3C75Lp3rXs5MggJJNnMuB0yrosQb6J2hWP7yyGmRHfRoH9qmqJnNUk6Q3mV4634EQlzHoZDE7xti37MnsaSPBfOpD6nZOj8oP/nnTWOMY7cjPS/H7OO5+w7uAYLMNo6OWJLbQraejuC1ofqgwnWRlyh4UTA00EX+AgFoT7ZkbFYsMvxKYEEGyHiJxEJk8W8rR8BziraQXuKnVWGR06G2kLCQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=LRnO+c24jRSZ3FUXR38X89h2rXwebFdl1DXJhp2y1xQ=; b=AjgrrYrAxc9DU2s1oc0Z5x2nBX4akf+MB3sHL3vpfCS/4aiS1dobcWEZpUiFeBxuHqRJb3Qp+UOpY2C1jQZZY08zYo+ywGJhYpEWjCC1eGqs/VkKdVCYrav0tlrs26NMZ1hkoVCPZHePxPez0FYzhVhrJr1CRqJuaBIhjNhOSuhj655/Ws7vzHvM9XjiTZ0Yu/6+fwLAXJxbpaAe49bRIaPWehzOxgFjkXMykgzWv7fGCcUePOUpWOEFIIEsEbviR8BUfkpgl2oE+ER5c8CmALkacTZqKqIYLECsHA9/xpMIEt8Acj6iRRdpkvAVwbFPqC/6qnA9rhFXXGlJjpxBYA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=LRnO+c24jRSZ3FUXR38X89h2rXwebFdl1DXJhp2y1xQ=; b=MzQR89jS2+YAB2tX4ArgzJEFTc/yfVCUtoZaj3t20Z7h2UceelPVYfbmRa8y4CFbNZJ9kcU+MLdelfNZyXivSac7dDksH56smMl9JeacHIA5vvJdVbf/EbhRgkMtCK7ww72xsoqUWWewuztGGXHiVGzve4tHPRifBT+tEYyJdEr1eJZW9pI5BF8bZbFyHS1rFiuG8p0kv8GK30oO3jEGpSn4hOdq0Q9HUIP7YznsNWgdUNTXJ31iU7mt8JzSkowEinZ/+wS/+RNojUt7xzFGIV4WEo2mzbOie6/hgd+Qak+bDAw4Exfx/8Zt3uBpFADqh59d9al1a/h4Co/aoBK7jQ==
Received: from AM8PR07MB8137.eurprd07.prod.outlook.com (2603:10a6:20b:36c::18) by AS8PR07MB7432.eurprd07.prod.outlook.com (2603:10a6:20b:289::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8422.11; Thu, 6 Feb 2025 06:50:50 +0000
Received: from AM8PR07MB8137.eurprd07.prod.outlook.com ([fe80::9e03:ac31:a53:8b04]) by AM8PR07MB8137.eurprd07.prod.outlook.com ([fe80::9e03:ac31:a53:8b04%6]) with mapi id 15.20.8422.010; Thu, 6 Feb 2025 06:50:49 +0000
From: Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
To: Christian Huitema <huitema@huitema.net>, Ingemar Johansson S <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org>, "quic@ietf.org" <quic@ietf.org>
Subject: RE: Robustness to packet reordering
Thread-Topic: Robustness to packet reordering
Thread-Index: Adt32OkNYBGIQI0YQKWypvVayRL8XwAWZNyAAAwObCA=
Date: Thu, 06 Feb 2025 06:50:49 +0000
Message-ID: <AM8PR07MB81370760A8293580DDDB386BC2F62@AM8PR07MB8137.eurprd07.prod.outlook.com>
References: <AM8PR07MB81375E2D3CA840AEDA0F7E63C2F72@AM8PR07MB8137.eurprd07.prod.outlook.com> <38891fa7-b188-4767-8364-ae0a10c318b2@huitema.net>
In-Reply-To: <38891fa7-b188-4767-8364-ae0a10c318b2@huitema.net>
Accept-Language: sv-SE, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=ericsson.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: AM8PR07MB8137:EE_|AS8PR07MB7432:EE_
x-ms-office365-filtering-correlation-id: 33dad73d-3bc1-4a24-1f32-08dd467a9790
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;ARA:13230040|376014|366016|1800799024|38070700018;
x-microsoft-antispam-message-info: OHkNbx06YkQGLdEsXW+IRJdvnBPkSLDU0ibhyJ6cz9BmKUA34rzYra/LNaA7ZsyRTyZe7GFhhNsCYYY538ucekeHtfUU4PxQNK+eKpE5ZgGdOTEAt4dzSGrf28bqCTGuHbuqnOw0xPA+FMaDrF3/LgUA+dfsyqF+Gi77Vh6moUvfB+i8+C5aBJMQCZVabNIQXsrGwNAu/v/gPzDFN/FS5kz1OPq+xWYlFwoAhFpdencmVJUd26Kg0t4OHKbfSLDJvFxBCT5bWSMcULUgLWAXwR2qBJUJow6xj2sMhGQrNnYtB19GD0br8nhCP2fJZpHqEgufcvjiodU7rF/FmUIi+DGyQCvKP/a4xwR3yr2VUZSo+8RPzEoa/gjIdZKWdxd9R9jQoqq2vhmf89UReChFDB9jG4WwsOnoGL3tOjuQAU2N47Mq33ImzfYb2u9w28ZOLOui9sXjvlCXDEIElBhYCZqnmkshirCqCH4K/GrtUuNvVISP3N7fsb6W6JBuigv/3ykZl0JtMhtv5PkT4wpSViuwhVPt8ZFRnngCb4fqiAC0yJinbqyBZQha9AI/KcMEsJYmoeD9lCCOaTMjfztGDlm2ZI/IN3Kt+5WWfy4M+bPkj/JKDjjjLI4VqP9BXqM20acG4NIAqQur/p+SYOXesmvI0ZosL6i7NBsSdB/T9IA84B1r0gtFG+XSqtDWETdNFb5mEPzyf8Z6ii3imSTBLYZ4BdAB54xX0AOx59VU77P62bI8PAjzgQql4U2lSrEw7DbeoQ2PDF+qdxnk9HBJKsnf2azE1nsNLG4tSxeJInMGEx6LMQI58awZbcUkekbWdYV4O9RebxIGIwxeVNdDXJ8YZ6OrUA4ywmza6OwvT6vaSEdeWFLNzaCz2PKOLbeyxuxCsXdEme3ROdfoRlMAFUKgGBeGFj1q6zhCY6pGKSE2vyh4PWTj5NCW7ctLlp7SSoJTAqNIVTAfkVXQgmjffaQtzgPIAz8eUuwDIbDPv8Vlw5iy2WB5sp3tA47gaJweTcNvHz8DVB5vX9CzrYh6Ff9bT0z3hx2HRerjztVieWtxwMlnp6QuyvNpzxKgZxziDUXHp0qdkz1b6Eqp9XP109p0WhOmch/miSKcbMmFgEpqoe/5TwFAALYKucDd1vi2Gnx3GlZxJcI9kKya4eMnQvR2qlDWjZ9deGZazSskQLnEp6aoOw6keBJLiY3ferpu1umIgW9Kj58wgFfCEaTN2mAgYkeAofzaTrIpIQ9BfdREfhu3dT8Q1Nz07oNo4xKR4T7B2ifdsEu5lkTvEIBm25hDbcWNmNAldXecpXhz/fxZTaOmUjSgw7HotAp/JgaysKGHIVs5d2mi2NQLL/UTDpMxRKfMZVQjYqwB93WZd5o/SdOZzWiBc71LsrJCG4BN231dZVBN4hxpGEdsyioL383Dkh/nwnk/54SbdFqyQTcqtDyo7HI58PwITA49e04/
x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AM8PR07MB8137.eurprd07.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(376014)(366016)(1800799024)(38070700018);DIR:OUT;SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: rR1BBHnKt2j1g3bvjR151NA42UchFXW5VScGtQKcND9Ql6dIdiZpeSrWAXV9m1w3k98AeqGvEXk0octMrdMZKOjqIyyQxqFRjxZ0uB9I2CHXqH5e16aIH5IHSpoI0qZVWGL02JfdVPV7Byw0Mfqwcj1swmDymhruCS79v80h5JLY88eIAZUnm32m5x+Faq61XZvBkasuoF12Lagm8EYS/JNtVTbIYHe5rTf6N1+ZCHqYwoo6SrOZISiuKHJXGAurYL2PoRYoF2brGH39sB8kivwzMf9iQQz5DRA8zKDJwCW/yWhvEQvpdHn5P47UvJVyn7rvHQDryeQ/7cMwCBzHFLPWjP2D9qLSBknMs+T+Nj934goMD40O3J5cmob4XnFBUIM2VKpOI5/qc8MIA+SAm1tve08aWGSKmDoZZyyUTUr1/2Or0glDRpso1TJrZCm+hKsxJUGeexXxC/xwN/GkQGUvkBB2GIykwrx4ugkluqf/CSSo5DIENfBfwfoC2MQ+TQHP45egHdmwYkvrxVDLQqr4qW92Yln2zWLPEKZZKJkB27pGrTgs9ZBwoYAYjJc3myJubGe4oUdjI+2nnliHInYZfHHgeeZ0AtXx20TgCRAVizSdviYbuftM9/FKNyPZkBkxO9VgRNYKKQeevc3UWrtRtkwruR262AySTkB/OrjiYWlcXxGs5mwxXGYB04IOmtZ3OC9FPHkLrYGGr+X1uWTJODN7ICf7lHMQkMeM2PPg60DjOUTEqSOwV9KiLKN953Ds53u2IFY9q3Io0GH/yE4p53VzWvAaqvANavllsGnIlr/R3WhOeh3Gp3fVOznp38TCEJqaOFkKLMGq+QSkKol37JR0XgwpN9jrnQnjX4e0P1DUI8a1ND/wLxpFzLk0rQI4TEDyo+0pMliLwkahT61E38LnfFBIjs6aIvogngGNDHjc3U726NyxuD7/hZyU29ld6jY2DsAQPFiA+qYwZr5BrPREWFNkcwZ3F0uHrUVjF49BcbJ9WhnNWIUAKVhYGydH9N8DHa/ZsxspuElfrnpTpk0A+i5NjIe+nbHkxEVTLDdQ150zWc5VZ/DAhZ9QRHFKs5sG+kicl4R1iYZTK5e6GVIcqpqntkUzZnLttTeNk/saFSAKyC/t3x77fIbFgr3+yuntEwghreAnFgLxTnQK6VEzpNR2JvyV3lSyacxjACS69F9D+QrxkS92ZV9jiNRH3AuH450jMseqly/mxR3qMgzG3X7JAZOcL6gNgW1kRDqgCReGn1XGpmTO9Oj1y8OAorXmjGQk79I9oN+ea3c5PJriQoJ+8hdqdfvpaRrt+3PeCz7GiiVoDfrf1H7xZgIcJgTbgbwC31JJaZHD+v/xz7gugStz5yI3getjS9IeiFE/17GiIrem/9ZL3BpBgkzOHULmb+xtE1gzr8jA2lR/zrsj2LPH2anCTyibDVgH/jgLWWKQO5UseBkAXDZuX9sHp0IdoK+w/1TbBIl/QfSZ8E/tamQ+EOhmNCzdqGnyd+qZAq0cHSD4CRwBgjz9G6waJPP2IAPSZbBW7xmnj+AUSDRgBuOiyqqs6fvKcFciAn3Stz3lVg147JKBPlSBkyL4iwW0xPAGHkgHGMQAuA==
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM8PR07MB8137.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 33dad73d-3bc1-4a24-1f32-08dd467a9790
X-MS-Exchange-CrossTenant-originalarrivaltime: 06 Feb 2025 06:50:49.8731 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: u8Ynzwh43Tb2pU8UnFam7QH8iewFLOM6pSgWa5EqAIqkbfEU4d7hpXc7sDle6T8yIA68WxT6nExh/4IO+pj2VWkTlxeLkaFpvL6qV7i+6sz6lXj8bMt+Xt6z1oHnIpjz
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS8PR07MB7432
Message-ID-Hash: KOFFWGM2RWCYQZXBAQTVXLMPCGFRGSSH
X-Message-ID-Hash: KOFFWGM2RWCYQZXBAQTVXLMPCGFRGSSH
X-MailFrom: ingemar.s.johansson@ericsson.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-quic.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
X-Mailman-Version: 3.3.9rc6
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/QGhjBmaMAHxK7s9cBu39oKJN67A>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Owner: <mailto:quic-owner@ietf.org>
List-Post: <mailto:quic@ietf.org>
List-Subscribe: <mailto:quic-join@ietf.org>
List-Unsubscribe: <mailto:quic-leave@ietf.org>

Hi Christian

I was perhaps a bit unclear, sorry. 
I refer to "in the stack". 

The RACK function in Linux TCP increases the reordering window when packet reordering is detected and thus avoids fast retransmits. In current Linux TCP the reordering window can increase to accept up to one RTT reordering. 

Do any current QUIC stack support this RACK functionality and/or is it planned.

/Ingemar

> -----Original Message-----
> From: Christian Huitema <huitema@huitema.net>
> Sent: Thursday, 6 February 2025 02:00
> To: Ingemar Johansson S
> <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org>; quic@ietf.org
> Cc: Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
> Subject: Re: Robustness to packet reordering
> 
> 
> On 2/5/2025 6:21 AM, Ingemar Johansson S wrote:
> > Hi
> >
> > A very short question, with possibly many answers:
> > Do current QUIC stacks support out of order delivery up to one RTT, as
> is the case with TCP Linux with RACK enabled.
> 
> Define support. Do you mean "at the API" or "in the stack"?
> 
> The programming APi for QUIC exposes a set of "streams", as well as
> possibly a "datagram" capability. Data sent on one stream is delivered
> in sequence on that stream. Multiple streams can be processed in
> parallel. There is no guarantee of ordering between stream. If a packet
> containing data for stream number N is lost, delivery on that stream
> will stop until the loss recovery -- but delivery will continue for
> other streams.
> 
> Data sent as datagram is delivered whenever the datagram arrives. There
> is no guarantee of ordering between datagrams, or between datagrams and
> streams. There is also no expectation of loss recovery: if a packet
> containing a datagram is lost, the datagram is lost.
> 
> In the stack, QUIC stacks are expected to check whether a packet was
> "already received", and not process duplicates. Note that if packets are
> lost, the frames contained in the packet may be processed differently --
> some may not be resent, either because they are now obsolete, or because
> the frame has already been received -- for example, in case of spurious
> retransmission. The packets carrying the repeated data will have their
> own packet number, different from the initial packet.
> 
> In order to not process duplicate, implementations have to maintain
> knowledge of already received packets. That knowledge typically has some
> kind of horizon, such as "the last N packets". Packets that are older
> than that will be ignored, because there is no way to tell whether they
> are duplicate. The value of that "horizon" is implementation dependent.
> About 1 RTT worth of packet makes sense, but implementations could use
> something else, like for example 3*PTO.
> 
> -- Christian Huitema
> 
>