[tsvwg] Re: Robustness to packet reordering
Sebastian Moeller <moeller0@gmx.de> Thu, 13 February 2025 08:23 UTC
Return-Path: <moeller0@gmx.de>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A83E3C1CAF28; Thu, 13 Feb 2025 00:23:46 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.85
X-Spam-Level:
X-Spam-Status: No, score=-1.85 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmx.de
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id XiRGiNj-fVcb; Thu, 13 Feb 2025 00:23:42 -0800 (PST)
Received: from mout.gmx.net (mout.gmx.net [212.227.17.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 32CF8C14F61C; Thu, 13 Feb 2025 00:23:41 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmx.de; s=s31663417; t=1739435013; x=1740039813; i=moeller0@gmx.de; bh=pDBgNRuT31MHSQV2UkOjwKCAbHdN27HmutPhQvgO/hg=; h=X-UI-Sender-Class:Content-Type:Mime-Version:Subject:From: In-Reply-To:Date:Cc:Content-Transfer-Encoding:Message-Id: References:To:cc:content-transfer-encoding:content-type:date:from: message-id:mime-version:reply-to:subject:to; b=fRRSukdDgWO9H3cJ1fwRPMBUcOKJHkCm8/+QOHSj4mpvGZjg7pydHr7fa7rPUt06 H2CQ49R4OQUB+kvqxi5eyx2ZZuZnZOxSLyjW6QflHZKlb+1XD8mAiAcKPrubvnC8D Yv1QLoe+KnJrJbYOm2+BoZB8lbgOROWxULvYnpNWu+vQcVXwGcxKAeUWgu4NtOzUT EO/HY5m+pgI8Q4hF/okr+pkJNBFYNqu1AsvBXenl4+euSfESGEmPvUnHUGqf03ztq H2zDFUFCFtwK0TwVGARLUig9qT18ihy4ikh/CTqp83DlnapRR0uwo/V8e/72f+4/e mrBYrepg/BWpPxRlCw==
X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a
Received: from smtpclient.apple ([95.112.80.65]) by mail.gmx.net (mrgmx104 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MGQnF-1taUIq1eJB-007TKF; Thu, 13 Feb 2025 09:23:33 +0100
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3776.700.51.11.1\))
From: Sebastian Moeller <moeller0@gmx.de>
In-Reply-To: <F4CE389D-E877-4502-99FC-B5D756D17A1B@strayalpha.com>
Date: Thu, 13 Feb 2025 09:23:20 +0100
Content-Transfer-Encoding: quoted-printable
Message-Id: <B79048ED-A7C9-4F95-9655-5A37E0C01A72@gmx.de>
References: <CAJ_4DfQjNRd2k+JBFoR+=Y9D-Nvh4-Kw29nQP=tEYS4BY0B-BQ@mail.gmail.com> <FB1FD652-08EB-41BE-ADC0-C4704349DD5E@strayalpha.com> <56B1E0D7-EE02-4D6F-9BC3-90FEEB4EF98D@gmx.de> <15EEFFDF-ED14-4F55-B194-11D6FB3AC8A0@strayalpha.com> <9D4ADA8A-24BF-4AE9-A65E-115F2FB59AC1@gmx.de> <F4CE389D-E877-4502-99FC-B5D756D17A1B@strayalpha.com>
To: "touch@strayalpha.com" <touch@strayalpha.com>
X-Mailer: Apple Mail (2.3776.700.51.11.1)
X-Provags-ID: V03:K1:JZO8YhWANVExakLwmRpl0N5JaIfd6V37aANuN2dXG7XT58XjOxJ 4gHS5tUX6xM8S6UwU5tnKT2pafVPFIapa32zfBlXQZflQMStgEy2I/y9bZkrITjZO4nONEb WXSU7RnaPJu/SkYbqDMg9a+BuuTvNQ3n76dz6oeH4yqq/vV1NiQ6MU0qymAGjKZLyBVqcS9 0dAhKvH+hbQt2W53NN9Hg==
UI-OutboundReport: notjunk:1;M01:P0:fgMa8D6W/PM=;gSed5Gb4iQmx9OETFH/RIaVZU8u +MyFQjV3iHmawI1LfW09ywQnNpOvRsejcQBoFG57ItbqMfxUbQu80K+yPQGZhk/WtM8KqiEQQ cpVx9al6urI2UhUBdBK86UaLpUoG10JJ5l4HFd6qv/5sMP2cr42LYLecvSlzcpDzyTlesipsQ gBs9Ycji/GEKHWYaCUSGdmhR/97GEoiCa6Tx3S+VIXoAWl/qAaZfgCF0aIt2/t+ToX46gWUrY T40LXu1QZQLOpxcVuozuzhS8ycX1Ck/sSyLbdoqP0RnSgqy+39N6XAZGR67ziMI11MMEOWZ19 mKMTz4/BJIXQ84wU9WGxxVx0DOrlPmudUH4TiBxLwciLu0UgtkqqIYGITaM89DVRr3FTDUcpN LyXjRHwqf/lv+5DJWlWgF1YpnnpC0LJFiafs0M2Nh+qVuk9ojCKCX736wJzbljCM5O2JZdE9/ 81YhWqRN2CcmMd4tf5/8OOZPLCdE30bmEKXFtzzj/M5iYDhT9p6f+TUBmywjoz3KzvCfiAK0w VkY/qCu+CQ4QT0/+KNoy5xvkKBa3Do+afcWH/2FhcXC7AEiP3j0nyoGm9CGCPVml4UDkZ6Ry8 SOYxTayG6VQWBxtsXdqhblDNHJNHV1E5qNY7VQNY87ScC1ULNOa50+i8Db2pu7m7Bbqz+fUwM EL0uknCuaF8dBbhIGnEyvxBkVSTyq0l+0kRGrha0R6Y4AMjWBMxvPmelAbIjLbdIHcBmGGlis MM825vgJM46eNgGfO2o1A0WZBfshIbi2uWI73fJhS0rZYS3Ojxmr2Ids7PK0lhUCKBDFFAMTa 1tzsJwGSCc1QAYrq9RptpRx6HdQfYOcMJshlQv0x/XC5Z4RtWb0EJ5rL4qI/qQPeKrE9Bc5cB YzoGyITDZDit/l1W65+7n1RnUSty3rZ8Fq3S7mHrlKokkGcbCyOh6anXR7hMmas/E1cGpLb9m tNGHhngPhOjz4RYHQ9eYl4HsOXtQRH3VcjLvqYW3bPTeJx9x+aZAVqXYEfx6xJ2+qubRdVrxu KNg2A8j0lC5qKV+3A94EeFmaWDWvhTeby83+rGX69rFBSNd0MELIZ2KF12N7n3foPq21JGm8r EwRQ0oGOs9mGlh9bKOXHzS2jLvccuPk3vpMumUJUykDWHJ2Px8EkcWxlgQxHGYivrx/Hr63yy 9tEMu8qLcrCj2Jrk4QEN1QPfSpNJPWniuEqmfxFfSuQQ6fNdULt7+42h3TwkzBhI+FlhfBGZN H6b+/MMr4UXX49qRAAh27/+lYKiKv1wK5CJ/0tXH3VuUo8oVqjYyzhISms84YonpDaGxZwpZp sBVd3f9QwFZwcCODlJu5aJzbIor+wxT/sgXEvrj4uJ3cMdhUWJcVdUswfsf7iKZsAXxviMUJC ag6GOPzlvjCavES9GO0a82bjjZm487mAfaQIg8O5LkjhFo9BEEvC9ZXZi9U6a8qHgviqwaHx9 hkPbieQ==
Message-ID-Hash: 5DV3AQKH6WWM2BM6BZHMKHOH5VIUDZWR
X-Message-ID-Hash: 5DV3AQKH6WWM2BM6BZHMKHOH5VIUDZWR
X-MailFrom: moeller0@gmx.de
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-tsvwg.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: tsvwg IETF list <tsvwg@ietf.org>, Ryan Hamilton <rch@google.com>, Martin Thomson <mt@lowentropy.net>, Greg White <g.white@CableLabs.com>, IETF QUIC WG <quic@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [tsvwg] Re: Robustness to packet reordering
List-Id: Transport Area Working Group <tsvwg.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/Tu1htPLwAGM5uMufJeshv0vpmao>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Owner: <mailto:tsvwg-owner@ietf.org>
List-Post: <mailto:tsvwg@ietf.org>
List-Subscribe: <mailto:tsvwg-join@ietf.org>
List-Unsubscribe: <mailto:tsvwg-leave@ietf.org>
Hi Joe, > On 12. Feb 2025, at 16:45, touch@strayalpha.com wrote: > > Notes below... > >> On Feb 12, 2025, at 12:02 AM, Sebastian Moeller <moeller0=40gmx.de@dmarc.ietf.org> wrote: >> >> Hi Joe, >> >>> On 12. Feb 2025, at 08:39, touch@strayalpha.com wrote: >>> >>>> On Feb 11, 2025, at 11:05 PM, Sebastian Moeller <moeller0=40gmx.de@dmarc.ietf.org> wrote: >>>> >>>> Hi Joe, >>>> >>>> On 7 February 2025 23:17:38 CET, Joe Touch <touch@strayalpha.com> wrote: >>>>> >>>>>> On Feb 7, 2025, at 2:12 PM, Ryan Hamilton <rch=40google.com@dmarc.ietf.org> wrote: >>>>>> >>>>> …. >>>>>> Let's not hobble the performance of modern protocols in order to *potentially* provide minimal improvements to the performance of obsolete implementations. >>>>> >>>>> Agreed. As I noted, RFC3819 still has imo the best advice: >>>>> >>>>> This suggests that subnetwork implementers should try to avoid packet >>>>> reordering whenever possible, but not if doing so compromises >>>>> efficiency, impairs reliability, or increases average packet delay. >>>> >>>> [SM] This really is just stating that reordering and undoing reordering have both positive and negative effects. IMHO it completely fails to give actionable advice how to assess and weigh these effects objectively to conclude whether/how much reordering in a given circumstance is acceptable or not. >>>> In a BCP I would have wished for at least an example how this trade off is assesses in practice... (or multiple examples if the exact circumstances matter a lot). >>> >>> Actionable advice is context dependent - it varies based on the measure of “efficiency”, “reliability”, and “increased delay”. >> >> [SM] Even if I accept that argument, that still does not address the lack of practical examples if need be for different contexts. Respectfully, the proposed method to assess acceptable reordering needs to have terms for modelling the context. > > This isn’t a research plan document, nor should it be. [SM] It is also not actionable practical advice, but in a BCP it should be exactly that... this is verbiage of little utility. > >>>> In a later post you assess that 13ms reordering window acceptable and in accordance with the above recommendations, so let me ask, what is the threshold for acceptable and non-acceptable (max) reordering-induced delays? >>> >>> My metric is that delay increase matter only when they are a significant fraction of the current message latency. 13ms probably under 25% of most Internet delays, if not lower. It’s also a small fraction (about 1/6) of the delay a human would notice (100ms). So its impact is small both relatively (25%) and as an absolute (1/6 of notiicible). >> >> [SM] That is IMHO, by all means tricky advice for a specific link/link layer as the OWDs of the affected packets are unknown to the link layer... Also assuming humans are blind to delays < 100ms is a statement that would need to be backed-up by psychophysics. > > > It is (to a rough approximation). By thousands of cognitive psychology experiments. [SM] Please cite which you want to consider and how you assessed 1000s of experiments... > >> I give you https://human-factors.arc.nasa.gov/publications/p39-mania-1.pdf "From the results of these two studies, it can be inferred that the Just Noticeable Difference (JND) for latency discrimination by trained observers averages ~15 ms or less, independent of scene complexity and real-world meaning." 15ms not 100ms... If we, for the sake of the argument accept these 15ms, then 13ms would be close by your chosen method but still justifiable. > > There are a variety of delays that such studies measure - minimum perceived latency differences, impact of latency on interaction, etc. > > But this basically makes my “YMMV” point. [SM] Which you did not take, you argued that 100ms is the perception thresholds for humans, glad we agree that that is not so. > If you’re doing a game where you need to decide if two things happen at the same time, 13ms matters. If you’re using the web for remote editing, the threshold is more like 50ms. The point where the delay starts to become a pain is around 100ms. [SM] Again, how did you come up with these two numbers... > Note that this is E2E latency; L2 designers have no way of knowing if their L2 is the entire E2E path or just part of it, so they basically should be playing with the fraction of delay they contribute (at best). [SM] I am well aware, this is why I argue that any advice for permissible re-ordering that is based on path RTTs is essentially of little utility as the element having other decide about reordering has no reliable knowledge of that RTT. > >>> But the point above applies - I’m using my metrics. You might use others. No absolute or more specific advice is appropriate than what the doc already says. >> >> [SM] That would however mean, the amount of torleable re-ordering delay is subjective, and that is hardly worth putting into a BCP as that is the default... > > That’s the point - the doc already says this in (IMO) a well crafted way: > > This suggests that subnetwork implementers should try to avoid packet > reordering whenever possible, but not if doing so compromises > efficiency, impairs reliability, or increases average packet delay. [SM] If I want to know how much reordering is recommended thgis text really does not help me at all, except it tells me the IETF does not know either... > > >>>> Without objective measures for the positive and negative effects and how to aggregate both, I am not sure RFC3819 really is all that useful in regards to reordering. >>> >>> Even a research paper with such detail would provide advice for one situation at most. BCPs provide more general advice. >> >> [SM] Sorry, that BCP gives advice so generally as to be essentially of no practical utility. See, I believe that the P in BCP should have meaning, and as long as we expand it to practice and not policy, a BCP should have practical utility... but I understand I am in the rough here. > > I’m sorry, but doesn’t this contradict what you observed just above? [SM] I say this a last time, the section we keep citing really does not help me deciding about if/how much reordering is acceptable, all it tells me there are "pos" and "cons"... hardly actionable advice and not practical. > > Latency, efficiency, and reliability are all subjective. [SM] No these are not, there need to be agrred up measures how to assess these, what might be subjective is, how much/little is acceptable for a given use-case. But even that is IMHO not helpful, e.g. for traditional TCP we know its it 3 dupACKs we want to avoid, nothing subjective here. > >>> >>> If what you want is a doc that says “DOCSIS v3.25 should not reorder”, that’s fine - but not a BCP. >> >> [SM] No I want BCPs to give actionable advice and/or practical examples if a question is deemed so context dependent that only non-specific general guidelines can be given… > > It gives actionable advice that is intentionally subjective. [SM] Sorry, to disagree. > > Basically don’t design L2 to reorder if you can help it. [SM] That horse has left the stable long ago... link layer retransmits as means to create links of a desired bit error rate are IMHO ubiquitous by now, that is one trick L1/L2 designers are not going to give up, so we will mostly trigger the "can not help it" condition, and there the BCP lacks in specificity. > Don’t try to help the endpoints if, in doing so, you create make reordering (subjectively) worse. [SM] That is a conditional that depends IMHO on use-cases, but the L2 designer likely will not know what use-cases will actually happen. I guess, I will stop here, we differ in our assessment of the BCP text, and it seems we will not convince each other, so with all respect, thanks for the discussion. Sebastian > > Joe >
- [tsvwg] Re: Robustness to packet reordering Greg White
- [tsvwg] Re: Robustness to packet reordering Tom Herbert
- [tsvwg] Re: Robustness to packet reordering Joe Touch
- [tsvwg] Re: Robustness to packet reordering Martin Thomson
- [tsvwg] Re: Robustness to packet reordering Christian Huitema
- [tsvwg] Re: Robustness to packet reordering David Schinazi
- [tsvwg] Re: Robustness to packet reordering Neal Cardwell
- [tsvwg] Re: Robustness to packet reordering Martin Thomson
- [tsvwg] Re: Robustness to packet reordering Christian Huitema
- [tsvwg] Re: Robustness to packet reordering Ingemar Johansson S
- [tsvwg] Re: Robustness to packet reordering Koen De Schepper (Nokia)
- [tsvwg] Re: Robustness to packet reordering Neal Cardwell
- [tsvwg] Re: Robustness to packet reordering David Schinazi
- [tsvwg] Re: [EXTERNAL] Re: Robustness to packet r… Overcash, Michael (CCI-Atlanta)
- [tsvwg] Re: Robustness to packet reordering Ryan Hamilton
- [tsvwg] Re: Robustness to packet reordering Joe Touch
- [tsvwg] Re: Robustness to packet reordering Michael Eriksson
- [tsvwg] Re: Robustness to packet reordering Greg White
- [tsvwg] Re: Robustness to packet reordering Vasilenko Eduard
- [tsvwg] Re: Robustness to packet reordering touch@strayalpha.com
- [tsvwg] Re: Robustness to packet reordering Greg White
- [tsvwg] Re: Robustness to packet reordering touch@strayalpha.com
- [tsvwg] Re: Robustness to packet reordering Sebastian Moeller
- [tsvwg] Re: Robustness to packet reordering touch@strayalpha.com
- [tsvwg] Re: Robustness to packet reordering Sebastian Moeller
- [tsvwg] Re: Robustness to packet reordering Ingemar Johansson S
- [tsvwg] Re: Robustness to packet reordering touch@strayalpha.com
- [tsvwg] Re: Robustness to packet reordering touch@strayalpha.com
- [tsvwg] Re: Robustness to packet reordering Christian Huitema
- [tsvwg] Re: Robustness to packet reordering Ruediger.Geib
- [tsvwg] Re: Robustness to packet reordering Sebastian Moeller
- [tsvwg] Re: Robustness to packet reordering Greg White
- [tsvwg] Re: Robustness to packet reordering -- dr… Gorry Fairhurst
- [tsvwg] Re: Robustness to packet reordering Sebastian Moeller