[tsvwg] Re: Robustness to packet reordering

"touch@strayalpha.com" <touch@strayalpha.com> Wed, 12 February 2025 15:45 UTC

Return-Path: <touch@strayalpha.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 430AFC14F69E; Wed, 12 Feb 2025 07:45:40 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.102
X-Spam-Level:
X-Spam-Status: No, score=-2.102 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=strayalpha.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ojde-CyaCJXt; Wed, 12 Feb 2025 07:45:36 -0800 (PST)
Received: from server217-3.web-hosting.com (server217-3.web-hosting.com [198.54.115.226]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1942FC1D3DCE; Wed, 12 Feb 2025 07:45:36 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=strayalpha.com; s=default; h=To:References:Message-Id:Cc:Date:In-Reply-To: From:Subject:Mime-Version:Content-Type:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=0N4aMathHq6TkSl6l/ptIxwx0ZmpzBX8UW2/VQ1LhRs=; b=iKcDyuRj2NFP1OFNUkrAiK9HMA h56UChpLx13n+mMX9E6rMvlhSyxxhur1f1E/brWQ5sebc4Me5irWFhzeuCEZRYkWej0IxG1ofv4F2 0t9QLnFYo8WsPMb3X6OSM0B/ZSHbtybwZD9gvvxHvVc5qKVdV3j+kbkBKOyD33KOM1KeFHlDRI+Eo kflGwnSwFtioTNM0IsxWDDpQD/U/ss91NPVBWZlog3dv271kD7QkxhYojnblEgjVZHAPZQ3ub4pIU fppuCm/Ju4LwDMU4nWL96c3SPrtq3azFzEgfanKdnZ18drSm0arKPbpqKckXmIyvHqa6r9BViiGyx Y6MEZOTg==;
Received: from [172.58.209.159] (port=7859 helo=smtpclient.apple) by server217.web-hosting.com with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96.2) (envelope-from <touch@strayalpha.com>) id 1tiEve-0072T7-1w; Wed, 12 Feb 2025 10:45:34 -0500
Content-Type: multipart/alternative; boundary="Apple-Mail=_9FFA3D31-3222-40E5-BF68-EEE288B380AF"
Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.400.131.1.6\))
From: "touch@strayalpha.com" <touch@strayalpha.com>
In-Reply-To: <9D4ADA8A-24BF-4AE9-A65E-115F2FB59AC1@gmx.de>
Date: Wed, 12 Feb 2025 07:45:22 -0800
Message-Id: <F4CE389D-E877-4502-99FC-B5D756D17A1B@strayalpha.com>
References: <CAJ_4DfQjNRd2k+JBFoR+=Y9D-Nvh4-Kw29nQP=tEYS4BY0B-BQ@mail.gmail.com> <FB1FD652-08EB-41BE-ADC0-C4704349DD5E@strayalpha.com> <56B1E0D7-EE02-4D6F-9BC3-90FEEB4EF98D@gmx.de> <15EEFFDF-ED14-4F55-B194-11D6FB3AC8A0@strayalpha.com> <9D4ADA8A-24BF-4AE9-A65E-115F2FB59AC1@gmx.de>
To: Sebastian Moeller <moeller0=40gmx.de@dmarc.ietf.org>
X-Mailer: Apple Mail (2.3826.400.131.1.6)
X-AntiAbuse: This header was added to track abuse, please include it with any abuse report
X-AntiAbuse: Primary Hostname - server217.web-hosting.com
X-AntiAbuse: Original Domain - ietf.org
X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12]
X-AntiAbuse: Sender Address Domain - strayalpha.com
X-Get-Message-Sender-Via: server217.web-hosting.com: authenticated_id: touch@strayalpha.com
X-Authenticated-Sender: server217.web-hosting.com: touch@strayalpha.com
X-Source:
X-Source-Args:
X-Source-Dir:
X-From-Rewrite: unmodified, already matched
Message-ID-Hash: 7PPMT34DDPIUNZ2ZPJG4K6CZLGRX2HJY
X-Message-ID-Hash: 7PPMT34DDPIUNZ2ZPJG4K6CZLGRX2HJY
X-MailFrom: touch@strayalpha.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-tsvwg.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: tsvwg IETF list <tsvwg@ietf.org>, Ryan Hamilton <rch@google.com>, Martin Thomson <mt@lowentropy.net>, Greg White <g.white@CableLabs.com>, IETF QUIC WG <quic@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [tsvwg] Re: Robustness to packet reordering
List-Id: Transport Area Working Group <tsvwg.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/3jg_viEQzH5fCegpjbU66g43BUc>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Owner: <mailto:tsvwg-owner@ietf.org>
List-Post: <mailto:tsvwg@ietf.org>
List-Subscribe: <mailto:tsvwg-join@ietf.org>
List-Unsubscribe: <mailto:tsvwg-leave@ietf.org>

Notes below...

> On Feb 12, 2025, at 12:02 AM, Sebastian Moeller <moeller0=40gmx.de@dmarc.ietf.org> wrote:
> 
> Hi Joe,
> 
>> On 12. Feb 2025, at 08:39, touch@strayalpha.com wrote:
>> 
>>> On Feb 11, 2025, at 11:05 PM, Sebastian Moeller <moeller0=40gmx.de@dmarc.ietf.org> wrote:
>>> 
>>> Hi Joe,
>>> 
>>> On 7 February 2025 23:17:38 CET, Joe Touch <touch@strayalpha.com> wrote:
>>>> 
>>>>> On Feb 7, 2025, at 2:12 PM, Ryan Hamilton <rch=40google.com@dmarc.ietf.org> wrote:
>>>>> 
>>>> ….
>>>>> Let's not hobble the performance of modern protocols in order to *potentially* provide minimal improvements to the performance of obsolete implementations.
>>>> 
>>>> Agreed. As I noted, RFC3819 still has imo the best advice:
>>>> 
>>>> This suggests that subnetwork implementers should try to avoid packet
>>>> reordering whenever possible, but not if doing so compromises
>>>> efficiency, impairs reliability, or increases average packet delay.
>>> 
>>> [SM] This really is just stating that reordering and undoing reordering have both positive and negative effects. IMHO it completely fails to give actionable advice how to assess and weigh these effects objectively to conclude whether/how much reordering in a given circumstance is acceptable or not.
>>> In a BCP I would have wished for at least an example how this trade off is assesses in practice... (or multiple examples if the exact circumstances matter a lot).
>> 
>> Actionable advice is context dependent - it varies based on the measure of “efficiency”, “reliability”, and “increased delay”.
> 
> [SM] Even if I accept that argument, that still does not address the lack of practical examples if need be for different contexts. Respectfully, the proposed method to assess acceptable reordering needs to have terms for modelling the context.

This isn’t a research plan document, nor should it be.

>>> In a later post you assess that 13ms reordering window acceptable and in accordance with the above recommendations, so let me ask, what is the threshold for acceptable and non-acceptable (max) reordering-induced delays?
>> 
>> My metric is that delay increase matter only when they are a significant fraction of the current message latency. 13ms probably under 25% of most Internet delays, if not lower. It’s also a small fraction (about 1/6) of the delay a human would notice (100ms). So its impact is small both relatively (25%) and as an absolute (1/6 of notiicible).
> 
> [SM] That is IMHO, by all means tricky advice for a specific link/link layer as the OWDs of the affected packets are unknown to the link layer... Also assuming humans are blind to delays < 100ms is a statement that would need to be backed-up by psychophysics.

It is (to a rough approximation). By thousands of cognitive psychology experiments.

> I give you https://human-factors.arc.nasa.gov/publications/p39-mania-1.pdf "From the results of these two studies, it can be inferred that the Just Noticeable Difference (JND) for latency discrimination by trained observers averages ~15 ms or less, independent of scene complexity and real-world meaning."  15ms not 100ms... If we, for the sake of the argument accept these 15ms, then 13ms would be close by your chosen method but still justifiable.

There are a variety of delays that such studies measure - minimum perceived latency differences, impact of latency on interaction, etc. 

But this basically makes my “YMMV” point. If you’re doing a game where you need to decide if two things happen at the same time, 13ms matters. If you’re using the web for remote editing, the threshold is more like 50ms. The point where the delay starts to become a pain is around 100ms.

Note that this is E2E latency; L2 designers have no way of knowing if their L2 is the entire E2E path or just part of it, so they basically should be playing with the fraction of delay they contribute (at best).

>> But the point above applies - I’m using my metrics. You might use others. No absolute or more specific advice is appropriate than what the doc already says.
> 
> [SM] That would however mean, the amount of torleable re-ordering delay is subjective, and that is hardly worth putting into a BCP as that is the default...

That’s the point - the doc already says this in (IMO) a well crafted way:

   This suggests that subnetwork implementers should try to avoid packet
   reordering whenever possible, but not if doing so compromises
   efficiency, impairs reliability, or increases average packet delay.

>>> Without objective measures for the positive and negative effects and how to aggregate both, I am not sure RFC3819 really is all that useful in regards to reordering.
>> 
>> Even a research paper with such detail would provide advice for one situation at most. BCPs provide more general advice.
> 
> [SM] Sorry, that BCP gives advice so generally as to be essentially of no practical utility. See, I believe that the P in BCP should have meaning, and as long as we expand it to practice and not policy, a BCP should have practical utility... but I understand I am in  the rough here.

I’m sorry, but doesn’t this contradict what you observed just above?

Latency, efficiency, and reliability are all subjective.

>> 
>> If what you want is a doc that says “DOCSIS v3.25 should not reorder”, that’s fine - but not a BCP.
> 
> [SM] No I want BCPs to give actionable advice and/or practical examples if a question is deemed so context dependent that only non-specific general guidelines can be given…

It gives actionable advice that is intentionally subjective.

Basically don’t design L2 to reorder if you can help it. Don’t try to help the endpoints if, in doing so, you create make reordering (subjectively) worse.

Joe