Re: [tsvwg] Re: Robustness to packet reordering

Tom Herbert <tom@herbertland.com> Thu, 06 February 2025 18:51 UTC

Return-Path: <tom@herbertland.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id DF33FC1D3DF0 for <quic@ietfa.amsl.com>; Thu, 6 Feb 2025 10:51:36 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.106
X-Spam-Level:
X-Spam-Status: No, score=-2.106 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=herbertland.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id QOHpLMstLmJv for <quic@ietfa.amsl.com>; Thu, 6 Feb 2025 10:51:32 -0800 (PST)
Received: from mail-ej1-x62b.google.com (mail-ej1-x62b.google.com [IPv6:2a00:1450:4864:20::62b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B11ADC1D4A69 for <quic@ietf.org>; Thu, 6 Feb 2025 10:51:32 -0800 (PST)
Received: by mail-ej1-x62b.google.com with SMTP id a640c23a62f3a-aaf900cc7fbso239065366b.3 for <quic@ietf.org>; Thu, 06 Feb 2025 10:51:32 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=herbertland.com; s=google; t=1738867891; x=1739472691; darn=ietf.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=tBMDnaE2unN6hQFeixda/lY7H0fU9iQ6GOHqM2sPimY=; b=ZqF1QU3pp/9i76DIR2yWxJcnukQKD9ShAeRWY8i3FH5ulbKUupcoKC1hMquBrg/XKQ CHpq7nt9PHnqsHVPnSB2YVWz5BOEaZtn9cFh4lWGExkpkV/ygkaO3qId+zkbplVW1Mk+ Bmz0zZvu5xUd+4I1Tk/u1OA0yZtNLSTTGz7GjI45SfqkAojBOw7xX346HCdSPvjgzlms O+ak3ceF9gCjm7iUkKTxvp1YP6r8P9epOoubUGkin+AX4B68iKD3nZXDzHZjS7EaNb5K piEdvhgtfXxPsN8MjOmGxz079RjXaPXDT/9MOWfVm1eDre1YZRX++ABkWNNHPDSb6sB7 oDpg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1738867891; x=1739472691; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=tBMDnaE2unN6hQFeixda/lY7H0fU9iQ6GOHqM2sPimY=; b=bESJ6DpKsYh5PM6uXClAqyuL8lW1v16m0GyhWUy1Vku2H5KEj5ikQ9W2rivUqgn/hO B8WHwOat9wHLlgKIYCsqjX5RH4/HNskLk6eM4UO6o612hF/8AOM6xyVhkPV3QT0cJnAL CL6R6Vwv/YzRWDvOujXaJgn1r283YSEh1sDVNVHkAkSREdhlHNpODLshsToBOrBcxI9J nddPpU+9VL7gr3OxdS8hSLzGzjrOdwhLrTYM+sbtYcHYI8kiNDHssIeFrXvtCNSAGv1W oURf84EA8z8poP4PGpziZcXNcj/qVRY71or+AEwn5OHPWF6GRrjZPSvEr8mrlhx52d63 /8AA==
X-Forwarded-Encrypted: i=1; AJvYcCW+dxRbZ6+F7EjXN3K83gRs0MVS2BCNX7o6GeFWyToQDPVGJupZhHWH+vETLkTIib4gMznt@ietf.org
X-Gm-Message-State: AOJu0YzCn/orFowfBSyibYf6irZexrOyXpQ4rjBrjU7c5vimifdXiLXm z6QV8yZCv+NCmkyRChW38ObiKUJr7ZnXIfqq9imo0zNGoxZ0H6lkYweC6xRF4b84nBTcjiQ8Yim HG+BVy9BngdquzLEuOpgIQCWBdnN3t46tS/XEG5yhHl56e8g=
X-Gm-Gg: ASbGncsCJtZQ2hA2aR2ZgW/eWw3VSlREpX6suW8uDrSt/QtEJ7Z4ftmJuJ8dy8Fb5+l dL+RhTlApO+ZOjWcpcBp5SJ0SkOkrSxn6EkXgvHcfpwNtPeXqmrJDdCXSOEIz+CGqcg55WEHitE +SfSZnccMIA43SrnYJLsMPh6c9EWyG3Q8=
X-Google-Smtp-Source: AGHT+IFNEVfrUAsJXMiiNSt7nDRDSQagpCpTXUqO4giYzUgc45SgJQddp2Ssvj5cHscj/An6kK1LWp7wp0E8hjNxn5o=
X-Received: by 2002:a17:907:9484:b0:ab3:84ac:4dbc with SMTP id a640c23a62f3a-ab78979492fmr7519966b.0.1738867890349; Thu, 06 Feb 2025 10:51:30 -0800 (PST)
MIME-Version: 1.0
References: <AM8PR07MB81375E2D3CA840AEDA0F7E63C2F72@AM8PR07MB8137.eurprd07.prod.outlook.com> <38891fa7-b188-4767-8364-ae0a10c318b2@huitema.net> <AM8PR07MB81370760A8293580DDDB386BC2F62@AM8PR07MB8137.eurprd07.prod.outlook.com> <537f0095-68a3-43d5-a2f0-f91b4499017d@huitema.net> <AM8PR07MB81377C0A967260302A687113C2F62@AM8PR07MB8137.eurprd07.prod.outlook.com> <5C5E0FCB-1725-4775-9421-F4F5F687D051@CableLabs.com>
In-Reply-To: <5C5E0FCB-1725-4775-9421-F4F5F687D051@CableLabs.com>
From: Tom Herbert <tom@herbertland.com>
Date: Thu, 06 Feb 2025 11:51:18 -0700
X-Gm-Features: AWEUYZkXAP7EtR8sjjrGO04QWD-7BJltNewUumw_JBYqKs4GuIrJbZSvoHDBDIo
Message-ID: <CALx6S35iaABAavJ4aG8hq8b+vKW1FKkz6DcbHCsUeWkeCB6DCg@mail.gmail.com>
Subject: Re: [tsvwg] Re: Robustness to packet reordering
To: Greg White <g.white=40CableLabs.com@dmarc.ietf.org>
Content-Type: multipart/alternative; boundary="000000000000ea8674062d7dba0a"
Message-ID-Hash: DEHTQMABBR5OGLNDR2NMKRTKUDHZ4OLI
X-Message-ID-Hash: DEHTQMABBR5OGLNDR2NMKRTKUDHZ4OLI
X-MailFrom: tom@herbertland.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-quic.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: Ingemar Johansson S <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org>, Christian Huitema <huitema@huitema.net>, QUIC WG <quic@ietf.org>, tsvwg <tsvwg@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/m5K8kODWvA1LxFoPqoNua2-oSCU>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Owner: <mailto:quic-owner@ietf.org>
List-Post: <mailto:quic@ietf.org>
List-Subscribe: <mailto:quic-join@ietf.org>
List-Unsubscribe: <mailto:quic-leave@ietf.org>

On Thu, Feb 6, 2025, 11:00 AM Greg White <g.white=
40CableLabs.com@dmarc.ietf.org> wrote:

> Cross-posting this topic to tsvwg.
>
> > On 2/6/25, 2:36 AM, "Ingemar Johansson S" <ingemar.s.johansson=
> 40ericsson.com@dmarc.ietf.org <mailto:40ericsson.com@dmarc.ietf.org>>
> wrote:
> > [snip]
> > The reason I ask is that we poll the interest in the support for out of
> order delivery of packets in 5G. The outline is that we ensure in order
> delivery for
> > up to some given milliseconds, to handle possible HARQ retransmissions
> on the MAC layer. Beyond that we forward packets as they are processed by
> > the radio stack.
> > The rationale behind this is to avoid that packets for latency sensitive
> flows (streams) are delayed more than necessary if they share the same data
> > radio bearer as other streams.
> > [snip]
>
> This is an important topic relating to the expectations and requirements
> that transport protocols place on layer 2 protocols.  In layer 2 standards
> bodies that I've been involved in, it has been understood that "the upper
> layers" expect in-order delivery, and since the L2 protocols commonly don't
> have visibility or awareness of L4+ sessions (connections, streams, etc.)
> they are often designed to handle L2 retransmissions (or other sources of
> re-ordering in L2) by delaying all frames in the L2 link - to the detriment
> of all latency-sensitive L4+ sessions that might be sharing that L2 link.
>  A few years ago, I recall there was a brief discussion in TSVWG (or
> possibly TSVAREA) about this, and would it be possible to change this
> requirement on L2.  Unfortunately, I don't think any action came from that
> discussion at the time.
>

Greg,

>
There's no requirement for in order delivery, that's fundamental to IP.
There are some L4 protocols that operate better with in order delivery,
like TCP. Selective Acknowledgements mitigate issues with OOO to a large
extent.

There is also a trend in data centers towards packet spaying across
networks. That is each packet in a flow can take a different path to the
destination so that OOO is common. Newer transports can take this into
account (lots of SACKs, conveying packets packed via bitmaps).

Tom


> In my opinion, this is a topic that could use some further discussion.
> It's unclear to me how this requirement has been communicated to layer 2
> standards bodies, so it is similarly unclear to me how the IETF would
> communicate any change to it. Assuming there is a reasonable answer to
> that, what would be a better requirement for the IETF provide to layer 2?
>
> I assume there are some L4 implementations (and tunneling protocols) that
> are reordering sensitive today, so perhaps this isn't an easy thing to
> change, but it would be good to understand the scale of deployment of such
> protocols. In the NQB draft
> https://www.ietf.org/archive/id/draft-ietf-tsvwg-nqb-27.html#section-4.5
> we have a section that mentions reordering sensitive tunneling protocols.
> It references RFC 2983 which describes certain (possibly optional) features
> of IPSEC and L2TP which create some ordering sensitivity. In addition, I
> recall some discussion about replay-attack safeguards in some encrypted
> tunneling protocols that might have problems with reordering.  Obviously,
> older TCP implementations that don't support RACK would have problems with
> reordering.
>
> I would be interested if you could share any aspects of the discussion in
> 5G on this topic.
>
> -Greg
>
>
>
>
>