Re: [iccrg] [tsvwg] New Internet Draft: Congestion Signaling (CSIG)

Tom Herbert <tom@herbertland.com> Sun, 18 February 2024 16:49 UTC

Return-Path: <tom@herbertland.com>
X-Original-To: iccrg@ietfa.amsl.com
Delivered-To: iccrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A7FBDC14F60A for <iccrg@ietfa.amsl.com>; Sun, 18 Feb 2024 08:49:12 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.107
X-Spam-Level:
X-Spam-Status: No, score=-2.107 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=herbertland.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id uW8XtqJLyn1V for <iccrg@ietfa.amsl.com>; Sun, 18 Feb 2024 08:49:08 -0800 (PST)
Received: from mail-ed1-x52a.google.com (mail-ed1-x52a.google.com [IPv6:2a00:1450:4864:20::52a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BEA2AC14F5F7 for <iccrg@irtf.org>; Sun, 18 Feb 2024 08:49:03 -0800 (PST)
Received: by mail-ed1-x52a.google.com with SMTP id 4fb4d7f45d1cf-55f50cf2021so4834139a12.1 for <iccrg@irtf.org>; Sun, 18 Feb 2024 08:49:03 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=herbertland.com; s=google; t=1708274942; x=1708879742; darn=irtf.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=kWcR8tnvmIWv/WctPVajkCDXfJBYlNZfSdu4b9mtTjw=; b=N1B0DqSAQoGW8NTtZV4kCVoP07ytRuoDhW+U3Fy0DMTiOI4103lq/ynQEyQQgu/nOD e31nBlBy5En97Cnmn6XfzyN7QkeMGjQp9zfUMjZgmy6dNlPyBBW59uy4dNxqrMVdU/lL ormpdH8eYMWHFiqsTkUbkjEInOhcZpxJXc1ERJ24J2gDRj6BH31dR6g5VaudiCE0+4NP 06k/AimQIVNdILDsH5mRxvtu2upJFsnkp79XqIeA5gpRmrB+yKtOhI6GFAslA5CUu/V3 1b/wqN5juafVCrQEuCuIm+5P88mTuIBbj90SA4qo6q1SQralid12YK7nLgYUH6tEqdf/ v+kg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1708274942; x=1708879742; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=kWcR8tnvmIWv/WctPVajkCDXfJBYlNZfSdu4b9mtTjw=; b=gdGlYq5H8mAPKppTndnE9pPPYt9a6IAFZgNOP2TmUEgFL7GNiB3p2aBMINA3mSqCDx Fl8bveswhLpNRDGnokdm9MtAThQfzP7ZGKreBu26PRSGX1gQ5zjHqbdW4T6QrsnZAV3A Vv3DetX3+EIo/eF+82DhwPSl7c6UbAiDFvBs0EJ6bmQvJlzN5ZQJP2aaMgTbU9gdRQPP ilShdUXzdBmz0ELm0HmA1jbxuCwNSUCwh8IMMI7QlWd+LiTld0z00eI/jofrymFXq8rk a0aChpSzZ7qd47W14/IUtnjWgvkDnMd25hvA/QTWmn1BGYCAyCWGF7wnX8jvaQHEcO1g FiJw==
X-Forwarded-Encrypted: i=1; AJvYcCUh3DTt0O+mdqeGu27tmXrrp1zPvnux01G/ctGKDS4vVsSUpueWK+Y1Hb2Gd9ioULo6QD2Iv+V6h1C7m/+q8Q==
X-Gm-Message-State: AOJu0YzhZFOk/3DlaYsTPpGoDNPWNYFCTdQ9y3kB1+OXAmConIKAmZLh YnPuuJrd0+0uivRkEGM/vqg8uIsQxKUOGKIAODn0ZP7XjhYIlXRDASr17aI4Pe/2KwFqpinFvXQ BZJaQfMPjJshK6kjFYEByA1ImbNnvlL70xuE8
X-Google-Smtp-Source: AGHT+IFCP9XFuEKisPBjv4AykZmwBta/yYMXR7oywjEAtoy7gwqaL/McTmNH82eICKi27cha8a2xvteuNPyCosImzTM=
X-Received: by 2002:a05:6402:2151:b0:563:bd60:5809 with SMTP id bq17-20020a056402215100b00563bd605809mr7201475edb.31.1708274941659; Sun, 18 Feb 2024 08:49:01 -0800 (PST)
MIME-Version: 1.0
References: <CAF0+TDD+44TAHf7y05GzmCgbau66ey7AU2RaVroim_Tukf=7nQ@mail.gmail.com> <CALx6S35V8xyDBkN0m8kDEcNk0N734Fqq0Ne8ZJ284ZnSSUwV9w@mail.gmail.com> <CALx6S35XNyBe5=gh7JpaCKEkiXaEwPGHrDZe=E-EPkiF5mUCLA@mail.gmail.com> <CAB_+Fg5McYXt=M5MNkuxHrKrXQgZMS6PLRoVeUKiSUe5Qb7LjA@mail.gmail.com> <CALx6S35OHyhWjmkV2jiOqO-sB9Csugx0umB_yF_ann9rB8Tgbw@mail.gmail.com> <CAEsRLK9_bHrhyvFqCz3do=Ax3mKZor4EtqXY2chdfL7fzi1UMw@mail.gmail.com>
In-Reply-To: <CAEsRLK9_bHrhyvFqCz3do=Ax3mKZor4EtqXY2chdfL7fzi1UMw@mail.gmail.com>
From: Tom Herbert <tom@herbertland.com>
Date: Sun, 18 Feb 2024 08:48:49 -0800
Message-ID: <CALx6S347exOZhHtsJCwDA3mZEBjMW=c5GYRgOiAJUNUbEG=SOQ@mail.gmail.com>
To: Matt Mathis <mattmathis@measurementlab.net>
Cc: Nandita Dukkipati <nanditad@google.com>, Abhiram Ravi <abhiramr@google.com>, IETF IPPM WG <ippm@ietf.org>, tsvwg <tsvwg@ietf.org>, ccwg@ietf.org, iccrg@irtf.org, Naoshad Mehta <naoshad@google.com>, Jai Kumar <jai.kumar@broadcom.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: <https://mailarchive.ietf.org/arch/msg/iccrg/w03KEWr3iIO24gEldjbYCOpMnag>
Subject: Re: [iccrg] [tsvwg] New Internet Draft: Congestion Signaling (CSIG)
X-BeenThere: iccrg@irtf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: "Discussions of Internet Congestion Control Research Group \(ICCRG\)" <iccrg.irtf.org>
List-Unsubscribe: <https://mailman.irtf.org/mailman/options/iccrg>, <mailto:iccrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/iccrg/>
List-Post: <mailto:iccrg@irtf.org>
List-Help: <mailto:iccrg-request@irtf.org?subject=help>
List-Subscribe: <https://mailman.irtf.org/mailman/listinfo/iccrg>, <mailto:iccrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Sun, 18 Feb 2024 16:49:12 -0000

On Sat, Feb 17, 2024 at 11:17 AM Matt Mathis
<mattmathis@measurementlab.net> wrote:
>

Hi Matt,

> I think the L2/L4 split is brilliant.

As opposed to the L1-L7 split being brilliant? :-)

> Putting the forward instrumentation as low as possible in the stack permits easy processing in HW w/o parsing any L3.

A switch is already doing IP routing which requires parsing of L3. If
we insert more information into L2 that makes it a variable length
header which actually makes processing *harder*, not easier,
especially for legacy devices that don't support CSIG. If this is done
in a Hop-by-Hop Option, then all the protocols a router looks at are
at fixed offsets and fixed length (Ethernet header could be at offset
0, IPv6 header is at offset 14, and the CSIG information is at offset
54)-- that's the best case scenario for Hw router processing.

> Putting the replies in L4 only requires a handful of implementations to cover all possible paths,

I'm not sure "a handful of implementations" could cover all possible
paths. The draft only talks about TCP and QUIC, but that is hardly a
complete set of protocols-- there's RTP, GTP, ROCEE, and various
tunneling protocols to name a few. On the other hand, if this
information is in the Network layer then there are at most two
protocols that need to be extended: IPv4 and IPv6. This also true at
the link layer, this proposal would need to extend Ethernet, Mobile,
and tunnels. The fundamental premise of a network layer protocol is
that it works with *any* transport layer above it, and *any* link
layer protocol below it (that to me is the brilliant thing :-) ).

> and piggybacks on existing solutions to session layer issues, such as authentication and authorization.

But that only considers the return path of the signals, not the
forward path so it could only solve half the problem. If the forward
path is in L2 then we can't leverage Internet protocols for
authentication (maybe there's ways to do this at L2 but then we have
to consider every L2 protocol and regardless the the path
characteristics are very different in both directions of
communications and the protocols aren't even under the same SDO). If
we use L3 in both directions then we can leverage all of the IETF
protocols. For instance, if E2E authentication is required, then it's
just a matter of using AH in both directions (note the presence of AH
in packet doesn't affect router processing).

>
> I would consider mentioning but then temporarily excluding alternet placements: either as a shim at the top of L2, sort of like VLAN tags, or within an L3 option.   Both of these have their own challenges, but might be extremely valuable in some environments.

There have been a *lot* of discussions and work in IETF on how to
optimize router processing for network to host signaling like this
draft is proposing.  Please look at IOAM, the work being done in 6man
to make Hop-by-Hop Options viable, and work done in tunneling
protocols that are intended to be processed in HW.

Tom

>
> On Sat, Feb 10, 2024 at 7:42 AM Tom Herbert <tom=40herbertland.com@dmarc.ietf.org> wrote:
>>
>> On Fri, Feb 9, 2024 at 10:53 PM Nandita Dukkipati <nanditad@google.com> wrote:
>> >
>> > Hi Tom,
>> >
>> > We updated the draft, correcting some nit errata, and to not let the draft expire. It's not discussed in any other mailing lists.
>>
>> Thanks Nandita.
>>
>> I still have fundamental concerns about the protocol layering in this
>> draft, please see my previous comments on that. The draft defines a
>> protocol for end-to-end network to host signaling and IMO, such a
>> protocol belongs in the network layer but the draft puts the protocol
>> in L2 and L4 and seems to avoid L3 without explanation. IOAM defines a
>> very similar method of signaling and RFC9486 is a good model for
>> network layer protocol that provides network to host signaling.
>>
>> Tom
>>
>> >
>> > Nandita
>> >
>> > On Thu, Feb 8, 2024 at 3:53 PM Tom Herbert <tom@herbertland.com> wrote:
>> >>
>> >> Hi,
>> >>
>> >> I noticed there is now an -01 version of the draft posted on Feb. 2.
>> >> Is this draft being discussed on some other list?
>> >>
>> >> Thanks,
>> >> Tom
>> >>
>> >> On Sat, Sep 9, 2023 at 9:09 AM Tom Herbert <tom@herbertland.com> wrote:
>> >> >
>> >> > Hi, thanks for draft!
>> >> >
>> >> > The first thing that stands out to me is the carrier of the new packet headers. In the forward path it would be in L2 and in reflection it would be L4. As the draft describes, this would entail having to support the protocol in multiple L2 and multiple L4 protocols-- that's going to be a pretty big lift! Also, L2 is not really an end-to-end protocol (would legacy switches in the path also forward the header)l?).
>> >> >
>> >> > The signaling being described in the draft is network layer information, and hence IMO should be conveyed in network layer headers. That's is L3 which conveniently is the average of L2+L4 :-)
>> >> >
>> >> > IMO, the proper carrier of the signal data is Hop-by-Hop Options. This is end-to-end and allows modification of data in-flight. The typical concern with Hop-by-Hop Options is high drop rates on the Internet, however in this case the protocol is explicitly confined to a limited domain so I don't see that as a blocking issue for this use case.
>> >> >
>> >> > The information being carried seems very similar to that of IOAM (IOAM uses Hop-by-Hop Options and supports reflection). I suppose the differences are that this protocol is meant to be consumed by the transport Layer and the data is a condensed summary of path characteristics. IOAM seems pretty extensible, so maybe it could be adapted to carry the signals of this draft?
>> >> >
>> >> > A related proposal might be FAST draft-herbert-fast. Where the CSIG is network to host signaling, FAST is host to network signaling for the purposes of requesting network services. These might be complementary and options for both may be in the same packet. FAST also uses reflection, so we might be able to leverage some common implementation at a destination.
>> >> >
>> >> > Tom
>> >> >
>> >> > On Fri, Sep 8, 2023, 7:43 PM Abhiram Ravi <abhiramr=40google.com@dmarc.ietf.org> wrote:
>> >> >>
>> >> >> Hi IPPM folks,
>> >> >>
>> >> >> I am pleased to announce the publication of a new internet draft, Congestion Signaling (CSIG): https://datatracker.ietf.org/doc/draft-ravi-ippm-csig/
>> >> >>
>> >> >> CSIG is a new end-to-end packet header mechanism for in-band signaling that is simple, efficient, deployable, and grounded in concrete use cases of congestion control, traffic management, and network debuggability. We believe that CSIG is an important new protocol that builds on top of existing in-band network telemetry protocols.
>> >> >>
>> >> >> We encourage you to read the CSIG draft and provide your feedback and comments. We have also cc'd the TSVWG, CCWG, and ICCRG mailing lists, as we believe that this work may be of interest to their members as well.
>> >> >>
>> >> >> Thank you for your time and consideration.
>> >> >>
>> >> >> Sincerely,
>> >> >> Abhiram Ravi
>> >> >> On behalf of the CSIG authors
>>
>> _______________________________________________
>> iccrg mailing list
>> iccrg@irtf.org
>> https://mailman.irtf.org/mailman/listinfo/iccrg
>
>
>
> --
> Thanks,
> --MM--
> Evil is defined by mortals who think they know "The Truth" and use force to apply it to others.