Re: [ippm] [tsvwg] [iccrg] New Internet Draft: Congestion Signaling (CSIG)

Sebastian Moeller <moeller0@gmx.de> Tue, 20 February 2024 20:35 UTC

Return-Path: <moeller0@gmx.de>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9F188C180B76; Tue, 20 Feb 2024 12:35:16 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.856
X-Spam-Level:
X-Spam-Status: No, score=-6.856 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmx.de
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Df2qXQ2sqCKc; Tue, 20 Feb 2024 12:35:12 -0800 (PST)
Received: from mout.gmx.net (mout.gmx.net [212.227.17.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2DEB6C180B69; Tue, 20 Feb 2024 12:35:12 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.de; s=s31663417; t=1708461305; x=1709066105; i=moeller0@gmx.de; bh=tS8UcqVKV1lxnHlYGe956WRVfzlBZXGZBMYpaxKf8p0=; h=X-UI-Sender-Class:Subject:From:In-Reply-To:Date:Cc:References: To; b=W5uC/KS8x4s4P0zWdUit3Fl74Xi6GnjD2QxCenNz/QA/IjKL3S0b5VfEHlAq4YIW 40vKSpNuxvKvwXDBNdJ7SOwmu22TbcglcGKwboh+z9bVQqjFbfIAFb8kCRoAL2+1r wbszJOINv0Pq7O0eGP4tMpOzE+BOZXv2lgQLfpbz1T7SY2awK/ZLwhmoOqu6uRQEx uDsCS2WXB+Heo/Mlu0+EekRZ2ztWGcfAiCzz7OUQjuS8SOqFrftjCiWa5WqPjm78h oylDKOFUKiyE5zFW2XagkJEMOp7s+cMGfqBGo8cLeuV2+TCxr25x0kYq4p00AghOY s1VkfXO7LtY2fBbyGw==
X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a
Received: from smtpclient.apple ([77.0.25.47]) by mail.gmx.net (mrgmx104 [212.227.17.168]) with ESMTPSA (Nemesis) id 1Mkpex-1rDfOQ2OYZ-00mOCo; Tue, 20 Feb 2024 21:35:05 +0100
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.400.31\))
From: Sebastian Moeller <moeller0@gmx.de>
In-Reply-To: <CALx6S35OJi0p8rSiHWyhGvmkZLKdrAKO3R=O=bgOjHaWQrWQ0Q@mail.gmail.com>
Date: Tue, 20 Feb 2024 21:34:54 +0100
Cc: Christian Huitema <huitema@huitema.net>, tsvwg <tsvwg@ietf.org>, Jai Kumar <jai.kumar@broadcom.com>, IETF IPPM WG <ippm@ietf.org>, Nandita Dukkipati <nanditad@google.com>, iccrg@irtf.org, Naoshad Mehta <naoshad@google.com>, ccwg@ietf.org, Abhiram Ravi <abhiramr@google.com>
Content-Transfer-Encoding: quoted-printable
Message-Id: <EE631A7E-2CAF-4CCC-8932-AED83B4611C0@gmx.de>
References: <CAF0+TDD+44TAHf7y05GzmCgbau66ey7AU2RaVroim_Tukf=7nQ@mail.gmail.com> <CALx6S35V8xyDBkN0m8kDEcNk0N734Fqq0Ne8ZJ284ZnSSUwV9w@mail.gmail.com> <CALx6S35XNyBe5=gh7JpaCKEkiXaEwPGHrDZe=E-EPkiF5mUCLA@mail.gmail.com> <CAB_+Fg5McYXt=M5MNkuxHrKrXQgZMS6PLRoVeUKiSUe5Qb7LjA@mail.gmail.com> <CALx6S35OHyhWjmkV2jiOqO-sB9Csugx0umB_yF_ann9rB8Tgbw@mail.gmail.com> <CAEsRLK9_bHrhyvFqCz3do=Ax3mKZor4EtqXY2chdfL7fzi1UMw@mail.gmail.com> <500388A6-50D3-4535-84CB-E6EF454960DD@gmx.de> <CALx6S37gOatLC_DZiM4M=e8qrzyE9y1D1i+UqOYXatd7Y6Nauw@mail.gmail.com> <918C1325-EC13-48CF-9B29-50EEB3A0FF1C@gmx.de> <CALx6S37zGrNMai+9khwG2_rpsiQuTd8bSiWbxZK-oiVEB0aimQ@mail.gmail.com> <A68A0319-7942-482D-A395-BB72901B2EA7@gmx.de> <CALx6S36AON6GkPLLcBVaq1uKxaRwgvc-txCkb9PCyX0DGs7ktw@mail.gmail.com> <4E3C7A28-C810-4420-A799-81ACC320A5D2@gmx.de> <9a0b8228-ed26-431c-92df-03a29d5f1a0d@huitema.net> <CALx6S35OJi0p8rSiHWyhGvmkZLKdrAKO3R=O=bgOjHaWQrWQ0Q@mail.gmail.com>
To: Tom Herbert <tom@herbertland.com>
X-Mailer: Apple Mail (2.3774.400.31)
X-Provags-ID: V03:K1:GQyIxIvPM1OWK2pW5oFu6Jze3Xeu79VZnWTGwF9J8oxlf3e2CwQ SN/kg9eq2mZSIVsPt4JIC6YX0MEVUBOIiWQdoGOtwj9EywhH6bDSJXlU8zMTjde/F3cMn84 s1AYwsplztXQlb5ehY+ovM8VSQEkEvUaSZlsUOWazHSGenxcWKqchi2Xa4+B0ZReai5CTfm AJ9qGNkYPBhEoWu/5IYtg==
UI-OutboundReport: notjunk:1;M01:P0:CxZEXyfJuHk=;q+c/vVGc7OlEoJ7NjsZmbcRAz8B PUb1N/Wkr494S8wgIdVRVidnZsSHwV91AhNcdjtM2awkdJxsumTewEHRPBym8i6XfHLUcKrqA J42a1/aZrG1cdKW6z5jLD0H6zpXIvxVok5bxNZY9wWTFMH+9gh45qGkMD6YtM2qrEmmfrzaon rKlntNQ+VaSiPdkrsbhAGs4E1UJycLJFzkynRfbLRHEZ+OnOT1SO3YVCw+Qdc44C+Lx0T+Jli Vze23n0nbx2iw2efGL9gJQK4s5KtrZM6UpvPY81XMKOKP77psbNRGIFB6BEUwbX2ivzsup7kp uiz881G2K2quYS2MpfUEvnRWytItmSpK9emfPy5wWBEr4sh6Gr5ZTbCK3yLW8RChc4aEnPmD9 0U0MT01C99VBCExlt98vEgItCSF4qG/Z0y/fqMFt0X3wqFF6/I3uYWaBEorFJsf+Rjlp1z7Mu 6GWJDeWCuGN79M8Vzi/C2T8Aq6s1jQGElTRG7S7O7rJVS4cM6U0l1aveSjOTIsvhPDu9451VZ m1U9xRGoEgaluAMIFQ6HkgndZXznpPekWLY6htyDDwjxT5celdn2zR5yM6wxpTiH9NzIVBNaD 3DPXzLx+2WZvCzG6Ah8yyZ+l0sUBNPgmvc1SlvGSyr1AYagT9RC6NpFmMklD+8JEkUYxMwhn7 /p3SiW7EJPQW+z8xV92RkkcMxTbKvQ6jUBUV1fkpvdXCk/0A6z2THBNCWdG/fHpRESOO5165d U2Rc0+4riSn0pofk6WzE/xtk+bP1XgB7YDWSt3rtaymd9Dv60NbjPCKmcDExhZM6t26SGjkpL /OJWiHGN6Qdam3lc01sf9Y9+IqKXzA6Ys9mRW0u7bneoE=
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/ql-mxu0vE-6sWJ2J7oc6fQvfKSc>
X-Mailman-Approved-At: Wed, 21 Feb 2024 03:45:32 -0800
Subject: Re: [ippm] [tsvwg] [iccrg] New Internet Draft: Congestion Signaling (CSIG)
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 20 Feb 2024 20:35:16 -0000

Hi Tom,


> On 20. Feb 2024, at 21:26, Tom Herbert <tom@herbertland.com> wrote:
> 
> On Tue, Feb 20, 2024 at 12:09 PM Christian Huitema <huitema@huitema.net> wrote:
>> 
>> 
>> 
>> On 2/20/2024 9:55 AM, Sebastian Moeller wrote:
>>>> That's more of a statement of security and not feasibility. There's simply no security in the Internet, so we cannot trust or validate that anonymous intermediate nodes are going to write correct information. Any plain text in a packet on the Internet is subject to inspection and modification if the data isn't authenticated, and in the worst case this could be a DoS vector by writing bad information.
>>> [SM3] Indeed, but e.g. for TCP you would need to know a lot about the most recent packet to be able to play games, no? So either you are on path and already can drop/duplicate packets at will or you are off path but still need a recent enough veridical packet to be able cause mischief, no? (I might be insufficiently creative in attack vectors)
>> 
>> I am analysis congestion control information using the framework of
>> "honest signals". In human communication, "honest signals" are those
>> that cannot be easily faked by the communicator. For example, smiling is
>> not really a honest signal, because it is easy to fake; blushing, on the
>> other hand, is hard to fake.
>> 
>> When it come to Internet wide congestion control, we have pretty much
>> the same issue. Networks may want to fool the application for a variety
>> of reasons, and may start faking congestion signals. Some of these
>> signals are hard to fake. End to end data rate for example: slowing a
>> specific stream of packets is hard to fake; measuring the end to end
>> data rate is a pretty good indication of the state of the network. End
>> to end RTT is also a rather honest signal: yes, routers could put some
>> specific packets in a slow queue, but that requires resource.
>> 
>> Packet losses almost belong in that category. They are not hard to fake,
>> routers could play favorites and selectively drop packets with a certain
>> profile. But dropping too many packets affects the "quality rating" of a
>> provider, so there is some pressure to not fake it. That pressure is
>> probably one of the reasons behind bufferbloat. The main problem with
>> packet loss as a signal is that losses may have other causes than
>> congestion.
>> 
>> ECN is not really a honest signal. Setting a bit in a packet header does
>> not require a lot of efforts, so routers could do that to play
>> favorites. In fact, past bugs in some networks caused almost all packets
>> to be marked as CE. Using ECN is very nice when you can trust it, but
>> end nodes should probably do that cautiously, detecting for example a
>> sudden raise in ECN marks rather than reacting to an average value.
>> 
>> ECN is just one bit. There is always a temptation to do a better ECN
>> with many more bits. For example, CE directs a sender to slow down. It
>> would be nice to have a corresponding "All clear" signal telling the
>> senders that they can speed up. L4S attempts to do that by modulating
>> the CE bit, so that a low frequency kinda indicates "all clear", while a
>> high frequency says "slow down", and give some indication of how much.
>> Suddenly, one bit becomes several bits, just spread over many packets.
>> 
>> The idea of adding more bits in packet headers is not exactly new -- see
>> for example TCP QUIC Start by Sally Floyd et al., RFC 4782, January
>> 2007. The problem is that the more bits you add, the more you exacerbate
>> issues of trust, and also risks of bugs. "Many more bits" may work in a
>> controlled environment, but I really do not see that working on the
>> whole Internet.
> 
> Hi Christian,
> 
> Do you know what the state of ECN deployment over the Internet is?

[SM5] Nobody knows exactly, but quite a lot of Linux servers use the LInux defaults and will use ECN if the client negotiates it. In my qdisc statistics I routinely see not only drops, but also CE marks logged (from my AQM).... so believe it or not, ECN over the internet mostly works...


> It seems to me that if someone is sending to an arbitrary host over the
> Internet they're already pretty much accepting "best effort" service:

[SM5] Not sure about the US, but that is all ISPs offer to end users over here... but ECN works well even over a best effort internet access link in my personal experience.
 
> long latencies and with potentially high variance, such that getting
> fined grained congestion information from intermediate routers, even
> if it's honest, probably doesn't add much to the information that we
> can derive from packet loss or measuring RTT with no additional
> mechanisms or implementation.

[SM5] How can you come to that conclusion without ever trying?


> The situation is very different in a limited domain which could
> include large service provider networks.

[SM5] Indeed, papers discussion 'better congestion signalling' often come out of those environments. But IMHO not because these methods only help in those environments, but that this is where people are willing to spend the money to test and implement potential solutions.

Sebastian

> In that case more information
> is good, it's easier to provide security so we can trust the
> information, and we're not restricted to just one or two bits of
> information to carry the information in a packet. This is also where I
> see host-to-network signaling being useful-- this allows applications
> to request QoS for their packets

> 
> Tom
> 
>> 
>> -- Christian Huitema