Re: [L4s-discuss] rpi 5 and hardware ptp

rjmcmahon <rjmcmahon@rjmcmahon.com> Mon, 08 April 2024 21:12 UTC

Return-Path: <rjmcmahon@rjmcmahon.com>
X-Original-To: l4s-discuss@ietfa.amsl.com
Delivered-To: l4s-discuss@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1BFE7C14CF0C for <l4s-discuss@ietfa.amsl.com>; Mon, 8 Apr 2024 14:12:21 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.096
X-Spam-Level:
X-Spam-Status: No, score=-1.096 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HK_RANDOM_ENVFROM=0.001, HK_RANDOM_FROM=0.999, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=rjmcmahon.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id fuiHF2G0bZf0 for <l4s-discuss@ietfa.amsl.com>; Mon, 8 Apr 2024 14:12:17 -0700 (PDT)
Received: from bobcat.rjmcmahon.com (bobcat.rjmcmahon.com [45.33.58.123]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 091FAC14F6FA for <l4s-discuss@ietf.org>; Mon, 8 Apr 2024 14:12:16 -0700 (PDT)
Received: from mail.rjmcmahon.com (bobcat.rjmcmahon.com [45.33.58.123]) by bobcat.rjmcmahon.com (Postfix) with ESMTPA id 9E8911B289; Mon, 8 Apr 2024 14:12:16 -0700 (PDT)
DKIM-Filter: OpenDKIM Filter v2.11.0 bobcat.rjmcmahon.com 9E8911B289
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rjmcmahon.com; s=bobcat; t=1712610736; bh=EU10Hhp3mHn04X0UR0j1VBGNlWQkU7r1Y9eiM5bDfNM=; h=Date:From:To:Cc:Subject:In-Reply-To:References:From; b=IfQPD8pzbLggzB7duNnl4vvOMQKaVm7dmVeAldFVyMzLbVNTKEYpy8g5Q3enqloLi d6Y7mp5yvUexQudBpjthI3qZWVxm1uVXWy56j348EeALayHTEvAP9pd+OBDX5jD8mp ZPgUlPeVKxVbR5m7e0DjbkU4pKL6jfcePEqZNJZI=
MIME-Version: 1.0
Date: Mon, 08 Apr 2024 14:12:16 -0700
From: rjmcmahon <rjmcmahon@rjmcmahon.com>
To: "Rodney W. Grimes" <ietf@gndrsh.dnsmgr.net>
Cc: l4s-discuss@ietf.org
In-Reply-To: <202404082057.438KvB9m091986@gndrsh.dnsmgr.net>
References: <202404082057.438KvB9m091986@gndrsh.dnsmgr.net>
Message-ID: <1d79058c568151d35da00843569e7b8d@rjmcmahon.com>
X-Sender: rjmcmahon@rjmcmahon.com
Content-Type: text/plain; charset="US-ASCII"; format="flowed"
Content-Transfer-Encoding: 7bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/l4s-discuss/MF0sEVOfwSc6CZj4L5MbjhBMqZE>
Subject: Re: [L4s-discuss] rpi 5 and hardware ptp
X-BeenThere: l4s-discuss@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: "Low Latency, Low Loss, Scalable Throughput \(L4S\) " <l4s-discuss.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/l4s-discuss>, <mailto:l4s-discuss-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/l4s-discuss/>
List-Post: <mailto:l4s-discuss@ietf.org>
List-Help: <mailto:l4s-discuss-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/l4s-discuss>, <mailto:l4s-discuss-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 08 Apr 2024 21:12:21 -0000

On 2024-04-08 13:57, Rodney W. Grimes wrote:
>> >
>> > Your kernel should have full support for ECN and PACING.
>> > sysctl net.ipv4.tcp_ecn
>> > to check for ecn state, 2 is the default, you probably want to
>> > flip this to 1 on the end running iperf -s to get a ecn connection.
>> >
>> > PACING is a setsockopt, try man tc or man fq and search for pacing.
>> >
>> 
>> Thanks for this. Which CCA will impelement ECN based pacing?
> 
> I know of none that implement ECN and Pacing at the same time,
> other than L4S may be able to do that, but not sure if that
> is in the stock L4S tree or if it requires combining some
> patches.
> 
> BBR can use pacing, but iirc it does not use ECN, which may be
> fixed in bbr3, but I dont know if that has hit a mainstream
> kernel yet.
> 

A reason I added fq-rate-step is to allow network engineers to validate 
source pacing as the best option for e2e link treatment. This combined 
with bytes/packets inflight, cwnd and RTT should allow one to test the 
effectiveness of pacing and then push for ECN or AccurateECN controlled 
pacing, a la L4S. It's an interim test for ECN (including L4S) 
"non-believers" so to speak.

After that, I plan to add CE bit instrumentation. But that requires a 
marking plane (e.g. iproute2 diffs) and a CCA both coming from standard 
kernels. Testing private kernels isn't sufficiently conclusive and 
something I try to avoid if possible.

Note: I added support for TCP_TX_DELAY (thanks to the prescience of Eric 
Dumazet) so one can affect different RTTs per socket. It can be set on 
client, server or both.

--tcp-tx-delay n,[<prob>]
Set TCP_TX_DELAY on the socket. Delay units are milliseconds and 
probability is prob >= 0 and prob <= 1. Values takes float. See Notes 
for qdisc requirements.

(Ignore the probability part for now as it's not fully vetted and 
doesn't really work.)

Bob