Re: [L4s-discuss] Expected ACK ratios with accurate ECN ?

Ingemar Johansson S <ingemar.s.johansson@ericsson.com> Wed, 10 January 2024 09:29 UTC

Return-Path: <ingemar.s.johansson@ericsson.com>
X-Original-To: l4s-discuss@ietfa.amsl.com
Delivered-To: l4s-discuss@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F2E9CC1CFC5B for <l4s-discuss@ietfa.amsl.com>; Wed, 10 Jan 2024 01:29:09 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.108
X-Spam-Level:
X-Spam-Status: No, score=-2.108 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id sxBZ9BLOkHtU for <l4s-discuss@ietfa.amsl.com>; Wed, 10 Jan 2024 01:29:05 -0800 (PST)
Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-vi1eur04on2053.outbound.protection.outlook.com [40.107.8.53]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 518ACC1CFC55 for <l4s-discuss@ietf.org>; Wed, 10 Jan 2024 01:29:05 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=f5N2O62LqpRAmbA/iBtIXE2A+PZYNizYrBWVD+0XzWo+5od/nsT3zJAqAeg2fLHGvq9gwjiZpIBdm/AHURy1BlCnxJGSe0yn9zr4azjAzmjbQfEL+npsZ+dfp4dcA3Zh2MPgqH1dXQ10QMMCdINAFTKbKbX2Olo4RIwFrLPegIjh0m6zEs4jNjelQ/LdfxvvjMhxRQVBauaxfpwahrXuhv19BWwJmAOLbHbNtqKtogayDygqTVTbrmKrvXbEqHWCCGXAixPxK7i2NYLDfOLOPSXFDrBslRaMCyPSLx2bg1SdHYtoXbSRpxB3Z0wSoUEB1D0nvo2L+UoJFHi59Wfctg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=2tl89bz01vaCuEAhKiiHnA8vCf9gsvymXaOJ8JL7VQY=; b=B5IDGcpk3pVMVpbnysXoISpkPsVqK26ORQIR+rZhmQodBDO3blRVCaWsABcdrUPQBJgDs6qzQa2ZWYw+Jcw4rVOOCKLNTLqkvRwkUCVbFh+JA3Za84Z5FRrncqyFdf9QgzAaqO1XE35yiBB0IkN18v/61rNA+LbP1ycRxZZA70Tfn7UpJcWCBATJ1a5GFcYNFmh64qtPqNKjICopU0xlN1ZpeJBCIXb1uCoAsJX/5sjKHsrcurQAloVSkLgMlVNn1fAf4eH5pDDxxh/QIjyyI9Y5YfLuHihKlqqLdLOeGhU4FdZ2Ie2c845TX9+/y+Hi9LVPOBOmm0QRq6B/a3XVdw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=2tl89bz01vaCuEAhKiiHnA8vCf9gsvymXaOJ8JL7VQY=; b=TdOuDZdOP1AQRe8u8tnB94uEHoOBPNr785Fr/fpPgHAXE4SrVv4wwnCHC/v7qdN9OEGp3DQwCm4DOA6EYKsH4hbvny3eQtKOb8k92QUXOn7rvzZAaRtsOCsmbng1i7t40dIq6fsRjLS/1HDVS2GE5BWtYEtZzgJFpVwljv+aIA+MgKmTxCs/g40/FxZf4cHN2E1mBz/0UbXb6E1VhHCsjL5oxbjL8HJMyul/5cBYFnKt5UxGX21LEbh3kKtEiM88pshKATO8Y1xYPuFOKf5fFCKZuRBKOpsBtWHcil5Jmtk3R/Hm5Caz784Z5joI+YGSVqjJQIVCp6QvQwTwjM7VaA==
Received: from AM8PR07MB8137.eurprd07.prod.outlook.com (2603:10a6:20b:36c::18) by AM9PR07MB7860.eurprd07.prod.outlook.com (2603:10a6:20b:30d::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7181.17; Wed, 10 Jan 2024 09:29:02 +0000
Received: from AM8PR07MB8137.eurprd07.prod.outlook.com ([fe80::f75a:bee7:cfdd:5d47]) by AM8PR07MB8137.eurprd07.prod.outlook.com ([fe80::f75a:bee7:cfdd:5d47%3]) with mapi id 15.20.7159.020; Wed, 10 Jan 2024 09:29:02 +0000
From: Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
To: Neal Cardwell <ncardwell@google.com>, Ingemar Johansson S <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org>
CC: "l4s-discuss@ietf.org" <l4s-discuss@ietf.org>, Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
Thread-Topic: [L4s-discuss] Expected ACK ratios with accurate ECN ?
Thread-Index: AdpCzfLFQ0mkaL6ER6K6my30mQn0IAAUvGWAACFvKIA=
Date: Wed, 10 Jan 2024 09:29:01 +0000
Message-ID: <AM8PR07MB81378DC0854EB64EAF3BFFB3C2692@AM8PR07MB8137.eurprd07.prod.outlook.com>
References: <AM8PR07MB813731A5A3080ADADBE083E1C26A2@AM8PR07MB8137.eurprd07.prod.outlook.com> <CADVnQykvABwjmjj7RN3ChYU=yndbKHRjjJGiovsVEdCnkR2Euw@mail.gmail.com>
In-Reply-To: <CADVnQykvABwjmjj7RN3ChYU=yndbKHRjjJGiovsVEdCnkR2Euw@mail.gmail.com>
Accept-Language: sv-SE, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=ericsson.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: AM8PR07MB8137:EE_|AM9PR07MB7860:EE_
x-ms-office365-filtering-correlation-id: f44fc6da-f386-4b78-96eb-08dc11be94e0
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: ACwDbYfWbJ8U6gmcr2A//q+cRuh11+R/BVf4prKOI1ISXhBiG329QbPWtlmyxoin6BMHEGh/+E2Y13HapG3l77wqdvW36juPR08Z3rMsZ1UUOqGYqoUDBHFFX8GFzV+TCAEE0WS1Iy5d0f1ABEO9ZsIcINL7cSVSCyziODHNunfun4JtXijzCBf9oq+ujzZ0mtAECqFBt+8ZX6EkUgqeB+fMH86cYaTf4u8Blrne+v1LBNZ675XV11NSckS0ibPQ4Wt5OQOry6P6ghew5JXpj9DqXGzSitD2mAb4vi3O8UHKsY8afgzdmjmkSD+WiEdcHgs2U0ch4atOxW6pYEZ+BSJDmYrp2QLahzJKTf/WxFCBrVB2ipZthM2OQE3uduUFzStPoub30E94RH/p3Ms7Drq9tQq48w1rdFEKtqxdPuli6gslHLFi9L0l98wtn7S1+GntQrBncWM8f1P4YCI0mSu4W1OYN4ZAdExfPnTzzvEUUFYA2eyacN6KjFB5SZjaXKJgOazwsSSY8EcI/vKFErDEO1Us5UBux0iePsGKtDUyH1zEfJFX1zB5RIxBcWrV6OdUzEsQPtg2Na5H4k8AYF6gqOSg7j+srVnGIY8n16jU8acXZyLZWymk0IQJZO/iBiSyCQsRZXpt11sykjZ/IyASWKssmEhwWxc4FsFOW1lY9GkJlS+aSNVtNp1wyHXY
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM8PR07MB8137.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(346002)(39860400002)(366004)(376002)(396003)(136003)(230922051799003)(1800799012)(451199024)(64100799003)(186009)(82960400001)(66574015)(107886003)(38070700009)(5660300002)(2906002)(83380400001)(316002)(966005)(66946007)(54906003)(66476007)(66446008)(52536014)(64756008)(110136005)(4326008)(8676002)(8936002)(478600001)(26005)(166002)(41300700001)(122000001)(76116006)(38100700002)(9686003)(66556008)(86362001)(53546011)(7696005)(71200400001)(33656002)(55016003)(6506007); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: IhBS/rO2gEl8J6I+dxONOW7wgrJdrkijkM017HDKxDWsFIwE6Bzbb2KPV0SNZU1pZiPO/zw9RnOdZZNFhB7D9PC4aQaTEPgXd+GlVpJ7kQ2fJ4np5/mImWV1Z4DFuz696S0a4jNCApTvXTRPzx5AoDoGBpp0y4NGghN/k/2aKM6XNQUqxpb7vch3tEM6ALCKE2Wgr7pO0B/VeQYTO7FvvSYS1cdXNLSbKLMUcRaH0O4Ny8OHpew0jqryCd6OyBBShVBY8n+uhq9+AlmuO1FjiB8wDuPIBYR7yu16KGUEnt/WohO+COo6HVo16BC3RmkBzDBCzylAenmfroedI0+knfBvYQ7HumKl4Z5dmJMSZ1krl/PgxUpJgfqZs8103WisYeHqfRt5zJ26jv7KuOW/Y0dsj06Ev1idL0l/xmO+ZzEq5xqJp5szyp3vXeVrEPw1URBurrvScZPoGzWRMnAZ7ey6vuG2XEuX/d+j31x5x1caFXijw4wqFibtt2mhUp6BaieKUMuDow/pstemGgiuSyfjAI0cjNQYCVDJgmEehpIHKuzw7dyrabuLA/ZUSQBpSrgsa+oSfUG3I0tOlCg7rIxJ2SoMcXz8tZjjB2C+QC3to11fmSo9EO+B47413Ba8N15CJAhuXrXhVI7b7T8nWBiq36RPPZP0Ndky4xRw0k5fflUCDNT0KTRgsqv8tboY9FZNmPo13i4q/3MnWGvk6ZI5pZAh+l8QKyIwMjQcYmCz4Je8VzoI8RTbdU+fi1c6wxyvbX2/rfsR5sJTacD0pfM48xfHlrAgWrn61wF6SHCA14qjLRPFFovYOh/QMOxo+dI2NrZDk0LWu3KLdCEqDn09jcvDlhPfOK+X8rJ+QoqxgYlcBoqwnttRhqWvYGXKMcCHJnoPI3OLlReyb+/CZsvuuq5pUaDmW0gq2fU/1H2YHn0jQfFraeexaufhsAbp1LCtP73l4XbN6NcdoyXOOKOW40y0pTdMchdBbYDQp+si5c/3RaYZskg6+IIWmBAvXU5D0VrKa8zitfQZO+1grNqzhev5um3WCBJzwaE/R9JsyHdPc2U2eHlEJhUxuuJZ3jMJWXKtt2XXbzl5Wk6hOK5BgGMhoelLkluSFeo+gmJdM01TBq0qBY/Zin3gTz30AAEvwXDwOSkjQcyuB+L1R1wowH7kv3vc/X6ozqKuAI8oPjN8WCzm5xuA49t0bNDozy1XfODQcAOD0+etZ2JHkaSx9WyDKQft+f+mGnLlcjuxHDMlsYBCnkyk4vQ9HUFkml516tDA6LR2yX/a99CyExIbwd0FYk22dV4JGmvSyvbkUrlMGxf1MOAKV3WLTOtx6SsePONgkcKEWeqOzQfmsfg5Y58GJubAQP8KBkGkCWfEUxIl6CsOBVj+zlsIvFMPNIVLxiFvQA9UQWmetRiqG+vQYYukjBtWyJCx1x9hpbmv3NGoTV7kmz9YVdCPEvEcQwms7qavV57Ssu+kkKw0tNtWTBaNS9NCxcv8uQZGr4wQBtfaOgtp5fEgRkfhwD2yNewQAtc4CIq/MvPwgsWdkKRI71c4fF8cFZoWp3qQCQKjJZ7PZnyFAPAU9fReRSYy03tXpi+omS28pH69S5no/A==
Content-Type: multipart/alternative; boundary="_000_AM8PR07MB81378DC0854EB64EAF3BFFB3C2692AM8PR07MB8137eurp_"
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM8PR07MB8137.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: f44fc6da-f386-4b78-96eb-08dc11be94e0
X-MS-Exchange-CrossTenant-originalarrivaltime: 10 Jan 2024 09:29:01.8830 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: g+8bLe/QH/Hp1UGb9jFzjnQhlVMyBkdhkJl8CKZJq+0hE1iMxf1El7K1VTu/v4LHZu9XQjmLrs5W3mP+mV3WdFvJmdZG9AMSb3BeyUuCOSltWIrM5as1ask60P948MFn
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM9PR07MB7860
Archived-At: <https://mailarchive.ietf.org/arch/msg/l4s-discuss/XI_Jh8ACSZM9JljUza8NyE84crQ>
Subject: Re: [L4s-discuss] Expected ACK ratios with accurate ECN ?
X-BeenThere: l4s-discuss@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: "Low Latency, Low Loss, Scalable Throughput \(L4S\) " <l4s-discuss.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/l4s-discuss>, <mailto:l4s-discuss-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/l4s-discuss/>
List-Post: <mailto:l4s-discuss@ietf.org>
List-Help: <mailto:l4s-discuss-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/l4s-discuss>, <mailto:l4s-discuss-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 10 Jan 2024 09:29:10 -0000

Hi
and thanks for the insight. One thing I did not mention is that we actually load the 5G cell with 5 UEs (= modems) running IPerf. Given that they have roughly the same radio conditions, each UE would get ~1.2Gbps/5 = 240Mbps. Given your calculation below then
0.24 * 10^9 / (1500*8) * .000250 ~= 5 packets
So perhaps 1:12 is quite reasonable after all?

/Ingemar

From: Neal Cardwell <ncardwell@google.com>
Sent: Tuesday, 9 January 2024 18:26
To: Ingemar Johansson S <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org>
Cc: l4s-discuss@ietf.org; Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
Subject: Re: [L4s-discuss] Expected ACK ratios with accurate ECN ?



On Tue, Jan 9, 2024 at 2:32 AM Ingemar Johansson S <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org<mailto:40ericsson.com@dmarc.ietf.org>> wrote:
Hi

I wonder what ACK ratios one can expect with Accurate ECN ?.
In one 5G experiment with large file transfers we see a downlink throughput of 1.12Gbps and an uplink bitrate of 4Mbps, attributed to TCP ACKs.
The downlink is loaded close to 100% so one should expect quite frequent L4S marking.

IIRC the Prague sending rate is supposed to be roughly (1/p - 1) in Mbit/sec, where p is the ECN marking probability. So to reach 1.12Gbps the marking probability should be roughly 1/1120, which is quite low. So ECN marks should be rare and should not interfere with aggregation or change ACKs much.


4Mbps in UL and 65 byte ACK packets would mean 7600 ACKs/s
1.12Gbps in DL and 1500 byte packets would mean 93000 pakets/s
This implies an ACK ratio of 1:12. I think that this sounds reasonable, or ?
Regards
A ratio of 1:12 sounds reasonable to me for that workload. The Prague CC module tries to send bursts of 250us worth of packets:
  https://datatracker.ietf.org/doc/html/draft-briscoe-iccrg-prague-congestion-control-01#section-2.5.2

At 1.12Gbps that's roughly:
  1.12 * 10^9 / (1500*8) * .000250 ~= 23 packets
So if all layers are optimized perfectly then there should be about 23 data packets per ACK. So 12 data packets per ACK is pretty good. Perhaps the receiving  5G chip or driver or GRO coalescing behavior is passing batches of only 12 data packets per skbuff up to the receiving TCP layer (which TCP should then ACK immediately).

cheers,
neal

/Ingemar


====================================
Ingemar Johansson  M.Sc.
Master Researcher

Ericsson AB
GFTL ER Networks RNS Protocol & E2E Perf
Labratoriegränd 11
977 53, Luleå, Sweden
Phone +46-1071 43042
SMS/MMS +46-73 078 3289<tel:+46%2073%20078%2032%2089>
ingemar.s.johansson@ericsson.com<mailto:ingemar.s.johansson@ericsson.com>
www.ericsson.com<http://www.ericsson.com/>

  The past is never the past. It is always present.
       And you better reckon with it in your life
   and in your daily experience, or it will get you.
                  It will get you really bad.

                      Bruce Springsteen
=====================================

--
L4s-discuss mailing list
L4s-discuss@ietf.org<mailto:L4s-discuss@ietf.org>
https://www.ietf.org/mailman/listinfo/l4s-discuss