[tcpm] Re: [CCWG] CWND increase in CUBIC and ACK policy

Yoshifumi Nishida <nsd.ietf@gmail.com> Tue, 18 August 2026 09:02 UTC

Return-Path: <nsd.ietf@gmail.com>
X-Original-To: tcpm@mail2.ietf.org
Delivered-To: tcpm@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 4819E12B7D9BA for <tcpm@mail2.ietf.org>; Tue, 18 Aug 2026 02:02:51 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1787043771; bh=l4P0woyVLb0m1F87cro1VGOUGkMeO/r5u0Le4vluBs8=; h=References:In-Reply-To:From:Date:Subject:To:Cc; b=pXkM1looes6V3+rw9Ho9xwWCeebnJBrIp4zGsoD+XSMb4RTwLbKiWnWtT3k2qnFU5 zIeEOb9u5A9FWRUjVnFAwaQNG/NRIe0X+rykrzUeOaGhsGBuaCsHVLtZtF0BghcHD3 y5KCkG1/fWA1gMKCkWloQd8x5wjfRo+pAbd+ne1Y=
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -2.098
X-Spam-Level:
X-Spam-Status: No, score=-2.098 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id P819F7nofjp4 for <tcpm@mail2.ietf.org>; Tue, 18 Aug 2026 02:02:50 -0700 (PDT)
Received: from mail-lj1-x233.google.com (mail-lj1-x233.google.com [IPv6:2a00:1450:4864:20::233]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id AAB5112B7D98A for <tcpm@ietf.org>; Tue, 18 Aug 2026 02:02:50 -0700 (PDT)
Received: by mail-lj1-x233.google.com with SMTP id 38308e7fff4ca-39c9a3acd40so30166551fa.3 for <tcpm@ietf.org>; Tue, 18 Aug 2026 02:02:50 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; t=1787043763; cv=none; d=google.com; s=arc-20260327; b=PQ47cmRNjzo6Rq/ZnEzDRqSLnDABTsxWxLwxU16e+jMdau3mVoSgiNTlofhOt0eI7X 4O1XvnZJ1KNf40XvT7vg+qbnQOn7ClZoxs0Z0Qkjt1nOJfZlEr+amuvYWvU2NwS3DOOD mSowzTa1/MakRYvKkihDRk1QaH4ZTetFG9Q99tFRIIYC/Wp1x3JEPKBYYzHMbEPR6bKC kfQ8B/H0rfld+DZlYRLzCyUQLtchFnWd8Kz2Yht8q5ea2Trl5WO2NnP+86VUMtkDS74l 8y0q/9UCnrRW/CuGIoLS9fUbKSBEPxSofmsDcRj46zz0syUOWtcQsbxtoO3iQnIYBTfz xFiA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=TSPwPBNwjtpsBJHyMMcSwkoqgeJyoFx1OOo+xopkRx4=; fh=NigoEE2GOzPbXEepKn8DBMqzyEUUsCVtlm1JAIbZrT4=; b=gCDhYnB3D1I2x8IFUP0SlVSIGuIaoAuHQut3FMGp3F4iQEhG4aByGkbdc2+BLXs+BE v5r43icdL15/BGzeitiQ8QTOX063J7iQQCXctWgHjMoQPb7poa+xTkL4NKC2kF6TuRuN tl9aOdlZGjraR1ByCthJn0cJWxEeeCSRlsTyZiPAO1CmCLErAXDq0TuKK60v49JjeFGv MjhVqE63vGPM9bbXQy/AFmJRu2m0LjV7I6xYbaArgFI+C1lUMFP02sKcd4PA+tBWFnO8 EEZ/45r5u5Cv7DDTHJ9INRDDRmKEaTXji4fdOkQ1TtBXAgt63TX5AlqJccJI2rw6Y0NR z9tw==; darn=ietf.org
ARC-Authentication-Results: i=1; mx.google.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1787043763; x=1787648563; darn=ietf.org; h=content-type:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:from:to:cc:subject:date:message-id:reply-to :content-type; bh=TSPwPBNwjtpsBJHyMMcSwkoqgeJyoFx1OOo+xopkRx4=; b=Jq6kmXU48m4cCYQn296e0fmJJpqe32OSFV51eAih1206al2HCfVBYLByPwnBn4glvG M0Ib7YR1okULaVtbzTcSmjjg3aEFQq8/q3N7iuJkABGwFQ6yt27WtGKFajbExLKzhQWX L1qOmENwW7gghCDiYFLO+YIclnZTydjUM0bxG3g/qauYzNRzMrFNEvb2nTiCX2jMPBEK XatQ7bX/g5GaQ/VrhSCNw22k4GQ+5zyBZev/bfs0x5KeqgIPcKAI9mMNWGNtpdVbc9Wk /PDusb6f1u+fXgqVo08wFpo229yOOQ97fTxfOgeIHX2SG94RcoQIC1RrNNlq8gjYNJTK BIDA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1787043763; x=1787648563; h=content-type:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:x-gm-gg:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to:content-type; bh=TSPwPBNwjtpsBJHyMMcSwkoqgeJyoFx1OOo+xopkRx4=; b=l+gtjiQpvilMu2EGnuJQQmo9WTrySrJLEQmPcXyGchI28csTZxSoV2/jE96GuIvBzW 3n6JkVwCY88etSzhLaDeBCRCHCWBYSOXvVLWziwfTrgzmw0doGIuxZ8JkVWodbDi1YO6 6Azl2jYPNcV1kxAVMPuyTIw6VqCHK5i4DQEXpaS8w6QCCx+1Aho6kuo/PiVcOkZxCM4c K1GyYqdJlcuDsx26vQrrb9vParLfeG+Oqr5Ao4KQaRjGyBvxtrKe6EBAD4ziXDupXF1J MfcH+D5MZ2HUVQ1VSYWQjc+C6AeOa7URw2l3o6JMoFwBES0r6+YArQPWVfpLDZrzapbc u13A==
X-Forwarded-Encrypted: i=1; AHgh+RpdKro+zJF7PfLnB0y9JWP+SzKC7Qr9n/dllD/+QizdQNmhrJPcb3oJLFlHCer9ZPwUriMQ@ietf.org
X-Gm-Message-State: AOJu0YxBv+zB7T32EXjmyYNtjfXLuefBw3vGNRm0gLkEN0u0+ONFNDQh YkBbkvWsDsqiwYRVcbe6rLR0FyfeQsvudjT0s0/xzbqSo1aFqTdc6aMZLHAJIgh6V54HTEhzD// SR39YdiS8AdV3OAilIpwO79SUofZ9eas=
X-Gm-Gg: AR+sD11Gg3HbzILypUY/VTcGpFrQ/kW/7gH5gvlZE/+DE8kv2QWHJLIidSY9BmKyqlP 3LsRulC8Q20fvaROh6ocY/M6epgSAwGP9aAp+zQSSHyt+ievBOUuf8z8e/oZbWmkp3KThwcj6vr Br/DCwWKnNqKnhTxq+7EC3ATvA3mJ8DlZCNJOCjKBlgWReovIoSrpxOXX7jePw++qjscYW1f5xH B6ymJeIhLjKq+CsHdZ1nFzHI9D65BlbHlij4IwZjWwTfKraTTEmNoSaduOXi4Dn/WVe9FixsRmt XSQ9l+q2V3bI79n4jSBBU1VYzpdyWQGq7uxiUVdQnOWaag0WVaZp4l+7WZ0Kj9WtGsCfpw0zIl3 GGVnJD1dQC1LVu3jiFt//Vd8+6NSAPsfzdiJds7zJFC+8kl0HdoUja/xSeIm9D29tP5qhSCiFw1 XFglJ/Y7rGa2N15VXdlbGkYntxYwQHlZnww3Vti1JAzTHZ9i3+Ga+ELVW3oBkLgbuHNw==
X-Received: by 2002:a05:651c:a388:20b0:39c:9955:9e0c with SMTP id 38308e7fff4ca-3a17516837cmr6986741fa.6.1787043762444; Tue, 18 Aug 2026 02:02:42 -0700 (PDT)
MIME-Version: 1.0
References: <CANatvzyZJxOLcwsrb52oyVm3T8ZhqbzPpOWDSvMvSo-b1hW+Ng@mail.gmail.com> <CADVnQymPjzRk-_ULFkz7F4ZkYD1dYizYd2BR_nwP7VbxunqgsA@mail.gmail.com>
In-Reply-To: <CADVnQymPjzRk-_ULFkz7F4ZkYD1dYizYd2BR_nwP7VbxunqgsA@mail.gmail.com>
From: Yoshifumi Nishida <nsd.ietf@gmail.com>
Date: Tue, 18 Aug 2026 02:02:30 -0700
X-Gm-Features: AcwNN1WG7RYZW5VeAjik9k3dpWSaZm9IG908pib22_nza_pv8coyCXyYF9gGqSA
Message-ID: <CAAK044RXrUHBAZfjUFaKRtspWhOyi0hhXsyqaUt95fJJuvjcrQ@mail.gmail.com>
To: Neal Cardwell <ncardwell=40google.com@dmarc.ietf.org>
Content-Type: multipart/alternative; boundary="000000000000a89ef406594e8c20"
Message-ID-Hash: MTHMZLMD7FCSDEGLIWB6EVVPIUOFC2VZ
X-Message-ID-Hash: MTHMZLMD7FCSDEGLIWB6EVVPIUOFC2VZ
X-MailFrom: nsd.ietf@gmail.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-tcpm.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: Kazuho Oku <kazuhooku@gmail.com>, ccwg@ietf.org, IETF QUIC WG <quic@ietf.org>, "tcpm@ietf.org Extensions" <tcpm@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [tcpm] Re: [CCWG] CWND increase in CUBIC and ACK policy
List-Id: TCP Maintenance and Minor Extensions Working Group <tcpm.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/tcpm/S8FNYwJPqVYr9lzUe1MjF7Qaemw>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tcpm>
List-Help: <mailto:tcpm-request@ietf.org?subject=help>
List-Owner: <mailto:tcpm-owner@ietf.org>
List-Post: <mailto:tcpm@ietf.org>
List-Subscribe: <mailto:tcpm-join@ietf.org>
List-Unsubscribe: <mailto:tcpm-leave@ietf.org>

Hello,

Added tcpm just in case as RFC9438 was standardized at tcpm wg.

On Mon, Aug 17, 2026 at 6:31 AM Neal Cardwell <ncardwell=
40google.com@dmarc.ietf.org> wrote:

>
>
> On Sun, Aug 16, 2026 at 9:14 PM Kazuho Oku <kazuhooku@gmail.com> wrote:
>
>> Dear CCWG and QUICWG folks,
>>
>> TL;DR: Sections 4.4 and 4.5 of RFC 9438 do not account for segments_acked
>> when increasing CWND outside the Reno-friendly region. As a result, a
>> literal implementation makes CUBIC's growth rate depend on the receiver's
>> ACK ratio, and causes measurable unfairness. It gets increasingly worse as
>> ACKs become less frequent.
>>
>> While testing a vibe-coded CUBIC implementation, I think I've found a
>> peculiarity in RFC 9438.
>>
>> Section 4.1 defines a "new ACK" as
>>
>> > a "new
>> > ACK" is received, i.e., an ACK that cumulatively acknowledges the
>> > delivery of previously unacknowledged data.
>>
>> Then, figure 4 in section 4.3 uses segments_acked to determine the amount
>> being acked, which is perfectly fine:
>>
>> > West = West + αcubic * segments_acked / cwnd
>>
>> It even notes that accounting for segments_acked is needed "for
>> connections with enabled or disabled delayed ACKs".
>>
>> But in sections 4.4 and 4.5, the CWND increase is specified as:
>>
>> > (target - cwnd) / cwnd
>>
>> where the target is Wcubic(t + RTT). It does not take segments_acked into
>> account. This update rule approximates the intended increase toward
>> `target` over one RTT only when there are roughly `cwnd` ACK events per
>> RTT, i.e., approximately one ACK per segment.
>>
>> Consequently, as ACKs become less frequent, the actual CWND increasingly
>> trails the CUBIC window function.
>>
>> On a simulated 100 Mbps bottleneck with a full RTT of 80 ms, when
>> competing against an otherwise identical CUBIC flow using ACK1 (i.e.,
>> ack-every-packet), the bandwidth that a CUBIC flow doing ACKn (i.e., ack
>> every n packet) obtains is:
>>
>> ACK1: 50.0%
>> ACK2: 45.29%    <-- 👀
>> ACK10: 10.07%
>>
>> ACK2 is particularly interesting because acknowledging at least every
>> second packet is the conventional delayed-ACK behavior recommended by both
>> TCP and QUIC v1.
>>
>> Changing the increase to:
>>
>> > (target - cwnd) / cwnd * segments_acked
>>
>> fixes the issue.
>>
>> Perhaps unsurprisingly, this issue does not exist in the Linux TCP stack
>> or Google Quiche. Both account for the amount of newly acknowledged
>> segments. I see some QUIC stacks also doing the correct thing, especially
>> those that seem to have used CUBIC inside linux or Google Quiche as a
>> reference.
>>
>> But there also seems to be multiple QUIC stacks that contain this bug.
>>
>> To paraphrase, under stable conditions and the receiver using the default
>> ACK2 policy, a literal implementation of RFC 9438 gets about 17% less
>> throughput than a stack that does not have this bug.
>>
>> Attempts to reduce ACKs (e.g., draft-ietf-quic-ack-frequency) are
>> going to make the downside more prominent.
>>
>> Am I missing something? Please let me know what you think.
>>
>
> Thanks for the post! Your analysis looks correct.
>

I agree. Thanks for the finding.


> In the Linux TCP CUBIC implementation we fixed this "stretch ACKs" issue
> in 2015 here:
>
> https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=9cd981dcf174d26805a032aefa791436da709bee
>
> IMHO this is worth adding an errata, if we don't yet have one for this
> issue.
>

Also, +1 for this.
--
Yoshi

>