Re: qlog, AckFrame, and ack_delay

Damien Neil <dneil@google.com> Fri, 10 November 2023 17:50 UTC

Return-Path: <dneil@google.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id CACE5C18E530 for <quic@ietfa.amsl.com>; Fri, 10 Nov 2023 09:50:39 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -17.606
X-Spam-Level:
X-Spam-Status: No, score=-17.606 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, ENV_AND_HDR_SPF_MATCH=-0.5, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001, USER_IN_DEF_DKIM_WL=-7.5, USER_IN_DEF_SPF_WL=-7.5] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id r4KLG6d0ryTp for <quic@ietfa.amsl.com>; Fri, 10 Nov 2023 09:50:38 -0800 (PST)
Received: from mail-ej1-x62a.google.com (mail-ej1-x62a.google.com [IPv6:2a00:1450:4864:20::62a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E059AC18E539 for <quic@ietf.org>; Fri, 10 Nov 2023 09:50:37 -0800 (PST)
Received: by mail-ej1-x62a.google.com with SMTP id a640c23a62f3a-9dd3f4a0f5aso380914166b.1 for <quic@ietf.org>; Fri, 10 Nov 2023 09:50:37 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20230601; t=1699638636; x=1700243436; darn=ietf.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=DM61MhK3HIKrbd9sUSMJhm5Rw1LWjesxJvfjbJBVuFY=; b=u0OUKZ8KnpDsiwFOiSe4FoZ2DTTUkk6W38S0Ds6ll5i71At9FY2YU7ckB4DirgjvPY oW13s26kFX3mvz25jvBzvzPGTD4AKmPK3q7242+wUC6zvk2UCz39ijHJ5j3czOTsLhVl LZamgpeYmYZVZTLf1KoGxNT5Fu04t3jL+VloyoA1WJz/WfvfGkOv/qDz+rtdg1mDJ5wD /h/sdm4GV7+uFI1oFPUIgUaF9E0ELQ1vL1c1SRlaskFJBhV7mjUWD7rVixUosJHlgFyU 86C8kj5xun1sp2gr6uv5SnxY6Yx0Of3okqqLy3GCp2nbENnR00LrtO4lTVuXtCa9AOfx cEzg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1699638636; x=1700243436; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=DM61MhK3HIKrbd9sUSMJhm5Rw1LWjesxJvfjbJBVuFY=; b=uXTKrG2lLHyAIRJ23/t/v1gtUFErXIAW1AjM3PjS7hJS857adG5vw2YxlNREOoVLF9 gp73j1tXkTpwWY4UHLrHDyHrJrxIVmcVWWGik42EFHcqjFA9zlqfKQ+tI0WNq4xH8lW9 S7+6zDctqlPfffdxzCejRATf7yW8B6uZd0dow79otqA6YFmPMc7L6kfVC5W8A4ALlFck vqJ1xOTmckmmuMyOZDxHL0AL/CluXcphKrth27e532BxUYcVwoWGQY0x+DrXdXjzcLk1 v99U8Bj+OyH02jUftCz/W0GPkNVxLIcZzbFdhyg3fz/jPvVFjIpyHcQb4krH0SxeL7j3 KspA==
X-Gm-Message-State: AOJu0YwEQqRs/ZKXkWgjk1eL+y7S5gPTeTFT4zX1mfTEkt0ISAw1gGOc N0AJ11bdlPJ/zmddRfqbnqPA1zSfmtfBJeVpGmXBC0kX9DxHjTgmKTb0xA==
X-Google-Smtp-Source: AGHT+IFvfW7Dj7FUQWQkiaQmpePJCJJM1CSf00BdKlh+6jAUP36IISppzQXDG+eiheEkNC0XHAAKcCfVIT7yXcIb0C0=
X-Received: by 2002:a17:906:c44d:b0:9e6:38f2:8439 with SMTP id ck13-20020a170906c44d00b009e638f28439mr1253600ejb.60.1699638635615; Fri, 10 Nov 2023 09:50:35 -0800 (PST)
MIME-Version: 1.0
References: <CAGgfL4tDDb7jZ-e-_STZ8SFPESyuPtqfFesQZOjzX_5i0XpAdw@mail.gmail.com> <CAOYVs2p2Z1JMa97uXF0SYYzsw_AOFP0-G9R+PVfeMwRw46Gw-w@mail.gmail.com> <CAGgfL4u=T-f=Uft=0-cLN9Jte4RETwYVq1UsmDVUER5geDnMiw@mail.gmail.com> <CALGR9oZU7ppYX8WDob_NXjy2exn5rNT4zLojKtaqP7b2P3gTag@mail.gmail.com>
In-Reply-To: <CALGR9oZU7ppYX8WDob_NXjy2exn5rNT4zLojKtaqP7b2P3gTag@mail.gmail.com>
From: Damien Neil <dneil@google.com>
Date: Fri, 10 Nov 2023 09:50:24 -0800
Message-ID: <CAGgfL4vrkSgCbOtPOFZ0c6XEKSe5JPxApbKh5KkMHP0VZGPAZg@mail.gmail.com>
Subject: Re: qlog, AckFrame, and ack_delay
To: Lucas Pardue <lucaspardue.24.7@gmail.com>
Cc: Damien Neil <dneil=40google.com@dmarc.ietf.org>, Marten Seemann <martenseemann@gmail.com>, QUIC WG <quic@ietf.org>
Content-Type: multipart/alternative; boundary="00000000000020129f0609cff59c"
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/nKq2FrnmhNs7U3U2roBjU6C3-XI>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 10 Nov 2023 17:50:39 -0000

I believe the ACK Delay field is unique in the QUIC wire protocol in being
a field which can't be interpreted without information from a separate
protocol layer. I don't think this change leads to anything else.

More precisely: Viewed as an integer, ACK Delay can be interpreted by
considering the ACK frame alone. Viewed as a duration, it requires
additional information exchanged in the TLS handshake. ACK Delay is the
only field I know of which has this duality.

I can write a function which takes a QUIC packet payload and outputs a list
of qlog $QuicFrames, with the sole exception of the ACK Delay field which
requires access to the ack_delay_exponent. And as the ack_delay_exponent is
not known early in the handshake, it's currently impossible to fully log
early ACK frames. (Probably the right choice under the current design is to
not emit the ack_delay field in this case.)

On Fri, Nov 10, 2023 at 9:20 AM Lucas Pardue <lucaspardue.24.7@gmail.com>
wrote:

> These use cases seem like they are more general than just one field in one
> frame type.
>
> I don't want to commit to doing 1 thing if it's the start of a string of
> work that updates many other events.
>
> Would you be willing to survey all current events (modulo qpack, which we
> are removing) in order understand the full scope of change?
>
> Cheers
> Lucas
>
> On Fri, 10 Nov 2023, 17:31 Damien Neil, <dneil=40google.com@dmarc.ietf.org>
> wrote:
>
>> Consider an endpoint processing an ACK frame in an Initial packet
>> received before transport parameters have been received. This can happen
>> when, for example, a client's Initial CRYPTO flight is too large to fit in
>> a single datagram; the server will send an ACK for the first Initial packet
>> before it has the ability to send transport parameters in the Handshake
>> flight. Or even in the case where the client Initial CRYPTO flight fits in
>> one datagram, the server may respond with an ACK in an Initial packet prior
>> to sending a Handshake packet.
>>
>> In this case, the client is processing an ACK frame that may contain a
>> non-zero ACK Delay value, but has no ability to interpret it because it
>> doesn't know the peer's ack_delay_exponent. I forget whether it's permitted
>> for an endpoint to send a non-zero ACK Delay in an Initial packet, but even
>> if it isn't, the recipient may want to log the value.
>>
>> Or one could imagine a tool which converts a pcap packet capture to a
>> qlog file; in this case, the tool may have access to a key log to permit it
>> to decrypt packets, but may be processing a section of the log that does
>> not include the handshake.
>>
>> On Fri, Nov 10, 2023 at 12:48 AM Marten Seemann <martenseemann@gmail.com>
>> wrote:
>>
>>> There's a tradeoff here: Giving writers of qlog files more flexibility
>>> comes at a cost to consumers of qlog files, who now need to support
>>> multiple representations. There's a lot of value in having only a single
>>> way to log something.
>>>
>>> I'm not sure the proposal for unscaled_ack_delay strikes the right
>>> balance here. For a consumer of a qlog file, I can't think of a single
>>> scenario where the unscaled_ack_delay would provide any advantage over the
>>> actual value, so introducing this option would purely to make the writer's
>>> life easier. And I'm struggling to see why logging the ack_delay would
>>> place a big burden on the writer, since a QUIC stack will need to decode
>>> this field at some point anyway.
>>>
>>> On Thu, 9 Nov 2023 at 22:44, Damien Neil <dneil=
>>> 40google.com@dmarc.ietf.org> wrote:
>>>
>>>> The qlog AckFrame type includes the ack delay as a float32 number of
>>>> milliseconds:
>>>>
>>>> AckFrame = {
>>>>     frame_type: "ack"
>>>>
>>>>     ; in ms
>>>>     ? ack_delay: float32
>>>>     ; ...
>>>> }
>>>>
>>>>
>>>> https://www.ietf.org/archive/id/draft-ietf-quic-qlog-quic-events-06.html#section-8.12.3
>>>>
>>>> Given a serialized ack frame, determining the delay as a duration
>>>> requires knowing the ack_delay_exponent. In some cases, the logging
>>>> endpoint may not have this available (if receiving an ack before transport
>>>> parameters have been received). Even when available, it may not be easily
>>>> accessible at the point of logging. For example, in my own implementation,
>>>> I'd like to be able to convert a packet payload to a series of qlog event
>>>> frames without needing to reference persistent connection state.
>>>>
>>>> I think there should be an alternative to log the raw value of the ACK
>>>> Delay field:
>>>>
>>>> AckFrame = {
>>>>     frame_type: "ack"
>>>>
>>>>     ; in ms
>>>>     ? ack_delay: float32
>>>>
>>>>     ; integer value of the ACK Delay field, not scaled by the
>>>> ack_delay_exponent
>>>>     ? unscaled_ack_delay: uint64
>>>>
>>>>     ; ...
>>>> }
>>>>
>>>> - Damien
>>>>
>>>