Re: HTTP/3 server push: handling of lost PUSH_PROMISE
Tatsuhiro Tsujikawa <tatsuhiro.t@gmail.com> Wed, 28 July 2021 02:53 UTC
Return-Path: <tatsuhiro.t@gmail.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id EBA333A1819 for <quic@ietfa.amsl.com>; Tue, 27 Jul 2021 19:53:00 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id kZy6jqbVWrse for <quic@ietfa.amsl.com>; Tue, 27 Jul 2021 19:52:56 -0700 (PDT)
Received: from mail-ot1-x335.google.com (mail-ot1-x335.google.com [IPv6:2607:f8b0:4864:20::335]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 49AF03A1818 for <quic@ietf.org>; Tue, 27 Jul 2021 19:52:56 -0700 (PDT)
Received: by mail-ot1-x335.google.com with SMTP id c7-20020a9d27870000b02904d360fbc71bso631901otb.10 for <quic@ietf.org>; Tue, 27 Jul 2021 19:52:56 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=PA9AVoxWyStge31oJyNIXZzOrerArelnZgWxvL4RM70=; b=aAAuFk3nLrBeTu7kf2kFtbGounaQA0bueZdX7dwA3SD9WT/4fzDXWnvuTEzIJ9MVHV rJuJMMkvDNAYUpnpZZWm77gKFK+mbqqDFRgFFhZIgkCot0eZVr1EzYykvZnYV1uCQSkT jA1Qhh48dhlyf1+k/jiryHzLKtrF63WF+XD1nFd2dVbUs8+hD/EbzH0tpsd6s5CWrfSN s5I+aRnBjSD88648+rOxr39acnqoXNhkEqbwjWK2mxVg+7Ni2WrFpELMxFuV5HZg1Sfs umB3LxC1lSe9dPAcoIB19w/uoBVWd0FySyPPC42rMMsh9mHZ0sPOHkR+dGmYuV6H9emH TpDA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=PA9AVoxWyStge31oJyNIXZzOrerArelnZgWxvL4RM70=; b=Eh9zipqcGqsHyI8ibJ445hCfUwmVUlg8zcAKnl9NZGwHWM11YiBH9w6j8hxpvpD9f/ PIWqq5bURU0xLDFW8Tze27e2NGHb6tDARm5t8fUk69JiiU9gaK1oEed4+PVMmqOP08PU +yYojZ57zgQF65icMaByvV0/tVm2/DzsRjFBs2CamboutnqZqdHjP8zuKzIO061itPJk 4OuCitlgwTJ68AvWOvS2jOpQGbAir13roMUtXDsuoBORF5xLKcsR6w4A+uCW/hjR4AHf 7uoLeWpvQUjsABlBjGjIUh6qAv/xOYTqpzrYpbnG95NbAXyuzrMwqte1Y1JRIwaxRRsX RcVg==
X-Gm-Message-State: AOAM531qbHsy0wqPcPoA1uUhcWKSjBDsSJ1ICXAwUitCXsoR0Q49JsD2 vnbQwfCe0AdfemiV1vNxbvTY2/3uhQDdt52XqJCgxvwCVaw=
X-Google-Smtp-Source: ABdhPJybwp3HwAJLW2YjkVJBInwU5QLK5QPAa9zh41tMt6dZCdQBRLxfV+2DE3el2tTbyksnuqt8KUdRlXuGIbdnXCU=
X-Received: by 2002:a05:6830:18f7:: with SMTP id d23mr17289574otf.310.1627440774525; Tue, 27 Jul 2021 19:52:54 -0700 (PDT)
MIME-Version: 1.0
References: <CAPyZ6=+tCHNGYq0Za38-pju23_d_2wwXbWMgCbJK_Ou8mH3aKQ@mail.gmail.com> <72de8a9e-9f93-4bdc-8c2a-3f359beb94ac@www.fastmail.com> <CAPyZ6=+he3A0y_PtdDmUcG0vSgczPMqOwKLLY37ZUACpAz46kw@mail.gmail.com> <CANatvzxG+Y+Zm5W3-d=_xUdUQMNX2No2CjMNNXBzrGkq245jxA@mail.gmail.com>
In-Reply-To: <CANatvzxG+Y+Zm5W3-d=_xUdUQMNX2No2CjMNNXBzrGkq245jxA@mail.gmail.com>
From: Tatsuhiro Tsujikawa <tatsuhiro.t@gmail.com>
Date: Wed, 28 Jul 2021 11:52:42 +0900
Message-ID: <CAPyZ6=J5ZthTBH6TxGxgmMQnhQVLQJbtp_HNrRfxjbd5DJmG=A@mail.gmail.com>
Subject: Re: HTTP/3 server push: handling of lost PUSH_PROMISE
To: IETF QUIC WG <quic@ietf.org>
Content-Type: multipart/alternative; boundary="00000000000042366b05c82615d7"
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/hQ_X14SMEtwrP0wR0u-hRZOPiQ8>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 28 Jul 2021 02:53:01 -0000
Hi, On Wed, Jul 28, 2021 at 9:21 AM Kazuho Oku <kazuhooku@gmail.com> wrote: > Tatsuhiro, thank you for raising the issue. > > I actually wonder if the example being provided is a tip of an iceberg - > is the problem related to FIN at all? > > Let's consider the following pattern: > > * client sends a request > * server starts sending response, alongside a PUSH_PROMISE > * in addition, server initiates a push stream and starts sending data > * server-sent packets carrying the PUSH_PROMISE frame are lost > * client decides to cancel the request and sends RESET_STREAM & > STOP_SENDING > * server continues sending the contents of the push stream > > I could well be missing some aspects of push, but to me, the problem looks > like the lack of delivery guarantee of PUSH_PROMISE frames. > > My initial example is intentionally nallowed down to the specific case so that client does not send STOP_SENDING, but yes, essentially, you are correct that the inherent problem is that server push design relays on the PUSH_PROMISE which can be lost. Best regards, Tatsuhiro Tsujikawa > > 2021年7月27日(火) 17:56 Tatsuhiro Tsujikawa <tatsuhiro.t@gmail.com>: > >> Hi, >> >> On Tue, Jul 27, 2021 at 3:31 PM Martin Thomson <mt@lowentropy.net> wrote: >> >>> This is a case where QUIC processing something doesn't imply HTTP/3 >>> processing something. QUIC read the data and "processed" it. HTTP/3 >>> decided not to handle it deliberately, and the PUSH_PROMISE fell between >>> the cracks. >>> >>> One "solution" is to insist that endpoints attempt to process streams >>> for this stuff if they decide to discard responses. This is like how in >>> HTTP/2 you still have to update the HPACK table after resetting a stream. >>> It's awkward, but I think that it would work if data is available. I don't >>> think that there is any case in which data is unavailable to the client but >>> the server doesn't receive STOP_SENDING. >>> >>> >> It is indeed awkward that QUIC stack has to pass stream data all the way >> to the end of the stream (or sees RESET_STREAM or closed) to HTTP/3 client >> even after it requested stopping reading. And the HTTP/3 client has to >> process it just for PUSH_PROMISE. Does any implementation do this? >> >> Sending STOP_SENDING alone is not enough. As I wrote in the previous >> post, by the time STOP_SENDING is received by the HTTP/3 server, it has >> finished processing the pushed stream and forgets it. I imagine that if >> QUIC stack provides BSD socket-like interface and HTTP/3 server writes all >> data and can clear the memory without waiting for an acknowledgement. >> >> Best regards, >> Tatsuhiro Tsujikawa >> >> >>> On Tue, Jul 27, 2021, at 13:01, Tatsuhiro Tsujikawa wrote: >>> > Hi, >>> > >>> > It looks like in certain conditions, client is unable to process pushed >>> > stream and leaves it in unprocessable state indefinitely. >>> > >>> > Consider that client opens bidi stream and server sends PUSH_PROMISE >>> > and completes the response body which is very short (just a single >>> packet >>> > or two). For some reason, client has decided to stop reading >>> > response, but FIN is seen (data recvd state), and does not send >>> > STOP_SENDING because it is not required (RFC mentions that it has a >>> > little value to send STOP_SENDING in data recvd state and >>> > unnecessary). Client discards all stream data without handing it over >>> > to application, so PUSH_PROMISE is not processed. Client does not >>> > know the push ID. Because STOP_SENDING is not sent, server has no >>> signal >>> > which indicates PUSH_PROMISE is not processed, and opens a pushed >>> > stream. Client receives pushed stream, but unable to find the >>> > corresponding PUSH_PROMISE. It holds pushed stream until it sees >>> > PUSH_PROMISE, but it never come. This causes the pushed stream to be >>> held by >>> > client indefinitely. >>> > >>> > Even if client sends STOP_SENDING to the bidi stream, it might not >>> > work if server finishes sending stream data and a pushed stream and >>> > forgets them before receiving STOP_SENDING. >>> > >>> > Best regards, >>> > Tatsuhiro Tsujikawa >>> >>> > > -- > Kazuho Oku >
- HTTP/3 server push: handling of lost PUSH_PROMISE Tatsuhiro Tsujikawa
- Re: HTTP/3 server push: handling of lost PUSH_PRO… Martin Thomson
- Re: HTTP/3 server push: handling of lost PUSH_PRO… Tatsuhiro Tsujikawa
- Re: HTTP/3 server push: handling of lost PUSH_PRO… Mikkel Fahnøe Jørgensen
- Re: HTTP/3 server push: handling of lost PUSH_PRO… Kazuho Oku
- Re: HTTP/3 server push: handling of lost PUSH_PRO… Tatsuhiro Tsujikawa
- Re: HTTP/3 server push: handling of lost PUSH_PRO… Kazuho Oku
- Re: HTTP/3 server push: handling of lost PUSH_PRO… Tatsuhiro Tsujikawa