Re: HTTP/3 server push: handling of lost PUSH_PROMISE

Kazuho Oku <kazuhooku@gmail.com> Wed, 28 July 2021 23:49 UTC

Return-Path: <kazuhooku@gmail.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1201B3A0BAE for <quic@ietfa.amsl.com>; Wed, 28 Jul 2021 16:49:08 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id iDwYeVNUiDRj for <quic@ietfa.amsl.com>; Wed, 28 Jul 2021 16:49:03 -0700 (PDT)
Received: from mail-ed1-x534.google.com (mail-ed1-x534.google.com [IPv6:2a00:1450:4864:20::534]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4AE653A0BAB for <quic@ietf.org>; Wed, 28 Jul 2021 16:49:03 -0700 (PDT)
Received: by mail-ed1-x534.google.com with SMTP id ec13so5058087edb.0 for <quic@ietf.org>; Wed, 28 Jul 2021 16:49:03 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=L5hqXyRpe0cpbuljWAFzXvXJxmlg6Kapx2nOKLHZQ9w=; b=eHK2fMmJ80Tv7eUp2e4uAi1RtxSiw3hcHq8uUbRv4qKLkis90hQiOATq24ud76WhtB YTPf7Umc4CR53DZ/rTmyCMjv3ihD2b3rvg0MhStUMHTun3+c30yMBI7J94GqfYCs4oC9 2TN9BsXYxqr+yKYZl7YrAzOK2dlPJ1gpROv+Uezx0EwccPnwaPm6BhUzugT2QmjRyai+ 6OHIOGCXEnnmguVV73BMEF9FrKZB3Vue+VtjfxjwCbMuIf3qJBWXpSRMW4v4hn9hAKqQ q/eLfNMQ1U9GRv8eWTzHvMcHvZhR1SOvPNngCFrc+0fuI5SZ4erIscQGyHj70R0i2Mua ax4A==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=L5hqXyRpe0cpbuljWAFzXvXJxmlg6Kapx2nOKLHZQ9w=; b=ZO5RohURqzqxstYFwmOWSoy6q3kPOGumF/P1xv/HkN1PpOp3010LOwcLuepAdUJN+E eOc4p8zzYNCbDcDwHcXgvAoTVgnaKcYNfSCJ+s0Vz5E0yecUUaTxh4dY4VrjMhWe0+k9 bkm+OH32gVnOa0Jc34PFiBW8vGAUhZIXuhAPBsWCehmB/zm8wh9dZcaD7b6YwWCVGonF cj6Uvpbd2ea/RiFd/0dtVWdtSJhnvSQJteaxz9EQZ8dT+MTZn2KhHHTp/j4jtuqXnqjp IAqyLtJeF7y1PYrOc6WVCaGqG9ooVWHqGsZ4+7R8BNDWuzcB/0V2Jt4sw4uyQIwgfIYG iLDw==
X-Gm-Message-State: AOAM530Qg6ENNyYkwizg88fkKtGIaCCQ3MAFKAOdUJAYAe5ZwY1dHEfN DTzlPBRsoXWP2Evn7Z4VHzyYm0olB84n4nuHINc=
X-Google-Smtp-Source: ABdhPJzs79S3HMISEZ9Ha28BHry/YayQQeNrk7nquDjTV7SfevYzG/7GkJZ90GIuCJwpP+5BcmR5iNNVd5FVLjmH/Gs=
X-Received: by 2002:aa7:c805:: with SMTP id a5mr671101edt.23.1627516140543; Wed, 28 Jul 2021 16:49:00 -0700 (PDT)
MIME-Version: 1.0
References: <CAPyZ6=+tCHNGYq0Za38-pju23_d_2wwXbWMgCbJK_Ou8mH3aKQ@mail.gmail.com> <72de8a9e-9f93-4bdc-8c2a-3f359beb94ac@www.fastmail.com> <CAPyZ6=+he3A0y_PtdDmUcG0vSgczPMqOwKLLY37ZUACpAz46kw@mail.gmail.com> <CANatvzxG+Y+Zm5W3-d=_xUdUQMNX2No2CjMNNXBzrGkq245jxA@mail.gmail.com> <CAPyZ6=J5ZthTBH6TxGxgmMQnhQVLQJbtp_HNrRfxjbd5DJmG=A@mail.gmail.com>
In-Reply-To: <CAPyZ6=J5ZthTBH6TxGxgmMQnhQVLQJbtp_HNrRfxjbd5DJmG=A@mail.gmail.com>
From: Kazuho Oku <kazuhooku@gmail.com>
Date: Thu, 29 Jul 2021 08:48:48 +0900
Message-ID: <CANatvzxCV1OCx=boOqYiRCJQyGP-b4bQYHUUv0oOJyz3KeU--g@mail.gmail.com>
Subject: Re: HTTP/3 server push: handling of lost PUSH_PROMISE
To: Tatsuhiro Tsujikawa <tatsuhiro.t@gmail.com>
Cc: IETF QUIC WG <quic@ietf.org>
Content-Type: multipart/alternative; boundary="0000000000006c603f05c837a153"
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/hVGJ8r7mpNp-noKkQU-l-FUedaU>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 28 Jul 2021 23:49:08 -0000

2021年7月28日(水) 11:53 Tatsuhiro Tsujikawa <tatsuhiro.t@gmail.com>:

> Hi,
>
> On Wed, Jul 28, 2021 at 9:21 AM Kazuho Oku <kazuhooku@gmail.com> wrote:
>
>> Tatsuhiro, thank you for raising the issue.
>>
>> I actually wonder if the example being provided is a tip of an iceberg -
>> is the problem related to FIN at all?
>>
>> Let's consider the following pattern:
>>
>> * client sends a request
>> * server starts sending response, alongside a PUSH_PROMISE
>> * in addition, server initiates a push stream and starts sending data
>> * server-sent packets carrying the PUSH_PROMISE frame are lost
>> * client decides to cancel the request and sends RESET_STREAM &
>> STOP_SENDING
>> * server continues sending the contents of the push stream
>>
>> I could well be missing some aspects of push, but to me, the problem
>> looks like the lack of delivery guarantee of PUSH_PROMISE frames.
>>
>>
> My initial example is intentionally nallowed down to the specific case so
> that client does not send STOP_SENDING, but yes, essentially, you are
> correct that the inherent problem is that server push design relays on the
> PUSH_PROMISE which can be lost.
>

Thank you for checking.

I've opened https://github.com/quicwg/base-drafts/issues/4930.

As stated on the issue, I think that lack of delivery guarantee is not only
a problem for PUSH_PROMISE, but also for Push Stream Header.


> Best regards,
> Tatsuhiro Tsujikawa
>
>
>
>
>>
>> 2021年7月27日(火) 17:56 Tatsuhiro Tsujikawa <tatsuhiro.t@gmail.com>:
>>
>>> Hi,
>>>
>>> On Tue, Jul 27, 2021 at 3:31 PM Martin Thomson <mt@lowentropy.net>
>>> wrote:
>>>
>>>> This is a case where QUIC processing something doesn't imply HTTP/3
>>>> processing something.  QUIC read the data and "processed" it.  HTTP/3
>>>> decided not to handle it deliberately, and the PUSH_PROMISE fell between
>>>> the cracks.
>>>>
>>>> One "solution" is to insist that endpoints attempt to process streams
>>>> for this stuff if they decide to discard responses.  This is like how in
>>>> HTTP/2 you still have to update the HPACK table after resetting a stream.
>>>> It's awkward, but I think that it would work if data is available.  I don't
>>>> think that there is any case in which data is unavailable to the client but
>>>> the server doesn't receive STOP_SENDING.
>>>>
>>>>
>>> It is indeed awkward that QUIC stack has to pass stream data all the way
>>> to the end of the stream (or sees RESET_STREAM or closed) to HTTP/3 client
>>> even after it requested stopping reading.  And the HTTP/3 client has to
>>> process it just for PUSH_PROMISE.  Does any implementation do this?
>>>
>>> Sending STOP_SENDING alone is not enough.  As I wrote in the previous
>>> post, by the time STOP_SENDING is received by the HTTP/3 server, it has
>>> finished processing the pushed stream and forgets it.  I imagine that if
>>> QUIC stack provides BSD socket-like interface and HTTP/3 server writes all
>>> data and can clear the memory without waiting for an acknowledgement.
>>>
>>> Best regards,
>>> Tatsuhiro Tsujikawa
>>>
>>>
>>>> On Tue, Jul 27, 2021, at 13:01, Tatsuhiro Tsujikawa wrote:
>>>> > Hi,
>>>> >
>>>> > It looks like in certain conditions, client is unable to process
>>>> pushed
>>>> > stream and leaves it in unprocessable state indefinitely.
>>>> >
>>>> > Consider that client opens bidi stream and server sends PUSH_PROMISE
>>>> > and completes the response body which is very short (just a single
>>>> packet
>>>> > or two).  For some reason, client has decided to stop reading
>>>> > response, but FIN is seen (data recvd state), and does not send
>>>> > STOP_SENDING because it is not required (RFC mentions that it has a
>>>> > little value to send STOP_SENDING in data recvd state and
>>>> > unnecessary).  Client discards all stream data without handing it over
>>>> > to application, so PUSH_PROMISE is not processed.  Client does not
>>>> > know the push ID.  Because STOP_SENDING is not sent, server has no
>>>> signal
>>>> > which indicates PUSH_PROMISE is not processed, and opens a pushed
>>>> > stream.  Client receives pushed stream, but unable to find the
>>>> > corresponding PUSH_PROMISE.  It holds pushed stream until it sees
>>>> > PUSH_PROMISE, but it never come.  This causes the pushed stream to be
>>>> held by
>>>> > client indefinitely.
>>>> >
>>>> > Even if client sends STOP_SENDING to the bidi stream, it might not
>>>> > work if server finishes sending stream data and a pushed stream and
>>>> > forgets them before receiving STOP_SENDING.
>>>> >
>>>> > Best regards,
>>>> > Tatsuhiro Tsujikawa
>>>>
>>>>
>>
>> --
>> Kazuho Oku
>>
>

-- 
Kazuho Oku