Re: New Version Notification for draft-kazuho-httpbis-priority-00.txt

Kazuho Oku <kazuhooku@gmail.com> Tue, 09 July 2019 01:45 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8C4031200E6 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Mon, 8 Jul 2019 18:45:51 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.75
X-Spam-Level:
X-Spam-Status: No, score=-2.75 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.249, HTML_MESSAGE=0.001, MAILING_LIST_MULTI=-1, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zPDt43WQ36o7 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Mon, 8 Jul 2019 18:45:45 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [IPv6:2603:400a:ffff:804:801e:34:0:38]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A1A42120047 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Mon, 8 Jul 2019 18:45:45 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.89) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1hkf9q-0008L4-Kl for ietf-http-wg-dist@listhub.w3.org; Tue, 09 Jul 2019 01:43:02 +0000
Resent-Date: Tue, 09 Jul 2019 01:43:02 +0000
Resent-Message-Id: <E1hkf9q-0008L4-Kl@frink.w3.org>
Received: from mimas.w3.org ([2603:400a:ffff:804:801e:34:0:4f]) by frink.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from <kazuhooku@gmail.com>) id 1hkf9p-0008KE-0j for ietf-http-wg@listhub.w3.org; Tue, 09 Jul 2019 01:43:01 +0000
Received: from mail-lf1-x133.google.com ([2a00:1450:4864:20::133]) by mimas.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.89) (envelope-from <kazuhooku@gmail.com>) id 1hkf9l-0005Og-VB for ietf-http-wg@w3.org; Tue, 09 Jul 2019 01:43:00 +0000
Received: by mail-lf1-x133.google.com with SMTP id c19so6590417lfm.10 for <ietf-http-wg@w3.org>; Mon, 08 Jul 2019 18:42:37 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=TSGjFLBjFzhlpSXx5IIWrvbXXbqB3PiI7EzpAvo1gIw=; b=vJVMnqGp2YrhLzGfYn1fmJiGsQvRfbcTOX7WR5grquNpfKsGMWauqYErq5+cEgZL53 WIxPrrp4iBqBdhON6FVcDGMo1hPbc1Ho5eHBNrAsye3XjczL+8CvapT2Duml5ULBLUhQ TzjwvueRnSd/00XYsimNpz16pZ+ctrZyQQiovbU97VLsOeRYNUkwEdyyYuQpVvBQ15B6 qz3KfrFiZYIQ4EzQrPhCEeWVxlWOn23qaIgRRqsU3eCmQ4HS2aysH7Ks6C7tMkBC6msv rGSfZ3b2zzguf8V6bAisFs8wASZDW8r3oZ461Kq0JtczJQYfWYpubuALc4MeFIUAZzef 1mgg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=TSGjFLBjFzhlpSXx5IIWrvbXXbqB3PiI7EzpAvo1gIw=; b=Ot/2WDJMcLafUdJ8slIaqKVSyRPTIgjJgJBkdKZHaRCDP7+tsqCTrb1Zln+5eYfI4O 2NlTSr+BoL2nkE9UNH4nzKduW5WnG1ItHdf3GASQch4cfNutws2xiaEogq1GJ5k0VCmU NFjgV8IJGpVX5u1IPL7QzVxYqNycIjZknld6KTG4Tg3GXnGgf0nzZ30fLL7CSeyGcNIz ErjQkd7m6z4bAoE599krb69/T3jU9kculYb0SlVo9wKhwU3HqOPFJq8QUL6vz9rr0y0a sKiRWfqlbI8wMpI0lUjBcvK61L7DbtLX9/mXU/vQXM1okel6pCQaySabNbFAnsRetgej ZdKg==
X-Gm-Message-State: APjAAAUMB0HBQ3SXuF19Jj8JPvTITe5+n/cD/yc7cvBfvojKGARg+sVQ d9SxRFJgNOONzgzMn63fu1bOd7nuhRqsiYW5DCY=
X-Google-Smtp-Source: APXvYqy3jWXmBiXgoADugDyd9cM/N/ZoRiQOueCXCnU+1aucqbVaAhCpZvfk2uF/j+QDdd/fzdxC7Z//sg7Jbd44mJk=
X-Received: by 2002:ac2:4839:: with SMTP id 25mr10157301lft.79.1562636556373; Mon, 08 Jul 2019 18:42:36 -0700 (PDT)
MIME-Version: 1.0
References: <156259027635.887.6250697935165505332.idtracker@ietfa.amsl.com> <CANatvzy7wH=h9tsbzVF9G4Mu5P=RtUMQ1kwAad5H7gpA49Sq+g@mail.gmail.com> <CAC7UV9bTUBpTZGZz+US8cGzQ0Dj6PMqTPaY2KtyYrC-4mavgoQ@mail.gmail.com>
In-Reply-To: <CAC7UV9bTUBpTZGZz+US8cGzQ0Dj6PMqTPaY2KtyYrC-4mavgoQ@mail.gmail.com>
From: Kazuho Oku <kazuhooku@gmail.com>
Date: Tue, 9 Jul 2019 10:42:23 +0900
Message-ID: <CANatvzz9rFcKo6BPLkDgExGghNhHckDrTHJQhAu6uLTNA-UW7g@mail.gmail.com>
To: Robin MARX <robin.marx@uhasselt.be>
Cc: HTTP Working Group <ietf-http-wg@w3.org>
Content-Type: multipart/alternative; boundary="000000000000db15a0058d35ace2"
Received-SPF: pass client-ip=2a00:1450:4864:20::133; envelope-from=kazuhooku@gmail.com; helo=mail-lf1-x133.google.com
X-W3C-Hub-Spam-Status: No, score=-3.2
X-W3C-Hub-Spam-Report: AWL=0.888, BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, W3C_AA=-1, W3C_WL=-1
X-W3C-Scan-Sig: mimas.w3.org 1hkf9l-0005Og-VB 846ff09b0a464d2b98633562b81a96c2
X-Original-To: ietf-http-wg@w3.org
Subject: Re: New Version Notification for draft-kazuho-httpbis-priority-00.txt
Archived-At: <https://www.w3.org/mid/CANatvzz9rFcKo6BPLkDgExGghNhHckDrTHJQhAu6uLTNA-UW7g@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/36768
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <https://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

Hi Robin,

Thank you for the comments. My responses below.

2019年7月8日(月) 23:56 Robin MARX <robin.marx@uhasselt.be>be>:

> Hello Kazuho and Lucas,
>
> Thank you for the draft. Most of this feedback I've given elsewhere as
> well, but to keep everything in one place:
>
> 1) I really like the header-based approach. It's extensible, allows us to
> make progress on H3, is easier to use/understand,
> can be "backported" to H2, has other nice properties which you touch upon
> in the text (intermediates, caching, etc.)
>

I'm delighted to hear that.


> 2) I really dislike the header-based approach. It makes re-prioritization
> a mess. You don't touch upon this (yet) in the draft,
> but the discussion on github (
> https://github.com/kazuho/draft-kazuho-httpbis-priority/wiki/Roughing-out-reprioritization)
> proposes
> using a separate, special H3/H2 level frame to provide this. This just
> feels -very- dirty to me. The problem is that I can't really think
> of a (much) better solution, other than referring to re-prioritized
> resource A in resource B's headers, which is a whole other can of worms.
> I'm not
> really opposed to using the separate frame if that's the only option, but
> it still takes away some of the nice properties of 1)
>

While I can see how you feel sad, I am not worried, because
reprioritization can also be HTTP-version-independent in terms of API. The
only difference would be how the prioritization hints (in text) are encoded
as frames.


> 3) I really like the switch to "absolute"/"stateless" priority
> levels/semantics (as you're referred to them elsewhere), as opposed to
> building the tree directly.
> This really helps for (partial) server-side (re-)prioritization. It does
> require the server (implementers) to know a bit more about how browsers
> work, but
> I don't really see that as a big issue (given that we provide guidance and
> examples on proper options)
>

:+1:


>
> 4) I don't feel the current defined priority fields+values cover the use
> cases though. You touch upon this in section 5.2, but I disagree with you
> there:
> For me, these new priority primitives are the core of the proposal (not
> the header-based approach. I would champion these new semantics in a
> frame-based setup as well)
> and imo these should be nailed down (semi-)completely before considering
> this approach. There should probably be more degrees of "urgency" \
> (e.g., as Patrick Meenan mentioned things like "deferred" and
> "background'), and there should maybe be something like
> "importance"/"weight"/"precedence"/...
> to be more fine-grained within resources of the same "urgency" level.
>

I think that adding "deferred" is easy, assuming that we would agree on the
meaning. It would mean the responses that should be sent _after_ the
"non-blocking" responses.

Re "background," I think we need to discuss how we want to prioritize them.
Should we assign it a yet lower precedence (than "deferred")? Or should we
state that it should be given some amount of bandwidth regardless of other
responses?

As mentioned in
> https://github.com/kazuho/draft-kazuho-httpbis-priority/issues/12, it
> might be good
> to look at the existing work on the Priority Hints spec, seeing as they
> probably have already looked at much of this as well.
>
> 5) I am also not sure about the interpretation of the current fields. For
> example, as noted by Patrick (
> https://github.com/kazuho/draft-kazuho-httpbis-priority/issues/13),
> blocking has a specific meaning and it doesn't map 100% to your current
> text.
>

I assume this to have been fixed by
https://github.com/kazuho/draft-kazuho-httpbis-priority/pull/14. IIUC,
Patrick's concern was that "blocks the processing of the document" seems to
be applicable to JavaScript files loaded in <BODY>. In #14 we've changed
the text to "blocks using the document", and I think it's clearer that
urgency=blocking does not necessarily apply to such JavaScript files.


> Similarly, what does progressive mean exactly? IIUC JS and CSS can be
> parsed/compiled
> in a streaming fashion in modern engines as well, it's mainly their
> application that is delayed until they are fully available.
>

When used by a client, it is a signal that indicates if the client prefers
receiving the responses with the bandwidth being distributed among similar
responses, or if it prefers receiving the response one by one.

Similarly, is a non-progressively encoded jpeg
> counted as "progressive"? How does the browser know if a JPEG will be
> progressive or not when making the request? I feel you've got the answers,
> but the usage of these
> specific terms can make it more difficult to actually use this scheme in
> practice.
>

For images, a browser should set progressive to 1, when it can assume that
the image can be rendered progressively, as doing so improves user
experience.

Servers would benefit from setting progressive to 0 for baseline JPEG
images, assuming that sending the first few percent of the file does not
improve user experience.

Assuming that what I've stated here makes sense, I think it might be a good
idea to clarify these points using examples in the draft.


>
> 6) This is also clear a bit from the example in section 3 (switching image
> from progressive to non-progressive). I -assume- the goal here is to do
> something like a "hero" image,
> which you want to send before other images. However, it feels to me that
> "abusing" the progressive field for this is not the best way to go about
> that.
>

As stated above, that's not the intent.


>
> 7) Most of this comes together in the fact that I'm having a hard time
> thinking of how to represent existing H2 logic/browser use cases in this
> new scheme.
> E.g., how would you derive Chrome's current "dynamic fifo" from this
> metadata? How would you implement Patrick Meenan's proposed 'ideal' setup
> from these directives?
> Having a couple of concrete examples would help to understand your intents
> and probably also to ferret out some missing pieces.
>

I agree that talking about mappings is a good idea. I think it would be
something like:

HTML -> urgency=document, progressive=?1
JS, CSS in HEAD -> urgency=blocking, progressive=?0
images -> urgency=non-blocking, progressive=?1
async-loaded JS -> urgency=deferred, progressive=?0

There's some wiggle room for fonts and JS, CSS being used inside BODY.
Depending on how important they seem to be, a client can set urgency to
"blocking" (if it essentially prevents the document from being used), to
"document" (if it thinks that the resources are as important as characters
and tags inside the HTML document), to "non-blocking" (if it thinks that
they are not important in terms of using the document), or even to
"deferred" (consider the case of a script tag at the body of the HTML
loading some analytic script).

If we are to be fine with one particular approach, I think we can recommend
that. But we do not need to struggle to reach consensus on one particular
algorithm, because in the proposed approach, servers can correct the
precedence of mis-prioritized requests under the proposed scheme.


>
> TL;DR: I see this draft as a combination of two proposals:
> A) a new way to define priority levels/semantics (i.e., "how will the
> resource be used " rather than "when should you send it") : all for this!
>          Needs more work though, current draft doesn't (fully) support use
> cases and imo, it should.
> B) sending those new levels via headers instead of frames: many
> advantages, and "feels right"
>         Except for the re-prioritization bit...
>
> With best regards,
> Robin
>
>
> On Mon, 8 Jul 2019 at 15:00, Kazuho Oku <kazuhooku@gmail.com> wrote:
>
>> Hi,
>>
>> Today, Lucas and I have submitted the following draft, that defines an
>> HTTP header field for driving prioritization.
>>
>> https://datatracker.ietf.org/doc/draft-kazuho-httpbis-priority/
>>
>> In short, the draft defines an end-to-end HTTP header field called
>> "Priority" for transmitting prioritization hints in absolute values
>> that have meanings. It is much simpler than the prioritization scheme
>> of H2 that communicates and uses a "tree". Not only the client, but
>> also the server can send the prioritization hints, in order to improve
>> the way the responses are prioritized. The prioritization scheme is
>> independent to HTTP versions; it can be used on both H2 and H3 (and
>> also on H1 for providing hints to intermediaries).
>>
>> For more detail, please refer to the draft.
>>
>> Background: back in May in London, the QUIC WG had a discussion on if
>> porting the prioritization scheme of H2 to H3 is the way to go [1].
>>
>> I think there were two major arguments for having something different:
>> * Prioritization scheme of H2 is complex, and porting it to H3
>> increases the complexity [2].
>> * With the H2 scheme, it is hard for the server to tweak the
>> prioritization tree, because clients build their trees in their own
>> ways [3][4].
>>
>> The arguments against were:
>> * Redesigning prioritization for H3 is likely to delay the
>> standardization and time-to-market.
>> * Having something different in H3 is an act of "adding" complexity to
>> HTTP as a whole.
>>
>> This discussion has led us to wonder if there could be a technical
>> solution that resolves the issues of the H2 scheme (see the pro
>> arguments), at the same time minimizing the downsides.
>>
>> And we came up with this proposal. I think the key selling points of
>> the proposal are:
>>
>> * Much simpler thanks to each request carrying an absolute priority
>> value. No need to synchronize a "tree".
>> * Because the priority value sent by the client indicates how each
>> request / response affects the use of other responses (e.g.,
>> "blocking", "non-blocking"), the server can understand the intent of
>> the client and further optimize the delivery order.
>> * Use of the HTTP header field as the conveyer of the priority value
>> allows an origin server to indicate hints to an intermediary that
>> terminates the H2/H3 connections from the client. For example, an
>> origin server can indicate higher precedence for some images that
>> matter more to the user, while giving lower precedence to others.
>> * Another benefit of using an HTTP header field instead of a frame is
>> that prioritization logic becomes independent from HTTP versions. That
>> would help both clients and servers improve the quality of their
>> implementation, as well as fostering website owners fine-tune the
>> prioritization through the use of the Priority response header.
>> * A header-based prioritization scheme can be improved as time goes,
>> as HTTP headers are extensible by their nature. It also means that a
>> header-based design can be rolled out at an earlier stage than a
>> frame-based design.
>>
>> To paraphrase, the header-based design provides simplicity,
>> extensibility, room to evolve, and the possibility to roll out early.
>> This could be the only prioritization scheme for H3. Separating
>> prioritization into a version-independent approach simplifies H3,
>> taking some load away from QUIC WG.
>>
>> Of course, H3 needs to hit the market with a prioritization scheme, we
>> need to agree on that particular scheme. But I think we might be able
>> to agree on the need for a header-based prioritization scheme, that a
>> server can tweak, that uses absolute priorities. If that is the case,
>> I think we have fair chance on agreeing on something pretty soon.
>>
>> To summarize, with the proposed design, I think we have the chance of
>> making prioritization better as we roll out HTTP/3, without getting
>> the standardization process delayed.
>>
>> Please let us know what you think. Thank you in advance.
>>
>>
>> [1]
>> https://github.com/quicwg/wg-materials/blob/master/interim-19-05/priorities.pdf
>> [2] https://github.com/quicwg/base-drafts/issues/2739
>> [3] https://github.com/quicwg/base-drafts/issues/2740
>> [4] In
>> https://lists.w3.org/Archives/Public/ietf-http-wg/2019JulSep/0008.html,
>> Robin points out that server intervention is necessary for best
>> performance.
>>
>> ---------- Forwarded message ---------
>> From: <internet-drafts@ietf.org>
>> Date: 2019年7月8日(月) 21:51
>> Subject: New Version Notification for draft-kazuho-httpbis-priority-00.txt
>> To: Kazuho Oku <kazuhooku@gmail.com>om>, Lucas Pardue <
>> lucaspardue.24.7@gmail.com>
>>
>>
>>
>> A new version of I-D, draft-kazuho-httpbis-priority-00.txt
>> has been successfully submitted by Kazuho Oku and posted to the
>> IETF repository.
>>
>> Name:           draft-kazuho-httpbis-priority
>> Revision:       00
>> Title:          The Priority HTTP Header Field
>> Document date:  2019-07-08
>> Group:          Individual Submission
>> Pages:          9
>> URL:
>> https://www.ietf.org/internet-drafts/draft-kazuho-httpbis-priority-00.txt
>> Status:
>> https://datatracker.ietf.org/doc/draft-kazuho-httpbis-priority/
>> Htmlized:
>> https://tools.ietf.org/html/draft-kazuho-httpbis-priority-00
>> Htmlized:
>> https://datatracker.ietf.org/doc/html/draft-kazuho-httpbis-priority
>>
>>
>> Abstract:
>>    This document describes the Priority HTTP header field.  This header
>>    field can be used by endpoints to specify the absolute precedence of
>>    an HTTP response in an HTTP-version-independent way.
>>
>>
>>
>>
>> Please note that it may take a couple of minutes from the time of
>> submission
>> until the htmlized version and diff are available at tools.ietf.org.
>>
>> The IETF Secretariat
>>
>>
>>
>> --
>> Kazuho Oku
>>
>>
>
> --
>
> Robin Marx
> PhD researcher - web performance
> Expertise centre for Digital Media
>
> T +32(0)11 26 84 79 - GSM +32(0)497 72 86 94
>
> www.uhasselt.be
> Universiteit Hasselt - Campus Diepenbeek
> Agoralaan Gebouw D - B-3590 Diepenbeek
> Kantoor EDM-2.05
>
>
>

-- 
Kazuho Oku