Re: Design Issue: Separate HEADERS and PRIORITY Frames, Eliminate HEADERS+PRIORITY

James M Snell <jasnell@gmail.com> Tue, 21 May 2013 21:57 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 31B7D21F95FC for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Tue, 21 May 2013 14:57:31 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.455
X-Spam-Level:
X-Spam-Status: No, score=-9.455 tagged_above=-999 required=5 tests=[AWL=1.144, BAYES_00=-2.599, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id r-aBZ4c2kMaz for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Tue, 21 May 2013 14:57:24 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id C499521F95FD for <httpbisa-archive-bis2Juki@lists.ietf.org>; Tue, 21 May 2013 14:57:24 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1UeuY7-0005N1-VI for ietf-http-wg-dist@listhub.w3.org; Tue, 21 May 2013 21:56:52 +0000
Resent-Date: Tue, 21 May 2013 21:56:51 +0000
Resent-Message-Id: <E1UeuY7-0005N1-VI@frink.w3.org>
Received: from maggie.w3.org ([128.30.52.39]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <jasnell@gmail.com>) id 1UeuXw-0005Hn-Gw for ietf-http-wg@listhub.w3.org; Tue, 21 May 2013 21:56:40 +0000
Received: from mail-oa0-f41.google.com ([209.85.219.41]) by maggie.w3.org with esmtps (TLS1.0:RSA_ARCFOUR_SHA1:16) (Exim 4.72) (envelope-from <jasnell@gmail.com>) id 1UeuXv-0002PF-Dx for ietf-http-wg@w3.org; Tue, 21 May 2013 21:56:40 +0000
Received: by mail-oa0-f41.google.com with SMTP id n9so1560205oag.28 for <ietf-http-wg@w3.org>; Tue, 21 May 2013 14:56:13 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type:content-transfer-encoding; bh=eH1zseCA2pvW+PqzDEel769o46oMTsWNzvsRr8hbZ74=; b=ny+6/Y9ivHDEYBeQFk13crBIR4Wbw8LdHW1FXDBll1bOPFUZHbe6Zpci8xc3rKoUiA uuvO9ECbcd9iEdcJ+dsvmac00udI9YKKFj/s4hvyna3BMg082F2qYP81ST4QYCRYzphV fkOpl7PDfy7iuKP3UVmtoxQ1lcSadHk16qncNzeS+b9QheFja+4p8qMvVsd8Wn0oQAFT vd7BeJvly812q62T9ijh65FoyQztDQOk8pWelY2o07phz+EZJLqmzRd4qUGtfSSixKpR j14i4sFRrh8oBqe7QcnfDml26UdKVnp/3yDcTleZUPeCn+uGlaK1iriXoQ0jJ9rg3NL8 gM4w==
X-Received: by 10.60.80.103 with SMTP id q7mr2762740oex.135.1369173373394; Tue, 21 May 2013 14:56:13 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.60.3.137 with HTTP; Tue, 21 May 2013 14:55:53 -0700 (PDT)
In-Reply-To: <CAP+FsNd95pXcPM1OiG2qjOyXKV80noh2frdEbORwe6HxsgeK3Q@mail.gmail.com>
References: <CABP7RbfX_H_7dwM7ExL5qJgpV5JN1NYyv9tqnu_E23qGk63mWg@mail.gmail.com> <CAA4WUYhDhoS+BNknRnYLAOXfWzumcjkWnQnM=NkNM8oqqE=atw@mail.gmail.com> <CAOdDvNqkuY5qtOzFz5J0v1F1_n8HmFY9J==sXMs_9tDrTTE=cg@mail.gmail.com> <CAA4WUYhZb_ScYZ=F8ypGkXkX=3oK+4TnyWOtuN_FNkZqqhbZLQ@mail.gmail.com> <CABP7RbeAwrT15QKn5kL0=w+V0zBgObe_pOzT-NxbwSrZ_RyA+A@mail.gmail.com> <CAP+FsNd95pXcPM1OiG2qjOyXKV80noh2frdEbORwe6HxsgeK3Q@mail.gmail.com>
From: James M Snell <jasnell@gmail.com>
Date: Tue, 21 May 2013 14:55:53 -0700
Message-ID: <CABP7RbfOWdaOVeVSmnrqUtHM5F8=xjLauDBoRbpijWsWxyK+rw@mail.gmail.com>
To: Roberto Peon <grmocg@gmail.com>
Cc: "William Chan (陈智昌)" <willchan@chromium.org>, Patrick McManus <pmcmanus@mozilla.com>, "ietf-http-wg@w3.org" <ietf-http-wg@w3.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=209.85.219.41; envelope-from=jasnell@gmail.com; helo=mail-oa0-f41.google.com
X-W3C-Hub-Spam-Status: No, score=-3.4
X-W3C-Hub-Spam-Report: AWL=-2.640, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001
X-W3C-Scan-Sig: maggie.w3.org 1UeuXv-0002PF-Dx efe7a54ec85de44a87130362ea598658
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Design Issue: Separate HEADERS and PRIORITY Frames, Eliminate HEADERS+PRIORITY
Archived-At: <http://www.w3.org/mid/CABP7RbfOWdaOVeVSmnrqUtHM5F8=xjLauDBoRbpijWsWxyK+rw@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/18079
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

On Tue, May 21, 2013 at 2:43 PM, Roberto Peon <grmocg@gmail.com> wrote:
> Sending the PRIORITY frame *MUST* cause state allocation at the receiver,
> else it was useless to send before the HEADERS frame. As you point out, at
> minimum it must allocate a stream ID and priority field, and for most
> implementations it will also need to include so mechanism of pointing out
> that the headers don't exist, so, probably between 16 to 24 bytes worth of
> allocation on a 64 bit machine.
>

Sorry, I wasn't clear in my initial response. Yes, there is some state
that would need to be allocated but not the same as that when the
initial HEADERS frame is received, for instance.

> If the PRIORITY frame was renamed to CHANGE_PRIORITY, would that clarify
> anything? Priority changing is the current intent of that frame type.
>

Not particularly, because we'd still have the question of when to use
HEADERS+PRIORITY vs. the combination of HEADERS and a CHANGE_PRIORITY.
Can HEADERS+PRIORITY be used any time? For instance, could I send an
initial HEADERS frame on a stream then later send a HEADERS+PRIORITY
on the same stream? I honestly don't care how it ultimately ends up so
long as (a) It's the simplest thing that could possibly work and (b)
Is easy to explain in the spec and easy for a developer to implement.

> btw, I am not particularly partial to the "any frame opening up a stream"
> thing. I'm not completely against it though :)
> My reason for slightly preferring that streams must begin with HEADERS or
> HEADERS+PRIORITY is that it is an explicit statement of intent, and thus
> off-by-one, uninitialized var, etc. errors are more likely to be detectable
> in a world where such is required.
>

I would very much like to see us mandate that streams always initiate
with a HEADERS / HEADERS+PRIORITY frame.

- James

>
>
> -=R
>
>
> On Tue, May 21, 2013 at 2:19 PM, James M Snell <jasnell@gmail.com> wrote:
>>
>> On Tue, May 21, 2013 at 10:30 AM, William Chan (陈智昌)
>> <willchan@chromium.org> wrote:
>> > Thanks for describing these cases now. I had not thought of them.
>> >
>> > If everyone's sold on reprioritization, then let's go ahead and do this
>> > and
>> > have the debate about ditching HEADERS+PRIORITY or not. I want to keep
>> > it. I
>> > don't like the idea of sending a PRIORITY frame first. Is sending a
>> > PRIORITY
>> > frame going to trigger stream state allocation at the receiver? What's
>> > the
>> > expectation? And if you don't have a priority for the HEADERS, then you
>> > have
>> > the race that Roberto described.
>> >
>>
>> There is no reason to assume that sending a PRIORITY frame first would
>> trigger stream state allocation at the receiver. At most, it would
>> reserve the stream ID and store the priority value. The full state
>> allocation would not occur until the HEADERS frame is received. That
>> said, I'm not 100% dead set on removing HEADERS+PRIORITY, I would just
>> like to simplify the protocol where it makes sense to, and even then
>> only after it's been proven out in implementation. Having separate
>> HEADERS, HEADERS+PRIORITY and PRIORITY frames is confusing, if we can
>> do without separating them, we ought to do so.
>>
>> - James
>>
>> >
>> > On Tue, May 21, 2013 at 2:09 PM, Patrick McManus <pmcmanus@mozilla.com>
>> > wrote:
>> >>
>> >>
>> >> On Tue, May 21, 2013 at 12:32 PM, William Chan (陈智昌)
>> >> <willchan@chromium.org> wrote:
>> >>>
>> >>>
>> >>> I support adding a new additional PRIORITY frame for stream
>> >>> reprioritization.
>> >>
>> >>
>> >> me too. Specifically I support this as a mechanism for the client to be
>> >> able to explicitly prioritize an open pushed stream. I can wait for
>> >> more
>> >> evidence about re-prioritizing, but in cases where the client hasn't
>> >> ever
>> >> explicitly set the stream's priority I think we have evidence that its
>> >> time
>> >> to do something.
>> >>>
>> >>>
>> >>> Unless there's a reason this needs to be in the current http/2 draft
>> >>> sooner rather than later, I'd rather punt on this discussion until we
>> >>> have
>> >>> implementation experience that can guide this debate.
>> >>
>> >>
>> >> I think there is experience here specifically related to push.
>> >>
>> >> e.g. You can easily configure mod_spdy to push images when html is
>> >> pulled.
>> >> but you can't effectively dictate the relative priorities of those two
>> >> things.
>> >>
>> >> Sure, you can define an explicit priority for those images but priority
>> >> implementations are all about relative levels and the client set the
>> >> priority of the html.
>> >>
>> >> You can argue that mod_spdy should have defined relative priorities
>> >> (+/-
>> >> the associated stream) instead of constants.. that would be better but
>> >> the
>> >> client still has no way to make sure those streams are at a higher
>> >> priority
>> >> than a "save as" background stream (I've seen this one happen as
>> >> mod_spdy
>> >> defaults to lowest priority when pushing), or a lower priority than a
>> >> real-time video stream..
>> >>
>> >> plus there is no scale for the server to work with.. it might set a +2
>> >> priority for pushed images but the client might be using +3 for pulled
>> >> images causing a mismatch in something that was intended to be equally
>> >> weighted.
>> >>
>> >> at least with a priority frame the client can make those adjustments in
>> >> a
>> >> RTT.
>> >>
>> >> Cheefully,
>> >> -Patrick
>> >>
>> >>
>> >
>> >
>>
>