Re: [Editorial Errata Reported] RFC7540 (4871)

Martin Thomson <martin.thomson@gmail.com> Wed, 30 November 2016 23:23 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BF33C129963 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 30 Nov 2016 15:23:00 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.897
X-Spam-Level:
X-Spam-Status: No, score=-9.897 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, RCVD_IN_DNSWL_HI=-5, RP_MATCHES_RCVD=-2.896, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id XYSDd4GRCSvA for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 30 Nov 2016 15:22:59 -0800 (PST)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E2AFE1293DF for <httpbisa-archive-bis2Juki@lists.ietf.org>; Wed, 30 Nov 2016 15:22:58 -0800 (PST)
Received: from lists by frink.w3.org with local (Exim 4.80) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1cCE9q-0002Sd-Fv for ietf-http-wg-dist@listhub.w3.org; Wed, 30 Nov 2016 23:19:22 +0000
Resent-Date: Wed, 30 Nov 2016 23:19:22 +0000
Resent-Message-Id: <E1cCE9q-0002Sd-Fv@frink.w3.org>
Received: from mimas.w3.org ([128.30.52.79]) by frink.w3.org with esmtps (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from <martin.thomson@gmail.com>) id 1cCE9j-0002Qi-0r for ietf-http-wg@listhub.w3.org; Wed, 30 Nov 2016 23:19:15 +0000
Received: from mail-qt0-f194.google.com ([209.85.216.194]) by mimas.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.84_2) (envelope-from <martin.thomson@gmail.com>) id 1cCE9c-00019N-Dl for ietf-http-wg@w3.org; Wed, 30 Nov 2016 23:19:09 +0000
Received: by mail-qt0-f194.google.com with SMTP id m48so21507677qta.2 for <ietf-http-wg@w3.org>; Wed, 30 Nov 2016 15:18:47 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=Z9rpLz796nV/j8fArYjd6Q7mYOdDBefPE2NPfmYjdi8=; b=NhV9WBt5+EDciItPUP8mzRRMtbF/f7ekx0HpNjULkcuy+XyoM611DrPIeaIECYKeKA TGCSZFGHrbyhq634z2HOgOkW816FrNiD/AwQn25LBUcpBP2NfA2UyOtexOnx0JT2Hpp+ KEXxujgGBULyIHdyqGOReHs1EQPN/NkyNsrTIO04hf6BkQwohdQlE7dvyM8SUKBmlypH 7c7rby/Obn6/1+ykL72crXL6mQ2N7Em2VX1Z+TPmasSIFrM3axrTsp8op5kXjsk2wrRI 79Yy8F3xRc34RuhyHne24Zp2oVK4hxnuBeeLR+GyZBtBYHQVrQKCnpF7b26rTkJjTq4F hdRA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=Z9rpLz796nV/j8fArYjd6Q7mYOdDBefPE2NPfmYjdi8=; b=ch/5S3gYiHyJUxF65rPVcysUey4qWMk1hEvbapsmVgbmMrM1ugN5jxQIp7adXCb7Hn HrolXv6bzEGGwnOcpz6uGE065Thfn4gLqtdIbNaTmHmqRQ2ksI1OPqA4B4Fusya5HXAa ju/WMeW31BArrogbBw8D2sO44XzHHRqbQz0SNBfdwQrV3reODjRTaxF5kxBMnOQd3eKv JZR8Z+LThd/HfsCuKgd/gcM3AmOETr/XERjVEKL+dHPij61RtgMR+AUcvdQO73+AE+RB iMAfU2L3YjtE8RBF5zq9BJsyBK9XQxkjZ5VtMdVLtTmYvHIyUWt46YPFt3ORhiztk4Co hDxQ==
X-Gm-Message-State: AKaTC01doW1n+So+S5WH5N8OW63fuRBJMlGzLgxX7G5nMqLOZ//Jt+vwbnbrFSyegFXycoKeDsQuSmKY3NdB9g==
X-Received: by 10.200.41.248 with SMTP id 53mr34573672qtt.3.1480547017742; Wed, 30 Nov 2016 15:03:37 -0800 (PST)
MIME-Version: 1.0
Received: by 10.140.38.233 with HTTP; Wed, 30 Nov 2016 15:03:37 -0800 (PST)
In-Reply-To: <24141783-A04A-42AD-9730-EB5C91A36516@lukasa.co.uk>
References: <20161130043354.C786DB81319@rfc-editor.org> <1102C272-E8D6-40D3-9D39-7D4801ABD286@lukasa.co.uk> <CABkgnnXYTi0uv=Dm7zPrA=oPam+Zyka-jujFT2bU8GvqvT5JPg@mail.gmail.com> <03C57CE4-E61A-4BF6-A976-2191EB4B127C@lukasa.co.uk> <CANatvzzQZ_isxmd3Ne41QxE2s-sYsrksME+T0RtchM-K1b0DwA@mail.gmail.com> <24141783-A04A-42AD-9730-EB5C91A36516@lukasa.co.uk>
From: Martin Thomson <martin.thomson@gmail.com>
Date: Thu, 01 Dec 2016 10:03:37 +1100
Message-ID: <CABkgnnXXLUfC9q5YSQjRWZOqyPevkVrPT2VKvUAEK7caxQDDng@mail.gmail.com>
To: Cory Benfield <cory@lukasa.co.uk>
Cc: Kazuho Oku <kazuhooku@gmail.com>, RFC Errata System <rfc-editor@rfc-editor.org>, Mike Belshe <mike@belshe.com>, Roberto Peon <fenix@google.com>, Ben Campbell <ben@nostrum.com>, Alissa Cooper <alissa@cooperw.in>, Alexey Melnikov <aamelnikov@fastmail.fm>, Patrick McManus <pmcmanus@mozilla.com>, Mark Nottingham <mnot@mnot.net>, HTTP Working Group <ietf-http-wg@w3.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=209.85.216.194; envelope-from=martin.thomson@gmail.com; helo=mail-qt0-f194.google.com
X-W3C-Hub-Spam-Status: No, score=-6.0
X-W3C-Hub-Spam-Report: AWL=0.003, BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, W3C_AA=-1, W3C_DB=-1, W3C_IRA=-1, W3C_WL=-1
X-W3C-Scan-Sig: mimas.w3.org 1cCE9c-00019N-Dl 93b24f17e30b463511b335bbb73327a2
X-Original-To: ietf-http-wg@w3.org
Subject: Re: [Editorial Errata Reported] RFC7540 (4871)
Archived-At: <http://www.w3.org/mid/CABkgnnXXLUfC9q5YSQjRWZOqyPevkVrPT2VKvUAEK7caxQDDng@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/33056
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

On 1 December 2016 at 00:05, Cory Benfield <cory@lukasa.co.uk> wrote:
> My understanding of what Martin is suggesting is that that isn’t true:
> blocked streams do not distribute their weight to their dependants. However,
> that’s also what the Python Priority implementation does.

And this was my error in writing up the errata and my earlier emails.
The spec is clear that there is no functional distinction between
blocked and finished.  The original text is correct.

It's pretty obvious however that it's not clear.  I'd answered on the
basis of first principles, and that was an error on my part.

Mike's algorithm is almost correct, but I would revise it.  Starting
at the top level:

Given a set of dependents of S,
  find all S where not TreeBlocked(S) as S'
  allocate resources to S' proportional to their weights
    for a stream s in S', if StreamBlocked(s), repeat algorithm with
its dependents

Not treating closed as special keeps this simple.  If you were to
treat closed as different to blocked, then you have the issues that
Cory was digging into.

Kazuho points out:
> I also do not see why it would be beneficial to treat them [closed streams] differently.

It's beneficial if you have other streams that are not blocked that
don't have dependencies.

Imagine that you have two HTML files and then images for each as
dependents.  If one HTML file is blocked, then there is potentially
less value in loading the images that depend on it than there is in
making progress on the other HTML file.  Now, that is arguably not
valuable because HTML/image dependencies are sort of loose, but if you
have an application that has absolute dependencies (I can't use this
until you give me that) and other constraints (not enough memory to
buffer), then you can see a way to treating closed and blocked
differently.

Of course, that isn't what the spec says and we don't get to change that :)

BTW, in answer to what people suggested about flow control, that is
only one reason a resource might be blocked.  A resource might be
blocked because the server hasn't finished building it, that might be
IO or processing.