Re: http/2 prioritization/fairness bug with proxies

William Chan (陈智昌) <willchan@chromium.org> Tue, 05 February 2013 01:49 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 02F2221F87A5 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Mon, 4 Feb 2013 17:49:16 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.225
X-Spam-Level:
X-Spam-Status: No, score=-9.225 tagged_above=-999 required=5 tests=[AWL=0.452, BAYES_00=-2.599, FM_FORGED_GMAIL=0.622, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id nPv7cdusdd-r for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Mon, 4 Feb 2013 17:49:15 -0800 (PST)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id 2A5DF21F843F for <httpbisa-archive-bis2Juki@lists.ietf.org>; Mon, 4 Feb 2013 17:49:15 -0800 (PST)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1U2XdZ-0001R3-TE for ietf-http-wg-dist@listhub.w3.org; Tue, 05 Feb 2013 01:47:53 +0000
Resent-Date: Tue, 05 Feb 2013 01:47:53 +0000
Resent-Message-Id: <E1U2XdZ-0001R3-TE@frink.w3.org>
Received: from lisa.w3.org ([128.30.52.41]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <willchan@google.com>) id 1U2XdT-0001QJ-3y for ietf-http-wg@listhub.w3.org; Tue, 05 Feb 2013 01:47:47 +0000
Received: from mail-oa0-f52.google.com ([209.85.219.52]) by lisa.w3.org with esmtps (TLS1.0:RSA_ARCFOUR_SHA1:16) (Exim 4.72) (envelope-from <willchan@google.com>) id 1U2XdS-0005fe-0e for ietf-http-wg@w3.org; Tue, 05 Feb 2013 01:47:47 +0000
Received: by mail-oa0-f52.google.com with SMTP id k14so7408902oag.11 for <ietf-http-wg@w3.org>; Mon, 04 Feb 2013 17:47:20 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=3KIUnrPwUpW4gfCTaF+1dYxdFXRhP1YB1jnsjnU1sW4=; b=IdQZTWhW11h+QSDnjvpQtKVd1IeGIAtchUkSqRjyqOmmWLetaud2PP+uomFkmySGBi n+tTfsWyyFSy1lplct1l/60etPmiSpgyFqsLrN9v1yVW7v/B6cZImbL+kVD9E6c3WrMb /KNFqK79uL3wBq1CclfA8u4PSPR3yGvoK6jAxgT0oQYw81xRUQL8Awmlh8TMNdEABReD BOxJYzpp5vPGTHPvoi+C4n5Ril93B7+LTCWenM4sJqHDezPLaXoz0b9+kGviRxMMkCfU rEpZRDZx7947pyXGWQOrvh+M2X0aSN+AL1H0YDENqYJ2gKAnOMyZfqzinL9YDNJxUVQJ ycuQ==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=chromium.org; s=google; h=mime-version:x-received:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=3KIUnrPwUpW4gfCTaF+1dYxdFXRhP1YB1jnsjnU1sW4=; b=UfIznHfBHYoDOYfV33pkyfQSUqv81bjdO03pjVhtz7yzOcMopkFmhGV8ZZPXy9f+iP ub7aLbD0Y9e3AliufNbpMSBXlkH4o8+UuJzCJLYsc3e3+3kIbbM6+GO/uBZpexU1t48y 7wZskDY2JwwiJQW/d4R1gdczG30JF5X4bNs/c=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :x-gm-message-state; bh=3KIUnrPwUpW4gfCTaF+1dYxdFXRhP1YB1jnsjnU1sW4=; b=DbwILnxq0TEJUbpusIwAd2qUEbPA7WQoUKMJzxvrGLlLQiaoQXJQYl184I4f+Zh5qF ojUqyR5U73wwozmGiS5lLXx3xyCE3JWcj6bFH5pwpk3DNKFC9q1hTS24YkGTt4MmSEaw lCQONnpg2/nQkTRK/273tpwRvTAe7YmosSH8/DkCgry1u3ga+OaoKfOU6tS81DOIMOEe ANnVr86TWr0iA67G0OrWkMz30V5Q8OUs3IWoPFgRsX5a0IgKPCKh0gED4KPKwDcsCFGP FGtowqOWu99YvYfjXLM8ejaZWmnOHOZbghesODm8KhnXEHytqP0mIdl3xcFn96HtLLPL ri6w==
MIME-Version: 1.0
X-Received: by 10.60.20.35 with SMTP id k3mr13375521oee.119.1360028839829; Mon, 04 Feb 2013 17:47:19 -0800 (PST)
Sender: willchan@google.com
Received: by 10.182.73.165 with HTTP; Mon, 4 Feb 2013 17:47:19 -0800 (PST)
In-Reply-To: <2346.1360010079@critter.freebsd.dk>
References: <CAA4WUYjiBZpShKKFfHQnixc94aOLrck0oR4ykARB=hF5h8nkfA@mail.gmail.com> <3430.1359961022@critter.freebsd.dk> <510F72CE.8030003@treenet.co.nz> <CAA4WUYiBJrLjM0-vurFOuJfUaabXtK=W8N5z28yshSfrvD9crg@mail.gmail.com> <1516.1360002578@critter.freebsd.dk> <42A54D15-0AA3-4172-94F7-E94C86E84D7F@niven-jenkins.co.uk> <2346.1360010079@critter.freebsd.dk>
Date: Tue, 05 Feb 2013 10:47:19 +0900
X-Google-Sender-Auth: ZMVO3O6eeTe20_5ZrI-rwb6lnUY
Message-ID: <CAA4WUYiyu+JvFuKooqa4xVdCJP=Mngu9dgHjhH99_SEac1kCZQ@mail.gmail.com>
From: "William Chan (陈智昌)" <willchan@chromium.org>
To: Poul-Henning Kamp <phk@phk.freebsd.dk>
Cc: Ben Niven-Jenkins <ben@niven-jenkins.co.uk>, Amos Jeffries <squid3@treenet.co.nz>, HTTP Working Group <ietf-http-wg@w3.org>
Content-Type: text/plain; charset="ISO-8859-1"
X-Gm-Message-State: ALoCoQnJmIWSg7Zjwc79CQ0rLEymWM0VYr3XtUKNc1/ycBet1JZ7EJRc3om77Ilwnax60KXC1de6HvaLEcjF5TWvDZYsDxbjcdidTG1cDgDuw6/fbYoK+Lk1ftG6QRsihBeXOIXyvsr5Vv0RHgDnjBvIimCgl7xnSPQyxFxhnHeI6gbV8pt61TclLBy3dZfO48uhEucJjTy/
Received-SPF: pass client-ip=209.85.219.52; envelope-from=willchan@google.com; helo=mail-oa0-f52.google.com
X-W3C-Hub-Spam-Status: No, score=-3.2
X-W3C-Hub-Spam-Report: AWL=-2.382, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001
X-W3C-Scan-Sig: lisa.w3.org 1U2XdS-0005fe-0e 652c6e37fb42e6e692634b51048b5cce
X-Original-To: ietf-http-wg@w3.org
Subject: Re: http/2 prioritization/fairness bug with proxies
Archived-At: <http://www.w3.org/mid/CAA4WUYiyu+JvFuKooqa4xVdCJP=Mngu9dgHjhH99_SEac1kCZQ@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/16367
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

I'm sorry if I am unclear in any way. Please continue to
challenge/question my comments/assertions so I can clarify my position
as appropriate.

Just to be clear here, I stand by that it's a protocol bug currently.
I agree with adding more hooks to convey advisory priority semantics.
That said, "advisory" is open to interpretation. I agree that the
sender should ultimately be in control of how it orders responses, and
indeed there are of course many situations where it's best for the
sender to ignore the advisory priority. Yet, if the advisory priority
semantics are generally not respected, then clients will not be able
to rely on them, and will be forced to implement prioritization at a
higher layer, which suffers from the link underutilization vs
contention tradeoff I highlighted earlier.

I appreciate the concern that we're adding complexity by introducing
new semantics. I am arguing that because the existing mechanisms for
addressing starvation are suboptimal, we should treat this as a
protocol bug and thus change the protocol in such a way as to fix this
problem. My suggestion for doing so was adding new priority "grouping"
semantics. I am hopeful that these new semantics will not introduce an
inordinate amount of specification, as the primary idea is that the
current SPDY priority levels would apply within a "group". I think we
can come up with a way to define a group that will be relatively easy
to spec.

SPDY/4 introduces other prioritization semantics beyond just grouping,
but I wanted to focus on this one first, as I believe this is a bug
that we *need* to fix. The other SPDY/4 priority changes are of a
performance optimization nature, and I believe they will need to be
justified by data. I have no plans to raise them up in this group
until we have said data.

On Tue, Feb 5, 2013 at 5:34 AM, Poul-Henning Kamp <phk@phk.freebsd.dk> wrote:
> Content-Type: text/plain; charset=ISO-8859-1
> --------
> In message <42A54D15-0AA3-4172-94F7-E94C86E84D7F@niven-jenkins.co.uk>, Ben Nive
> n-Jenkins writes:
>
>>So the idea is the protocol contains enough 'hooks' to sufficiently
>>express the different priorities between & within groups that folks
>>would like to express but isn't prescriptive about how anyone uses or
>>implements different prioritisation, scheduling, etc schemes.
>
> That was clearly not how the original poster presented it:
>
>         "I consider all those options as suboptimal, and thus
>         consider this issue to be a protocol bug. Our SPDY/4
>         prioritization proposal addresses this by [...]"
>
> --
> Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
> phk@FreeBSD.ORG         | TCP/IP since RFC 956
> FreeBSD committer       | BSD since 4.3-tahoe
> Never attribute to malice what can adequately be explained by incompetence.