Re: Retrospective on PRIORITY

Kazuho Oku <kazuhooku@gmail.com> Wed, 19 April 2017 04:39 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 197F2127B73 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Tue, 18 Apr 2017 21:39:42 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.502
X-Spam-Level:
X-Spam-Status: No, score=-6.502 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_SORBS_SPAM=0.5, RP_MATCHES_RCVD=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3TveUE0LtxIa for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Tue, 18 Apr 2017 21:39:40 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4CCF7126C83 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Tue, 18 Apr 2017 21:39:39 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.80) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1d0hKs-0001Vg-35 for ietf-http-wg-dist@listhub.w3.org; Wed, 19 Apr 2017 04:35:22 +0000
Resent-Date: Wed, 19 Apr 2017 04:35:22 +0000
Resent-Message-Id: <E1d0hKs-0001Vg-35@frink.w3.org>
Received: from mimas.w3.org ([128.30.52.79]) by frink.w3.org with esmtps (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from <kazuhooku@gmail.com>) id 1d0hKp-0001Tu-6E for ietf-http-wg@listhub.w3.org; Wed, 19 Apr 2017 04:35:19 +0000
Received: from mail-pg0-f53.google.com ([74.125.83.53]) by mimas.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.84_2) (envelope-from <kazuhooku@gmail.com>) id 1d0hKh-0001EJ-HP for ietf-http-wg@w3.org; Wed, 19 Apr 2017 04:35:13 +0000
Received: by mail-pg0-f53.google.com with SMTP id s64so6523242pgb.1 for <ietf-http-wg@w3.org>; Tue, 18 Apr 2017 21:34:51 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=QlCb6KR9TRo13r6yRVZEemEwALnoOqUyoSD/uTCnqi8=; b=dCrLh2aJQQmF0TvFEBKF54wwZqHIUDiRDqLiFrOYHZadedaG2yHcPaCGpvs/N8KXYW CHthuQcLrkYkgTauRvn4zlZ+O8AKIpG4Nh/d/QeK5XpoetPE5hgbkPyoQdoWL5A93R5l lgG5bjjj3KCMZ6wKF8iMx+1LlychQY/1/P0LBlRLfl651HChe7jppdyVHzcjV1ONR/gp +OQtAXt1Q20oE8ZMJDQskmRYIuPtKQHlDRAvKAdbNr8rkjn4/dd2j6d4Wi5IJYaeYg+Y k9qOtbw6j3/FordmH6+f8bZ83VKORZEfrVJdw5YKODhr4h0cEPUsDiBuDZDaW6s+cchD AvVQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=QlCb6KR9TRo13r6yRVZEemEwALnoOqUyoSD/uTCnqi8=; b=OAiZWNRC+hoLuGuAxohzWmp3Pk+CG9u9jAYx0pZPf/aFBt9jm+G0/M7ojeMLW5iueX EwhUyiY20RegjhHKBBfY/Nj1DVvsg13FdAdvK9NK2JixjKD+ufn5nidhAQQ34zvR2/OJ 9Kn8x6UL2z6cqdzKqSB45EeXv0ZcGKajpp/x4B61YhfNmIPb7Jdja4YkniPVeCANo+wv 2vViDdd0bIxK3KYLqX7xIIA01vqNyWVF2J4Cg8cYNOnL+3JF6fyRybcYMdJWML+3vKoN AUoYB+3b8ismXOGzHvrPu6dKOL2sA499kp7CXC5bMkUJ0+REHZnRXtbc5yooVBtuXZiY 3EiQ==
X-Gm-Message-State: AN3rC/48R/+6cbrVRnvYv25nmyrbUTFBh0eazGcU3mZv69eApLiT2iW5 yMuioLkZy4ycps8+OlgMLRNy2N9hVEHk
X-Received: by 10.84.149.168 with SMTP id m37mr1343043pla.74.1492576485013; Tue, 18 Apr 2017 21:34:45 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.100.153.15 with HTTP; Tue, 18 Apr 2017 21:34:44 -0700 (PDT)
In-Reply-To: <BN6PR03MB2708D32F12FAF2953E0F499487190@BN6PR03MB2708.namprd03.prod.outlook.com>
References: <BN6PR03MB2708D32F12FAF2953E0F499487190@BN6PR03MB2708.namprd03.prod.outlook.com>
From: Kazuho Oku <kazuhooku@gmail.com>
Date: Wed, 19 Apr 2017 13:34:44 +0900
Message-ID: <CANatvzzxHJMN2478GJLrGqomL61wsdF2E5=pEAN6R+P2n5gB+w@mail.gmail.com>
To: Mike Bishop <Michael.Bishop@microsoft.com>
Cc: HTTP Working Group <ietf-http-wg@w3.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=74.125.83.53; envelope-from=kazuhooku@gmail.com; helo=mail-pg0-f53.google.com
X-W3C-Hub-Spam-Status: No, score=-4.1
X-W3C-Hub-Spam-Report: AWL=-0.622, BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001, W3C_AA=-1, W3C_WL=-1
X-W3C-Scan-Sig: mimas.w3.org 1d0hKh-0001EJ-HP bef3041086f5a4fc25d8de1b4b22fe06
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Retrospective on PRIORITY
Archived-At: <http://www.w3.org/mid/CANatvzzxHJMN2478GJLrGqomL61wsdF2E5=pEAN6R+P2n5gB+w@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/33826
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

Hi Mike,

Thank you for raising this interesting discussion.

2017-04-19 3:46 GMT+09:00 Mike Bishop <Michael.Bishop@microsoft.com>:
> I had an interesting side conversation in Chicago, where it was proposed
> that HTTP/QUIC pull out the H2 priority scheme and go with something
> simpler, or at least make all priority schemes extensions so client/server
> can negotiate which one they want to use.  I think efforts like that
> probably need to be driven out of the HTTP WG rather than the QUIC WG, but
> it did raise some interesting questions.
>
>
>
> Back in this thread
> (https://lists.w3.org/Archives/Public/ietf-http-wg/2014JanMar/0396.html), we
> had a proposal which permits expressing the same desired end-states, but
> requires the client to do the tree collapsing instead of the server.  That
> means clients can be as simple or as complex as they desire, and the server
> just needs to see the end output of whatever fancy algorithm they’re using.
>
>
>
> The argument that drove the current scheme was that when running a proxy,
> you need a way to be able to encapsulate the priorities declared by one
> client onto priorities in a back-end connection while isolating the user’s
> declared priorities from other users’ declared priorities.  Clearly you
> can’t just do a straight pass-through, or everyone is incented to use the
> top end of the priority range.  The scheme that ultimately landed in H2
> allows this at the proxy:
>
> Every user gets a placeholder node; weights of placeholders represent
> relative priorities of the users
> Anything the user declares depends on stream zero in their connection
> depends on this placeholder; weights unchanged
> Anything the user declares depends some other stream still depends on that
> stream; weights unchanged
>
> Also, when something changes near the root of the tree, the client might be
> issuing a lot of PRIORITY frames to update everything as a result if all the
> server gets is the output of the tree.  In the video playback case,
> finishing the current chunk is a change near the root of the tree that’s
> fairly common.
>
>
>
> With any simpler scheme, the proxy either has to ignore declared priorities
> or do work to coalesce declared priorities across users.  And obviously, if
> you have tiers of proxies, the same logic can be applied multiple times and
> still get a sensible result at the back-end.  You could bring that idea into
> the proposal linked above, but you’d need groups-of-groups, and
> groups-of-groups-of-groups, and soon you wind up with something that looks a
> lot like a dependency tree again.
>
>
>
> I think any reasonable priority scheme will work fine between client and
> server – it’s the proxy (forward or reverse) that needs to see the
> uncollapsed tree so that it can merge trees between clients.  Now that H2 is
> deployed, I’m curious how proxy vendors are finding this to work out.  Do
> you find the additional richness useful, or is there more appetite for
> simpler priority schemes?  Are you actually using the algorithm above, or
> something like it?

I would argue that for a reverse proxy there is no much need to
prioritize requests sent to origin, since the majority of HTTP
requests are requests for static assets and hence are terminated at
the reverse proxy. Users of a reverse proxy that sends all requests to
origin (e.g. WAF-as-a-service) might have a different opinion, though.

OTOH, I am kind of negative about designing a new priority scheme. The
priority scheme of HTTP/2 works fairly well, and we have experiences.
Is there any reason not to reuse?

My point is that we should better not risk delaying the delivery of
QUIC by trying to replace something that might be a bit complicated
but is already known to work well.

-- 
Kazuho Oku