Re: HTTP router point-of-view concerns
Patrick McManus <pmcmanus@mozilla.com> Thu, 11 July 2013 19:55 UTC
Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8034821F9256 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 11 Jul 2013 12:55:47 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.976
X-Spam-Level:
X-Spam-Status: No, score=-9.976 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, FM_FORGED_GMAIL=0.622, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id sw4o5ggV1PCJ for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 11 Jul 2013 12:55:41 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id C249621F9808 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Thu, 11 Jul 2013 12:55:40 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1UxMwy-0000oU-Bl for ietf-http-wg-dist@listhub.w3.org; Thu, 11 Jul 2013 19:54:48 +0000
Resent-Date: Thu, 11 Jul 2013 19:54:48 +0000
Resent-Message-Id: <E1UxMwy-0000oU-Bl@frink.w3.org>
Received: from lisa.w3.org ([128.30.52.41]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <patrick.ducksong@gmail.com>) id 1UxMwq-0000kr-0e for ietf-http-wg@listhub.w3.org; Thu, 11 Jul 2013 19:54:40 +0000
Received: from mail-oa0-f44.google.com ([209.85.219.44]) by lisa.w3.org with esmtps (TLS1.0:RSA_ARCFOUR_SHA1:16) (Exim 4.72) (envelope-from <patrick.ducksong@gmail.com>) id 1UxMwo-0001ia-3L for ietf-http-wg@w3.org; Thu, 11 Jul 2013 19:54:39 +0000
Received: by mail-oa0-f44.google.com with SMTP id l10so11661931oag.17 for <ietf-http-wg@w3.org>; Thu, 11 Jul 2013 12:54:12 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=mDydFpNDp/dqOwpNwTJ49ShY2mRFwmPY4ELXSBUwI7g=; b=s3RqCzotsnCwXs+AxbyHImTYq6v4JdipVnQFNrDLzeyMq0Ee+To6NMMbOMvKLCMG3i XDf5+yPw3ohbYukntVCqRJYD21szYl16fMXGHkaNy1PEOg2PKrGkRKV4Bp4BYaB7sER1 hQRe0eBjVGFhpUImj3ygNarXUKsh1kII97ngqA475ap9IOcgqF0QqLocdS4zJ0OmDtnN zkIE33kGM84IeoGUf6eHTMNGmykOaUC0iNpC4t4IsIK/JgF58y7c4YGvZuCC6H/jMgRY QxdB2up4hhJveKdMDF6j6QNjpHA9juv4tLxuWDuUGv1tDj/J4i6WYCTiqVU2za67VCDQ 2d3w==
MIME-Version: 1.0
X-Received: by 10.182.60.2 with SMTP id d2mr33303776obr.75.1373572452056; Thu, 11 Jul 2013 12:54:12 -0700 (PDT)
Sender: patrick.ducksong@gmail.com
Received: by 10.76.152.133 with HTTP; Thu, 11 Jul 2013 12:54:11 -0700 (PDT)
In-Reply-To: <092D65A8-8CB7-419D-B6A4-77CAE40A0026@gmail.com>
References: <CA+qvzFPUpcm6kUtJx+rTw8Dpp4Gtx4Bmr3XPDhjNsjchUfN9_w@mail.gmail.com> <51DE1E32.9010801@treenet.co.nz> <CAP+FsNdcYhA=V5Z+zbt70b5e7WmcmXgjG5M9L3vfXeXfTwmRnw@mail.gmail.com> <51DE327C.7010901@treenet.co.nz> <CABkgnnXeqD6wh0dcJ1Dz=4PLAJNkDeGcCuzMr9ATd_7xS7nbGQ@mail.gmail.com> <CABP7RbcUkLf3CTAB4jwicnsiKWLGVY6=hX0k=0256SR_gcVt9A@mail.gmail.com> <092D65A8-8CB7-419D-B6A4-77CAE40A0026@gmail.com>
Date: Thu, 11 Jul 2013 15:54:11 -0400
X-Google-Sender-Auth: _ROkBbjKk_XimS5YPwPGbJOtYxw
Message-ID: <CAOdDvNr=9YPYbyOBgKn_nNCzKBoMqdoE-xFNQzm1uQBqU4Hhzw@mail.gmail.com>
From: Patrick McManus <pmcmanus@mozilla.com>
To: Sam Pullara <spullara@gmail.com>
Cc: James M Snell <jasnell@gmail.com>, Martin Thomson <martin.thomson@gmail.com>, Amos Jeffries <squid3@treenet.co.nz>, HTTP Working Group <ietf-http-wg@w3.org>
Content-Type: multipart/alternative; boundary="089e015387dc140adf04e141c2f3"
Received-SPF: pass client-ip=209.85.219.44; envelope-from=patrick.ducksong@gmail.com; helo=mail-oa0-f44.google.com
X-W3C-Hub-Spam-Status: No, score=-3.4
X-W3C-Hub-Spam-Report: AWL=-2.651, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001
X-W3C-Scan-Sig: lisa.w3.org 1UxMwo-0001ia-3L bd124d6e8f0898e37b807cd83f8d4ee2
X-Original-To: ietf-http-wg@w3.org
Subject: Re: HTTP router point-of-view concerns
Archived-At: <http://www.w3.org/mid/CAOdDvNr=9YPYbyOBgKn_nNCzKBoMqdoE-xFNQzm1uQBqU4Hhzw@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/18705
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>
Header compression on the upstream path is more or less required to enable effective prioritized mux of multiple transactions due to interactions with TCP congestion control. If you don't have it you cannot effectively achieve the parallelism needed to leverage the most important HTTP/2 feature with out an RTT penalty. and RTT's are the enemy. Without compression you can "pipeline" between 1 and 10 requests depending on your cookie size. Probably closer to 3 or 4. With compression, the sky is more or less the limit. On Thu, Jul 11, 2013 at 1:21 PM, Sam Pullara <spullara@gmail.com> wrote: > How sure are we that the entire idea of header compression isn't a bad > idea? I implemented something similar in the WebLogic T3 protocol > (BubblingAbbrevTable, probably still in there) and it was mostly just a > pain. If I were to go back I would just use gzip with some agreed upon seed > dictionary. Thought I would bring this up since it seems like it is a very > controversial feature to begin with. > > Sam > > On Jul 11, 2013, at 10:14 AM, James M Snell <jasnell@gmail.com> wrote: > > > Yes, the ability to set compression context size to 0 is very useful. > > My fears around this area are: > > > > 1. In order to achieve maximum throughput, Intermediaries may opt to > > *always* set compression context to 0, forcing the headers to always > > be passed as Literals, killing the utility of having the header > > compression mechanism there in the first place. > > > > 2. The assumption of a non-zero default compression context size when > > the connection is established opens a race condition that a malicious > > sender could exploit in a denial of service attack. Yes, the receiver > > could opt to terminate the connection once it detects bad behavior, > > but there is still a potential window of time there where the receiver > > could be forced to do significant additional work. > > > > (This is particularly bad given that header continuations are > unbounded.) > > > > 3. Setting the compression context size to 0 does not stop the sender > > from sending the Indexed Literal instructions anyway. The receiving > > endpoint would still be required to process those instructions even if > > the data is not actually being indexed, causing CPU cycles to be > > consumed. For any individual block of headers it may not be a > > significant load, but it's something that needs to be addressed. > > > > (This can be fixed in the spec by stating that any attempt to Index > > any individual (name,value) whose size is greater than the available > > header table size results in a Compression Error. Making this change > > would mean that when Compression Context size is 0, the only operation > > that would not result in an error is Literal without Indexing. This > > was discussed on the list but as far as I can tell it's not yet > > captured in the spec). > > > > 4. The fact that header continuations can be unbounded is deeply > > troubling, especially given that the endpoint is required to buffer > > and process the complete header block (well.. that's only half true, > > the encoding does allow for incremental processing of the HEADERS > > frame payloads but the spec requires that the complete header block is > > always processed). Sure, the recipient is free to terminate the > > connection as soon as it detects bad behavior, but the sender could > > end up forcing the recipient to do a significant amount of extra > > processing with a never ending sequence of HEADERS frames. Smart > > implementations will know how to deal with this, yes, but overall it > > adds to the already growing list of "New Complex Things" that an > > HTTP/2 implementer needs to know about. > > > > (In the implementation I've done, I provide a configuration > > parameter that allows a developer to cap the number of the > > continuations and the total size of the header block) > > > > I know that we're in "implementation" phase right now and that > > everyone is busy getting their code ready for testing in August, but > > after updating my implementation to the latest version of the draft, > > my concerns with regards to stateful header compression definitely > > remain. > > > > On Thu, Jul 11, 2013 at 9:36 AM, Martin Thomson > > <martin.thomson@gmail.com> wrote: > >> On 10 July 2013 21:20, Amos Jeffries <squid3@treenet.co.nz> wrote: > >>> It seems not to be negotiable from the recipients side. > >> > >> Compression context size = 0 is entirely negotiable from the recipient > >> end, with a small wrinkle, that I know some folks are working on. > >> Which is, a client can start using a default compression context size > >> prior to learning that a server has no space (substitute intermediary > >> as appropriate there). > >> > > > > >
- Re: HTTP router point-of-view concerns Poul-Henning Kamp
- HTTP router point-of-view concerns Christian Parpart
- Re: HTTP router point-of-view concerns Amos Jeffries
- Re: HTTP router point-of-view concerns Roberto Peon
- Re: HTTP router point-of-view concerns Amos Jeffries
- Re: HTTP router point-of-view concerns Christian Parpart
- Re: HTTP router point-of-view concerns Amos Jeffries
- Re: HTTP router point-of-view concerns Michael Sweet
- Re: HTTP router point-of-view concerns Martin Thomson
- Re: HTTP router point-of-view concerns James M Snell
- Re: HTTP router point-of-view concerns Sam Pullara
- Re: HTTP router point-of-view concerns Roberto Peon
- Re: HTTP router point-of-view concerns Roberto Peon
- Re: HTTP router point-of-view concerns Amos Jeffries
- Re: HTTP router point-of-view concerns Sam Pullara
- Re: HTTP router point-of-view concerns Patrick McManus
- Re: HTTP router point-of-view concerns Roberto Peon
- Re: HTTP router point-of-view concerns James M Snell
- Re: HTTP router point-of-view concerns Roberto Peon
- Re: HTTP router point-of-view concerns James M Snell
- Re: HTTP router point-of-view concerns Roberto Peon
- Re: HTTP router point-of-view concerns Sam Pullara
- Re: HTTP router point-of-view concerns Roberto Peon
- Re: HTTP router point-of-view concerns Martin Thomson
- Re: HTTP router point-of-view concerns Poul-Henning Kamp
- Re: HTTP router point-of-view concerns Mark Nottingham
- Re: HTTP router point-of-view concerns Mike Belshe
- Re: HTTP router point-of-view concerns Gábor Molnár
- Re: HTTP router point-of-view concerns Gábor Molnár
- Re: HTTP router point-of-view concerns Poul-Henning Kamp
- Re: HTTP router point-of-view concerns Michael Sweet
- Re: HTTP router point-of-view concerns Christian Parpart
- Re: HTTP router point-of-view concerns Willy Tarreau
- Re: HTTP router point-of-view concerns Patrick McManus
- Re: HTTP router point-of-view concerns Jeff Pinner
- Re: HTTP router point-of-view concerns Martin Thomson
- Re: HTTP router point-of-view concerns Roberto Peon
- Re: HTTP router point-of-view concerns Ludin, Stephen
- Re: HTTP router point-of-view concerns Roberto Peon
- Re: HTTP router point-of-view concerns James M Snell
- Re: HTTP router point-of-view concerns Amos Jeffries
- Re: HTTP router point-of-view concerns Amos Jeffries
- Re: HTTP router point-of-view concerns Roberto Peon
- Re: HTTP router point-of-view concerns Yoav Nir
- Re: HTTP router point-of-view concerns Willy Tarreau
- Re: HTTP router point-of-view concerns Poul-Henning Kamp
- Re: HTTP router point-of-view concerns Poul-Henning Kamp
- Re: HTTP router point-of-view concerns Willy Tarreau
- Re: HTTP router point-of-view concerns Poul-Henning Kamp
- Re: HTTP router point-of-view concerns Sam Pullara
- Re: HTTP router point-of-view concerns Willy Tarreau
- Re: HTTP router point-of-view concerns Mark Delany
- Re: HTTP router point-of-view concerns Poul-Henning Kamp
- Re: HTTP router point-of-view concerns Poul-Henning Kamp
- Re: HTTP router point-of-view concerns Willy Tarreau
- Re: HTTP router point-of-view concerns Willy Tarreau
- Re: HTTP router point-of-view concerns Poul-Henning Kamp
- Re: HTTP router point-of-view concerns Willy Tarreau
- Re: HTTP router point-of-view concerns Yoav Nir
- Re: HTTP router point-of-view concerns Poul-Henning Kamp
- Re: HTTP router point-of-view concerns Yoav Nir
- Re: HTTP router point-of-view concerns Willy Tarreau
- Re: HTTP router point-of-view concerns Poul-Henning Kamp
- Re: HTTP router point-of-view concerns Stephen Farrell
- Re: HTTP router point-of-view concerns Willy Tarreau
- Re: HTTP router point-of-view concerns Sam Pullara
- Re: HTTP router point-of-view concerns Nicolas Mailhot
- Re: HTTP router point-of-view concerns Nicolas Mailhot
- Re: HTTP router point-of-view concerns Nicolas Mailhot
- Re: HTTP router point-of-view concerns Martin Nilsson
- Re: HTTP router point-of-view concerns Nico Williams
- Re: HTTP router point-of-view concerns Nico Williams
- Re: HTTP router point-of-view concerns Poul-Henning Kamp
- Re: HTTP router point-of-view concerns Nico Williams
- Re: HTTP router point-of-view concerns Poul-Henning Kamp
- Re: HTTP router point-of-view concerns Nico Williams