Re: delta encoding and state management

Nico Williams <nico@cryptonector.com> Thu, 17 January 2013 22:18 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6FA2C21F8A41 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 17 Jan 2013 14:18:30 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -8.095
X-Spam-Level:
X-Spam-Status: No, score=-8.095 tagged_above=-999 required=5 tests=[AWL=1.883, BAYES_00=-2.599, FM_FORGED_GMAIL=0.622, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id kVgMVYIXoQih for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 17 Jan 2013 14:18:29 -0800 (PST)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id A597121F8A22 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Thu, 17 Jan 2013 14:18:29 -0800 (PST)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1Tvxm7-0007QL-U7 for ietf-http-wg-dist@listhub.w3.org; Thu, 17 Jan 2013 22:17:31 +0000
Resent-Date: Thu, 17 Jan 2013 22:17:31 +0000
Resent-Message-Id: <E1Tvxm7-0007QL-U7@frink.w3.org>
Received: from maggie.w3.org ([128.30.52.39]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <nico@cryptonector.com>) id 1Tvxlu-0007PY-Qj for ietf-http-wg@listhub.w3.org; Thu, 17 Jan 2013 22:17:18 +0000
Received: from caiajhbdcaib.dreamhost.com ([208.97.132.81] helo=homiemail-a32.g.dreamhost.com) by maggie.w3.org with esmtp (Exim 4.72) (envelope-from <nico@cryptonector.com>) id 1Tvxlu-000608-6i for ietf-http-wg@w3.org; Thu, 17 Jan 2013 22:17:18 +0000
Received: from homiemail-a32.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a32.g.dreamhost.com (Postfix) with ESMTP id 5CA71584058 for <ietf-http-wg@w3.org>; Thu, 17 Jan 2013 14:16:57 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=cryptonector.com; h= mime-version:in-reply-to:references:date:message-id:subject:from :to:cc:content-type; s=cryptonector.com; bh=0o/lv3BJgHbC2HsG1dH8 7po+CZ4=; b=Zat51hghNTcxwxnqfEXt3W4J8FvTv+lnbAxpp9ghb7X4/9mTZ+DZ XpCEpJLF0u7w+KbWjpoAk1TbWHdud8tyW6urZuyrUsKcjpmO/TuJ1KLbItCiP2JK JpJzYg0YhGO0LNDloMPivB3qsDeXQmqztxJwM48+86yKCEfdNqUpmFU=
Received: from mail-wg0-f41.google.com (mail-wg0-f41.google.com [74.125.82.41]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: nico@cryptonector.com) by homiemail-a32.g.dreamhost.com (Postfix) with ESMTPSA id 08169584057 for <ietf-http-wg@w3.org>; Thu, 17 Jan 2013 14:16:56 -0800 (PST)
Received: by mail-wg0-f41.google.com with SMTP id ds1so82443wgb.0 for <ietf-http-wg@w3.org>; Thu, 17 Jan 2013 14:16:55 -0800 (PST)
MIME-Version: 1.0
X-Received: by 10.194.77.13 with SMTP id o13mr10830765wjw.58.1358461015503; Thu, 17 Jan 2013 14:16:55 -0800 (PST)
Received: by 10.217.82.73 with HTTP; Thu, 17 Jan 2013 14:16:55 -0800 (PST)
In-Reply-To: <CABP7RbfDZcRH-0_AaN9iYjPN-v6QjU6_Xdy5o1BHYnDFWHtuAg@mail.gmail.com>
References: <CABP7Rbf-_Of0Gnn7uaeuPiiZ6n+MxbpJjbggmD3qjykWX3gaXQ@mail.gmail.com> <CAK3OfOgvK=GEhCr3jghgFu-1FnZLv5j4bmpYoEpsj59kekL5kg@mail.gmail.com> <CAP+FsNcmLH6fWQoptBoP3a1x-zSpbP8piCFz1fg5KuF+6R3jjg@mail.gmail.com> <CAK3OfOj3ZgOZnzcQCifhb9f2One7vBUNGv7yhidkZqRzaeZYvQ@mail.gmail.com> <CAP+FsNfswUN-CK6heRGqEnSJatHGo3q2mZZLTrPnjapCZz2sTg@mail.gmail.com> <CABP7RbfDZcRH-0_AaN9iYjPN-v6QjU6_Xdy5o1BHYnDFWHtuAg@mail.gmail.com>
Date: Thu, 17 Jan 2013 16:16:55 -0600
Message-ID: <CAK3OfOh0xqZsPYcb0uRLnebKWTKO7ARkJ4joFZoqjiBSTmwBTA@mail.gmail.com>
From: Nico Williams <nico@cryptonector.com>
To: James M Snell <jasnell@gmail.com>
Cc: Roberto Peon <grmocg@gmail.com>, "ietf-http-wg@w3.org" <ietf-http-wg@w3.org>
Content-Type: text/plain; charset="UTF-8"
Received-SPF: none client-ip=208.97.132.81; envelope-from=nico@cryptonector.com; helo=homiemail-a32.g.dreamhost.com
X-W3C-Hub-Spam-Status: No, score=-2.5
X-W3C-Hub-Spam-Report: AWL=-2.423, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001
X-W3C-Scan-Sig: maggie.w3.org 1Tvxlu-000608-6i f598a0f817be8217ceade6b84623fae5
X-Original-To: ietf-http-wg@w3.org
Subject: Re: delta encoding and state management
Archived-At: <http://www.w3.org/mid/CAK3OfOh0xqZsPYcb0uRLnebKWTKO7ARkJ4joFZoqjiBSTmwBTA@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/15981
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

On Thu, Jan 17, 2013 at 3:44 PM, James M Snell <jasnell@gmail.com> wrote:
> We certainly cannot come up with optimized binary encodings for everything
> but we can get a good ways down the road optimizing the parts we do know
> about. We've already seen, for instance, that date headers can be optimized
> significantly; and the separation of individual cookie crumbs allows us to
> keep from having to resend the entire cookie whenever just one small part
> changes. I'm certain there are other optimizations we can make without
> feeling like we have to find encodings for everything.

The only way cookie compression can work is by having connection
state.  But often the whole point of cookies is to not store state on
the server but on the client.

The more state we associate with connections the more pressure there
will be to close connections sooner and then we'll have to establish
new connections, build new compression state, and then have it torn
down again.  Fast TCP can help w.r.t. reconnect overhead, but that's
about it.

We need to do more than measure compression ratios.  We need to
measure state size and performance impact on fully-loaded middleboxes.
 We need to measure the full impact of compression on the user
experience.  A fabulous compression ratio might nonetheless spell doom
for the user experience and thence the protocol.  If we take the wrong
measures we risk failure for the new protocol, and we may not try
again for a long time.

Also, with respect to some of those items we cannot encode minimally
(cookies, URIs, ...): their size is really in the hands of the
entities that create them -- let *them* worry about compression.  That
might cause some pressure to create shorter, less-meaningful URIs,
but... we're already there anyways.

Nico
--