Re: Header compression: header set diff

James M Snell <jasnell@gmail.com> Mon, 25 March 2013 18:00 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0DA4721F9508 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Mon, 25 Mar 2013 11:00:28 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.202
X-Spam-Level:
X-Spam-Status: No, score=-9.202 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, HTML_MESSAGE=0.001, MIME_QP_LONG_LINE=1.396, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jNz2Z3m3oO77 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Mon, 25 Mar 2013 11:00:27 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id D1F3221F9457 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Mon, 25 Mar 2013 11:00:26 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1UKBg4-00041q-FE for ietf-http-wg-dist@listhub.w3.org; Mon, 25 Mar 2013 17:59:24 +0000
Resent-Date: Mon, 25 Mar 2013 17:59:24 +0000
Resent-Message-Id: <E1UKBg4-00041q-FE@frink.w3.org>
Received: from lisa.w3.org ([128.30.52.41]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <jasnell@gmail.com>) id 1UKBfr-000416-Lj for ietf-http-wg@listhub.w3.org; Mon, 25 Mar 2013 17:59:11 +0000
Received: from mail-ob0-f174.google.com ([209.85.214.174]) by lisa.w3.org with esmtps (TLS1.0:RSA_ARCFOUR_SHA1:16) (Exim 4.72) (envelope-from <jasnell@gmail.com>) id 1UKBfq-0006HB-Fl for ietf-http-wg@w3.org; Mon, 25 Mar 2013 17:59:11 +0000
Received: by mail-ob0-f174.google.com with SMTP id 16so6322151obc.33 for <ietf-http-wg@w3.org>; Mon, 25 Mar 2013 10:58:44 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:cc:content-type; bh=vRzOtgI626tOynXdQ/kmMRfVrx0X/qOJHVxbasmDoTg=; b=yGu/0aHtI9ntQZyfbftLFyzyqRzwm9mJ3SjoqvkTpI3dpK/CJSL+WVVz+Hii4ES+UP U7YgDGiB2wfZ85O53faBYTtuHSTr/hAibXbyVAaynwmX7fTDz7+oD02vUuP2ubVzElXQ kJvGhcqYpKYbngWz7qreskFUoBQnhvP1ZEp5GRcY6vvfcujrkdwWqJFXOZrhk+/y77AF d6dc9nw7mnxVOSHXnc8jovkNp1PD8UKWEJ1DLAn9Ck8FxdovTCuKOEOTz0YhWr7uyUxq LkElnxuYoSfr8hAXbEd0vZcn6uxCbUrtsKbZ6SUyeMnG8QyGwVildOjcOI6v8Wpp5YIF k4Ug==
X-Received: by 10.182.14.39 with SMTP id m7mr575149obc.96.1364234324199; Mon, 25 Mar 2013 10:58:44 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.60.23.193 with HTTP; Mon, 25 Mar 2013 10:58:24 -0700 (PDT)
In-Reply-To: <6C71876BDCCD01488E70A2399529D5E5163F40C5@ADELE.crf.canon.fr>
References: <6C71876BDCCD01488E70A2399529D5E5163F39CB@ADELE.crf.canon.fr> <CAOdDvNq8K52L1rOF8GR7pi4VDx+fOshO=Co7O+0YQTGUL9XMZw@mail.gmail.com> <CABP7RbfCyK8EFHt7g2s+uFhQHHPs3tv=2eunJ8rYDYgz2p=wmw@mail.gmail.com> <CAP+FsNcHTJRsuZ9ZAH6FdQnQjBSpJ08brYnbNhnSM0e5_ZjLAA@mail.gmail.com> <6C71876BDCCD01488E70A2399529D5E5163F3C98@ADELE.crf.canon.fr> <CABP7RbdB80ZTC06juA2LWoivppvc1X8zPZ3By4Nway=pEY8Z9A@mail.gmail.com> <6C71876BDCCD01488E70A2399529D5E5163F40C5@ADELE.crf.canon.fr>
From: James M Snell <jasnell@gmail.com>
Date: Mon, 25 Mar 2013 10:58:24 -0700
Message-ID: <CABP7RbftbeBWby5r1RJ5xOikC-ZZ6UomXyaVTF9onHLsG4hK5Q@mail.gmail.com>
To: RUELLAN Herve <Herve.Ruellan@crf.canon.fr>
Cc: Roberto Peon <grmocg@gmail.com>, Patrick McManus <pmcmanus@mozilla.com>, HTTP Working Group <ietf-http-wg@w3.org>
Content-Type: multipart/alternative; boundary="14dae9399ad1491c8a04d8c38e86"
Received-SPF: pass client-ip=209.85.214.174; envelope-from=jasnell@gmail.com; helo=mail-ob0-f174.google.com
X-W3C-Hub-Spam-Status: No, score=-3.5
X-W3C-Hub-Spam-Report: AWL=-2.699, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001
X-W3C-Scan-Sig: lisa.w3.org 1UKBfq-0006HB-Fl d8c251a432ae6db72b7a8359e668a140
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Header compression: header set diff
Archived-At: <http://www.w3.org/mid/CABP7RbftbeBWby5r1RJ5xOikC-ZZ6UomXyaVTF9onHLsG4hK5Q@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/17135
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

On Mon, Mar 25, 2013 at 10:50 AM, RUELLAN Herve
<Herve.Ruellan@crf.canon.fr>wrote:

>
>
> ​[snip]​
> I you have time, we would welcome another implementation of HeaderDiff.
>
>

​Gimme about two to three weeks and I'll see if I can put it together...​



> I think we really should aim at a customizable compression mechanism: if
> you don’t want to spend too much resources (or even any resource) on
> compression, just use a simple encoder. From my experience, by using very
> few resources, you can easily divide the size of the headers by at least
> two. If you really want to save some bytes, then you can implement a very
> complex and very clever encoder.
>

​I tend to fear solutions that are "too clever", especially if it's not yet
completely clear how much benefit the solution will ultimately provide. In
the meantime, I'm still going to be writing the code tho ;-)​



> I think that binary-optimized headers are also interesting. We
> experimented with a few of them internally and found that a binary encoding
> for dates and integers are simple to add and provide good compaction
> improvements.
>

In about a week I'll have a modified draft of the BOHE draft spec that adds
binary encoding to Roberto's delta2 encoding. I can look at HeaderDiff and
add it in there also. If we focus on a limit number of value types
(specifically text, numbers, dates and binary blobs) then things can remain
very simple.

- James
​​

>
> Hervé.
>
>
>