Re: Choosing a header compression algorithm

Mark Nottingham <mnot@mnot.net> Mon, 25 March 2013 05:37 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 688E921F8CED for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Sun, 24 Mar 2013 22:37:19 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -8
X-Spam-Level:
X-Spam-Status: No, score=-8 tagged_above=-999 required=5 tests=[RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id fU+lXkjlRR2n for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Sun, 24 Mar 2013 22:37:18 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id A9A3221F8C4F for <httpbisa-archive-bis2Juki@lists.ietf.org>; Sun, 24 Mar 2013 22:37:15 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1UK03O-0000Ts-Ny for ietf-http-wg-dist@listhub.w3.org; Mon, 25 Mar 2013 05:34:42 +0000
Resent-Date: Mon, 25 Mar 2013 05:34:42 +0000
Resent-Message-Id: <E1UK03O-0000Ts-Ny@frink.w3.org>
Received: from maggie.w3.org ([128.30.52.39]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <mnot@mnot.net>) id 1UK036-0000T5-L8 for ietf-http-wg@listhub.w3.org; Mon, 25 Mar 2013 05:34:24 +0000
Received: from mxout-08.mxes.net ([216.86.168.183]) by maggie.w3.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.72) (envelope-from <mnot@mnot.net>) id 1UK035-0004Wd-J0 for ietf-http-wg@w3.org; Mon, 25 Mar 2013 05:34:24 +0000
Received: from mnot-mini.mnot.net (unknown [118.209.42.8]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by smtp.mxes.net (Postfix) with ESMTPSA id 10C57509B6; Mon, 25 Mar 2013 01:33:59 -0400 (EDT)
Content-Type: text/plain; charset="us-ascii"
Mime-Version: 1.0 (Mac OS X Mail 6.3 \(1503\))
From: Mark Nottingham <mnot@mnot.net>
In-Reply-To: <A14105FB-ED1A-4B70-8840-9648847BCC3A@mnot.net>
Date: Mon, 25 Mar 2013 16:33:56 +1100
Content-Transfer-Encoding: quoted-printable
Message-Id: <CC028265-F68B-4864-8DAF-AD0F3DE5BE44@mnot.net>
References: <254AABEE-22B9-418E-81B0-2729902C4413@mnot.net> <A14105FB-ED1A-4B70-8840-9648847BCC3A@mnot.net>
To: "ietf-http-wg@w3.org Group" <ietf-http-wg@w3.org>, RUELLAN Herve <Herve.Ruellan@crf.canon.fr>
X-Mailer: Apple Mail (2.1503)
Received-SPF: pass client-ip=216.86.168.183; envelope-from=mnot@mnot.net; helo=mxout-08.mxes.net
X-W3C-Hub-Spam-Status: No, score=-3.4
X-W3C-Hub-Spam-Report: AWL=-3.362, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001
X-W3C-Scan-Sig: maggie.w3.org 1UK035-0004Wd-J0 a5729cce693ca480ad85d0939b3db69e
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Choosing a header compression algorithm
Archived-At: <http://www.w3.org/mid/CC028265-F68B-4864-8DAF-AD0F3DE5BE44@mnot.net>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/17125
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

After Herve's most recent pull request, this:

On 22/03/2013, at 5:32 PM, Mark Nottingham <mnot@mnot.net> wrote:

> 4096 Byte Buffer
> ----------------------
> 
> * TOTAL: 5948 req messages
>                                       size  time | ratio min   max   std
>                        http1     3,460,925  0.18 | 1.00  1.00  1.00  0.00
>  delta2 (max_byte_size=4096)       665,642 13.35 | 0.19  0.03  0.77  0.12
>     headerdiff (buffer=4096)     1,406,429  3.92 | 0.41  0.03  0.88  0.18
> 
> * TOTAL: 5948 res messages
>                                       size  time | ratio min   max   std
>                        http1     2,186,162  0.21 | 1.00  1.00  1.00  0.00
>  delta2 (max_byte_size=4096)       610,764 15.48 | 0.28  0.02  1.06  0.13
>     headerdiff (buffer=4096)     1,009,185  7.58 | 0.46  0.05  0.93  0.13

becomes:

* TOTAL: 5948 req messages
                                       size  time | ratio min   max   std
                        http1     3,460,925  0.24 | 1.00  1.00  1.00  0.00
  delta2 (max_byte_size=4096)       665,642 12.21 | 0.19  0.03  0.77  0.12
     headerdiff (buffer=4096)       944,716  1.23 | 0.27  0.01  0.96  0.23

* TOTAL: 5948 res messages
                                       size  time | ratio min   max   std
                        http1     2,186,162  0.25 | 1.00  1.00  1.00  0.00
  delta2 (max_byte_size=4096)       610,764 13.41 | 0.28  0.02  1.06  0.13
     headerdiff (buffer=4096)       584,188  4.45 | 0.27  0.02  0.92  0.18

with the invocation:

> ./compare_compressors.py -c delta2=max_byte_size=4096 -c headerdiff=buffer=4096 ../http_samples/mnot/*.har

Herve, before I re-run everything*, what other flags are appropriate (esp. considering the discussion around CRIME)?

Cheers,


* Yes, we should discuss the streamifier first, too.


--
Mark Nottingham   http://www.mnot.net/