IETF Logo Mail Archive

RE: FYI: Tools to evaluate header compression algorithms

RUELLAN Herve <Herve.Ruellan@crf.canon.fr> Wed, 16 January 2013 10:59 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0BEDE21F86BE for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 16 Jan 2013 02:59:18 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -10.248
X-Spam-Level:
X-Spam-Status: No, score=-10.248 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, HELO_EQ_FR=0.35, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id bbAG73QgGVql for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 16 Jan 2013 02:59:17 -0800 (PST)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id C121F21F86B8 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Wed, 16 Jan 2013 02:59:16 -0800 (PST)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1TvQgW-0006iD-4J for ietf-http-wg-dist@listhub.w3.org; Wed, 16 Jan 2013 10:57:32 +0000
Resent-Date: Wed, 16 Jan 2013 10:57:32 +0000
Resent-Message-Id: <E1TvQgW-0006iD-4J@frink.w3.org>
Received: from maggie.w3.org ([128.30.52.39]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <Herve.Ruellan@crf.canon.fr>) id 1TvQgS-0006hY-0X for ietf-http-wg@listhub.w3.org; Wed, 16 Jan 2013 10:57:28 +0000
Received: from inari-msr.crf.canon.fr ([194.2.158.67]) by maggie.w3.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.72) (envelope-from <Herve.Ruellan@crf.canon.fr>) id 1TvQgQ-0008RJ-IG for ietf-http-wg@w3.org; Wed, 16 Jan 2013 10:57:27 +0000
Received: from mir-msr.corp.crf.canon.fr (mir-msr.corp.crf.canon.fr [172.19.77.98]) by inari-msr.crf.canon.fr (8.13.8/8.13.8) with ESMTP id r0GAug5q029797; Wed, 16 Jan 2013 11:56:42 +0100
Received: from ADELE.crf.canon.fr (adele.fesl2.crf.canon.fr [172.19.70.17]) by mir-msr.corp.crf.canon.fr (8.13.8/8.13.8) with ESMTP id r0GAugXL030286; Wed, 16 Jan 2013 11:56:42 +0100
Received: from ADELE.crf.canon.fr ([::1]) by ADELE.crf.canon.fr ([::1]) with mapi id 14.02.0328.009; Wed, 16 Jan 2013 11:56:42 +0100
From: RUELLAN Herve <Herve.Ruellan@crf.canon.fr>
To: James M Snell <jasnell@gmail.com>, Mark Nottingham <mnot@mnot.net>
CC: Martin Nilsson <nilsson@opera.com>, "ietf-http-wg@w3.org" <ietf-http-wg@w3.org>
Thread-Topic: FYI: Tools to evaluate header compression algorithms
Thread-Index: AQHN5wC/ag+GXnD39EW9wmEWOICET5g7xoWAgAa8VwCABjdQAIAANk2AgALxnRA=
Date: Wed, 16 Jan 2013 10:56:40 +0000
Message-ID: <6C71876BDCCD01488E70A2399529D5E52DED4A@ADELE.crf.canon.fr>
References: <B7943590-9C82-4B5B-B084-89347B9B7D6A@mnot.net> <A7C46E35-DFC2-4E7B-A41A-5074ACEBA31C@mnot.net> <op.wqo4jewmiw9drz@uranium> <18B73FFF-350A-424F-ADF9-4B070F7A98B2@mnot.net> <CABP7RbfL9HLGziepZoYiAgvct71r+D6ObYR-=Kd7MwT3EiB3=g@mail.gmail.com>
In-Reply-To: <CABP7RbfL9HLGziepZoYiAgvct71r+D6ObYR-=Kd7MwT3EiB3=g@mail.gmail.com>
Accept-Language: en-US, fr-FR
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [172.20.8.250]
Content-Type: multipart/alternative; boundary="_000_6C71876BDCCD01488E70A2399529D5E52DED4AADELEcrfcanonfr_"
MIME-Version: 1.0
Received-SPF: none client-ip=194.2.158.67; envelope-from=Herve.Ruellan@crf.canon.fr; helo=inari-msr.crf.canon.fr
X-W3C-Hub-Spam-Status: No, score=-3.5
X-W3C-Hub-Spam-Report: AWL=-3.450, HTML_MESSAGE=0.001, RP_MATCHES_RCVD=-0.001
X-W3C-Scan-Sig: maggie.w3.org 1TvQgQ-0008RJ-IG e9d24ecd58590cce2e7a9d9752582dbd
X-Original-To: ietf-http-wg@w3.org
Subject: RE: FYI: Tools to evaluate header compression algorithms
Archived-At: <http://www.w3.org/mid/6C71876BDCCD01488E70A2399529D5E52DED4A@ADELE.crf.canon.fr>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/15906
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

Hi,



I just sent a patch allowing to do that.



The following command line using twice http1 (the second time with a dummy parameter) will generate an output containing both runs.



$ python compare_compressors.py -c http1 -c http1=dummy ../http_samples/mnot/wikipedia.org.har

408 req messages processed

                   compressed | ratio min   max   std

req       http1        89,284 | 1.00  1.00  1.00  0.00

req http1=dummy        89,284 | 1.00  1.00  1.00  0.00



408 res messages processed

                   compressed | ratio min   max   std

res       http1        85,817 | 1.00  1.00  1.00  0.00

res http1=dummy        85,817 | 1.00  1.00  1.00  0.00

Hervé.

From: James M Snell [mailto:jasnell@gmail.com]
Sent: lundi 14 janvier 2013 15:59
To: Mark Nottingham
Cc: Martin Nilsson; ietf-http-wg@w3.org
Subject: Re: FYI: Tools to evaluate header compression algorithms


What would be helpful is the ability to define multiple compression runs per compressor subdirectory... But the current design works fine too. Pretty straightforward really.
On Jan 14, 2013 3:47 AM, "Mark Nottingham" <mnot@mnot.net<mailto:mnot@mnot.net>> wrote:
Perhaps, but they're not really easy to disentangle; if people are interested in the different combinations, they can easily factor the compressor code to cover the space (as we're already starting to see with James' work).

Cheers,

(of course, if you want to tackle this, a pull request would be welcome)


On 10/01/2013, at 11:48 PM, Martin Nilsson <nilsson@opera.com<mailto:nilsson@opera.com>> wrote:

> On Sun, 06 Jan 2013 06:57:01 +0100, Mark Nottingham <mnot@mnot.net<mailto:mnot@mnot.net>> wrote:
>
>> Quick follow-up:
>>
>> I posted more about this here:
>>  http://www.mnot.net/blog/2013/01/04/http2_header_compression
>>
>> In particular, we have graphs for all of the HAR samples I took earlier:
>>  http://http2.github.com/http_samples/mnot/
>>
>
> One minor issue is that you are comparing both encoding and compression at the same time. I.e. you could have a (http, spdy) x (uncompressed, delta, delta-huffman, gzip) result matrix.
>
> /Martin Nilsson
>
> --
> Using Opera's revolutionary email client: http://www.opera.com/mail/
>

--
Mark Nottingham   http://www.mnot.net/

v2.23.0 | Report a Bug | By Email