FYI: Tools to evaluate header compression algorithms

Mark Nottingham <mnot@mnot.net> Mon, 31 December 2012 02:25 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1206821F8BCC for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Sun, 30 Dec 2012 18:25:44 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.739
X-Spam-Level:
X-Spam-Status: No, score=-7.739 tagged_above=-999 required=5 tests=[AWL=2.860, BAYES_00=-2.599, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id V1lhXp0V4Ngl for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Sun, 30 Dec 2012 18:25:43 -0800 (PST)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id 6746D21F8BC2 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Sun, 30 Dec 2012 18:25:43 -0800 (PST)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1TpV1x-0008NW-LJ for ietf-http-wg-dist@listhub.w3.org; Mon, 31 Dec 2012 02:23:09 +0000
Resent-Date: Mon, 31 Dec 2012 02:23:09 +0000
Resent-Message-Id: <E1TpV1x-0008NW-LJ@frink.w3.org>
Received: from maggie.w3.org ([128.30.52.39]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <mnot@mnot.net>) id 1TpV1o-0008Mi-NP for ietf-http-wg@listhub.w3.org; Mon, 31 Dec 2012 02:23:00 +0000
Received: from mxout-08.mxes.net ([216.86.168.183]) by maggie.w3.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.72) (envelope-from <mnot@mnot.net>) id 1TpV1n-0007MB-JC for ietf-http-wg@w3.org; Mon, 31 Dec 2012 02:23:00 +0000
Received: from [192.168.1.80] (unknown [118.209.136.19]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by smtp.mxes.net (Postfix) with ESMTPSA id 048D9509B6 for <ietf-http-wg@w3.org>; Sun, 30 Dec 2012 21:22:36 -0500 (EST)
From: Mark Nottingham <mnot@mnot.net>
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Message-Id: <B7943590-9C82-4B5B-B084-89347B9B7D6A@mnot.net>
Date: Mon, 31 Dec 2012 13:22:33 +1100
To: "ietf-http-wg@w3.org Group" <ietf-http-wg@w3.org>
Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\))
X-Mailer: Apple Mail (2.1499)
Received-SPF: pass client-ip=216.86.168.183; envelope-from=mnot@mnot.net; helo=mxout-08.mxes.net
X-W3C-Hub-Spam-Status: No, score=-4.2
X-W3C-Hub-Spam-Report: AWL=-2.293, BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001
X-W3C-Scan-Sig: maggie.w3.org 1TpV1n-0007MB-JC c2a9a281bc4345c960ff868972a36101
X-Original-To: ietf-http-wg@w3.org
Subject: FYI: Tools to evaluate header compression algorithms
Archived-At: <http://www.w3.org/mid/B7943590-9C82-4B5B-B084-89347B9B7D6A@mnot.net>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/15790
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

As part of his implementation, Roberto created a test harness for comparing headers. With his help, I've forked that and refactored a bit --
  https://github.com/http2/compression-test
Note that there's the textual output you see in the README, as well as a graph available, e.g.,:
  http://http2.github.com/compression-test/

This makes it possible to take our collection of HAR samples:
  https://github.com/http2/http_samples
and get metrics on how the compression algorithms perform.

This is by no means complete. I'd like to process the HAR files so that the headers fed to the compressor more closely align with those that will be seen in a typical HTTP2 connection, and also get some more interesting metrics out.

As always, pull requests and issues welcome.

Cheers,

--
Mark Nottingham   http://www.mnot.net/