HTTP header compression benchmark

Christian Grothoff <christian@grothoff.org> Sat, 20 July 2013 17:57 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 36C4811E80E1 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Sat, 20 Jul 2013 10:57:08 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -10.599
X-Spam-Level:
X-Spam-Status: No, score=-10.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id fsryasulLVGh for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Sat, 20 Jul 2013 10:57:02 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id 48B1311E8117 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Sat, 20 Jul 2013 10:57:01 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1V0bMx-0003tm-4B for ietf-http-wg-dist@listhub.w3.org; Sat, 20 Jul 2013 17:54:59 +0000
Resent-Date: Sat, 20 Jul 2013 17:54:59 +0000
Resent-Message-Id: <E1V0bMx-0003tm-4B@frink.w3.org>
Received: from lisa.w3.org ([128.30.52.41]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <christian@grothoff.org>) id 1V0bMm-0003t3-Cf for ietf-http-wg@listhub.w3.org; Sat, 20 Jul 2013 17:54:48 +0000
Received: from mailsender1.informatik.tu-muenchen.de ([131.159.0.97] helo=mail-out1.informatik.tu-muenchen.de) by lisa.w3.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.72) (envelope-from <christian@grothoff.org>) id 1V0bMl-0008VH-PU for ietf-http-wg@w3.org; Sat, 20 Jul 2013 17:54:48 +0000
Received: from [192.168.178.20] (pd95c0f92.dip0.t-ipconnect.de [217.92.15.146]) by mail.net.in.tum.de (Postfix) with ESMTPSA id 4ECDD19A49FB for <ietf-http-wg@w3.org>; Sat, 20 Jul 2013 19:54:24 +0200 (CEST)
Message-ID: <51EACECE.9000508@grothoff.org>
Date: Sat, 20 Jul 2013 19:54:22 +0200
From: Christian Grothoff <christian@grothoff.org>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130704 Icedove/17.0.7
MIME-Version: 1.0
To: ietf-http-wg@w3.org
X-Enigmail-Version: 1.5.1
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: 7bit
Received-SPF: none client-ip=131.159.0.97; envelope-from=christian@grothoff.org; helo=mail-out1.informatik.tu-muenchen.de
X-W3C-Hub-Spam-Status: No, score=0.0
X-W3C-Hub-Spam-Report: none
X-W3C-Scan-Sig: lisa.w3.org 1V0bMl-0008VH-PU 806c6a3554e44545ad19c6b649135acd
X-Original-To: ietf-http-wg@w3.org
Subject: HTTP header compression benchmark
Archived-At: <http://www.w3.org/mid/51EACECE.9000508@grothoff.org>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/18857
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

Dear all,

I've recently published a benchmark for HTTP header compression based on captured
real-world HTTP traffic data.  The benchmark contains five sets of approximately
one million HTTP request and response headers.  Details on how the data was
collected, preprocessed, C code (generation, preprocessing and sample compressions
using gzip and bzip2), as well as some statistical data on the benchmarks are
all available at https://gnunet.org/httpbenchmark/.

It should be noted that these are not just raw HTTP headers, but request sequences.
So the benchmark will allow you to assess the performance of compression algorithms
that compress traffic for an entire SPDY/HTTP 2.0 session (differences, etc.) and
not just process each header in isolation.

I hope this will be useful for informed discussions on HTTP 2.0 header compression;
I'll be available for discussions on the benchmark at IETF 87.

Happy hacking!

Christian