Re: bohe implementation for compression tests

Martin Thomson <martin.thomson@gmail.com> Thu, 17 January 2013 01:22 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E1C2D11E80A6 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 16 Jan 2013 17:22:09 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -8.883
X-Spam-Level:
X-Spam-Status: No, score=-8.883 tagged_above=-999 required=5 tests=[AWL=1.716, BAYES_00=-2.599, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zKr2yKVUr1fK for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 16 Jan 2013 17:22:08 -0800 (PST)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id 7FC9111E809A for <httpbisa-archive-bis2Juki@lists.ietf.org>; Wed, 16 Jan 2013 17:22:07 -0800 (PST)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1TveAr-0005Tz-Eu for ietf-http-wg-dist@listhub.w3.org; Thu, 17 Jan 2013 01:21:45 +0000
Resent-Date: Thu, 17 Jan 2013 01:21:45 +0000
Resent-Message-Id: <E1TveAr-0005Tz-Eu@frink.w3.org>
Received: from lisa.w3.org ([128.30.52.41]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <martin.thomson@gmail.com>) id 1TveAn-0005RF-Ub for ietf-http-wg@listhub.w3.org; Thu, 17 Jan 2013 01:21:41 +0000
Received: from mail-wg0-f46.google.com ([74.125.82.46]) by lisa.w3.org with esmtps (TLS1.0:RSA_ARCFOUR_SHA1:16) (Exim 4.72) (envelope-from <martin.thomson@gmail.com>) id 1TveAn-0006lj-AH for ietf-http-wg@w3.org; Thu, 17 Jan 2013 01:21:41 +0000
Received: by mail-wg0-f46.google.com with SMTP id dr13so1262912wgb.13 for <ietf-http-wg@w3.org>; Wed, 16 Jan 2013 17:21:15 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=0ozcYqHUjUQvZ8JHwXvIo6t/gjRbg/Tw2DxdGIq57V8=; b=fW1AQJZFBOiUcUDW1u5WH1wwtx9QF4QEFWKE4skV879fJKDGI7sw4vWY1JYfkrksKK 8bh2jJuQsk+pCoDLynzDDPqiTLS69Rj2Go4AsahRAgHl1t0prv47ScW9NfxI6Zfodsnk Ie+iAkynK+dMvkkTRpG/zY3yOqIDXdnIFoPjhFDrDShzqBpjzSi0+7jfYcbRthG8lamP J3w+HWYu5kjMUh6OGXII07gtfjWpzhD126NkNywb+jc4TL0s1r2IvwA3icug5Dy17gjA smR0JF+O14pf3vIyV+f7vFsToH1RBI/imXI+FXn/Uv8H56CdtFwuPvZekI7ybC9jlFuD b+Lg==
MIME-Version: 1.0
X-Received: by 10.194.88.98 with SMTP id bf2mr5390888wjb.49.1358385675145; Wed, 16 Jan 2013 17:21:15 -0800 (PST)
Received: by 10.180.164.174 with HTTP; Wed, 16 Jan 2013 17:21:15 -0800 (PST)
In-Reply-To: <B8C9ED58-31E8-4DF0-9AE0-34E07B95F0A8@mnot.net>
References: <CABP7Rbe-B89vVm8=OnHtAG0Y3G2UOysX+DKaTQ3+rAKBJBJyKA@mail.gmail.com> <CABP7RbdSurNdLxvVV1F-9Bx4LwdhrX2btEvfA+RV=rVZ0moXNA@mail.gmail.com> <CABkgnnVdXwo5eiBMNMjONG88r8EvErxQ9_yrgdh5NFH=KQhfZQ@mail.gmail.com> <B8C9ED58-31E8-4DF0-9AE0-34E07B95F0A8@mnot.net>
Date: Wed, 16 Jan 2013 17:21:15 -0800
Message-ID: <CABkgnnUrs19_73Xc=E+TAhnP6AEdmuKQ5-XmDez+mJg-MONZfA@mail.gmail.com>
From: Martin Thomson <martin.thomson@gmail.com>
To: Mark Nottingham <mnot@mnot.net>
Cc: James M Snell <jasnell@gmail.com>, "ietf-http-wg@w3.org" <ietf-http-wg@w3.org>
Content-Type: text/plain; charset="UTF-8"
Received-SPF: pass client-ip=74.125.82.46; envelope-from=martin.thomson@gmail.com; helo=mail-wg0-f46.google.com
X-W3C-Hub-Spam-Status: No, score=-4.1
X-W3C-Hub-Spam-Report: AWL=-1.396, BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001
X-W3C-Scan-Sig: lisa.w3.org 1TveAn-0006lj-AH a34559848fd0380d79ccb0f4618afd46
X-Original-To: ietf-http-wg@w3.org
Subject: Re: bohe implementation for compression tests
Archived-At: <http://www.w3.org/mid/CABkgnnUrs19_73Xc=E+TAhnP6AEdmuKQ5-XmDez+mJg-MONZfA@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/15944
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

On 16 January 2013 17:11, Mark Nottingham <mnot@mnot.net> wrote:
> Getting there, although you may need a small truck to haul the grain of salt that will accompany it...

Even if it just means running the sample set n times using 'time', it
would be nice to get ballpark figures.  Even if the errors are
enormous.  For instance, a python implementation of delta is probably
not that good to compare to an optimized gzip implementation, but it
might still let us know that deltav3 is better than deltav2.