IETF Logo Mail Archive

Re: [codec] Testing: A Novel Proposal

Monty Montgomery <xiphmont@gmail.com> Wed, 20 April 2011 10:37 UTC

Return-Path: <xiphmont@gmail.com>
X-Original-To: codec@ietfc.amsl.com
Delivered-To: codec@ietfc.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfc.amsl.com (Postfix) with ESMTP id EDECCE06CF for <codec@ietfc.amsl.com>; Wed, 20 Apr 2011 03:37:06 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.599
X-Spam-Level:
X-Spam-Status: No, score=-3.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_LOW=-1]
Received: from mail.ietf.org ([208.66.40.236]) by localhost (ietfc.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xng4IDKWiZov for <codec@ietfc.amsl.com>; Wed, 20 Apr 2011 03:37:06 -0700 (PDT)
Received: from mail-ww0-f42.google.com (mail-ww0-f42.google.com [74.125.82.42]) by ietfc.amsl.com (Postfix) with ESMTP id 39033E0689 for <codec@ietf.org>; Wed, 20 Apr 2011 03:37:06 -0700 (PDT)
Received: by wwk4 with SMTP id 4so3911065wwk.1 for <codec@ietf.org>; Wed, 20 Apr 2011 03:37:05 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=pIjsRg5yIVMaCBQmTRD1uKLmyWZ+pgGtWmiqSiZEJfk=; b=O9lwGvPCKm7667pd+X00FtRC2iLbJblytzUSaE5AfeZ5HHvz21xsFJ1r4vPxdG0gK9 VTQw77ZsJVSwdr05UKP+G3kolDU4AD2a1oHc2coiCOn9vYkcbXmty6LqBjItvvHuSkpv wyx5ZR1jlfS8Npm7JnN0BhPh/4VTsmMd6hmEw=
DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=uXUk1QH+6ZnhNtzcqYbfXJ9ozBKLd7vJ0gtbg5fIJaInWFd5G8KKA3Kzaz2akiaOV0 sTR6YgJhq7baFYP9OaX0julppfNTJNAMts5jytW8ktU6KBRRPh7wknGl9WDgcXLPpaeA JcEJLVVxdJrM+AXMCvf7/ozbBb3+RumuPtCfY=
MIME-Version: 1.0
Received: by 10.227.39.92 with SMTP id f28mr7403759wbe.153.1303295825401; Wed, 20 Apr 2011 03:37:05 -0700 (PDT)
Received: by 10.227.144.69 with HTTP; Wed, 20 Apr 2011 03:37:05 -0700 (PDT)
In-Reply-To: <BANLkTin7Mk=7UuOzUzKGg3m5wjtbKnd=Ag@mail.gmail.com>
References: <BANLkTindFywD--4RP8GdKjEMzyQxHx2zLA@mail.gmail.com> <F5AD4C2E5FBF304ABAE7394E9979AF7C26BC916C@LHREML503-MBX.china.huawei.com> <20110419124432.GG31013@audi.shelbyville.oz> <BANLkTin7Mk=7UuOzUzKGg3m5wjtbKnd=Ag@mail.gmail.com>
Date: Wed, 20 Apr 2011 06:37:05 -0400
Message-ID: <BANLkTimH9k3Yiqw5mNTuQmUtiyWuS=vcBA@mail.gmail.com>
From: Monty Montgomery <xiphmont@gmail.com>
To: Stephen Botzko <stephen.botzko@gmail.com>
Content-Type: text/plain; charset="ISO-8859-1"
Cc: codec@ietf.org
Subject: Re: [codec] Testing: A Novel Proposal
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 20 Apr 2011 10:37:07 -0000

On Tue, Apr 19, 2011 at 9:51 AM, Stephen Botzko
<stephen.botzko@gmail.com> wrote:
> I don't think this testing process is intended to be adversarial, it
> certainly is not for me.

Also, I what I was proposing with a Devil's Advocate was not so much
authentically adversarial, but more akin to a 'war game'.  Or a
white-hat hacking contest.

> Also, I think the main goal is to benchmark the final codec's performance,
> not so much to drive improvements.

I concur, and I hope some substantial confusion has cleared on that issue.

Monty

v2.23.0 | Report a Bug | By Email