Re: [codec] draft test and processing plan for the IETF Codec

Stephen Botzko <stephen.botzko@gmail.com> Mon, 18 April 2011 13:03 UTC

Return-Path: <stephen.botzko@gmail.com>
X-Original-To: codec@ietfc.amsl.com
Delivered-To: codec@ietfc.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfc.amsl.com (Postfix) with ESMTP id F3195E06C0 for <codec@ietfc.amsl.com>; Mon, 18 Apr 2011 06:03:15 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.269
X-Spam-Level:
X-Spam-Status: No, score=-3.269 tagged_above=-999 required=5 tests=[AWL=0.329, BAYES_00=-2.599, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-1]
Received: from mail.ietf.org ([208.66.40.236]) by localhost (ietfc.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ASmDs2v9T3bW for <codec@ietfc.amsl.com>; Mon, 18 Apr 2011 06:03:11 -0700 (PDT)
Received: from mail-vw0-f44.google.com (mail-vw0-f44.google.com [209.85.212.44]) by ietfc.amsl.com (Postfix) with ESMTP id BB02BE0693 for <codec@ietf.org>; Mon, 18 Apr 2011 06:03:11 -0700 (PDT)
Received: by vws12 with SMTP id 12so4379553vws.31 for <codec@ietf.org>; Mon, 18 Apr 2011 06:03:11 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=XobzFV+3APtypfpjf2zNnSJzbTByy2P33TDvdUKjHzc=; b=KOS7DbOa5Nj8JHkNtrV1iZX23NucyQghYeE9/iisIlHimcjKQNUZ465C4mWnlB/vQl 8B/SJSLgRDazI/4PHCVvxt833g2UYLDi3Xefxr0UNVi4OD8ZGHxJJg2ILtwObbIoUXIp /5nJCBcXNgRMqvDJ5A7CBSw0P2kUpNrXgWdgs=
DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=n1cB7O7jJQMQ80JQ33oBuI09XGEpymvxvwFBB7luPVDHSvdoKvlRB3Op/XOiunECO2 zPZhZ7+eb1910jjARU3PBWZTXsB15MlnNOqICaMNIq5DdvbMCLYaIGqzDsmMJv9lkR2r fQ/IcBwyKz2kYLAI9OHZRMorISgIPBc+h+3qk=
MIME-Version: 1.0
Received: by 10.52.88.238 with SMTP id bj14mr7258883vdb.165.1303131791257; Mon, 18 Apr 2011 06:03:11 -0700 (PDT)
Received: by 10.52.168.6 with HTTP; Mon, 18 Apr 2011 06:03:11 -0700 (PDT)
In-Reply-To: <20110418115246.GD31013@audi.shelbyville.oz>
References: <BLU0-SMTP54958DAFDD9DBFA2A5AD09D0910@phx.gbl> <613619677.239145.1303111675660.JavaMail.root@lu2-zimbra> <BANLkTimvcY3Dp3xKm73-ZZAPz5nmxOexmg@mail.gmail.com> <20110418115246.GD31013@audi.shelbyville.oz>
Date: Mon, 18 Apr 2011 09:03:11 -0400
Message-ID: <BANLkTi=XpamA+oJ0hpdM9jaT3f8qgA2PUA@mail.gmail.com>
From: Stephen Botzko <stephen.botzko@gmail.com>
To: Ron <ron@debian.org>
Content-Type: multipart/alternative; boundary="bcaec501631f8371a904a131030a"
Cc: codec@ietf.org
Subject: Re: [codec] draft test and processing plan for the IETF Codec
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 18 Apr 2011 13:03:16 -0000

in-line

On Mon, Apr 18, 2011 at 7:52 AM, Ron <ron@debian.org> wrote:

> On Mon, Apr 18, 2011 at 07:18:05AM -0400, Stephen Botzko wrote:
> > in-line
> > Stephen Botzko
> >
> > On Mon, Apr 18, 2011 at 3:27 AM, Koen Vos <koen.vos@skype.net> wrote:
> >
> > > Hi Paul,
> > >
> > > > I think where this discussion is going is that we need to be more
> > > > precise in defining what we mean by "NB", "WB", "SWB" and "FB" if
> > > > we want to make meaningful comparisons between codecs.
> > >
> > > The discussion so far was about whether to pre-distort test signals by
> > > bandpass filtering.
> > >
> >
> > I think this might depend on what you want to learn from the test.
> >
> > If you simply want to know which "sounds better" to the user, then
> perhaps
> > bandpass filtering gets in the way.
> >
> > If you want to see if there are there is an underlying difference in
> > intelligibility or user tolerance for the coding artifacts,, then the
> > bandpass filtering might be useful, since it controls for the known
> > preference that users have for wider frequency response.
>
> I think we can safely put the latter into the "category 3. tests", of
> things that would be quite interesting to know if someone has time to
> collect the data, but that aren't at all required knowledge to publish
> a proposed standard of what we have.
>

Generally speaking, I think it is more productive to separate the test plan
development itself from the publication and test schedule.

>From my point of view, checking for underlying differences in
intelligibility and perception of coding artifacts is more valuable than the
simple "sounds better" test.  We already know that more bandwidth sounds
better if everything is equal, and sometimes it sounds better in short
samples even if everything is not equal.


>
> Cheers,
> Ron
>
>
> _______________________________________________
> codec mailing list
> codec@ietf.org
> https://www.ietf.org/mailman/listinfo/codec
>