Re: [codec] comparitive quality testing

Steve Underwood <steveu@coppice.org> Fri, 15 April 2011 17:14 UTC

Return-Path: <steveu@coppice.org>
X-Original-To: codec@ietfc.amsl.com
Delivered-To: codec@ietfc.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfc.amsl.com (Postfix) with ESMTP id ECBF213008C for <codec@ietfc.amsl.com>; Fri, 15 Apr 2011 10:14:28 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.059
X-Spam-Level:
X-Spam-Status: No, score=-3.059 tagged_above=-999 required=5 tests=[AWL=0.540, BAYES_00=-2.599, RCVD_IN_DNSWL_LOW=-1]
Received: from mail.ietf.org ([208.66.40.236]) by localhost (ietfc.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2W4WqAnqifIb for <codec@ietfc.amsl.com>; Fri, 15 Apr 2011 10:14:28 -0700 (PDT)
Received: from cwb.pacific.net.hk (cwb.pacific.net.hk [202.14.67.92]) by ietfc.amsl.com (Postfix) with ESMTP id EF8CD13008B for <codec@ietf.org>; Fri, 15 Apr 2011 10:14:27 -0700 (PDT)
Received: from i7.coppice.org (62.166.232.220.dyn.pacific.net.hk [220.232.166.62]) by cwb.pacific.net.hk with ESMTP id p3FHEPhC021379 for <codec@ietf.org>; Sat, 16 Apr 2011 01:14:25 +0800
Message-ID: <4DA87CF1.1090306@coppice.org>
Date: Sat, 16 Apr 2011 01:14:25 +0800
From: Steve Underwood <steveu@coppice.org>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.15) Gecko/20110307 Fedora/3.1.9-0.38.b3pre.fc13 Lightning/1.0b3pre Thunderbird/3.1.9
MIME-Version: 1.0
To: codec@ietf.org
References: <BCB3F026FAC4C145A4A3330806FEFDA93BA8B64643@EMBX01-HQ.jnpr.net> <BANLkTimE6EzGY76Lm+-wtWtRTQgOjqhAEw@mail.gmail.com> <017901cbfb7b$fa079060$ee16b120$%virette@huawei.com> <BANLkTikC1LuwvLLuuDKPdRdam4_tJxsLCw@mail.gmail.com>
In-Reply-To: <BANLkTikC1LuwvLLuuDKPdRdam4_tJxsLCw@mail.gmail.com>
Content-Type: text/plain; charset="windows-1252"; format="flowed"
Content-Transfer-Encoding: 7bit
Subject: Re: [codec] comparitive quality testing
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 15 Apr 2011 17:14:29 -0000

Hi Roman,

On 04/16/2011 01:01 AM, Roman Shpount wrote:
> David,
>
> We should compare with standard G.729 (not A or B) at 8 kbit/s, 0 and 
> 5% packet loss, clean speech and speech mixed with at least one noise 
> sample. We can use ITU-T audio library for both speech and noise samples.
> _____________
> Roman Shpount
I fully agree that G.729 should be tested without the B annex, but I 
think your other choice is questionable. G.729 may sound distinctly 
better than G.729A, but G.729A is the dominant codec in the real world. 
Basic G.729 is actually quite rare. Are you trying to test against what 
people are familiar with, or what a pretty good current generation 8kbps 
codec can achieve?

Steve