Re: [codec] comparitive quality testing

Roman Shpount <roman@telurix.com> Fri, 15 April 2011 18:13 UTC

Return-Path: <roman@telurix.com>
X-Original-To: codec@ietfc.amsl.com
Delivered-To: codec@ietfc.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfc.amsl.com (Postfix) with ESMTP id 8CE63E0772 for <codec@ietfc.amsl.com>; Fri, 15 Apr 2011 11:13:57 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.976
X-Spam-Level:
X-Spam-Status: No, score=-2.976 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, FM_FORGED_GMAIL=0.622, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-1]
Received: from mail.ietf.org ([208.66.40.236]) by localhost (ietfc.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id MIMGF5dBKMYl for <codec@ietfc.amsl.com>; Fri, 15 Apr 2011 11:13:53 -0700 (PDT)
Received: from mail-ey0-f172.google.com (mail-ey0-f172.google.com [209.85.215.172]) by ietfc.amsl.com (Postfix) with ESMTP id 57258E06B0 for <codec@ietf.org>; Fri, 15 Apr 2011 11:13:53 -0700 (PDT)
Received: by eye13 with SMTP id 13so1056280eye.31 for <codec@ietf.org>; Fri, 15 Apr 2011 11:13:52 -0700 (PDT)
Received: by 10.213.15.202 with SMTP id l10mr2704921eba.119.1302891232288; Fri, 15 Apr 2011 11:13:52 -0700 (PDT)
Received: from mail-ew0-f44.google.com (mail-ew0-f44.google.com [209.85.215.44]) by mx.google.com with ESMTPS id k51sm2107449eei.10.2011.04.15.11.13.51 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 15 Apr 2011 11:13:51 -0700 (PDT)
Received: by ewy19 with SMTP id 19so1053579ewy.31 for <codec@ietf.org>; Fri, 15 Apr 2011 11:13:51 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.213.104.133 with SMTP id p5mr3008481ebo.109.1302891231084; Fri, 15 Apr 2011 11:13:51 -0700 (PDT)
Received: by 10.213.4.14 with HTTP; Fri, 15 Apr 2011 11:13:51 -0700 (PDT)
In-Reply-To: <4DA87CF1.1090306@coppice.org>
References: <BCB3F026FAC4C145A4A3330806FEFDA93BA8B64643@EMBX01-HQ.jnpr.net> <BANLkTimE6EzGY76Lm+-wtWtRTQgOjqhAEw@mail.gmail.com> <017901cbfb7b$fa079060$ee16b120$%virette@huawei.com> <BANLkTikC1LuwvLLuuDKPdRdam4_tJxsLCw@mail.gmail.com> <4DA87CF1.1090306@coppice.org>
Date: Fri, 15 Apr 2011 14:13:51 -0400
Message-ID: <BANLkTi=t_2bM1-PYwGy9th-ELS8MO66soQ@mail.gmail.com>
From: Roman Shpount <roman@telurix.com>
To: Steve Underwood <steveu@coppice.org>
Content-Type: multipart/alternative; boundary="00151748dd7c0280a904a0f901ce"
Cc: codec@ietf.org
Subject: Re: [codec] comparitive quality testing
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 15 Apr 2011 18:13:57 -0000

Steve,

I was actually not 100% certain which flavor of G.729 should be selected. I
had exactly the same reasoning as you that G.729 is better quality, but
G.729A is more commonly used. Since my primary goal is to compare with
something that most people find acceptable quality for a voice call, testing
against G.729A is probably more appropriate.
_____________
Roman Shpount


On Fri, Apr 15, 2011 at 1:14 PM, Steve Underwood <steveu@coppice.org> wrote:

> Hi Roman,
>
>
> On 04/16/2011 01:01 AM, Roman Shpount wrote:
>
>> David,
>>
>> We should compare with standard G.729 (not A or B) at 8 kbit/s, 0 and 5%
>> packet loss, clean speech and speech mixed with at least one noise sample.
>> We can use ITU-T audio library for both speech and noise samples.
>> _____________
>> Roman Shpount
>>
> I fully agree that G.729 should be tested without the B annex, but I think
> your other choice is questionable. G.729 may sound distinctly better than
> G.729A, but G.729A is the dominant codec in the real world. Basic G.729 is
> actually quite rare. Are you trying to test against what people are familiar
> with, or what a pretty good current generation 8kbps codec can achieve?
>
> Steve
>
> _______________________________________________
> codec mailing list
> codec@ietf.org
> https://www.ietf.org/mailman/listinfo/codec
>