Re: [codec] draft test and processing plan for the IETF Codec

Anisse Taleb <anisse.taleb@huawei.com> Tue, 19 April 2011 00:16 UTC

Return-Path: <anisse.taleb@huawei.com>
X-Original-To: codec@ietfc.amsl.com
Delivered-To: codec@ietfc.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfc.amsl.com (Postfix) with ESMTP id 71B2FE073F for <codec@ietfc.amsl.com>; Mon, 18 Apr 2011 17:16:53 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.364
X-Spam-Level:
X-Spam-Status: No, score=-6.364 tagged_above=-999 required=5 tests=[AWL=0.235, BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([208.66.40.236]) by localhost (ietfc.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ng7owfyCHtld for <codec@ietfc.amsl.com>; Mon, 18 Apr 2011 17:16:52 -0700 (PDT)
Received: from lhrga04-in.huawei.com (lhrga04-in.huawei.com [195.33.106.149]) by ietfc.amsl.com (Postfix) with ESMTP id A78B7E0692 for <codec@ietf.org>; Mon, 18 Apr 2011 17:16:52 -0700 (PDT)
Received: from huawei.com (localhost [127.0.0.1]) by lhrga04-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTP id <0LJV009J2I43P0@lhrga04-in.huawei.com> for codec@ietf.org; Tue, 19 Apr 2011 01:16:51 +0100 (BST)
Received: from LHREML202-EDG.china.huawei.com ([172.18.7.118]) by lhrga04-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTPS id <0LJV00MJJI43WY@lhrga04-in.huawei.com> for codec@ietf.org; Tue, 19 Apr 2011 01:16:51 +0100 (BST)
Received: from LHREML402-HUB.china.huawei.com (10.201.5.31) by LHREML202-EDG.china.huawei.com (172.18.7.189) with Microsoft SMTP Server (TLS) id 14.1.270.1; Tue, 19 Apr 2011 01:16:47 +0100
Received: from LHREML503-MBX.china.huawei.com ([fe80::f93f:958b:5b06:4f36]) by LHREML402-HUB.china.huawei.com ([::1]) with mapi id 14.01.0270.001; Tue, 19 Apr 2011 01:16:50 +0100
Date: Tue, 19 Apr 2011 00:16:49 +0000
From: Anisse Taleb <anisse.taleb@huawei.com>
In-reply-to: <1954673134.214770.1302930235411.JavaMail.root@lu2-zimbra>
X-Originating-IP: [10.200.217.213]
To: Koen Vos <koen.vos@skype.net>
Message-id: <F5AD4C2E5FBF304ABAE7394E9979AF7C26BC8C09@LHREML503-MBX.china.huawei.com>
MIME-version: 1.0
Content-type: text/plain; charset="utf-8"
Content-language: en-US
Content-transfer-encoding: 7bit
Accept-Language: en-GB, en-US
Thread-topic: [codec] draft test and processing plan for the IETF Codec
Thread-index: AQHL/icTAKZvBcYFz06cfdOUnPQHJA==
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
References: <F5AD4C2E5FBF304ABAE7394E9979AF7C26BC684E@LHREML503-MBX.china.huawei.com> <1954673134.214770.1302930235411.JavaMail.root@lu2-zimbra>
Cc: "codec@ietf.org" <codec@ietf.org>
Subject: Re: [codec] draft test and processing plan for the IETF Codec
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 19 Apr 2011 00:16:53 -0000

Dear Koen,

Let's mimic the real world as closely as possible :-).

Besides the DAC and AA filters, you cannot expect that every loudspeaker, headset, earplug, microphone out there to have a flat frequency response regardless of if it is a VoIP application or something else. Specifying a frequency mask helps in reducing some of the variability and uncertainty due to these and other external factors.
 
That aside, I am not against revisiting these in getting something that all agree on. 

Kind regards,
/Anisse
> -----Original Message-----
> From: Koen Vos [mailto:koen.vos@skype.net]
> Sent: Saturday, April 16, 2011 7:04 AM
> To: Anisse Taleb
> Cc: codec@ietf.org
> Subject: Re: [codec] draft test and processing plan for the IETF Codec
> 
> Hi Anisse,
> 
> I noticed your plan tests with band-limited signals: Narrowband signals are
> filtered from 300-4000 Hz, Wideband from 50-7000 Hz, Superwideband from
> 50-14000 Hz.
> 
> However, VoIP applications have no such band-pass filters (which degrade
> quality and add complexity).  So results will be more informative to the WG
> and potential adopters of the codec if the testing avoids band-pass
> filtering as well.  We want test conditions to mimic the real world as
> closely as possible.
> 
> Instead of band-pass filtering, tests on speech could use a simple high-
> pass
> filter with a cutoff around 50 Hz, as many VoIP applications do indeed have
> such a filter.
> 
> best,
> koen.
> 
> 
> ----- Original Message -----
> From: "Anisse Taleb" <anisse.taleb@huawei.com>
> To: codec@ietf.org
> Sent: Wednesday, April 13, 2011 12:32:00 AM
> Subject: [codec] draft test and processing plan for the IETF Codec
> 
> Hi,
> Please find attached a first draft of a test plan of the IETF codec (Opus).
> The proposal does not claim to be complete, there are still many missing
> things, e.g. tandeming cases, tests with delay jitter, dtx etc. Consider it
> as a starting point for discussion where everyone is welcome to contribute
> in a constructive manner. Further updates are planned, but let's see first
> some initial comments.
> 
> The attachment is a pdf version, please let me know if you would like to
> see another format and I would be glad to oblige.
> 
> Comments and additions are welcome!
> 
> Kind regards,
> /Anisse
> (From La Jolla - San Diego).
> 
> _______________________________________________
> codec mailing list
> codec@ietf.org
> https://www.ietf.org/mailman/listinfo/codec