Re: [codec] draft test and processing plan for the IETF Codec

David Virette <david.virette@huawei.com> Mon, 18 April 2011 20:41 UTC

Return-Path: <david.virette@huawei.com>
X-Original-To: codec@ietfc.amsl.com
Delivered-To: codec@ietfc.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfc.amsl.com (Postfix) with ESMTP id 85CB2E0724 for <codec@ietfc.amsl.com>; Mon, 18 Apr 2011 13:41:47 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.599
X-Spam-Level:
X-Spam-Status: No, score=-6.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([208.66.40.236]) by localhost (ietfc.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id pJx7InJtT6un for <codec@ietfc.amsl.com>; Mon, 18 Apr 2011 13:41:46 -0700 (PDT)
Received: from usaga03-in.huawei.com (usaga03-in.huawei.com [206.16.17.220]) by ietfc.amsl.com (Postfix) with ESMTP id C8A3CE070B for <codec@ietf.org>; Mon, 18 Apr 2011 13:41:46 -0700 (PDT)
Received: from huawei.com (usaga03-in [172.18.4.17]) by usaga03-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTP id <0LJV00K6K85MFR@usaga03-in.huawei.com> for codec@ietf.org; Mon, 18 Apr 2011 15:41:46 -0500 (CDT)
Received: from d009000303 (dslb-178-002-018-084.pools.arcor-ip.net [178.2.18.84]) by usaga03-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTPA id <0LJV00LY585K4K@usaga03-in.huawei.com> for codec@ietf.org; Mon, 18 Apr 2011 15:41:46 -0500 (CDT)
Date: Mon, 18 Apr 2011 22:41:44 +0200
From: David Virette <david.virette@huawei.com>
In-reply-to: <1954673134.214770.1302930235411.JavaMail.root@lu2-zimbra>
To: 'Koen Vos' <koen.vos@skype.net>, 'Anisse Taleb' <anisse.taleb@huawei.com>
Message-id: <036301cbfe09$089515a0$19bf40e0$%virette@huawei.com>
MIME-version: 1.0
X-Mailer: Microsoft Office Outlook 12.0
Content-type: text/plain; charset="us-ascii"
Content-language: fr
Content-transfer-encoding: 7bit
Thread-index: Acv787yZCu1L4BeHSLCWg8bQgRFUKwCEvqvg
References: <F5AD4C2E5FBF304ABAE7394E9979AF7C26BC684E@LHREML503-MBX.china.huawei.com> <1954673134.214770.1302930235411.JavaMail.root@lu2-zimbra>
Cc: codec@ietf.org
Subject: Re: [codec] draft test and processing plan for the IETF Codec
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 18 Apr 2011 20:41:47 -0000

Hi Koen,
I agree that for narrowband, in VoIP applications the 300-3400 Hz IRS filter
is not used and I think the 300-4000 was a typo in the test plan, this
should have been 50-4000Hz. This will be corrected in the next version. For
the super-wideband, if I understood correctly, the input signal from OPUS
will be sampled at 24 kHz. And I don't see the point to test it against the
super-wideband as defined in ITU-T. This comparison is part of the
requirement. 
At the same time, as pointed out by Jean-Marc, for some bitrates it is
better to use a full band mode rather than super-wideband. In that case, if
no full band reference codec can operate at the same bitrate, I think that
the final comparison will be done against a super-wideband reference codec
operating at the same bitrate. As all the super-wideband and full band codec
will be tested in the same experiments, all these comparisons will be
possible. 
Best regards,
David


-----Original Message-----
From: codec-bounces@ietf.org [mailto:codec-bounces@ietf.org] On Behalf Of
Koen Vos
Sent: samedi 16 avril 2011 07:04
To: Anisse Taleb
Cc: codec@ietf.org
Subject: Re: [codec] draft test and processing plan for the IETF Codec

Hi Anisse,

I noticed your plan tests with band-limited signals: Narrowband signals are 
filtered from 300-4000 Hz, Wideband from 50-7000 Hz, Superwideband from 
50-14000 Hz.

However, VoIP applications have no such band-pass filters (which degrade 
quality and add complexity).  So results will be more informative to the WG 
and potential adopters of the codec if the testing avoids band-pass 
filtering as well.  We want test conditions to mimic the real world as 
closely as possible. 

Instead of band-pass filtering, tests on speech could use a simple high-pass

filter with a cutoff around 50 Hz, as many VoIP applications do indeed have 
such a filter.  

best,
koen.


----- Original Message -----
From: "Anisse Taleb" <anisse.taleb@huawei.com>
To: codec@ietf.org
Sent: Wednesday, April 13, 2011 12:32:00 AM
Subject: [codec] draft test and processing plan for the IETF Codec

Hi,
Please find attached a first draft of a test plan of the IETF codec (Opus). 
The proposal does not claim to be complete, there are still many missing
things, e.g. tandeming cases, tests with delay jitter, dtx etc. Consider it
as a starting point for discussion where everyone is welcome to contribute
in a constructive manner. Further updates are planned, but let's see first
some initial comments.

The attachment is a pdf version, please let me know if you would like to see
another format and I would be glad to oblige.

Comments and additions are welcome!

Kind regards,
/Anisse
(From La Jolla - San Diego).

_______________________________________________
codec mailing list
codec@ietf.org
https://www.ietf.org/mailman/listinfo/codec
_______________________________________________
codec mailing list
codec@ietf.org
https://www.ietf.org/mailman/listinfo/codec