Re: [codec] comparitive quality testing
Anisse Taleb <anisse.taleb@huawei.com> Mon, 18 April 2011 23:40 UTC
Return-Path: <anisse.taleb@huawei.com>
X-Original-To: codec@ietfc.amsl.com
Delivered-To: codec@ietfc.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfc.amsl.com (Postfix) with ESMTP id 3C77EE06E5 for <codec@ietfc.amsl.com>; Mon, 18 Apr 2011 16:40:38 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.313
X-Spam-Level:
X-Spam-Status: No, score=-6.313 tagged_above=-999 required=5 tests=[AWL=0.286, BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([208.66.40.236]) by localhost (ietfc.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id wbc23qnY1ZyQ for <codec@ietfc.amsl.com>; Mon, 18 Apr 2011 16:40:37 -0700 (PDT)
Received: from lhrga04-in.huawei.com (lhrga04-in.huawei.com [195.33.106.149]) by ietfc.amsl.com (Postfix) with ESMTP id 7B65EE06AB for <codec@ietf.org>; Mon, 18 Apr 2011 16:40:37 -0700 (PDT)
Received: from huawei.com (localhost [127.0.0.1]) by lhrga04-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTP id <0LJV00907GFOP0@lhrga04-in.huawei.com> for codec@ietf.org; Tue, 19 Apr 2011 00:40:36 +0100 (BST)
Received: from LHREML201-EDG.china.huawei.com ([172.18.7.118]) by lhrga04-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTPS id <0LJV00MF3GFOWY@lhrga04-in.huawei.com> for codec@ietf.org; Tue, 19 Apr 2011 00:40:36 +0100 (BST)
Received: from LHREML401-HUB.china.huawei.com (10.201.5.30) by LHREML201-EDG.china.huawei.com (172.18.7.188) with Microsoft SMTP Server (TLS) id 14.1.270.1; Tue, 19 Apr 2011 00:40:31 +0100
Received: from LHREML503-MBX.china.huawei.com ([fe80::f93f:958b:5b06:4f36]) by LHREML401-HUB.china.huawei.com ([::1]) with mapi id 14.01.0270.001; Tue, 19 Apr 2011 00:40:35 +0100
Date: Mon, 18 Apr 2011 23:40:34 +0000
From: Anisse Taleb <anisse.taleb@huawei.com>
In-reply-to: <BCB3F026FAC4C145A4A3330806FEFDA93BA8B64643@EMBX01-HQ.jnpr.net>
X-Originating-IP: [10.200.217.213]
To: Gregory Maxwell <gmaxwell@juniper.net>, Roni Even <ron.even.tlv@gmail.com>, "codec@ietf.org" <codec@ietf.org>
Message-id: <F5AD4C2E5FBF304ABAE7394E9979AF7C26BC8BB1@LHREML503-MBX.china.huawei.com>
MIME-version: 1.0
Content-type: text/plain; charset="us-ascii"
Content-language: en-US
Content-transfer-encoding: 7bit
Accept-Language: en-GB, en-US
Thread-topic: comparitive quality testing
Thread-index: AQHL+q7ZhtE2QkE93ES+tYUuWp4R5JRkTj1A
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-cr-hashedpuzzle: BrnU DnLB ECrH J9sw KaRp QafD RVuS SZgQ Weun YARi aykO cFlx cslZ c5a0 eAy3 khY3; 3; YwBvAGQAZQBjAEAAaQBlAHQAZgAuAG8AcgBnADsAZwBtAGEAeAB3AGUAbABsAEAAagB1AG4AaQBwAGUAcgAuAG4AZQB0ADsAcgBvAG4ALgBlAHYAZQBuAC4AdABsAHYAQABnAG0AYQBpAGwALgBjAG8AbQA=; Sosha1_v1; 7; {024DBEF7-B0FF-4D81-8984-FFF6F37A12A7}; YQBuAGkAcwBzAGUALgB0AGEAbABlAGIAQABoAHUAYQB3AGUAaQAuAGMAbwBtAA==; Mon, 18 Apr 2011 23:40:26 GMT; UgBFADoAIABjAG8AbQBwAGEAcgBpAHQAaQB2AGUAIABxAHUAYQBsAGkAdAB5ACAAdABlAHMAdABpAG4AZwA=
x-cr-puzzleid: {024DBEF7-B0FF-4D81-8984-FFF6F37A12A7}
References: <BCB3F026FAC4C145A4A3330806FEFDA93BA8B64643@EMBX01-HQ.jnpr.net>
Subject: Re: [codec] comparitive quality testing
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 18 Apr 2011 23:40:38 -0000
> > The market can figure out the comparative quality question on its own. > What is even more funny, is that now we see more arguments against having a standard at all. Let the market decide ! > -----Original Message----- > From: codec-bounces@ietf.org [mailto:codec-bounces@ietf.org] On Behalf Of > Gregory Maxwell > Sent: Thursday, April 14, 2011 4:25 PM > To: Roni Even; codec@ietf.org > Subject: [codec] comparitive quality testing > > Roni Even [ron.even.tlv@gmail.com] wrote: > > I do not mind if the WG will decide to remove the quality claim and > continue > > with developing a royalty free codec with "good enough" quality not > saying > > it is better than other codecs. > > I just think that it should be clear from the charter and requirements > what > > is the purpose of the work. > > It's funny how we can argue and argue, only to later realize that it comes > down to a simple mutual misunderstanding. > > I thought everyone was already on the same page with respect to the > goals: it's good to be as good as possible, but the chartered purpose > of the WG was only to do a "good quality" codec that was suited > to the listed applications and deployments. > > As a developer I know that quality testing is important, and of course > we've done a lot of it of various types. I strongly believe in scientific > testing, so of course my first instinct would have been to do it here, > but perhaps the reality of the consensus process makes that less > reasonable-as others have pointed out, most other WGs don't really > do anything comparable to quality testing. > > Likewise, making sure the outcome is as legally unencumbered as I can > is also very important to me, but because of the vulgarities of the > process and the law, this isn't something that the working group itself > makes promises about. > > So, perhaps it makes sense for the working group to not make any quality > promises in the same way it makes no promises about patents. > > It seems clear enough to me now that we can much more easily come to > consensus about achieving good-enough status than about formal testing > gates and requirements. > > We should accept your suggestion-drop all the comparative quality > requirements from the requirements draft, and stop discussing comparative > quality here-and then make some progress on technology, rather than > continue bickering about details where we are not going to come to > consensus. > > The market can figure out the comparative quality question on its own. > > _______________________________________________ > codec mailing list > codec@ietf.org > https://www.ietf.org/mailman/listinfo/codec
- [codec] comparitive quality testing Gregory Maxwell
- Re: [codec] comparitive quality testing Roman Shpount
- Re: [codec] comparitive quality testing Cullen Jennings
- Re: [codec] comparitive quality testing Roman Shpount
- Re: [codec] comparitive quality testing David Virette
- Re: [codec] comparitive quality testing Roman Shpount
- Re: [codec] comparitive quality testing Steve Underwood
- Re: [codec] comparitive quality testing Roman Shpount
- Re: [codec] comparitive quality testing Cullen Jennings
- Re: [codec] comparitive quality testing Alan Duric
- Re: [codec] comparitive quality testing Anisse Taleb
- Re: [codec] comparitive quality testing Monty Montgomery
- Re: [codec] comparitive quality testing Roman Shpount
- Re: [codec] comparitive quality testing Stephan Wenger
- Re: [codec] comparitive quality testing Steve Underwood
- Re: [codec] comparitive quality testing Roman Shpount
- Re: [codec] comparitive quality testing Roman Shpount
- Re: [codec] comparitive quality testing Cullen Jennings
- Re: [codec] comparitive quality testing Alan Duric
- Re: [codec] comparitive quality testing Roman Shpount
- Re: [codec] comparitive quality testing Roman Shpount
- [codec] iLBC deployment statistics (Re: compariti… Harald Alvestrand
- [codec] Deployment of iLBC Re: comparitive qualit… Cullen Jennings
- Re: [codec] comparitive quality testing: vote to … Jean-Francois Mule
- Re: [codec] comparitive quality testing: vote to … Roman Shpount