IETF Logo Mail Archive

Re: [codec] Testing, requirements, and IETF process

Anisse Taleb <anisse.taleb@huawei.com> Tue, 19 April 2011 00:05 UTC

Return-Path: <anisse.taleb@huawei.com>
X-Original-To: codec@ietfc.amsl.com
Delivered-To: codec@ietfc.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfc.amsl.com (Postfix) with ESMTP id 9C1E6E078F for <codec@ietfc.amsl.com>; Mon, 18 Apr 2011 17:05:21 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.349
X-Spam-Level:
X-Spam-Status: No, score=-6.349 tagged_above=-999 required=5 tests=[AWL=0.250, BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([208.66.40.236]) by localhost (ietfc.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 8PyM2ojj63eC for <codec@ietfc.amsl.com>; Mon, 18 Apr 2011 17:05:21 -0700 (PDT)
Received: from lhrga04-in.huawei.com (lhrga04-in.huawei.com [195.33.106.149]) by ietfc.amsl.com (Postfix) with ESMTP id 0D4B8E0752 for <codec@ietf.org>; Mon, 18 Apr 2011 17:05:21 -0700 (PDT)
Received: from huawei.com (localhost [127.0.0.1]) by lhrga04-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTP id <0LJV009DSHKRP0@lhrga04-in.huawei.com> for codec@ietf.org; Tue, 19 Apr 2011 01:05:15 +0100 (BST)
Received: from LHREML201-EDG.china.huawei.com ([172.18.7.118]) by lhrga04-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTPS id <0LJV00M6NHKQWY@lhrga04-in.huawei.com> for codec@ietf.org; Tue, 19 Apr 2011 01:05:14 +0100 (BST)
Received: from LHREML402-HUB.china.huawei.com (10.201.5.31) by LHREML201-EDG.china.huawei.com (172.18.7.188) with Microsoft SMTP Server (TLS) id 14.1.270.1; Tue, 19 Apr 2011 01:05:09 +0100
Received: from LHREML503-MBX.china.huawei.com ([fe80::f93f:958b:5b06:4f36]) by LHREML402-HUB.china.huawei.com ([::1]) with mapi id 14.01.0270.001; Tue, 19 Apr 2011 01:05:13 +0100
Date: Tue, 19 Apr 2011 00:05:13 +0000
From: Anisse Taleb <anisse.taleb@huawei.com>
In-reply-to: <8FDB3712-6A59-4E6E-872B-B69C4E574257@cisco.com>
X-Originating-IP: [10.200.217.213]
To: Cullen Jennings <fluffy@cisco.com>, "codec@ietf.org" <codec@ietf.org>
Message-id: <F5AD4C2E5FBF304ABAE7394E9979AF7C26BC8BE3@LHREML503-MBX.china.huawei.com>
MIME-version: 1.0
Content-type: text/plain; charset="us-ascii"
Content-language: en-US
Content-transfer-encoding: 7bit
Accept-Language: en-GB, en-US
Thread-topic: [codec] Testing, requirements, and IETF process
Thread-index: AQHL+wg67uAtYlcyc0quqohdx3OzSZRkUSWg
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
References: <8FDB3712-6A59-4E6E-872B-B69C4E574257@cisco.com>
Subject: Re: [codec] Testing, requirements, and IETF process
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 19 Apr 2011 00:05:21 -0000

Dear Cullen,

> deploying. I think there are several points that many people would agree
> with

Not quite, the wording is somewhat misleading, I do not wish to be picky, but I would like that the statements made are as correct as possible. 

> 
> 1) test results are good
> 
The results presented so far are good, the actual tests however are debatable. 

> 2) understanding how a test was done and being able to reproduce it
> increases the confidence in test results

Agreed !

> 
> 3) we can't delay forever doing testing
> 

Testing is not delaying the process, it is part of the process. The topic of testing has been raised at the CODEC BoF and individuals present at that meeting and in support of the creation of the WG admitted to this fact.

>
> 4) perfection is the enemy of good
> 
So is imperfection.

v2.23.0 | Report a Bug | By Email