Re: [codec] #5: Mention DTMF in requirements

stephen botzko <stephen.botzko@gmail.com> Sat, 03 April 2010 11:22 UTC

Return-Path: <stephen.botzko@gmail.com>
X-Original-To: codec@core3.amsl.com
Delivered-To: codec@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 6CF5F3A67D3 for <codec@core3.amsl.com>; Sat, 3 Apr 2010 04:22:48 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 0.522
X-Spam-Level:
X-Spam-Status: No, score=0.522 tagged_above=-999 required=5 tests=[AWL=-1.024, BAYES_40=-0.185, DNS_FROM_OPENWHOIS=1.13, HTML_MESSAGE=0.001, J_CHICKENPOX_72=0.6]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NMMsBa-FdNPg for <codec@core3.amsl.com>; Sat, 3 Apr 2010 04:22:47 -0700 (PDT)
Received: from mail-yx0-f177.google.com (mail-yx0-f177.google.com [209.85.210.177]) by core3.amsl.com (Postfix) with ESMTP id 971773A6A1C for <codec@ietf.org>; Sat, 3 Apr 2010 04:21:25 -0700 (PDT)
Received: by yxe7 with SMTP id 7so170029yxe.19 for <codec@ietf.org>; Sat, 03 Apr 2010 04:21:21 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:received:message-id:subject:from:to:cc:content-type; bh=d8y0i1qZHq4iFcre295fUtgVo4GjKj5nruUFzA0VW9M=; b=Oyh2lEpHvl6GBiFLs7WU/6mYgvCYqCcROgbTPZ7mk8m6bu0upOmjwBL+0vFG/XdIi1 Y7Sjq4ilK2cv0PWbg6BUPKy6soT38Szk2+wr0+W48mJLsDJ7nLiMm8k6LAuy2+Eh5Q6y XnqUHH/UyStq7MIktY8iS7FRJDLJVh1YHTPPo=
DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=KAAzCxYAVp8MlVQxA3ekC9L2Yqh4kmBLHauK4C5HyWBdlT7pZaOouxGpKV7srBzHdp ljJoypz4R8PRDSfhClzGX28fqxjsn967KowwcyKIpVTHw1osIJjaBfthWS+FmFVuhpHb 17WLmADlpf3OmR7deAWDgVJuziG7K3AdBi4Ow=
MIME-Version: 1.0
Received: by 10.231.85.133 with HTTP; Sat, 3 Apr 2010 04:21:21 -0700 (PDT)
In-Reply-To: <071.6faf40466d8604354fffe2d42115af08@tools.ietf.org>
References: <062.e6b7c6326118bdb330a524f018229c15@tools.ietf.org> <071.6faf40466d8604354fffe2d42115af08@tools.ietf.org>
Date: Sat, 03 Apr 2010 07:21:21 -0400
Received: by 10.150.184.19 with SMTP id h19mr4154144ybf.235.1270293681432; Sat, 03 Apr 2010 04:21:21 -0700 (PDT)
Message-ID: <j2s6e9223711004030421v870d7663h353f6e14ba7b7402@mail.gmail.com>
From: stephen botzko <stephen.botzko@gmail.com>
To: trac@localhost.amsl.com
Content-Type: multipart/alternative; boundary="000e0cd6ec98a468d60483534b7d"
Cc: codec@ietf.org
Subject: Re: [codec] #5: Mention DTMF in requirements
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 03 Apr 2010 11:22:50 -0000

I think quite a few people seemed to support the SHOULD requirement (with
MUST be tested, since all requirements need to be tested). It might be
enough to say there is a rough consensus.

I'd suggest a show of hands (or hum) be used at the next meeting, in order
to get a better sense of the community's view.

I do not favor tabling a requirement for X until we find "a volunteer that
provides an X testing environment."

If there is agreement that the requirement exists (either in MUST or SHOULD
form), then we need to find a way to test it.  The tests in general will not
be exhaustive (for instance, we will certainly not produce MOS scores for
every language under every channel condition), but they need to be broad
enough that we can say we've characterized the performance with some
confidence.

IMHO we will need to specify and create the testing environment for each of
the requirements.  It seems to me unavoidable.

Implementing a test environment for this particular requirement is frankly *
much* easier than most of the testing we will have to do. Raymond Chen's
suggestions seem very reasonable, and would result in an objective automated
test score.

Stephen Botzko



On Sat, Apr 3, 2010 at 1:01 AM, codec issue tracker <trac@tools.ietf.org>wrote:

> #5: Mention DTMF in requirements
>
> ------------------------------------+---------------------------------------
>  Reporter:  hoene@…                 |       Owner:
>     Type:  defect                  |      Status:  new
>  Priority:  major                   |   Milestone:
> Component:  requirements            |     Version:
>  Severity:  Active WG Document      |    Keywords:
>
> ------------------------------------+---------------------------------------
>
> Comment(by hoene@…):
>
>  No consensus until now.
>  I see do opinions on the mailing list:
>
>  a) I think DTMF should be ignored entirely as far as requirements.  If
>  someone wishes to perform tests, they are welcome to do so and present
>  results, but there is no need to require anything.
>  There are many different machine-to-machine communications systems that
>  have been designed to operate over channels that also carry audio.  We
>  should not attempt to support any of them.  The only purpose of this codec
>  should be to carry sounds to a human ear.
>
>  b) DTMF support is important to ensure interoperability and reliable
>  operation. Thus, the codec SHOULD support the transmission DTMF at most
>  transmission conditions. The DTMF transmission performance MUST be tested
>  and characterized.
>
>  Thus, I suggest to pause the decision until we found "
>
>  PS:
>  It is common consensus that FAX NEED NOT to be support or tested.
>
> --
> Ticket URL: <http://trac.tools.ietf.org/wg/codec/trac/ticket/5#comment:2>
> codec <http://tools.ietf.org/codec/>
>
> _______________________________________________
> codec mailing list
> codec@ietf.org
> https://www.ietf.org/mailman/listinfo/codec
>