Re: [codec] A concrete proposal for requirements and testing

[Stephen Botzko <[e-mail]>]

Early on there was consensus on the need for codec characterization.

I see no reason to have that discussion again, I suggest it would be better
to get back on track and work through what a sensible test plan would
include.

Stephen Botzko

On Thu, Apr 7, 2011 at 2:36 PM, Peter Saint-Andre <[e-mail]>wrote:

> On 4/7/11 12:13 PM, Paul Coverdale wrote:
>
> > It doesn't matter what any single individual on this mailing list thinks
> > about Opus quality. What matters is the collective opinion of the
> population
> > of naïve users who may listen to speech/music over Opus in the future,
> and
> > how they rate it compared to listening to speech/music via other codecs
> (not
> > that they will know/care what a codec is...). A well-designed test plan
> and
> > statistical analysis can give a good estimate of this opinion.
>
> I completely agree. That's why it is so important for us to publish
> draft-ietf-codec-opus as a Proposed Standard.
>
> The IETF tradition is one of "rough consensus and running code". What
> this means is that we work hard on a new technology and publish it as an
> RFC ("request for comments"). This is the rough consensus part.
>
> Then we implement it and deploy it. Testing is something that happens
> naturally when we run a technology on networks. This is the "running
> code" part.
>
> Implementation and deployment experience can lead to revisions and
> refinements and better specification of the technology. Of course we'll
> also seek rough consensus on any modifications, but it's not necessary,
> or even desirable, to get that implementation and deployment experience
> before we publish a specification as a Proposed Standard RFC.
>
> Indeed, much discussion has occurred of late within the IETF about
> simplifying the Internet Standards Process by making it easier, not
> harder, to advance Internet-Drafts to Proposed Standard:
>
> https://datatracker.ietf.org/doc/draft-housley-two-maturity-levels/
>
> Let's get to rough consensus and then start running this code on the
> network. That will be the true test.
>
> Peter
>
> --
> Peter Saint-Andre
> https://stpeter.im/
>
>
>
>