Re: [codec] A concrete proposal for requirements and testing

[Ron <[e-mail]>]

Hi Anisse,

On Mon, Apr 11, 2011 at 06:26:08PM +0000, Anisse Taleb wrote:
> Hi all,
> 
> I feel this thread has somewhat diverged from its initial purpose which was
> to have a concrete plan for testing and requirements.

Well, its initial purpose, as clearly seen in its first post, was to resolve
the disagreement (or possibly confusion?) that resulted from trying to take
a hum on those questions, without adequate discussion, at Prague.

It diverged from that almost immediately, and has steadfastly refused to
return to it.  If we can take that as meaning that nobody actually does
disagree with the points that Jean-Marc asked to clarify, then I think
we can take that as meaning this (original) thread has actually achieved
its purpose and we now do have consensus on those points.

Is there some formal IETF thing we need to do to acknowledge that now?
(as separate from this subthread about an additional planned test)

> I have also a feeling
> that there are "cultural" differences and divergences as to what "testing"
> means.

I don't think anyone disagrees on what testing means.  I do think we have
some disagreement on what tests are relevant though.  Some people think
testing against G.711, or against codecs that cannot possibly fill the
requirements this group set out to achieve, is a fairly pointless exercise.
At least in the context of assessing whether we have met the requirements
of the WG, and to what standard.  And in the face of the test results that
we do already have.

Such tests may still be interesting to see (I'd be interested in seeing
them for one), but I strongly disagree that they are at all serving the
aims of the WG, and don't think we should delay its progress if we don't
have them in time.

> That aside, I would like to inform that a proposal for test plan is currently
> being drafted and will be communicated this week.

Thank you.  I'm very glad to hear that the people who weren't satisfied
by the results we've already seen are taking the initiative to resolve
that to their full satisfaction.  As only they can do.

I look forward to seeing your plan, and its results.  As I have all of
the other tests performed to date.

Best,
Ron