Re: [codec] draft test and processing plan for the IETF Codec

[Ron <[e-mail]>]

On Tue, Apr 19, 2011 at 03:38:46AM +0000, Anisse Taleb wrote:
> Paul,
> 
> Strictly speaking, the probability of failing at least one requirement
> increases (or stays constant in dependent cases) with increasing the number
> of requirements. Of course as you mention, the responses of the listeners are
> not really random and a heads-tail modeling of the pass-fail is way too
> simplistic. I didn't look at the analysis in depth, neither did I verify the
> numbers.  I think Greg is mostly concerned with the size of the test and how
> the analysis of the requirements would be used to derive a conclusion about
> the codec.

I think he's worried, as are many others, that it's sufficiently
sophisticated as to be indistinguishable from a rigged demo.

I think we can be equally worried that you haven't done this analysis
and yet still assert that this test is somehow more valid that the ones
which have already been conducted.

> [Off topic]
> Statistics are quite fun to play with, a while ago a Conspiracy theorist
> tried to convince me that man never landed on the moon and that it was
> impossible that Apollo 11 made it. The millions of components, given the
> technology of that time, had  a significant probability of failure that in
> total it was beyond doubt that such a rocket would have gone off course.

I guess you're also unaware of how many rockets they pranged before the
(g)odds did favour them with success, and how unrepeatable that success
subsequently proved to be.  And that they also didn't have a worried
cartel shrilling OMG patent! at them at every step of the way.


So can we please return to the topic at hand?

Do you or do you not have a test plan that you wish to conduct before
we reach the WG milestone of assessing the results of the currently
frozen candidate codec?  The clock is ticking, and you're wasting the
time that you do have remaining to perform that task and present its
results for the group to consider.

Cheers,
Ron