Re: [codec] draft test and processing plan for the IETF Codec

[Jean-Marc Valin <[e-mail]>]

Hi Anisse,

I gave some more thought on your proposed test plan and as Cullen 
suggested, I think the main cause of disagreement is not that much on 
the testing, but on the conditions for publishing (large number of BT, 
NWT). Considering that ultimately, the decision to publish a spec is 
always based on WG consensus, then I think that problem can be 
completely bypassed. Once we make it up to the individuals to decide, 
then we can focus on "simply" designing a good test.

Overall I thought the conditions you were proposing in section 2 were 
pretty reasonable. There's a few details like selecting existing rates 
for codecs like Speex and iLBC, but that should be easy to solve. Once 
these are sorted out, interested parties (we had several hands raised in 
the last meeting) can start testing and we then let each individual 
decide on whether the codec is any good based on the results of the tests.

Sounds like a plan?

     Jean-Marc


On 11-04-13 03:32 AM, Anisse Taleb wrote:
> Hi,
> Please find attached a first draft of a test plan of the IETF codec (Opus).
> The proposal does not claim to be complete, there are still many missing things, e.g. tandeming cases, tests with delay jitter, dtx etc. Consider it as a starting point for discussion where everyone is welcome to contribute in a constructive manner. Further updates are planned, but let's see first some initial comments.
>
> The attachment is a pdf version, please let me know if you would like to see another format and I would be glad to oblige.
>
> Comments and additions are welcome!
>
> Kind regards,
> /Anisse
> (From La Jolla - San Diego).
>
>
>
> _______________________________________________
> codec mailing list
> [e-mail]
> https://www.ietf.org/mailman/listinfo/codec