Re: [codec] Summary of test results

[Jean-Marc Valin <[e-mail]>]

Hi Christian,

On 11-06-16 04:21 PM, Christian Hoene wrote:
> Thank you very much for your efforts.  Allow me to play again the role of
> the critic. For the readers of Opus characterization document it would be
> more useful to have the measured results in table (concrete figures).

Note that this draft is not meant to include all the details of the tests. 
For that, you should refer to the original results documents that are cited 
for each test. All of them are available on the net except for the most 
recent test: "Voice Quality Characterization of IETF Opus Codec" that will 
be presented by Anssi Ramo (from Nokia) at Interspeech 2011. However, he 
was kind enough to provide me with a copy and gave me permission to 
redistribute it to working group members upon request.

> Also, in order to plan further listening-only tests, an overview of missing
> test cases is missing.
>
> Do you plan to provide anything in this respect in a later update of the
> document? How is going to coordinate future tests? Or do been already enough
> tests been made?

As stated in the conclusion, we believe that the combination of all tests 
demonstrates that Opus is better than the codecs it needs to beat. Feel 
free to conduct any test you deem useful if you disagree with parts of the 
conclusions.

> Do you plan to have an additional informal IETF RFC with the
> characterization results? This would make sense but it requires changes in
> the charter...

At this point, this draft is not meant to ever become an RFC. It is only 
meant for discussion (friendlier than a lengthy post on the mailing list).

Cheers,

	Jean-Marc