Re: [codec] I-D Action: draft-ietf-codec-results-02.txt

"Hoene" <hoene@uni-tuebingen.de> Mon, 05 November 2012 18:16 UTC

Return-Path: <hoene@uni-tuebingen.de>
X-Original-To: codec@ietfa.amsl.com
Delivered-To: codec@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4C70821F892A for <codec@ietfa.amsl.com>; Mon, 5 Nov 2012 10:16:44 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.249
X-Spam-Level:
X-Spam-Status: No, score=-6.249 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, HELO_EQ_DE=0.35, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id keFC3aisxVnC for <codec@ietfa.amsl.com>; Mon, 5 Nov 2012 10:16:43 -0800 (PST)
Received: from mx09.uni-tuebingen.de (mx09.uni-tuebingen.de [134.2.3.2]) by ietfa.amsl.com (Postfix) with ESMTP id E8E9421F8937 for <codec@ietf.org>; Mon, 5 Nov 2012 10:16:42 -0800 (PST)
Received: from ChristianHoene (dhcp-508e.meeting.ietf.org [130.129.80.142]) (authenticated bits=0) by mx09.uni-tuebingen.de (8.13.6/8.13.6) with ESMTP id qA5IGBmW016092 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Mon, 5 Nov 2012 19:16:28 +0100
From: "Hoene" <hoene@uni-tuebingen.de>
To: "'Jean-Marc Valin'" <jmvalin@mozilla.com>
References: <20121105150419.16812.98377.idtracker@ietfa.amsl.com> <012001cdbb68$6ccefdb0$466cf910$@uni-tuebingen.de> <5097F184.3010807@mozilla.com>
In-Reply-To: <5097F184.3010807@mozilla.com>
Date: Mon, 5 Nov 2012 13:15:59 -0500
Message-ID: <001201cdbb81$b0efe720$12cfb560$@uni-tuebingen.de>
MIME-Version: 1.0
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
X-Mailer: Microsoft Outlook 14.0
Thread-Index: AQNcQkaIhdpO6cgV4ATBGgn3yRRa/wGsmC0aApEmS4mUnIuPsA==
Content-Language: de
X-AntiVirus-Spam-Check: clean (checked by Avira MailGate: version: 3.2.1.23; spam filter version: 3.2.0/2.3; host: mx09)
X-AntiVirus: checked by Avira MailGate (version: 3.2.1.23; AVE: 8.2.5.34; VDF: 7.11.10.215; host: mx09); id=32218-9Lqp5d
Cc: codec@ietf.org
Subject: Re: [codec] I-D Action: draft-ietf-codec-results-02.txt
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 05 Nov 2012 18:16:44 -0000

Hi Valin,

we at University of Tübingen/Symonics. I am expecting about 100 participants
in the tests. Give me some more time to write down the testing plan. I will
be happy to read your comments then.

The tests will focus on
1) Comparision with other codecs (similar to the graph on the Opus web page
but based on scientific correctly measured results).
2) Characterisation of Opus and its operational modes (including packet
loss)
Also, I am planning to measure the complexity of the codecs somehow.

As the tests are not intended for the codec developers but for people
outside of the IETF, I will focus on well standardized testing procedures
like MUSHRA and the guidelines given in
"practical procedures of subjective testing"
http://www.itu.int/opb/publications.aspx?media=electronic&parent=T-HDB-QOS.0
2-2011

Jean-Marc, there is no reason to be worried. We will just do some very
transparent MUSHRA testing on use cases that are important for codec users.
But - of course - I cannot promise you that Opus will be best in every
testing condition.

See you today at the Video BOF?

With best regards,

 Christian Hoene

--
Universität Tübingen, Sand 13, 72076 Tübingen, Germany
Tel +49 7071 2970532, Fax +49 7071 5220
http://kn.inf.uni-tuebingen.de/staff/hoene.html

-----Ursprüngliche Nachricht-----
Von: Jean-Marc Valin [mailto:jmvalin@mozilla.com] 
Gesendet: Montag, 5. November 2012 12:04
An: Hoene
Cc: codec@ietf.org
Betreff: Re: [codec] I-D Action: draft-ietf-codec-results-02.txt

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 11/05/2012 10:15 AM, Hoene wrote:
> But still some good news, in the next weeks we will start some more 
> MUSHRA and complexity testing. More to come.

Just curious, who is "we"?

	Jean-Marc


> With best regards,
> 
> Christian
> 
> 
> -- Universität Tübingen, Sand 13, 72076 Tübingen, Germany Tel +49
> 7071 2970532, Fax +49 7071 5220
> http://kn.inf.uni-tuebingen.de/staff/hoene.html
> 
> -----Ursprüngliche Nachricht----- Von: codec-bounces@ietf.org 
> [mailto:codec-bounces@ietf.org] Im Auftrag von 
> internet-drafts@ietf.org Gesendet: Montag, 5. November 2012 16:04
> An: i-d-announce@ietf.org Cc: codec@ietf.org Betreff: [codec] I-D
> Action: draft-ietf-codec-results-02.txt
> 
> 
> A New Internet-Draft is available from the on-line Internet-Drafts 
> directories. This draft is a work item of the Internet Wideband Audio 
> Codec Working Group of the IETF.
> 
> Title           : Summary of Opus listening test results Author(s)
> : Christian Hoene Jean-Marc Valin Koen Vos Jan Skoglund Filename
> : draft-ietf-codec-results-02.txt Pages           : 31 Date
> : 2012-11-05
> 
> Abstract: This document describes and examines listening test results 
> obtained for the Opus codec and how they relate to the requirements.
> 
> 
> The IETF datatracker status page for this draft is: 
> https://datatracker.ietf.org/doc/draft-ietf-codec-results
> 
> There's also a htmlized version available at: 
> http://tools.ietf.org/html/draft-ietf-codec-results-02
> 
> A diff from the previous version is available at: 
> http://www.ietf.org/rfcdiff?url2=draft-ietf-codec-results-02
> 
> 
> Internet-Drafts are also available by anonymous FTP at: 
> ftp://ftp.ietf.org/internet-drafts/
> 
> _______________________________________________ codec mailing list 
> codec@ietf.org https://www.ietf.org/mailman/listinfo/codec
> 
> _______________________________________________ codec mailing list 
> codec@ietf.org https://www.ietf.org/mailman/listinfo/codec
> 

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.12 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://www.enigmail.net/

iQEcBAEBAgAGBQJQl/GAAAoJEJ6/8sItn9q9CVIH/1TDfJkv7OCfUq9k2YS1HfFA
Tt1qUuOJGw0OjGlDAhjA+bg0HdHmHxwtvBZ13bxRUVsCKolszrtnAk9AsqPFj23x
20vkKfTUMnh7xKelwX665zsD/cAS9MOvS4Xwd+bwyp7r4DxLP2oCu5EQGn/vOJvZ
tKERKh7cGHxTdSaRguGhxyJyzMoA5EZ2pl1rta+22JqNThX3IySQ+qy/Gdxh7JVZ
oVedmfCrBJy9Y2HUeAZrbugXZX9EiP7f4G/19/0TYD/qUuZl3JKem3lNQkHT8jyl
9q3dtYBHw4rtRzZoAnfLPvdJD38WGzWHwAZjoWi0R3WsWbdt0Oe/Dx0lMB4arAo=
=Ej0P
-----END PGP SIGNATURE-----