Re: [codec] Opus comparison test plan version 2

"Christian Hoene" <hoene@uni-tuebingen.de> Wed, 17 April 2013 18:47 UTC

Return-Path: <hoene@uni-tuebingen.de>
X-Original-To: codec@ietfa.amsl.com
Delivered-To: codec@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 72BE721E8087 for <codec@ietfa.amsl.com>; Wed, 17 Apr 2013 11:47:04 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.249
X-Spam-Level:
X-Spam-Status: No, score=-6.249 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, HELO_EQ_DE=0.35, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jiaEOWHKvv+w for <codec@ietfa.amsl.com>; Wed, 17 Apr 2013 11:47:02 -0700 (PDT)
Received: from mx09.uni-tuebingen.de (mx09.uni-tuebingen.de [134.2.3.2]) by ietfa.amsl.com (Postfix) with ESMTP id 6350F21E8063 for <codec@ietf.org>; Wed, 17 Apr 2013 11:47:02 -0700 (PDT)
Received: from samsung7PC (p5482BDAA.dip.t-dialin.net [84.130.189.170]) (authenticated bits=0) by mx09.uni-tuebingen.de (8.13.6/8.13.6) with ESMTP id r3HIkpxO014818 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Wed, 17 Apr 2013 20:46:57 +0200
From: "Christian Hoene" <hoene@uni-tuebingen.de>
To: "'Jean-Marc Valin'" <jmvalin@mozilla.com>, "'Alfons Martin'" <alfons.martin@symonics.com>
References: <516EA89C.80103@symonics.com> <516EE3DD.8030704@mozilla.com>
In-Reply-To: <516EE3DD.8030704@mozilla.com>
Date: Wed, 17 Apr 2013 20:47:23 +0200
Message-ID: <005901ce3b9c$0582acb0$10880610$@uni-tuebingen.de>
MIME-Version: 1.0
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
X-Mailer: Microsoft Outlook 14.0
Thread-Index: AQI5h+wjQFgrUroIrpJ1cWWFVJU3xQIZo5/jl/NZrjA=
Content-Language: de
X-AntiVirus-Spam-Check: clean (checked by Avira MailGate: version: 3.2.1.26; spam filter version: 3.2.0/2.3; host: mx09)
X-AntiVirus: checked by Avira MailGate (version: 3.2.1.26; AVE: 8.2.12.28; VDF: 7.11.73.42; host: mx09); id=5047-r6thkq
Cc: 'Christian Hoene' <christian.hoene@symonics.com>, codec@ietf.org, patrick.schreiner@symonics.com
Subject: Re: [codec] Opus comparison test plan version 2
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Apr 2013 18:47:04 -0000

Hello Jean-Marc,

I do not get your arguments.

* the 8.85 issues have been considered. It has been replaced with 12.65 plus
DTX
* low-pass filtering has been removed
* VBR is used in the music modes.
* and, because of the many requests, we will compare AMR-WB with both Opus
CBR und Opus VBR.

Happy? What else?


Christian



-----Ursprüngliche Nachricht-----
Von: codec-bounces@ietf.org [mailto:codec-bounces@ietf.org] Im Auftrag von
Jean-Marc Valin
Gesendet: Mittwoch, 17. April 2013 20:03
An: Alfons Martin
Cc: Christian Hoene; codec@ietf.org; patrick.schreiner@symonics.com
Betreff: Re: [codec] Opus comparison test plan version 2

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Well, my original email had 13 points, most of which seem to have been
ignored, including the low-pass filtering of speech and music, the
8.85 kb/s, and the VBR issue. So I guess I'm done with the reviewing.
Good luck with your test.

Cheers,

	Jean-Marc

On 04/17/2013 09:50 AM, Alfons Martin wrote:
> 
> 
> AMR-WB
> 
> 
> 
> Based on the feedback we changed the document.
> 
> 1)      No input bandwidth filtering for speech at all
> 
> 2)      “Make sure to tell the Opus encoder what the percentage of
> loss is so it can optimize the encoding for it.” – Ok, but we have to 
> consider both cases.
> 
> 3)      “For AMR-WB the 8.85 mode is "intended to be used only 
> temporarily during severe radio channel conditions or during network 
> congestion". Right, better we use AMR-WB 12.65 with DTX in this case.
> 
> 
> 
> We did not consider the following suggestion
> 
> 1)      “Opus should use VBR” – For direct comparison, we have to
> choose same mode as the other codec. For example, AMR-WB does not 
> support VBR.
> 
> 2)      “If you're going to test packet loss, there should be at
> least one test with FEC -- probably the 23.85 one”. As for now, we are 
> not sure whether the Opus FEC implementation is bug free (see FEC 
> question email).
> 
> 
> 
> AAC-eLD
> 
> Based on the feedback we changed the document.
> 
> 1)      We will use SBR
> 
> 2)      “Mono and stereo should not be mixed in one experiment to
> avoid the influence of this factor on the assessment of the coding 
> quality.” – agreed.
> 
> 3)      24, 32, 48 kbit/s for mono at 32 kHz sample rate CHECK
> 
> 4)      For stereo 32, 48, 64 and 96 kbit/s could be used. CHECK
> 
> 
> 
> We did not consider the following suggestion
> 
> 1)
> 
> 
> 
> 
> 
> 
> 
> General
> 
> Based on the feedback we changed the document.
> 
> 1)      We will use loss rates 0, 1, 3, 6%
> 
> 
> 
> We did not consider the following suggestion
> 
> 1)      We will keep the MNRU 16 anchor (MOS 2.2) because some of
> the samples will be worse than LP 3.5 but better than MOS 2.2. We skip 
> LP 7 as it is optional.
> 
> 2)      We stick to MUSHRA as it is the only tests that covers a
> wide range of degradations.
> 
> 
> 
> Thank you very much for your timely feedback.
> 
> 
> Alfons, Christian
> 
> 
> 
> _______________________________________________ codec mailing list 
> codec@ietf.org https://www.ietf.org/mailman/listinfo/codec
> 

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.13 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQEcBAEBAgAGBQJRbuPdAAoJEJ6/8sItn9q935wIAIra0oye/5HW7LMQ4rt4vQ1d
iIlzzNxYuravA/IHYVdlh7pfkrdoFRTNtp7RXCI8lOQEVUC0QeSS4mibtVnQyCgM
PgOYvGXu2W3nQxBo12A5hFLZkFJ50Gpw42o7IaWA3G7JSCoSGvsCRQp56o+E9Nhe
jN1TwlmLS5kEgWSZk+DDWtyie/VGn/X/Q+fp/DzQHYBbVHLtnYMZAWigsAEyoIWL
0z4SkpMBIEo7lctedf23LROslbiefq61K9neRhqQLMMo46Nu23IzVPHqdgnbthxi
oaQcvXpLix25e9CyMhoOnfTIzCnwXKO3XLPq0jgA0CRX8B5WrTYXqzBWLtYlQD0=
=GViO
-----END PGP SIGNATURE-----
_______________________________________________
codec mailing list
codec@ietf.org
https://www.ietf.org/mailman/listinfo/codec