Re: [codec] Opus comparison test plan version 2
"Christian Hoene" <hoene@uni-tuebingen.de> Wed, 17 April 2013 18:47 UTC
Return-Path: <hoene@uni-tuebingen.de>
X-Original-To: codec@ietfa.amsl.com
Delivered-To: codec@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix)
with ESMTP id 72BE721E8087 for <codec@ietfa.amsl.com>;
Wed, 17 Apr 2013 11:47:04 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.249
X-Spam-Level:
X-Spam-Status: No, score=-6.249 tagged_above=-999 required=5
tests=[BAYES_00=-2.599, HELO_EQ_DE=0.35, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com
[127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jiaEOWHKvv+w for
<codec@ietfa.amsl.com>; Wed, 17 Apr 2013 11:47:02 -0700 (PDT)
Received: from mx09.uni-tuebingen.de (mx09.uni-tuebingen.de [134.2.3.2]) by
ietfa.amsl.com (Postfix) with ESMTP id 6350F21E8063 for <codec@ietf.org>;
Wed, 17 Apr 2013 11:47:02 -0700 (PDT)
Received: from samsung7PC (p5482BDAA.dip.t-dialin.net [84.130.189.170])
(authenticated bits=0) by mx09.uni-tuebingen.de (8.13.6/8.13.6) with ESMTP id
r3HIkpxO014818 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO);
Wed, 17 Apr 2013 20:46:57 +0200
From: "Christian Hoene" <hoene@uni-tuebingen.de>
To: "'Jean-Marc Valin'" <jmvalin@mozilla.com>,
"'Alfons Martin'" <alfons.martin@symonics.com>
References: <516EA89C.80103@symonics.com> <516EE3DD.8030704@mozilla.com>
In-Reply-To: <516EE3DD.8030704@mozilla.com>
Date: Wed, 17 Apr 2013 20:47:23 +0200
Message-ID: <005901ce3b9c$0582acb0$10880610$@uni-tuebingen.de>
MIME-Version: 1.0
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
X-Mailer: Microsoft Outlook 14.0
Thread-Index: AQI5h+wjQFgrUroIrpJ1cWWFVJU3xQIZo5/jl/NZrjA=
Content-Language: de
X-AntiVirus-Spam-Check: clean (checked by Avira MailGate: version: 3.2.1.26;
spam filter version: 3.2.0/2.3; host: mx09)
X-AntiVirus: checked by Avira MailGate (version: 3.2.1.26; AVE: 8.2.12.28;
VDF: 7.11.73.42; host: mx09); id=5047-r6thkq
Cc: 'Christian Hoene' <christian.hoene@symonics.com>, codec@ietf.org,
patrick.schreiner@symonics.com
Subject: Re: [codec] Opus comparison test plan version 2
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>,
<mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>,
<mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Apr 2013 18:47:04 -0000
Hello Jean-Marc, I do not get your arguments. * the 8.85 issues have been considered. It has been replaced with 12.65 plus DTX * low-pass filtering has been removed * VBR is used in the music modes. * and, because of the many requests, we will compare AMR-WB with both Opus CBR und Opus VBR. Happy? What else? Christian -----Ursprüngliche Nachricht----- Von: codec-bounces@ietf.org [mailto:codec-bounces@ietf.org] Im Auftrag von Jean-Marc Valin Gesendet: Mittwoch, 17. April 2013 20:03 An: Alfons Martin Cc: Christian Hoene; codec@ietf.org; patrick.schreiner@symonics.com Betreff: Re: [codec] Opus comparison test plan version 2 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Well, my original email had 13 points, most of which seem to have been ignored, including the low-pass filtering of speech and music, the 8.85 kb/s, and the VBR issue. So I guess I'm done with the reviewing. Good luck with your test. Cheers, Jean-Marc On 04/17/2013 09:50 AM, Alfons Martin wrote: > > > AMR-WB > > > > Based on the feedback we changed the document. > > 1) No input bandwidth filtering for speech at all > > 2) Make sure to tell the Opus encoder what the percentage of > loss is so it can optimize the encoding for it. Ok, but we have to > consider both cases. > > 3) For AMR-WB the 8.85 mode is "intended to be used only > temporarily during severe radio channel conditions or during network > congestion". Right, better we use AMR-WB 12.65 with DTX in this case. > > > > We did not consider the following suggestion > > 1) Opus should use VBR For direct comparison, we have to > choose same mode as the other codec. For example, AMR-WB does not > support VBR. > > 2) If you're going to test packet loss, there should be at > least one test with FEC -- probably the 23.85 one. As for now, we are > not sure whether the Opus FEC implementation is bug free (see FEC > question email). > > > > AAC-eLD > > Based on the feedback we changed the document. > > 1) We will use SBR > > 2) Mono and stereo should not be mixed in one experiment to > avoid the influence of this factor on the assessment of the coding > quality. agreed. > > 3) 24, 32, 48 kbit/s for mono at 32 kHz sample rate CHECK > > 4) For stereo 32, 48, 64 and 96 kbit/s could be used. CHECK > > > > We did not consider the following suggestion > > 1) > > > > > > > > General > > Based on the feedback we changed the document. > > 1) We will use loss rates 0, 1, 3, 6% > > > > We did not consider the following suggestion > > 1) We will keep the MNRU 16 anchor (MOS 2.2) because some of > the samples will be worse than LP 3.5 but better than MOS 2.2. We skip > LP 7 as it is optional. > > 2) We stick to MUSHRA as it is the only tests that covers a > wide range of degradations. > > > > Thank you very much for your timely feedback. > > > Alfons, Christian > > > > _______________________________________________ codec mailing list > codec@ietf.org https://www.ietf.org/mailman/listinfo/codec > -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.13 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBAgAGBQJRbuPdAAoJEJ6/8sItn9q935wIAIra0oye/5HW7LMQ4rt4vQ1d iIlzzNxYuravA/IHYVdlh7pfkrdoFRTNtp7RXCI8lOQEVUC0QeSS4mibtVnQyCgM PgOYvGXu2W3nQxBo12A5hFLZkFJ50Gpw42o7IaWA3G7JSCoSGvsCRQp56o+E9Nhe jN1TwlmLS5kEgWSZk+DDWtyie/VGn/X/Q+fp/DzQHYBbVHLtnYMZAWigsAEyoIWL 0z4SkpMBIEo7lctedf23LROslbiefq61K9neRhqQLMMo46Nu23IzVPHqdgnbthxi oaQcvXpLix25e9CyMhoOnfTIzCnwXKO3XLPq0jgA0CRX8B5WrTYXqzBWLtYlQD0= =GViO -----END PGP SIGNATURE----- _______________________________________________ codec mailing list codec@ietf.org https://www.ietf.org/mailman/listinfo/codec
- [codec] Opus comparison test plan version 2 Alfons Martin
- Re: [codec] Opus comparison test plan version 2 Christian Hoene
- Re: [codec] Opus comparison test plan version 2 Ron
- Re: [codec] Opus comparison test plan version 2 Jean-Marc Valin
- Re: [codec] Opus comparison test plan version 2 Christian Hoene