Re: [codec] Listening tests at Google

Paul Beaumont <paulbeaumont.ietf@gmail.com> Tue, 18 October 2011 23:01 UTC

Return-Path: <paulbeaumont.ietf@gmail.com>
X-Original-To: codec@ietfa.amsl.com
Delivered-To: codec@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8316C21F8AC3 for <codec@ietfa.amsl.com>; Tue, 18 Oct 2011 16:01:34 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.599
X-Spam-Level:
X-Spam-Status: No, score=-3.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_LOW=-1]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Cc2+BIT36Y50 for <codec@ietfa.amsl.com>; Tue, 18 Oct 2011 16:01:34 -0700 (PDT)
Received: from mail-wy0-f172.google.com (mail-wy0-f172.google.com [74.125.82.172]) by ietfa.amsl.com (Postfix) with ESMTP id C100F21F8ABC for <codec@ietf.org>; Tue, 18 Oct 2011 16:01:33 -0700 (PDT)
Received: by wyh22 with SMTP id 22so1280173wyh.31 for <codec@ietf.org>; Tue, 18 Oct 2011 16:01:33 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=user-agent:date:subject:from:to:message-id:thread-topic:in-reply-to :mime-version:content-type:content-transfer-encoding; bh=PfZd4k1fT7FzuPK4/0YjMe4F1svPdcBRA7VfIXaZLts=; b=K0NkD5YT84OB3moBdJ3dTNTglEc88+jW9EDos2Ah5p2SqwMwEhP2m+xCplycIe7IiQ etqA+zizAqm8WZsh5Mdp8ZcflNXsxtc48XjlzArFPyBEwOfHbedXFiTRUplld9M/Nm/f O3wSjAsSCGFICk9hpADS+x6QZzqnAvK7sUziU=
Received: by 10.216.54.20 with SMTP id h20mr1500947wec.97.1318978892924; Tue, 18 Oct 2011 16:01:32 -0700 (PDT)
Received: from [192.168.0.7] (5e03bd2c.bb.sky.com. [94.3.189.44]) by mx.google.com with ESMTPS id q30sm6277021wbn.17.2011.10.18.16.01.27 (version=SSLv3 cipher=OTHER); Tue, 18 Oct 2011 16:01:31 -0700 (PDT)
User-Agent: Microsoft-MacOutlook/14.13.0.110805
Date: Wed, 19 Oct 2011 00:01:23 +0100
From: Paul Beaumont <paulbeaumont.ietf@gmail.com>
To: Jan Skoglund <jks@google.com>, IETF - CoDec <codec@ietf.org>
Message-ID: <CAC3C194.1C4DF%paulbeaumont.ietf@gmail.com>
Thread-Topic: [codec] Listening tests at Google
In-Reply-To: <CA+KMCSWzNUVWNZsvTKsv_+N=A1keUyOhM5qB3yj+GcUEp2VcFQ@mail.gmail.com>
Mime-version: 1.0
Content-type: text/plain; charset="US-ASCII"
Content-transfer-encoding: 7bit
Subject: Re: [codec] Listening tests at Google
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 18 Oct 2011 23:01:34 -0000

Hi Jan

Thank you for performing and sharing the results of your testing.

Please can you summarise what you see as the key findings wrt ...

1). Opus on Mandarin speech - be good to baseline this against comparable
English speech results and
2). Opus when Transcoded/Tandemed

Regards
Paul

--

On 14/09/2011 06:59, "Jan Skoglund" <jks@google.com> wrote:

>Hey,
>
>The listening tests at Google are now done and here are the results.
>
>Regards,
>Jan
>
>
>On Fri, Aug 19, 2011 at 3:28 PM, Jan Skoglund <jks@google.com> wrote:
>> Hey,
>>
>> We've prepared some listening tests for Opus on Mandarin speech and
>> transcoding (English) speech at Google. We started the tests today and
>> will have results at the end of August. The tests are split in four
>> MUSHRA groups:
>>
>> Test 1a - Mandarin NB
>> --------------------------
>> Opus NB
>> Speex NB
>> iLBC NB
>> Reference and 2 anchors (LP 3.5 kHz and MNRU of 15 dB)
>>
>> Test 1b - Mandarin "HD Voice" (WB, FB)
>> --------------------------------------------------------
>> Opus FB
>> G.719 FB
>> Opus WB
>> Speex WB
>> G.722.1 WB
>> Reference and 2 anchors (LP 3.5 kHz and LP 7 kHz)
>>
>> Test 2a - Transcoding NB
>> -------------------------------
>> G.711 -> Opus NB
>> G.711 -> AMR-NB
>> Opus NB -> G.711 -> AMR-NB
>> AMR-NB -> G.711 -> Opus NB
>> AMR-NB -> G.711 -> AMR-NB
>> Reference and 2 anchors (LP 3.5 kHz and MNRU of 15 dB)
>>
>> Test 2b - Transcoding WB
>> --------------------------------
>> Opus WB
>> AMR-WB
>> Opus WB -> AMR-WB
>> AMR-WB -> Opus WB
>> Reference and 2 anchors (LP 3.5 kHz and LP 7 kHz)
>>
>>
>> Cheers,
>> Jan
>>
>_______________________________________________
>codec mailing list
>codec@ietf.org
>https://www.ietf.org/mailman/listinfo/codec