[codec] Jan Skoglund's Opus test results (NB/WB/FB)
Gregory Maxwell <gmaxwell@juniper.net> Thu, 31 March 2011 16:10 UTC
Return-Path: <gmaxwell@juniper.net>
X-Original-To: codec@core3.amsl.com
Delivered-To: codec@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id C9D493A69BF for <codec@core3.amsl.com>; Thu, 31 Mar 2011 09:10:08 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.599
X-Spam-Level:
X-Spam-Status: No, score=-6.599 tagged_above=-999 required=5 tests=[AWL=0.000, BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YoR-NX-0NRTN for <codec@core3.amsl.com>; Thu, 31 Mar 2011 09:10:01 -0700 (PDT)
Received: from exprod7og109.obsmtp.com (exprod7og109.obsmtp.com [64.18.2.171]) by core3.amsl.com (Postfix) with ESMTP id 3465F3A6C06 for <codec@ietf.org>; Thu, 31 Mar 2011 09:10:01 -0700 (PDT)
Received: from source ([66.129.224.36]) (using TLSv1) by exprod7ob109.postini.com ([64.18.6.12]) with SMTP ID DSNKTZSnvKhI0ZoPo20VhT1JeltfzZqQo1vK@postini.com; Thu, 31 Mar 2011 09:11:41 PDT
Received: from EMBX01-HQ.jnpr.net ([fe80::c821:7c81:f21f:8bc7]) by P-EMHUB03-HQ.jnpr.net ([::1]) with mapi; Thu, 31 Mar 2011 09:08:03 -0700
From: Gregory Maxwell <gmaxwell@juniper.net>
To: "codec@ietf.org" <codec@ietf.org>
Date: Thu, 31 Mar 2011 09:08:03 -0700
Thread-Topic: Jan Skoglund's Opus test results (NB/WB/FB)
Thread-Index: AQHL77fy8b+vy8Y0b0quE7CqPI/JJQ==
Message-ID: <BCB3F026FAC4C145A4A3330806FEFDA93BA8B6461A@EMBX01-HQ.jnpr.net>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: text/plain; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Subject: [codec] Jan Skoglund's Opus test results (NB/WB/FB)
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 31 Mar 2011 16:10:09 -0000
Jan Skoglund presented listening test results in the WG meeting today: http://tools.ietf.org/agenda/80/slides/codec-4.pdf starting at slide 15. I did statistical tests on the results, which are available at: http://people.xiph.org/~tterribe/notes/celt/nb-overall-ptests.png http://people.xiph.org/~tterribe/notes/celt/wb-overall-ptests.png http://people.xiph.org/~tterribe/notes/celt/music-overall-ptests.png These are the results of randomized blocked permutation test with N=100000 and correction for multiple comparisons. Results with a p-value 0.05 of lower are considered significant— and are colored red or green based worse/better when read across the rows. The complete data from the testing is available at: https://people.xiph.org/~greg/Opus2011-Jan/OpusTest2011.xls (I'm posting it because I had the data from the statistical tests and easy web-hosting available) It's pretty self-explanatory— listeners on columns, samples on rows, totals driving graphs.
- Re: [codec] Jan Skoglund's Opus test results (NB/… Anisse Taleb
- [codec] Jan Skoglund's Opus test results (NB/WB/F… Gregory Maxwell
- Re: [codec] Jan Skoglund's Opus test results (NB/… Stephen Botzko
- Re: [codec] Jan Skoglund's Opus test results (NB/… Roman Shpount
- Re: [codec] Jan Skoglund's Opus test results (NB/… Paul Coverdale
- Re: [codec] Jan Skoglund's Opus test results (NB/… Benjamin M. Schwartz
- Re: [codec] Jan Skoglund's Opus test results (NB/… Benjamin M. Schwartz