Re: [codec] Opus comparision test plan

Paul Coverdale <coverdale@sympatico.ca> Wed, 17 April 2013 14:30 UTC

Return-Path: <coverdale@sympatico.ca>
X-Original-To: codec@ietfa.amsl.com
Delivered-To: codec@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 251D321F8A48 for <codec@ietfa.amsl.com>; Wed, 17 Apr 2013 07:30:11 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.796
X-Spam-Level:
X-Spam-Status: No, score=-1.796 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, MSGID_FROM_MTA_HEADER=0.803]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jZmi8TOHuOJr for <codec@ietfa.amsl.com>; Wed, 17 Apr 2013 07:30:10 -0700 (PDT)
Received: from blu0-omc2-s33.blu0.hotmail.com (blu0-omc2-s33.blu0.hotmail.com [65.55.111.108]) by ietfa.amsl.com (Postfix) with ESMTP id 83A0921F8A11 for <codec@ietf.org>; Wed, 17 Apr 2013 07:30:10 -0700 (PDT)
Received: from BLU0-SMTP59 ([65.55.111.71]) by blu0-omc2-s33.blu0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Wed, 17 Apr 2013 07:30:10 -0700
X-EIP: [N9U3YpHvjw09+guzvRm65J/ZPLRWF0zq]
X-Originating-Email: [coverdale@sympatico.ca]
Message-ID: <BLU0-SMTP595C8D71BCF131AE61A132D0CE0@phx.gbl>
Received: from PaulNewPC ([70.54.91.213]) by BLU0-SMTP59.phx.gbl over TLS secured channel with Microsoft SMTPSVC(6.0.3790.4675); Wed, 17 Apr 2013 07:30:07 -0700
From: Paul Coverdale <coverdale@sympatico.ca>
To: 'Jean-Marc Valin' <jmvalin@mozilla.com>
References: <016f01ce3a76$14577170$3d065450$@uni-tuebingen.de> <516D9A20.6060508@jmvalin.ca> <BLU0-SMTP8054D9BBD9A419B8716D06D0CD0@phx.gbl> <516DEF77.9050804@mozilla.com>
In-Reply-To: <516DEF77.9050804@mozilla.com>
Date: Wed, 17 Apr 2013 10:30:03 -0400
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Mailer: Microsoft Office Outlook 12.0
Thread-Index: Ac47BC63AU5VA7vKQ128GxnSsixFrQAbvJnA
Content-Language: en-us
X-OriginalArrivalTime: 17 Apr 2013 14:30:07.0973 (UTC) FILETIME=[0F55F950:01CE3B78]
Cc: codec@ietf.org, patrick.schreiner@symonics.com
Subject: Re: [codec] Opus comparision test plan
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Apr 2013 14:30:11 -0000

>MUSHRA is actually the least time-consuming...


This isn't what my colleagues in ITU-T and 3GPP, who are heavily involved in
codec subjective testing, are telling me. Typically, you can only test about
12 conditions at a time.

...Paul