[codec] Tübingen Test plan

"Christian Hoene" <hoene@uni-tuebingen.de> Sun, 14 August 2011 13:21 UTC

Return-Path: <hoene@uni-tuebingen.de>
X-Original-To: codec@ietfa.amsl.com
Delivered-To: codec@ietfa.amsl.com
Received: from localhost (localhost []) by ietfa.amsl.com (Postfix) with ESMTP id 76B8621F87C9 for <codec@ietfa.amsl.com>; Sun, 14 Aug 2011 06:21:37 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.433
X-Spam-Status: No, score=-4.433 tagged_above=-999 required=5 tests=[AWL=-1.236, BAYES_50=0.001, HELO_EQ_DE=0.35, HTML_MESSAGE=0.001, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_MED=-4, SARE_SUB_ENC_UTF8=0.152]
Received: from mail.ietf.org ([]) by localhost (ietfa.amsl.com []) (amavisd-new, port 10024) with ESMTP id nqkAkEsejDig for <codec@ietfa.amsl.com>; Sun, 14 Aug 2011 06:21:36 -0700 (PDT)
Received: from mx05.uni-tuebingen.de (mx05.uni-tuebingen.de []) by ietfa.amsl.com (Postfix) with ESMTP id B813621F87D6 for <codec@ietf.org>; Sun, 14 Aug 2011 06:21:35 -0700 (PDT)
Received: from hoeneT60 (u-080-c007.eap.uni-tuebingen.de []) (authenticated bits=0) by mx05.uni-tuebingen.de (8.13.6/8.13.6) with ESMTP id p7EDMGl9026637 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO) for <codec@ietf.org>; Sun, 14 Aug 2011 15:22:16 +0200
From: "Christian Hoene" <hoene@uni-tuebingen.de>
To: <codec@ietf.org>
Date: Sun, 14 Aug 2011 15:22:21 +0200
Organization: =?UTF-8?Q?Universit=C3=A4t_T=C3=BCbingen?=
Message-ID: <000001cc5a85$332ae0a0$9980a1e0$@uni-tuebingen.de>
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="----=_NextPart_000_0001_01CC5A95.F6BAB580"
X-Mailer: Microsoft Outlook 14.0
Thread-Index: AcxahSx4ldUEwItERKKaAC82tjo5Rg==
Content-Language: de
X-AntiVirus: NOT checked by Avira MailGate (version:; host: mx05)
Subject: [codec] =?utf-8?q?T=C3=BCbingen_Test_plan?=
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 14 Aug 2011 13:21:37 -0000



I was compiling the following tests plan for Tuesday.

Any comments and hint to improve the test plan?


With best regards,





Testplan for MUSHRA Listening Tests 
Focusing on a Conferencing Scenario

Mansoor Hyder, Christian Hoene
Universität Tübingen
14. August 2011

Test setup

MUSHRA tests following the recommendation ITU-R BS 1584.1 will take place on August 16th, from 9:00 till 19:00 in the office B303/B304 at the building Sand 13 in 72076 Tübingen.


Tests will be done with Sennheiser HD 280 pro headphones, a PC and the software „RateIt“ version 0.1.


Twenty participants have been selected from employees and students of the University of Tübingen. They have well to very good hearing abilities. Participant will receive soft drinks and/or coffee and 8 € compensation. 


Each session will last at most 60 minutes. This includes 15 to 20 minutes for explaining and practicing the tests, 25 to 30 minutes of testing, and 5 to 10 minutes of interviewing and farewell.


In total, 40 stimuli will be tested (in addition to the references).

Test stimuli

The focus of the stimuli is on a conferencing scenario, in which multiple persons speak at the same time. Only stereo test stimuli will be taken and only stereo coding modes will be tested.

Five different reference samples will be taken:

1.       A female German (¼ right channel, ¾ left channel)

2.       Two female voice (¼ right/left channel, ¾ left/right channel)

3.       One female voice, panning moving

4.       Two female voices, panning, rendered with a HRTF

5.       Music (Suzanne Vega singing or similar)

The following codec and codec modes will be tests

1.       Opus, Silk mode, stereo, high complexity, 20ms frame size, at 16 kbps.

2.       Opus, Hybrid mode, stereo, high complexity, 20ms frame size, at 32 kbps

3.       Opus, Celt mode, high complexity, stereo, 20ms frame size at 64 kbps

4.       Opus, Celt mode, high complexity, stereo, 5ms frame size, at 96 kbps

5.       G.719, stereo, at 2x48 kbps

6.       AMR-WB+, stereo, at 2x7,95 kbps

7.       AMR-WB+, stereo, at 2x15,85 kbps

8.       TBD, stereo at 64 kbits, 20ms frame size

In total, 5x8=40 stimuli are going to be tested.





Dr.-Ing. Christian Hoene, University of Tübingen, Computer Science, Chair of

Communication Networks, Research Group Interactive Communication Systems (ICS)

Sand 13, 72076 Tübingen, Germany, Tel +49 7071 2970532, www.net.uni-tuebingen.de