Re: [rtcweb] RTCWEB needs an Internet Codec

"Mandyam, Giridhar" <mandyam@quicinc.com> Fri, 31 August 2012 00:18 UTC

Return-Path: <mandyam@quicinc.com>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1E98F11E80D5 for <rtcweb@ietfa.amsl.com>; Thu, 30 Aug 2012 17:18:31 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -5.916
X-Spam-Level:
X-Spam-Status: No, score=-5.916 tagged_above=-999 required=5 tests=[AWL=0.683, BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id BUZYlEOfJ757 for <rtcweb@ietfa.amsl.com>; Thu, 30 Aug 2012 17:18:30 -0700 (PDT)
Received: from wolverine02.qualcomm.com (wolverine02.qualcomm.com [199.106.114.251]) by ietfa.amsl.com (Postfix) with ESMTP id 017EA11E80A2 for <rtcweb@ietf.org>; Thu, 30 Aug 2012 17:18:29 -0700 (PDT)
X-IronPort-AV: E=McAfee;i="5400,1158,6820"; a="229143444"
Received: from ironmsg04-l.qualcomm.com ([172.30.48.19]) by wolverine02.qualcomm.com with ESMTP; 30 Aug 2012 17:18:29 -0700
X-IronPort-AV: E=Sophos;i="4.80,344,1344236400"; d="scan'208";a="292449621"
Received: from nasanexhc12.na.qualcomm.com ([172.30.39.187]) by Ironmsg04-L.qualcomm.com with ESMTP/TLS/RC4-SHA; 30 Aug 2012 17:18:29 -0700
Received: from NASANEXD01H.na.qualcomm.com ([169.254.8.250]) by nasanexhc12.na.qualcomm.com ([172.30.39.187]) with mapi id 14.02.0318.001; Thu, 30 Aug 2012 17:18:29 -0700
From: "Mandyam, Giridhar" <mandyam@quicinc.com>
To: Jean-Marc Valin <jmvalin@mozilla.com>
Thread-Topic: [rtcweb] RTCWEB needs an Internet Codec
Thread-Index: AQHNhgORyuEFfQzQ3keG1dHHPO9QYpdypWyAgAAchICAAAO0AP//n3uwgADSpQD//6kqkA==
Date: Fri, 31 Aug 2012 00:18:28 +0000
Message-ID: <CAC8DBE4E9704C41BCB290C2F3CC921A162D2AF2@nasanexd01h.na.qualcomm.com>
References: <p06240603cc63f3f41ca9@[99.111.97.136]> <503F46C5.2090607@alvestrand.no> <EDC0A1AE77C57744B664A310A0B23AE240CBCCD8@FRMRSSXCHMBSC3.dc-m.alcatel-lucent.com> <503F61CC.1010709@alvestrand.no> <CAC8DBE4E9704C41BCB290C2F3CC921A162D278D@nasanexd01h.na.qualcomm.com> <503FC188.5050003@mozilla.com>
In-Reply-To: <503FC188.5050003@mozilla.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [10.64.139.227]
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Cc: "rtcweb@ietf.org" <rtcweb@ietf.org>
Subject: Re: [rtcweb] RTCWEB needs an Internet Codec
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 31 Aug 2012 00:18:31 -0000

> So because Opus is better except around 6 kb/s means that we have negotiation failure and that we should instead use G.711 at 64 kb/s?

I don't follow. If both parties in the call support a codec suitable for 6 kb/s (e.g. AMR-NB) then there should be no negotiation failure.  MTI still allows for non-MTI codecs to be used on a WebRTC call.  The point I was trying to make was that Opus does not satisfy the use case as specified.  I never said that G.711 satisfied this use case.  I believe it is unrealistic to require that the set of MTI audio codecs (whatever they may be) satisfy every single use case as currently outlined.  

> Also, keep in mind that browser-to-browser means RTP, which typically means 16 kb/s worth of overhead anyway (with 20 ms frames).

All the more reason to achieve toll quality at codec data rates below 8 kbps when operating in a cellular environment.  Just because there is substantial overhead for IP/UDP/RTP when compared to that for a circuit-switched call does not mean we shouldn't strive for the best quality at the lowest data rate.  Keep in mind that there are codecs that exhibit suitable performance at even lower data rates than AMR-NB (e.g. EVRC-B at approximately 4 kbps).  If we assume Opus has operate at 8 kbps to exhibit suitable voice quality (which still needs to be verified under codec performance testing as per industry standards), that is still a significant increase in required data rate even accounting for the IP/UDP/RTP header overhead.  Going from Opus at approx.. 8 kbps to EVRC-B at approx. 4 kbps gives near 20% savings in required bitrate even when considering 16 kbps overhead. This is a significant savings for cellular access.  

For any interested parties, EVRC-B characterization tests have been presented previously in the 3GPP2, e.g. the document "Characterization Test Report for EVRC-Release B" (A. Sharpley and I. Panzer, 3GPP2 Document 3GPP2- C11-20060327-015, March 27-31, 2006).

> If you want guaranteed good quality without Opus, you can also make AMR-NB, AMR-WB, G.722.1C, AAC-LD, HE-AAC, and AAC-LC all MTI. Then you'll have (on average) quality that's almost as good as Opus alone can do, you'll cover almost as many use cases, and as a bonus, you get all the negotiation and switching nightmares involved.

I've already stated my position on MTI audio codecs on this mailing list.  I never advocated making every codec that is optimal given a particular operating condition as MTI.  I also think the performance loss due to the use of Opus at sub 10 kbps is not trivial, and it is worth leveraging other codecs at these lower data rates. 

-----Original Message-----
From: Jean-Marc Valin [mailto:jmvalin@mozilla.com] 
Sent: Thursday, August 30, 2012 12:40 PM
To: Mandyam, Giridhar
Cc: Harald Alvestrand; DRAGE, Keith (Keith); rtcweb@ietf.org
Subject: Re: [rtcweb] RTCWEB needs an Internet Codec

On 12-08-30 03:13 PM, Mandyam, Giridhar wrote:
> The study available at
> http://research.nokia.com/files/public/%5B16%5D_InterSpeech2011_Voice_
> Quality_Characterization_of_IETF_Opus_Codec.pdf
> clearly shows a significant advantage in MOS scores at 5.9 kbps for 
> AMR-NB as compared to Opus (Silk).  The initial conclusion from my end 
> is that using Opus when cellular QoS support results in a guaranteed 
> bit rate less than 8 kbps would not result in the user being "able to 
> take advantage of the QoS support" as per the use case.

So because Opus is better except around 6 kb/s means that we have negotiation failure and that we should instead use G.711 at 64 kb/s?
Also, keep in mind that browser-to-browser means RTP, which typically means 16 kb/s worth of overhead anyway (with 20 ms frames). Even though Opus is not optimal at 6 kb/s, we still have something that works and we avoid interop failure. And what are the alternatives anyway? If we only decide on G.711, then we not only have embarrassingly bad quality, but we also have interop failure below 64 kb/s. If you want guaranteed good quality without Opus, you can also make AMR-NB, AMR-WB, G.722.1C, AAC-LD, HE-AAC, and AAC-LC all MTI. Then you'll have (on average) quality that's almost as good as Opus alone can do, you'll cover almost as many use cases, and as a bonus, you get all the negotiation and switching nightmares involved.

	Jean-Marc

> -----Original Message----- From: rtcweb-bounces@ietf.org 
> [mailto:rtcweb-bounces@ietf.org] On Behalf Of Harald Alvestrand Sent:
> Thursday, August 30, 2012 5:51 AM To: DRAGE, Keith (Keith) Cc:
> rtcweb@ietf.org Subject: Re: [rtcweb] RTCWEB needs an Internet Codec
> 
> On 08/30/2012 02:38 PM, DRAGE, Keith (Keith) wrote:
>> Surely that argument extends to every possible codec.
> The set of MTI codecs should cover the set of use cases that have been 
> identified. Additional MTI codecs that don't cover new use cases 
> shouldn't be added.
> 
> I believe the use case "distributed music band" in 
> draft-ietf-rtcweb-use-cases-and-requirements can't be satisified with 
> G.711.
> 
>> 
>> If the codecs supported by both endpoints do not supply the 
>> characteristics needed for the communication, then you will get 
>> interoperability failure.
>> 
>> If I want more bandwidth or quality than OPUS supplies, then I will 
>> also get interoperability failure.
>> 
>> Keith
>> 
>>> -----Original Message----- From: rtcweb-bounces@ietf.org 
>>> [mailto:rtcweb-bounces@ietf.org] On Behalf Of Harald Alvestrand
>>> Sent: 30 August 2012 11:56 To: rtcweb@ietf.org Subject: Re:
>>> [rtcweb] RTCWEB needs an Internet Codec
>>> 
>>> The counterpoint is that having G.711 as the only MTI means that you 
>>> get interoperability failure for any application in which
>>> G.711 sound quality is not acceptable.
>>> 
>>> This includes all applications involving music.
>>> 
>>> On 08/29/2012 06:30 PM, Randall Gellens wrote:
>>>> At 12:13 AM -0400 8/29/12, Roman Shpount wrote:
>>>> 
>>>>> I would argue G.711 should be the MTI codec. The rest can be left 
>>>>> up to browser implementers.
>>>> I agree.
>>>> 
>>>>> We can argue all we want, but the best royalty free low bitrate 
>>>>> codec available will be the one everybody supports.
>>>> Very good point, and why we should mandate only one audio codec.
>>>> 
>>> _______________________________________________ rtcweb mailing list 
>>> rtcweb@ietf.org https://www.ietf.org/mailman/listinfo/rtcweb
> 
> _______________________________________________ rtcweb mailing list 
> rtcweb@ietf.org https://www.ietf.org/mailman/listinfo/rtcweb
> _______________________________________________ rtcweb mailing list 
> rtcweb@ietf.org https://www.ietf.org/mailman/listinfo/rtcweb
>