Re: [rtcweb] A different perspective on the video codec MTI discussion

Ben Strong <ben@vline.com> Thu, 14 March 2013 16:24 UTC

Return-Path: <ben@vline.me>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B3A7A11E80B8 for <rtcweb@ietfa.amsl.com>; Thu, 14 Mar 2013 09:24:43 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.977
X-Spam-Level:
X-Spam-Status: No, score=-1.977 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, FM_FORGED_GMAIL=0.622, HTML_MESSAGE=0.001, NO_RELAYS=-0.001]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6IOgWLajcutU for <rtcweb@ietfa.amsl.com>; Thu, 14 Mar 2013 09:24:39 -0700 (PDT)
Received: from mail-wi0-x22c.google.com (mail-wi0-x22c.google.com [IPv6:2a00:1450:400c:c05::22c]) by ietfa.amsl.com (Postfix) with ESMTP id 4C84F21F8F2F for <rtcweb@ietf.org>; Thu, 14 Mar 2013 09:24:38 -0700 (PDT)
Received: by mail-wi0-f172.google.com with SMTP id ez12so3969352wid.17 for <rtcweb@ietf.org>; Thu, 14 Mar 2013 09:24:37 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :x-gm-message-state; bh=wbJgRpCVEoXQ+tFkDoBkl3BZF2kYTOlfyUmXg9xYceY=; b=hErJMcnxOOGDcUx5vTMvOLbobeA3bkF0/cf0c4N0jw5BOv/PBzKQM5s8qazSvhj1Ke FkkMnU5gIUVfGANbguEWS6x6s8X8oLlBHJT+wS8inIMpRj0mjfLfX3sBrdn8gMUap/dn UABpuF0KBg/aPKLwEG9FNeHrZB6p6tisQDNoMvANTaZ/lkmxxOpxk55n7MNQ1qakjUab 78ft3p4I6kNzwFpVNc66Gv3h+REWAi0+axN3zDA1HpOe33no7euxdiW0YBvKwtvzrOuV KHsb+uOTIdRKyjg+TU3rQh//S8/irTp38KhULy+ELNQOmGXgLjtT7+Z7FLX5xVl/+jeP 3y5g==
MIME-Version: 1.0
X-Received: by 10.180.189.169 with SMTP id gj9mr5324834wic.5.1363278277127; Thu, 14 Mar 2013 09:24:37 -0700 (PDT)
Sender: ben@vline.me
Received: by 10.227.8.226 with HTTP; Thu, 14 Mar 2013 09:24:36 -0700 (PDT)
In-Reply-To: <CA+23+fE3WRs5SxAUcsjWbxcjzQKxCtW7sdfHtAsbd7MbPyHAtQ@mail.gmail.com>
References: <CA+23+fE3WRs5SxAUcsjWbxcjzQKxCtW7sdfHtAsbd7MbPyHAtQ@mail.gmail.com>
Date: Thu, 14 Mar 2013 11:24:36 -0500
X-Google-Sender-Auth: 9zzXjlhCo3tpLOyN1MumTuL9AuU
Message-ID: <CAEWS6TJPKXdf7i140wKMZFHBcSVBtCxwzViWYYFgL01D=LdmEg@mail.gmail.com>
From: Ben Strong <ben@vline.com>
To: "rtcweb@ietf.org" <rtcweb@ietf.org>
Content-Type: multipart/alternative; boundary="001a11c34a627044b504d7e4f526"
X-Gm-Message-State: ALoCoQnnMrpTMLZCBhNLCTU+BQhRo86Te7o+/sbHPiEICr0bxly8J+wZpAsZsPV7p9WxjvhMlHlV
Subject: Re: [rtcweb] A different perspective on the video codec MTI discussion
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 14 Mar 2013 16:26:08 -0000

I've been talking to developers who are interested in building WebRTC apps
regularly for the past year and have drawn the opposite conclusion about
their preferences.

Before going into what they want and why, let me give you a flavor of who
I'm talking to: These are primarily inbound contacts who are interested in
the vLine WebRTC platform. I think they're pretty representative of the
non-legacy use-cases for WebRTC, but almost certainly under-represent the
existing enterprise market.

* Over half are building apps for healthcare or education. I'd say it's a
pretty even split between those categories, and within each category it's a
pretty even split between startups and more established organizations.
Non-profits make up a substantial fraction of both groups.

* Over half are outside the US, with most of the international interest
coming from developing countries (e.g., India, Brazil, and China).

* Not one of them has been interested in enabling video for customer
service calls (though a number have been interested in voice). I mention
this because it's frequently cited as an important use-case and I expected
it to be an important market for us, but I'm beginning to wonder if
businesses actually want this. I'll admit that those who _are_ interested
are more likely to be talking to Jonathan than to me, so take this with a
grain of salt.

* A sampling of other apps people are building: translation services (both
for foreign languages and sign language), social commerce services, and
social apps with all sorts of interesting new interaction models.

Here's what I've heard from them:

* The only questions I have ever gotten about interop with legacy equipment
are in regard to voice. I do occasionally talk to people with existing
investments in video conferencing systems, but they are mostly interested
in moving away from them (huge sample bias here, of course).

* Very rarely does the subject of codecs come up other than the context of
whether the browsers will all interoperate. The only concerns I ever hear
about VP8 quality are from people who haven't actually used WebRTC in
Chrome. The feedback I get from people who have used it is consistently
that they are surprised by how good the video quality is.

* All of them care about having a good mobile experience and
do occasionally express concerns about the battery life and performance
impact of software codecs.

* _Everyone_ is concerned about cross-browser interoperability. It is far
and away the biggest concern I hear about WebRTC, and I can't remember the
last time it didn't come up in a conversation with a customer.

Finally, here's my take on it all:

>From a power and performance point of view, H.264 is undoubtedly a better
option on devices with a hardware codec for it. Implementations on those
devices should by all means support it and attempt to negotiate it.
Implementations on other platforms where it is feasible to support it,
either because the implementation vendor has a license or the OS includes
it, should by all means support it as well, for the sake of allowing mobile
devices with a hardware codec to use it whenever possible.

I'm happy to grant that H.264 is technically superior to VP8 in every way
(though I think the differences are negligible in real-world use). By all
means implementations that wish to should attempt to negotiate it for that
reason, as well.

However, I fail to see how either one of those points has any bearing on
the MTI decision. The whole point of MTI is guaranteed interoperability
across all WebRTC implementations, which is absolutely critical to WebRTC
adoption. The only criteria should be the best quality codec which can be
supported by all implementations. And because some implementations are open
source, it absolutely must be royalty free.

I've already gone on too long here, but I want to make one final point on
open source. There are two new mobile platforms that have the potential to
drive innovation around mobile apps in general and the mobile web in
particular, and both are open source: FirefoxOS and Ubuntu Mobile. Neither
will be able to be WebRTC compatible unless a royalty-free codec is chosen.

I would argue that FirefoxOS and Ubuntu should be of special concern to the
working group for three reasons: 1) They support web apps as first class
citizens. Since the main goal of WebRTC is to make it possible to build
rich apps entirely with web technologies, I would hope that the innovators
in that arena will be able to support it. 2) I expect that some of the
areas where WebRTC will have the biggest impact (e.g., telemedicine in
rural India) will be most concerned about using a low-cost, open source
platform. 3) Even without every being market-share leaders, open source
platforms tend to drive innovation across the whole market. The best
example of this is how Firefox kickstarted a decade of innovation in
browsers and web apps. I have high hopes that FirefoxOS will do the same.

Adopting a codec that will more firmly entrench legacy providers at the
expense of some of the most innovative new platforms out there seems like a
bad trade-off to me.

Ben

[this post will probably need moderator approval, so apologies if it shows
up after the conversation has moved on]

--
Ben Strong
ben@vline.com



On Wed, Mar 13, 2013 at 5:06 PM, Jonathan Rosenberg <jdrosen@jdrosen.net>wrote:

> I’d like to put a different perspective on the video MTI discussion.
>
> Much of the discussion has been around video quality, IPR, and
> standardization status. While those are all important factors, to me they
> are secondary to the core question: how does the choice impact uptake of
> the webRTC APIs and protocols by developers who build applications ontop of
> it? In this regard, I would like to suggest that, at this time, adoption of
> VP8 as MTI will slow down adoption of webRTC by turning off developers that
> would otherwise embrace it if H.264 were selected.
>
> The reason is simple. For many application developers, what is interesting
> about webRTC is NOT just browser to browser communications, but connecting
> users in a browser to users elsewhere - on other devices, in other
> networks. After all, the vast majority of web application developers do not
> have the luxury of a massive social graph, or the luxury of their users
> being parked persistently on their website and thus able to receive an
> incoming call. Many websites that have customer support or service needs
> would love to be able to allow their users to have a video call with an
> agent. However, those agents are probably sitting on existing agent systems
> which are not web based, and it’s almost certainly true that they do not
> today support VP8, but rather H.264. Many developers would probably love to
> connect users on the web with users on mobile apps. Most mobile platforms
> today support H264 based hardware acceleration for decode and sometimes
> encode, but not yet VP8. Developers who want to build business
> communications clients will need to connect those users with other users in
> the business, who may be using videophones, PC clients, telepresence units
> or video room systems, the vast majority of which do not support VP8 today,
> but many of which do support H.264.
>
> The reality is – today’s Internet and IP communications systems are built
> on H.264. And unless the developer cares only about living within the
> island of the web browser – a VP8 based solution will simply not meet their
> requirements.
>
> This may not be true down the road. I applaud Google for working hard (and
> spending much money no doubt) to secure an RF license for VP8 from these
> patent holders. I think they should continue pushing and promoting the
> technology because a  free, high quality video codec would be great for the
> Internet. But today, it is not the video codec of the Internet. And, given
> the relatively early days of video, I am sure there will be video codecs
> after VP8. Maybe H.265, maybe the new video codec being developed here at
> the IETF. And once those codecs become more broadly implemented and
> available on the endpoints that matter, we can revise our specs and mandate
> support for them. But this is not about the web of five years from now, its
> about the web today. And if we mandate usage of a codec which is not widely
> implemented in all the endpoints that matter (not just the browser), I fear
> that it will hold developers back from using webRTC and thus prevent us
> from ever having the opportunity to add these video codecs in the future.
>
>
>
> And so – to the supporters of VP8 – I applaud your efforts and thank you
> for them. Please continue. And when the industry is ready, we can make VP8
> MTI in the browser. But we are not there yet.  I ask you to please put the
> needs of the developers ahead of your own, and do not hold back webRTC for
> the benefit of your ideals around an RF and open source video codec. WebRTC
> is too important for that.
>
> I have one more thing to say - speaking now as a developer.
>
> As some of you may know, I recently returned to Cisco as CTO of the cloud
> collaboration group, which is responsible for Webex. Webex was one of the
> first services to do voice and video on the web, using plugins of course.
> For our business, a key requirement is interoperability with other video
> systems in the Cisco portfolio, including our video clients and
> telepresence units. Those are all based on H.264. Consequently, much as I
> would like to avoid the need for a plugin, the benefits of eliminating the
> plugin do not outweigh the drawbacks of having to transcode from VP8 to
> H.264. If IETF selects VP8 as the MTI codec, this will make it dramatically
> more difficult and expensive for us to use webRTC. If H.264 is the MIT
> codec, it will make it much easier for us to use webRTC.
>
>
> Thx,
>
> Jonathan R.
> --
> Jonathan Rosenberg, Ph.D.
> jdrosen@jdrosen.net
> http://www.jdrosen.net
>
> _______________________________________________
> rtcweb mailing list
> rtcweb@ietf.org
> https://www.ietf.org/mailman/listinfo/rtcweb
>
>