Re: [rtcweb] Plan for MTI video codec?

Alexandre GOUAILLARD <agouaillard@gmail.com> Sun, 19 October 2014 18:46 UTC

Return-Path: <agouaillard@gmail.com>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A60141A1ADF for <rtcweb@ietfa.amsl.com>; Sun, 19 Oct 2014 11:46:46 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level:
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id U0pe-jRrPV4x for <rtcweb@ietfa.amsl.com>; Sun, 19 Oct 2014 11:46:42 -0700 (PDT)
Received: from mail-ob0-x22a.google.com (mail-ob0-x22a.google.com [IPv6:2607:f8b0:4003:c01::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5DA201A1AC9 for <rtcweb@ietf.org>; Sun, 19 Oct 2014 11:46:42 -0700 (PDT)
Received: by mail-ob0-f170.google.com with SMTP id uz6so2815395obc.15 for <rtcweb@ietf.org>; Sun, 19 Oct 2014 11:46:41 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=QF1+200+oUHLFoZNMTiM4aFf+hrKNH7aCottrSHMBf4=; b=efeyVM6QRHpLR157RC556F8KPHMfk164Km7ZkwctcsZHQKoi3shSzgpiySethPzb40 YSINVUqyvPDGBvXvaxtt2SvV5ZO+dp2PJ1kPxwjqCtIIdOboYql0CVzTuA7HJQJxodQ7 31CShQftllWrgXOdeET1uKeHzPfFqhdT/lZKj5I7ZoRJQUdELEHTY2B0TUURXPpEll9N CGD1QsPpVVEFQZqhv+cfVG2Fw65309Vel/ZYft3ZSkOLAJCN9RliMypArWca67XyuMYY 2TyPoiKHI507bHgY/Th9eyqAnjXpDE/V3inxe4aHWhMOTSX4kjPc+Td2HudFwaB500ih agWw==
MIME-Version: 1.0
X-Received: by 10.182.102.98 with SMTP id fn2mr19188031obb.15.1413744401598; Sun, 19 Oct 2014 11:46:41 -0700 (PDT)
Received: by 10.202.66.5 with HTTP; Sun, 19 Oct 2014 11:46:41 -0700 (PDT)
In-Reply-To: <CA+23+fG5R1C_40mi91+T1Ns+7xN0mZkgOB6L8aSq9DG-WrqbcA@mail.gmail.com>
References: <CAGTXFp-HVJDwd86207PNM2QVYO4Z_K4WF-KarnRs1fb7nvy4zA@mail.gmail.com> <CA+9kkMDfES8gpi0-PTXpCnQHjFYUSF2r44TNzH5B4UfDGo8PtA@mail.gmail.com> <CAGTXFp8O-7ACksk3v3f=KjCkcDb4e8G=t-e=EJ1503vt7TkpCQ@mail.gmail.com> <CAGTXFp867AMUZ_fEKxG9uAoR1H1AirVHi3-ayJ=KTQk9L+C7+g@mail.gmail.com> <CA+9kkMAZufR7gUrwkS7Tf5GOfg+ZtsZWGcn-8YLCvnmYnTgfFw@mail.gmail.com> <544035DE.8000606@matthew.at> <CABkgnnUNgWaauS6-nZ5fcExjsMPy4ZGPXaahduzA39=iqh9+fQ@mail.gmail.com> <D5D11F2B-9E32-4932-A601-F1D7FD50C706@gmail.com> <544117FB.6050706@alvestrand.no> <CAHgZEq6GTk5ei+LLpWPM5povpieompD66VU9F+u7--WJVgapaQ@mail.gmail.com> <CA+23+fGWnWd0QEeCmZ=6BmJkPrUVW6cZ0jwmXA+fM88=_+_NWw@mail.gmail.com> <CAOW+2dugTtfLhk0VuJOk7OPEonGBApMjY93EZocH90RbX6X22w@mail.gmail.com> <CAHgZEq5t4-Cot9XkU_pfyfi0TBCUxfT79ZvpiLW=X5_KUQh5dA@mail.gmail.com> <CA+23+fG5R1C_40mi91+T1Ns+7xN0mZkgOB6L8aSq9DG-WrqbcA@mail.gmail.com>
Date: Mon, 20 Oct 2014 02:46:41 +0800
Message-ID: <CAHgZEq4-tnM5fpgJjpVbJ+2d7T+e_EeSG_Y7KEGT1_VFDCNh+w@mail.gmail.com>
From: Alexandre GOUAILLARD <agouaillard@gmail.com>
To: Jonathan Rosenberg <jdrosen@jdrosen.net>
Content-Type: multipart/alternative; boundary=089e013c5d2cdc53cb0505cb049b
Archived-At: http://mailarchive.ietf.org/arch/msg/rtcweb/r_w5gEKHCGEngiouuM3YwrV_PGM
Cc: "rtcweb@ietf.org" <rtcweb@ietf.org>
Subject: Re: [rtcweb] Plan for MTI video codec?
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb/>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 19 Oct 2014 18:46:46 -0000

@watson

I would prefer the ISO process to see through before deciding. That's why I
keep bothering harald for news at every meeting ;-) If for any reason it
does not happen, we're back where we were when we did the last pool.
Nobody has sued .... yet, does not mean there is no IP risk. Actually,
there were at least 3 counts of nokia suing, but the three cases were
negotiated and the result is not available to the public. (here
<http://www.fosspatents.com/2013/05/nokia-files-third-patent-infringement.html>
)

@jonathan

Point taken, I hadn't thought about the implications of H264 hardware
acceleration. If indeed it leverages the need to get a license, that makes
the situation better. Would that be enough ...? We could map all the cases
and see what is left to be dealt with. In any case, deciding about 264
without looking at 265 seems shortsighted, and I am not aware of any
binary, or hardware acceleration support available for 265 yet (even though
iPhone 6 claims to supports 265 acc in its specs, I'm not aware of API that
would allow native app to leverage this capacity).

Correct me if I'm wrong or if I'm missing anything (anyone):

-- desktop browsers --
- firefox, let's assume the 264 binary is used. It also supports VP8.
- chrome on desktop supports vp8 but not 264 (as far as webrtc is
concerned, the media element supports 264 playback).
- what about IE / Safari ? I don't think apple will make a statement, but I
remember reading that microsoft would support 264 (at least for media
element playback) if it is available on the system. Bernard / shijun, any
comment about which codec would be used for ORTC/webRTC?

-- mobile browsers --
- no firefox on iOS. What about the android version, what does it support?
- chrome supports only VP8, and can't support webRTC on iOS anyway (even
though justin is working on a audio-only, API-injection-in-webkit solution).
- opera?

-- mobile native --
- iOS 8+ has system API for hw acc 264
- android has system API for both hw acc 264 and VP8 (is it true?)
- the webrtc.org stack does not support 264 even though kaiduan die from
blackberry provided a patch for this
- the ericson's openwebrtc stack supports 264 in multiple ways (does it
support hw acc?) but lack support for Windows and data channel.

-- Others --
- lots of MCUs / SFUs / Gateways would need 264 in more cases than just the
interoperability between webrtc and SIP, and I'm not sure the cisco
binaries can be used there.

On Mon, Oct 20, 2014 at 2:13 AM, Jonathan Rosenberg <jdrosen@jdrosen.net>
wrote:

> @Alexandre - you say "Today, nothing has changed with respect to those
> two items (even though providing open264 royalties and absorbing the
> license cost for some platforms might have been a set in the right
> direction). ". But, as you say, the availability of Firefox with H264 is a
> change (previously it was not yet available); the fact that Cisco has in
> fact fronted the cost is a change (at the last meeting some were skeptical
> this would happen, but it has). The other big news was IOS8, which now
> enables apps to access H264 and Apple pays the cost. Last time, the lack of
> a solution on IOS was a big deal. That is also now, no longer an issue. As
> such I think there are material changes.
>
>
> On Sun, Oct 19, 2014 at 12:13 PM, Alexandre GOUAILLARD <
> agouaillard@gmail.com> wrote:
>
>> @jonathan,
>>
>> while you are right and availability of 264 implementation or hardware
>> acceleration has improved, it has never been reported as a problem in the
>> previous pool by anyone. The 264 royalties, and the VP8 IP risks were,
>> AFAIR, the main reasons used by individuals to justify their positions.
>> Today, nothing has changed with respect to those two items (even though
>> providing open264 royalties and absorbing the license cost for some
>> platforms might have been a set in the right direction). This is why I
>> think the conditions are not met for a consensus to be reached.
>>
>> Alex.
>>
>>
>> On Sun, Oct 19, 2014 at 11:43 PM, Bernard Aboba <bernard.aboba@gmail.com>
>> wrote:
>>
>>> "And its one of the issues holding up wider adoption of the technology"
>>>
>>> [BA] Specifying an MTI encoder/decoder is not sufficient for
>>> interoperability.  It is also necessary to specify the transport in enough
>>> detail to allow independent implementations that interoperate well enough
>>> to be usable in a wide variety of scenarios, including wireless networks
>>> where loss is commonly experienced.
>>>
>>> We made the mistake of having an MTI discussion previously with not
>>> enough details on that subject, particularly with respect to H.264.
>>> draft-ietf-rtcweb-video sections 4.2 - 4.4 remain sketchy at best.
>>>
>>> So if we are to have the discussion again, it should occur in the
>>> context of detailed specifications and interoperability reports.
>>>
>>>
>>>
>>>
>>>
>>> On Sun, Oct 19, 2014 at 8:14 AM, Jonathan Rosenberg <jdrosen@jdrosen.net
>>> > wrote:
>>>
>>>> I'm in favor of taking another run at this.
>>>>
>>>> The working group has repeatedly said that an MTI codec is something we
>>>> need to produce. And its one of the issues holding up wider adoption of the
>>>> technology (not the only one for sure).
>>>>
>>>> And things have changed since the last meeting, a year ago now
>>>> (November in Vancouver). Cisco's open264 plugin shipped and now just
>>>> recently is integrated into Firefox. iOS8 shipped with APIs for H264. There
>>>> are other things worth noting. Will this change the minds of everyone?
>>>> Surely not. Will it sway enough for us to achieve rough consensus? Maybe.
>>>> IMHO - worth finding out.
>>>>
>>>> On Sat, Oct 18, 2014 at 5:08 PM, Alexandre GOUAILLARD <
>>>> agouaillard@gmail.com> wrote:
>>>>
>>>>> +1 to not having MTI codec discussion unless some progress has been
>>>>> made on VP8 at MPEG. Any news on that? I'm sharing harald's  feeling that
>>>>> there was no change on the members position.
>>>>>
>>>>> On Fri, Oct 17, 2014 at 9:22 PM, Harald Alvestrand <
>>>>> harald@alvestrand.no> wrote:
>>>>>
>>>>>> On 10/17/2014 12:02 AM, Bernard Aboba wrote:
>>>>>>
>>>>>>> One thing we could do instead of wasting time on MTI is to actually
>>>>>>> make progress on Sections 4.2 - 4.4 of draft-IETF-RTCWEB-video, so we could
>>>>>>> actually interoperate regardless of the codec.
>>>>>>>
>>>>>>
>>>>>> The big argument for an MTI is actually the one stated in -overview:
>>>>>> It guards against interoperability failure.
>>>>>>
>>>>>> I would like to have an ecosystem where one can field a box, connect
>>>>>> it to everything else, and run well for *some* level of "well" - and I
>>>>>> would prefer that ecosystem to be one where it's possible to field the box
>>>>>> without making prior arrangements with anyone about licenses.
>>>>>>
>>>>>> This argument hasn't changed one whit since last time we discussed
>>>>>> it. And I don't see much movement on the specifics of the proposals either.
>>>>>>
>>>>>> We'll have to interoperate well with the codecs we field. So using
>>>>>> some time to discuss draft-ietf-rtcweb-video seems to make sense. (And 4.1
>>>>>> isn't finished either. There's one sentence that needs to be removed.)
>>>>>>
>>>>>> I wouldn't say I'd be happy to not discuss this in Honolulu. But I'd
>>>>>> prefer to re-discuss based on the knowledge that some significant players
>>>>>> have actually changed their minds.
>>>>>>
>>>>>> At the moment, I don't see signs that any of the poll respondents
>>>>>> have said "I have changed my mind".
>>>>>>
>>>>>> Harald
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>  On Oct 16, 2014, at 2:28 PM, Martin Thomson <
>>>>>>>> martin.thomson@gmail.com> wrote:
>>>>>>>>
>>>>>>>>  On 16 October 2014 14:17, Matthew Kaufman <matthew@matthew.at>
>>>>>>>>> wrote:
>>>>>>>>> And that's because something substantive has changed, or simply
>>>>>>>>> because
>>>>>>>>> wasting the WG time on this again is more entertaining than
>>>>>>>>> actually
>>>>>>>>> finishing a specification that can be independently implemented by
>>>>>>>>> all
>>>>>>>>> browser vendors? (A specification that we are nowhere near having,
>>>>>>>>> as far as
>>>>>>>>> I can tell)
>>>>>>>>>
>>>>>>>> Personally, I've found the reprieve from this fight refreshing.  And
>>>>>>>> it would appear that we've made some real progress as a result.  I'd
>>>>>>>> suggest that if we don't have new information, we continue to spend
>>>>>>>> our time productively.  If we can't find topics to occupy our
>>>>>>>> meeting
>>>>>>>> agenda time, then maybe we can free an agenda slot.
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> rtcweb mailing list
>>>>>>>> rtcweb@ietf.org
>>>>>>>> https://www.ietf.org/mailman/listinfo/rtcweb
>>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> rtcweb mailing list
>>>>>>> rtcweb@ietf.org
>>>>>>> https://www.ietf.org/mailman/listinfo/rtcweb
>>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> rtcweb mailing list
>>>>>> rtcweb@ietf.org
>>>>>> https://www.ietf.org/mailman/listinfo/rtcweb
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Alex. Gouaillard, PhD, PhD, MBA
>>>>>
>>>>> ------------------------------------------------------------------------------------
>>>>> CTO - Temasys Communications, S'pore / Mountain View
>>>>> President - CoSMo Software, Cambridge, MA
>>>>>
>>>>> ------------------------------------------------------------------------------------
>>>>> sg.linkedin.com/agouaillard
>>>>>
>>>>>    -
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> rtcweb mailing list
>>>>> rtcweb@ietf.org
>>>>> https://www.ietf.org/mailman/listinfo/rtcweb
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Jonathan Rosenberg, Ph.D.
>>>> jdrosen@jdrosen.net
>>>> http://www.jdrosen.net
>>>>
>>>> _______________________________________________
>>>> rtcweb mailing list
>>>> rtcweb@ietf.org
>>>> https://www.ietf.org/mailman/listinfo/rtcweb
>>>>
>>>>
>>>
>>
>>
>> --
>> Alex. Gouaillard, PhD, PhD, MBA
>>
>> ------------------------------------------------------------------------------------
>> CTO - Temasys Communications, S'pore / Mountain View
>> President - CoSMo Software, Cambridge, MA
>>
>> ------------------------------------------------------------------------------------
>> sg.linkedin.com/agouaillard
>>
>>    -
>>
>>
>
>
> --
> Jonathan Rosenberg, Ph.D.
> jdrosen@jdrosen.net
> http://www.jdrosen.net
>



-- 
Alex. Gouaillard, PhD, PhD, MBA
------------------------------------------------------------------------------------
CTO - Temasys Communications, S'pore / Mountain View
President - CoSMo Software, Cambridge, MA
------------------------------------------------------------------------------------
sg.linkedin.com/agouaillard

   -