Re: [rtcweb] Asymmetric codecs

"Mo Zanaty (mzanaty)" <mzanaty@cisco.com> Mon, 25 November 2013 16:13 UTC

Return-Path: <mzanaty@cisco.com>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 36E871ADF77 for <rtcweb@ietfa.amsl.com>; Mon, 25 Nov 2013 08:13:08 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.501
X-Spam-Level:
X-Spam-Status: No, score=-9.501 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9dpHa8dGe-Dq for <rtcweb@ietfa.amsl.com>; Mon, 25 Nov 2013 08:13:05 -0800 (PST)
Received: from alln-iport-8.cisco.com (alln-iport-8.cisco.com [173.37.142.95]) by ietfa.amsl.com (Postfix) with ESMTP id 3A9DD1ADF50 for <rtcweb@ietf.org>; Mon, 25 Nov 2013 08:13:05 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=17241; q=dns/txt; s=iport; t=1385395985; x=1386605585; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=SRzoKkHnVRCjN7SI0Rt66mIP2+u41sxaZ3GCJuPqfSQ=; b=F+zFMHVFElOdakjxEw9wlJAUKI3VmbbzBe8CiTJHsSuBgcJvudQ8PcAN Gk3R62Nz9woUQw8PGa1hi4HI2N2fI0xiGIRFU713uvQXVP5hffSFjBZGg MzTVPDrov4FLNJ/0R6bsIffNJhVlc2jEdGDF3QzrA5zjxkgvhyFkmVoOt Q=;
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: Aq8GAFB2k1KtJXG8/2dsb2JhbABZgkNEOFOzV4hPgSoWdIIlAQEBBC1MEAIBCBEEAQEoByERFAkIAgQBDQUJEodUAw8NtV8NiAkXjHiBPgEBTwYBhDMDlimBa4EwiyqFOIMogXE5
X-IronPort-AV: E=Sophos;i="4.93,768,1378857600"; d="scan'208,217";a="2066396"
Received: from rcdn-core2-1.cisco.com ([173.37.113.188]) by alln-iport-8.cisco.com with ESMTP; 25 Nov 2013 16:13:05 +0000
Received: from xhc-aln-x05.cisco.com (xhc-aln-x05.cisco.com [173.36.12.79]) by rcdn-core2-1.cisco.com (8.14.5/8.14.5) with ESMTP id rAPGD5dm002247 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=FAIL); Mon, 25 Nov 2013 16:13:05 GMT
Received: from xmb-rcd-x14.cisco.com ([169.254.4.50]) by xhc-aln-x05.cisco.com ([173.36.12.79]) with mapi id 14.03.0123.003; Mon, 25 Nov 2013 10:13:04 -0600
From: "Mo Zanaty (mzanaty)" <mzanaty@cisco.com>
To: Christer Holmberg <christer.holmberg@ericsson.com>, Martin Thomson <martin.thomson@gmail.com>, "Paul Giralt (pgiralt)" <pgiralt@cisco.com>
Thread-Topic: Asymmetric codecs
Thread-Index: AQHO6fk4srko9WvZvkKiVv6I72CdiA==
Date: Mon, 25 Nov 2013 16:13:04 +0000
Message-ID: <CEB8D9AC.1F15E%mzanaty@cisco.com>
References: <CEB676E0.1ED44%mzanaty@cisco.com> <7594FB04B1934943A5C02806D1A2204B1C55441B@ESESSMB209.ericsson.se>
In-Reply-To: <7594FB04B1934943A5C02806D1A2204B1C55441B@ESESSMB209.ericsson.se>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/14.3.9.131030
x-originating-ip: [10.150.30.48]
Content-Type: multipart/alternative; boundary="_000_CEB8D9AC1F15Emzanatyciscocom_"
MIME-Version: 1.0
Cc: "rtcweb@ietf.org" <rtcweb@ietf.org>
Subject: Re: [rtcweb] Asymmetric codecs
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb/>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 25 Nov 2013 16:13:08 -0000

Re: MTI, I don’t think asymmetric codecs will solve all the MTI issues. However, it may solve some practical deployment issues regardless of MTI decisions. If products have a decoder but no encoder, it may help to express that. For example, Chrome can expose its H.264 decoder for webrtc despite no encoder. Hardware products can expose their VP8 decoder for webrtc despite no encoder.

Re: SDP, if you want asymmetric codecs over the same port, is it ok to mandate bundle to achieve this? I started with a single sendrecv m-line with all payload types that can be decoded but not necessarily encoded, as Justin suggested. That would not require bundle. However, it gets ugly when adding extra signaling for which payload types can’t be encoded and multiple O/A rounds for interop with arbitrary peers. The complexity approached bundle, so I ended up with separate sendonly/recvonly m-lines, as Martin suggested.

On 11/25/13, 2:24 AM, Christer Holmberg <christer.holmberg@ericsson.com<mailto:christer.holmberg@ericsson.com>> wrote:
Hi,
First, from a pure MTI codec perspective, the question is whether usage of asymmetric codecs would solve the issues that people have.
Second, from an SDP OA/BUNDLE perspective, I don’t think we can mandate usage of BUNDLE. And, even if we did, in the initial Offer you still need to assign unique port values for each m- line (as agreed in Vancouver).
…unless, of course, you assign an SDP ‘bundle-only’ attribute to all m- lines with asymmetric codecs.
Regards,
Christer

From: Mo Zanaty (mzanaty) [mailto:mzanaty@cisco.com]
Sent: 25. marraskuuta 2013 4:11
To: Christer Holmberg; Martin Thomson; Paul Giralt (pgiralt)
Cc: rtcweb@ietf.org<mailto:rtcweb@ietf.org>
Subject: Asymmetric codecs

I started a draft on how to standardize support for asymmetric codecs back in September. The primary motivation was decoding H.264 and H.265 while only encoding H.264. A secondary motivation, for rtcweb, was decoding H.264 and VP8 while only encoding one of them, as Stefan mentioned. I thought it would be a trivial thing to write up by the Oct. 6 deadline for MTI proposals. The draft is still incomplete and unpublished because all solutions are ugly and overly complex for something so seemingly trivial, just like bundle and unified plan. I now sympathize with Christer and Adam for how they arrived at those (not exactly elegant) solutions, and agree with Martin that a pair of (bundled) m-lines is the most viable (although not exactly elegant) solution for asymmetric codecs.

RFC 4317 drafts originally included asymmetric codecs until they were removed in draft 02:
http://tools.ietf.org/rfcdiff?difftype=--hwdiff&url2=draft-ietf-mmusic-offer-answer-examples-02.txt

They were removed for fear of issues with shared ports:
http://www.ietf.org/mail-archive/text/mmusic/2003-09.mail

Now that we (almost) have bundle, can we resurrect asymmetric codecs with separate sendonly and recvonly m-lines? Are folks ok with a dependency on bundle? I would be happy to complete a draft in that direction. (That is, a general mmusic draft on asymmetric codecs, not a rtcweb draft on MTI asymmetric codecs. I will move the discussion to mmusic after getting rtcweb opinions first.)

Some may consider this a bizarre corner case. However, for hardware codecs, it is the norm not the exception to have asymmetric encoder and decoder formats. Especially for new formats, which usually appear in hardware decoders well before hardware encoders are available. This happened for H.264, H.265, VP8, and virtually every popular codec format in virtually every popular chipset.

Mo

On 11/23/13, 9:09 AM, Christer Holmberg <christer.holmberg@ericsson.com<mailto:christer.holmberg@ericsson.com>> wrote:
Like some others, I think the must-decode-both-must-endcode-one alternative as such sounds interesting (whether it has any impact on the licence/IPR issues I'll leave to others to speak for). However, I have big concerns over the proposal to indicate sendrecv for a codec even if an entity is only able to receive/decode it. … Usage of unidirectional, sendonly/recvonly, m- line would of course solve this, and you might know that it is one option we are discussing in CLUE (for other reasons than MTI codec, though).

On 22 November 2013 16:20, Paul Giralt (pgiralt) <pgiralt@cisco.com<mailto:pgiralt@cisco.com>> wrote:
I gave this as an example of a possible way to do it, but that means you need two separate m= lines - one for send and one for receive. Seems strange to do this for something that you really want to be a single bi-directional stream.

On 11/22/13, 8:03 PM, Martin Thomson <martin.thomson@gmail.com<mailto:martin.thomson@gmail.com>> wrote:
The bidirectional thing in O/A is the strange way to do things.  Two lines is pretty intuitive.