Re: [MMUSIC] New Version Notification for draft-abhishek-mmusic-superimposition-grouping-00.txt

Paul Kyzivat <pkyzivat@alum.mit.edu> Thu, 14 January 2021 17:25 UTC

Return-Path: <pkyzivat@alum.mit.edu>
X-Original-To: mmusic@ietfa.amsl.com
Delivered-To: mmusic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0A5643A1639 for <mmusic@ietfa.amsl.com>; Thu, 14 Jan 2021 09:25:15 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.263
X-Spam-Level:
X-Spam-Status: No, score=-2.263 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, NICE_REPLY_A=-0.262, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=alum.mit.edu
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id QEe0TwFcmoIQ for <mmusic@ietfa.amsl.com>; Thu, 14 Jan 2021 09:25:09 -0800 (PST)
Received: from NAM10-BN7-obe.outbound.protection.outlook.com (mail-bn7nam10on2051.outbound.protection.outlook.com [40.107.92.51]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 206033A1623 for <mmusic@ietf.org>; Thu, 14 Jan 2021 09:25:08 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=mO4GDU0N0iEPMeT4IZD5j0jwju1JFpCzQ8H3St8wHEGzij8KwXzSvzkCZH4QHxZXeqwJ+IqhqG1EWD4D4XGWkmqlaeav4FNxgVOgYTeY1BtK9PkK6ghBnI3lFJ7TT/tmZ94FrmvAKud/X4N1c6q7Yj7C7yta+jeu7Mk91N+AX6qvy7hnkizgVr6f5uuq0j/K2RuD92XqhPI0nZMz4UzDwB6W4G07/cmBf1zwYLJxaDJy0bgmUn21N3yJZ4Gx9RUtRZKZfyj0SEWEWBaN4cibmxG+st8g557IGTOBYnEd34POM/Z5h1wjNt13od1rtU0po8P97WmbITOWAkfHn5+Qwg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9U2Iyk13LjtEzetSb+i+CEsiGIZFy1COp5GRAZIUUYE=; b=YqCbQudb9jt+uPiQYkB7TcnLdzfuKYny5uwnJlwiCmuUrVZXf2BW98AjkxQiARCj3E5pN1vZVM331elS5RNrz9DbD+nxTNN0rFkmRAIU2NUvo7mGLp3RPCf75aHcJ0+KvZdHGElH3Z9TzrFuXQezFdMAzqEcjLrsGnlh4Y86H9venYqchNXGisd6LmYREEJCTrKx6PrO4+W2pFuevUnkLAr7ddroyPCZLev2Zxl+xVG+rcDCHWON6WXZg7JQMOw205iMF4NJche6m8/c4R4x2KfiA7RbjSwoKsLQFOyFACIeR/nx1ldJ/OLPXHpAjWmb2qVZt4u2NZDRCPI3P/G9tQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 18.7.68.33) smtp.rcpttodomain=ietf.org smtp.mailfrom=alum.mit.edu; dmarc=bestguesspass action=none header.from=alum.mit.edu; dkim=none (message not signed); arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=alum.mit.edu; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9U2Iyk13LjtEzetSb+i+CEsiGIZFy1COp5GRAZIUUYE=; b=bZi0odGrrBEGgk9r9BdWWHEV39HTeHTAwb71sAnh5zduKuP1eBVKfWgs5NKEGuOnfPZ6aeLXUJUoFIcVeEeqUAgKP7bQ1mC8AdUXemPKvdikODDDXZUzHRJPzDJh9nF1kKawKbYk17i0FiuoJ9+ZeI86G5H8AJz9wbeyoVne288=
Received: from SN6PR01CA0008.prod.exchangelabs.com (2603:10b6:805:b6::21) by SN6PR12MB2640.namprd12.prod.outlook.com (2603:10b6:805:6c::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3742.6; Thu, 14 Jan 2021 17:25:07 +0000
Received: from SN1NAM02FT059.eop-nam02.prod.protection.outlook.com (2603:10b6:805:b6:cafe::58) by SN6PR01CA0008.outlook.office365.com (2603:10b6:805:b6::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3763.9 via Frontend Transport; Thu, 14 Jan 2021 17:25:07 +0000
X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 18.7.68.33) smtp.mailfrom=alum.mit.edu; ietf.org; dkim=none (message not signed) header.d=none;ietf.org; dmarc=bestguesspass action=none header.from=alum.mit.edu;
Received-SPF: Pass (protection.outlook.com: domain of alum.mit.edu designates 18.7.68.33 as permitted sender) receiver=protection.outlook.com; client-ip=18.7.68.33; helo=outgoing-alum.mit.edu;
Received: from outgoing-alum.mit.edu (18.7.68.33) by SN1NAM02FT059.mail.protection.outlook.com (10.152.72.177) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3742.6 via Frontend Transport; Thu, 14 Jan 2021 17:25:06 +0000
Received: from MacBook-Air.localdomain (c-24-62-227-142.hsd1.ma.comcast.net [24.62.227.142]) (authenticated bits=0) (User authenticated as pkyzivat@ALUM.MIT.EDU) by outgoing-alum.mit.edu (8.14.7/8.12.4) with ESMTP id 10EHP4ph000391 (version=TLSv1/SSLv3 cipher=AES128-GCM-SHA256 bits=128 verify=NOT) for <mmusic@ietf.org>; Thu, 14 Jan 2021 12:25:05 -0500
To: mmusic@ietf.org
References: <160771931179.3111.1400354969020371031@ietfa.amsl.com> <BLAPR07MB75720867628E07B8C3D07F23F3CA0@BLAPR07MB7572.namprd07.prod.outlook.com> <AM0PR07MB3860502D06574BC64596665A93C90@AM0PR07MB3860.eurprd07.prod.outlook.com> <ac9b28ee-d9fe-93e2-2e14-6fe95df53ddf@alum.mit.edu> <28946d30-d203-9890-1048-5ceeaefc3c27@alum.mit.edu> <b463a0b1-aad8-8534-e33e-f2c415441b60@alum.mit.edu> <AM0PR07MB38605AA9594E6511CBD0BDCB93A80@AM0PR07MB3860.eurprd07.prod.outlook.com>
From: Paul Kyzivat <pkyzivat@alum.mit.edu>
Message-ID: <d0ccc4f1-46b8-0b0e-4981-856a1eadd5a6@alum.mit.edu>
Date: Thu, 14 Jan 2021 12:25:04 -0500
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.16; rv:78.0) Gecko/20100101 Thunderbird/78.6.0
MIME-Version: 1.0
In-Reply-To: <AM0PR07MB38605AA9594E6511CBD0BDCB93A80@AM0PR07MB3860.eurprd07.prod.outlook.com>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Language: en-US
Content-Transfer-Encoding: 8bit
X-EOPAttributedMessage: 0
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-Correlation-Id: 5f559719-db7a-4a0d-69d2-08d8b8b15654
X-MS-TrafficTypeDiagnostic: SN6PR12MB2640:
X-Microsoft-Antispam-PRVS: <SN6PR12MB26400346D3E6D9EE7CAB0193F9A80@SN6PR12MB2640.namprd12.prod.outlook.com>
X-MS-Oob-TLC-OOBClassifiers: OLM:10000;
X-MS-Exchange-SenderADCheck: 1
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: yG2GxNBGNvrRoCoWDzB4V4QoWrYTm3rWjP7Haklxw1d1isZm1os+L9tYiFwUt5DaUlwWIKqrxxLZTv98IsbzmmhcbOwUAX17269nmB9TyAONAb5E8M2T8YSDnqAPNAcBAQvd9yfeC4/01a2xwghpn4rasZZ8SaCetuzCFQEolS2M3nFwZ0/RvzBOiTBE/PWWrd+gJV3pfx0D3VqRH+6IkoNfEeZ7sGM4zy73FnoUfYhqGbcwxT2bRfH9nVrj3xW+YAXcIUL7waje7t2hCuPJkT/BJi28N38lMKSQiEOOKnMZ9snaBzn+CV7uVsXeLmB01AEkJz4VO7QLBYA8D+mlAv8FM4k7YaKMyhxUfpFH/45Auzl82LMEztIx7SyJ8XdrzGiD/xaptosEEDMGf5hm2uSPYbxdT1remOeW6eqJ3stFtYQwJGKE+ydkQYHT9GZzkgCb5YYA4eRqitsAdDEeaQ4rw6XlBbflQi3/zaWv66pfY4pixiBX1ACacebdkZbfWL43R/jZSM/k7wJxdh+81iEQl4oQxUVgwc+vRpLqkVg5Wu78GDaDqkYF0ZpRcK103n0OxGV4FXLnUjRNhG1HSs9IQedxPXB+S5L+VHliALg=
X-Forefront-Antispam-Report: CIP:18.7.68.33; CTRY:US; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:outgoing-alum.mit.edu; PTR:outgoing-alum.mit.edu; CAT:NONE; SFS:(39860400002)(376002)(396003)(136003)(346002)(46966006)(36906005)(8676002)(4001150100001)(7596003)(26005)(966005)(2616005)(186003)(2906002)(15650500001)(70206006)(478600001)(75432002)(70586007)(356005)(82310400003)(47076005)(31696002)(956004)(6916009)(786003)(8936002)(5660300002)(31686004)(66574015)(82740400003)(83380400001)(86362001)(53546011)(316002)(336012)(34020700004)(43740500002); DIR:OUT; SFP:1101;
X-OriginatorOrg: alum.mit.edu
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Jan 2021 17:25:06.8040 (UTC)
X-MS-Exchange-CrossTenant-Network-Message-Id: 5f559719-db7a-4a0d-69d2-08d8b8b15654
X-MS-Exchange-CrossTenant-Id: 3326b102-c043-408b-a990-b89e477d582f
X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=3326b102-c043-408b-a990-b89e477d582f; Ip=[18.7.68.33]; Helo=[outgoing-alum.mit.edu]
X-MS-Exchange-CrossTenant-AuthSource: SN1NAM02FT059.eop-nam02.prod.protection.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Anonymous
X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN6PR12MB2640
Archived-At: <https://mailarchive.ietf.org/arch/msg/mmusic/f25IqpIELS0n-hpie4mgchNUfg8>
Subject: Re: [MMUSIC] New Version Notification for draft-abhishek-mmusic-superimposition-grouping-00.txt
X-BeenThere: mmusic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Multiparty Multimedia Session Control Working Group <mmusic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/mmusic>, <mailto:mmusic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/mmusic/>
List-Post: <mailto:mmusic@ietf.org>
List-Help: <mailto:mmusic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/mmusic>, <mailto:mmusic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 14 Jan 2021 17:25:20 -0000

On 1/14/21 4:54 AM, Christer Holmberg wrote:
> Hi,
> 
>> One more thing, regarding transparency:
>>
>> I'm fuzzy on how this is intended to work. I would think that each superposition layer would have some parts that are fully transparent.
>> (Transparent pixels.) And then the transparency attribute would apply to the parts that aren't fully transparent. But that is only a guess. I think you need to say more about how the superposition is supposed to work.
> 
> Isn't "transparent background" information carried within the video stream (codec or container) itself?

That is my impression, but I don't really know. But the transparency 
attribute must do *something*.

The draft needs to explain better.

	Thanks,
	Paul

> Regards,
> 
> Christer
> 
> 
> 
> On 12/14/20 11:21 AM, Paul Kyzivat wrote:
>> Rohit,
>>
>> Here are a few more points I forgot:
>>
>> 1) syntax
>>
>> In section 3 you repeat the syntax for the 'mid' attribute from RFC5888.
>> I guess you don't intend it to be normative, but it gave me that
>> impression.
>>
>> I don't think you need to repeat the syntax here. It should be
>> sufficient to mention that you follow RFC5888 in use of the 'mid'
>> attribute to identify the media sections that are to be included in
>> the superposition.
>>
>> Similarly in section 5, I suggest that you only provide ABNF for the
>> additions to syntax required for your extension. Specifically:
>>
>>     semantics =/ "superposition" <semantics as defined in RFC5888>
>>
>> (Everything else is inherited from RFC5888.)
>>
>> 2) applicability
>>
>> Regarding the following in section 3:
>>
>>      ... An application that receives a session
>>      description that contains "m" lines grouped together using "S"
>>      semantics MUST superimpose the corresponding media streams on top
>> of
>>      the background media stream.
>>
>> You need to recognize that because this feature is an extension its
>> requirements can only apply to those that implement the extension. Its
>> best to call that out specifically.
>>
>> Also, please give some thought to what will happen a device supporting
>> this negotiates a session with a device that doesn't. The
>> non-supporting device will treat these as independent media streams.
>> If that is a problem for you then we need to discuss strategies for
>> avoiding that situation.
>>
>> 3) differing size/resolution
>>
>> How the overlaying will work seems well defined if the image width and
>> height in pixels and pixel shape is the same for all the media streams
>> in the superposition group. But what if they aren't?
>>
>> I think the document should specify what should happen in such cases.
>>
>>       Thanks,
>>       Paul
>>
>> On 12/13/20 3:54 PM, Paul Kyzivat wrote:
>>> On 12/12/20 2:06 PM, Christer Holmberg wrote:
>>>> Hi,
>>>>
>>>> A few comments (some of which I gave already previously):
>>>
>>> Christer covered most of what I wanted to say. I'll just add a few
>>> tweaks below.
>>>
>>>> Q1:
>>>>
>>>> In Section 1, where you talk about the limitations of the mechanism,
>>>> you should mention that CLUE must be used something more "fancy" is
>>>> needed.
>>>>
>>>> ---
>>>>
>>>> Q2:
>>>>
>>>> In Section 3, you require a specific order of the m- lines in the
>>>> SDP. I think SDP explicitly says that the order of m- lines is not
>>>> relevant. Also, I know that parsers may change the orders of the m-
>>>> lines.
>>>>
>>>> (I also think that any counting should start from 1, not 0)
>>>>
>>>> My suggestion would be to have an explicit "order" attribute instead.
>>>
>>> I think it would be acceptable to use the order of the tokens in the
>>> a:group line to define the ordering of the "layers". The "lowest"
>>> layer would then be the background on which the others are overlain.
>>> (Whether the lowest layer is the first or last in the list is TBD.)
>>>
>>>> ---
>>>>
>>>> Q3:
>>>>
>>>> The example in Section 6 talks about "a background video". But, this
>>>> background video is not described in the SDP.
>>>>
>>>> Related to that, if the SDP describes multiple "background videos",
>>>> you need to describe how you map superimposed videos to a specific
>>>> background video.
>>>>
>>>> Based on the text in Section 3 (see Q2), I am not sure whether the
>>>> 0th m- line is supposed to be the background video, but the text in
>>>> Section 6 says that both m- lines are for superimposed video streams.
>>>
>>> See my comment above.
>>>
>>> The background layer would presumably have a transparency of zero.
>>>
>>> (It would also be good to specify that if the transparency attribute
>>> is omitted it defaults to zero.)
>>>
>>>> ---
>>>>
>>>> Q4:
>>>>
>>>> What happens to the superimposed videos if I disable/remove/mute the
>>>> background video?
>>>>
>>>> ---
>>>>
>>>> Q5:
>>>>
>>>> This is editorial, but please call the group attribute something
>>>> else than just "S". "supim", "spim" or something :)
>>>
>>> Yes please. "S" is way to cryptic.
>>>
>>>       Thanks,
>>>       Paul
>>>
>>>> Regards,
>>>>
>>>> Christer
>>>>
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: mmusic <mmusic-bounces@ietf.org> On Behalf Of Rohit Abhishek
>>>> Sent: lauantai 12. joulukuuta 2020 0.28
>>>> To: mmusic@ietf.org
>>>> Subject: [MMUSIC] FW: New Version Notification for
>>>> draft-abhishek-mmusic-superimposition-grouping-00.txt
>>>>
>>>> Dear All,
>>>>
>>>> A new version of the draft “SDP Superimposition Grouping framework”
>>>> has been uploaded.
>>>> We have changed the name from  “SDP Overlay Grouping framework for
>>>> immersive telepresence media streams” to  “SDP Superimposition
>>>> Grouping framework” as the previous name wasn’t an accurate
>>>> description of the content. Therefore, we had to start from version 00.
>>>>
>>>> Thank you all for the comments/suggestions on the previous draft.
>>>> We have tried to address them in this version. Specifically, a
>>>> transparency attribute and an informative Section on relationship
>>>> with CLUE has been added.
>>>>
>>>> Comments/Questions/Feedbacks are welcome.
>>>>
>>>> Best Regards,
>>>> Rohit
>>>>
>>>> On 12/11/20, 12:41 PM, "internet-drafts@ietf.org"
>>>> <internet-drafts@ietf.org> wrote:
>>>>
>>>>
>>>>       A new version of I-D,
>>>> draft-abhishek-mmusic-superimposition-grouping-00.txt
>>>>       has been successfully submitted by Rohit Abhishek and posted to
>>>> the
>>>>       IETF repository.
>>>>
>>>>       Name:        draft-abhishek-mmusic-superimposition-grouping
>>>>       Revision:    00
>>>>       Title:        SDP Superimposition Grouping framework
>>>>       Document date:    2020-12-11
>>>>       Group:        Individual Submission
>>>>       Pages:        8
>>>>       URL:
>>>> https://www.ietf.org/archive/id/draft-abhishek-mmusic-superimpositio
>>>> n-grouping-00.txt
>>>>
>>>>       Status:
>>>> https://datatracker.ietf.org/doc/draft-abhishek-mmusic-superimpositi
>>>> on-grouping/
>>>>
>>>>       Htmlized:
>>>> https://datatracker.ietf.org/doc/html/draft-abhishek-mmusic-superimp
>>>> osition-grouping
>>>>
>>>>       Htmlized:
>>>> https://tools.ietf.org/html/draft-abhishek-mmusic-superimposition-gr
>>>> ouping-00
>>>>
>>>>
>>>>
>>>>       Abstract:
>>>>          This document defines semantics that allow for signaling a
>>>> new SDP
>>>>          group "S" for superimposed media in an SDP session.  The "S"
>>>>          attribute can be used by the application to relate all the
>>>>          superimposed media streams enabling them to be added as an
>>>> overlay on
>>>>          top of any media stream.  The superimposition grouping
>>>> semantics is
>>>>          required, if the media data is separate and transported via
>>>> different
>>>>          sessions.
>>>>
>>>>
>>>>
>>>>
>>>>       Please note that it may take a couple of minutes from the time
>>>> of submission
>>>>       until the htmlized version and diff are available at
>>>> tools.ietf.org.
>>>>
>>>>       The IETF Secretariat
>>>>
>>>>
>>>> _______________________________________________
>>>> mmusic mailing list
>>>> mmusic@ietf.org
>>>> https://www.ietf.org/mailman/listinfo/mmusic
>>>> _______________________________________________
>>>> mmusic mailing list
>>>> mmusic@ietf.org
>>>> https://www.ietf.org/mailman/listinfo/mmusic
>>>>
>>>
>>> _______________________________________________
>>> mmusic mailing list
>>> mmusic@ietf.org
>>> https://www.ietf.org/mailman/listinfo/mmusic
>>
>> _______________________________________________
>> mmusic mailing list
>> mmusic@ietf.org
>> https://www.ietf.org/mailman/listinfo/mmusic
> 
> _______________________________________________
> mmusic mailing list
> mmusic@ietf.org
> https://www.ietf.org/mailman/listinfo/mmusic
> _______________________________________________
> mmusic mailing list
> mmusic@ietf.org
> https://www.ietf.org/mailman/listinfo/mmusic
>