[AVTCORE] Re: Design question about the V3C codec

"Lauri Ilola (Nokia)" <lauri.ilola@nokia.com> Tue, 20 August 2024 08:28 UTC

Return-Path: <lauri.ilola@nokia.com>
X-Original-To: avt@ietfa.amsl.com
Delivered-To: avt@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 082AAC14F700; Tue, 20 Aug 2024 01:28:38 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.254
X-Spam-Level:
X-Spam-Status: No, score=-7.254 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.148, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=nokia.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id TCOuwaQdg5_W; Tue, 20 Aug 2024 01:28:33 -0700 (PDT)
Received: from EUR02-DB5-obe.outbound.protection.outlook.com (mail-db5eur02on2072.outbound.protection.outlook.com [40.107.249.72]) (using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 755BEC14F6E9; Tue, 20 Aug 2024 01:28:33 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=inW/Mx6t0ct/EwDWl6LljhmpJevP1bDSOJO4XBu0HXOj4mWmIfU+GeB69Tl7jKPgb84nOixS+p8FagYiNJu+sCJLot63FzQ5w36VV8pNn/KgG7//fahc93iqsT7/Xd/Jv8RjAML/ZHMbvkxOpu6f4rfDgEtJsLtNF2C6bIGsQzkawQnSanmWtY5eM2Z80B1bRBmb8iu13UypMMQ7u5ZDVyatWIw0ZrQkAWVJLI6cP5eU/KafbeB0lCFjFU80QYBQwTitDu1nn5JtjbMCtrYiUgBcG+NW54/T9XtjP2VJZ38rLNNynjTKLcmS1LXvrybssw3/wvzN66do1TjB5LtI3w==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=1XdG1JWOUcBHj3V2ubEckX8k20Rw3hanvp0mWdcIVDU=; b=OYQZHqBieYTlv7oN0lF4PLQzQRjlS4jH1WRFSH4FU+yNhxkD+1ZqrG7IpSd74GSFA1VsvCKT10nvcmliMIBy1jiM+jYMVFz+V/WlwU3p+iR8duJpQn6HWwv8f0fha9KXnI3uhiYW44CfZtMpwOZwmitPCEeNKNkUr+/nCbBnnyrZIzgPAeouFxYeTn4T0wFB4WWb6cFXvZJQQ11tdDFr0k1ao5evpXArDQn8fIEo3mWSCs5Nehf39ucbJQI4L84JjAZq/XKmt4zYTOWDavSnQTwliNcUelGbcNU+2TZ2Wa1DEywdTffMjIttMH3mCe9UZIkPAj7egdnmLLxHrZrFSw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nokia.com; dmarc=pass action=none header.from=nokia.com; dkim=pass header.d=nokia.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1XdG1JWOUcBHj3V2ubEckX8k20Rw3hanvp0mWdcIVDU=; b=H5jf8b4rTa4XhDlVV+XfXZvWsw3FvE5xDPbhsmtgQYkZ8MH3oJNQtKA0T5KBDffZdyK1twWQH7pLnDeZdwHQTzl2qOEQJpiM8omiDcxWuTLOyLU3cC9hjP8F2lj/EE+riP9lQIN1ZgGJXVDj0I5dSHo3BXp2llPXUrt0sAnQQcibhX963+SM3suX54LYrMY0UxMExRTOpkrog32YRbsZeFGYIgp/S9IoSKsiKfM6NAfpzlyiPjdXkevfAtkn0fLdv4zoh3xUq0qf8IJud5bSngAdnodSlVccoSN6cjeDGQJcsOgv7lMPu2Vx5GYi/TXOa2Gw9mSnzLSv1dNEN1xZAQ==
Received: from AM8PR07MB8294.eurprd07.prod.outlook.com (2603:10a6:20b:329::22) by AS4PR07MB8481.eurprd07.prod.outlook.com (2603:10a6:20b:4e4::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7875.25; Tue, 20 Aug 2024 08:28:30 +0000
Received: from AM8PR07MB8294.eurprd07.prod.outlook.com ([fe80::6828:8d2d:d4ee:97]) by AM8PR07MB8294.eurprd07.prod.outlook.com ([fe80::6828:8d2d:d4ee:97%4]) with mapi id 15.20.7875.023; Tue, 20 Aug 2024 08:28:30 +0000
From: "Lauri Ilola (Nokia)" <lauri.ilola@nokia.com>
To: Christer Holmberg <christer.holmberg@ericsson.com>, "Lauri Ilola (Nokia)" <lauri.ilola=40nokia.com@dmarc.ietf.org>, "Lukasz Kondrad (Nokia)" <lukasz.kondrad@nokia.com>, Jonathan Lennox <jonathan.lennox@8x8.com>, "avt@ietf.org" <avt@ietf.org>
Thread-Topic: Design question about the V3C codec
Thread-Index: AQHaxm4fFpng76rdCkG1k1vmp55CvrHuF9AAgA863zCAKBAjgIAKxgJw
Date: Tue, 20 Aug 2024 08:28:30 +0000
Message-ID: <AM8PR07MB82949247F010974ED6ADD05AFD8D2@AM8PR07MB8294.eurprd07.prod.outlook.com>
References: <0386AF45-DDCA-4606-9001-54905E69FAF0@8x8.com> <AM8PR07MB81071DA186779E8C9778A1889ADB2@AM8PR07MB8107.eurprd07.prod.outlook.com> <AM8PR07MB8294D67D5D726F35365B72DAFDAD2@AM8PR07MB8294.eurprd07.prod.outlook.com> <AS8PR07MB80692A48C63B86E000680F9493862@AS8PR07MB8069.eurprd07.prod.outlook.com>
In-Reply-To: <AS8PR07MB80692A48C63B86E000680F9493862@AS8PR07MB8069.eurprd07.prod.outlook.com>
Accept-Language: fi-FI, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nokia.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: AM8PR07MB8294:EE_|AS4PR07MB8481:EE_
x-ms-office365-filtering-correlation-id: 23c7e4b9-4649-485f-8838-08dcc0f212a2
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;ARA:13230040|366016|1800799024|376014|38070700018;
x-microsoft-antispam-message-info: ruFbF8VM/xPN880I43kd1iszo1ocEvHpnoj/fo8rndd2VVfDELxzy/Xx1lecDvbpXxLFqrGni5Vy3CmcQ0wIOaglKY2q5MBXADAoojNn1DOhLuCGDCH6tGw+N0vw+giEFoev2RNvfbI3KvLR+sp+qzI4Ura6E9jQZoiztSQBVMOw1/xjDlHJegye6ILankWKaEcWZciDMlUeVA6mI8arPjh9DeUaDZ5NHPXyllqOUCKlkXbLNzpabdDiz3GSNZcf2s6f+QxJpSXCSZWZNc+UzdGnRqV5Xf3qfb6G4d2ehl1fpZCGTyUdjiRCE0mjO3+rpNDkPHv9b26mp9Ly5u2xZ6OW1WUaFhwO6KAA0k1BNIGhoI7gMCbT6O5r2z/pAwHFzNn7d1Qr3u2sLjIRKftgpKlFHdOBcVF1yOjOkmBCqplEEh2vplz4PaWnZYTYwKD/dC6IAt6UnlBiai2ySaDKo+qQVHOpB+GST9R2gtpGbppIrY5yNxoW5WpgKffP6AkuzfeSlls7QDgZzEOeOwx4rcnxR6YFD5UEeD9ltS6DXspex73n7wXkWV5y94szD3uu3kP9GM1HRRJsEMjYs8KIe7qSEtDuFsRgGQDpfTCFcZZ632v8N4zNhcYT2ApFnX3nO9O2uyorn2rwtT4pT03yrm5MTt818JOJn98ovelJaPek1On4zIob2SxtkL3Ny4dLrsAcwgYq0Pkd0Rh1/5xtHd2ZVpPVK2Zpg5RKi5bE1fLCz+Q+qkfuGjPc0GsmimlUzniSdwtwHOsxqtKvqoemgMU9HE7GcyRv0LyDhO1CTcVlXRhRhHbMDnVWQPJOv/OwzzBc25SulfXDrFHCNpzpNfY98aguIEXxgmM+VT5ZZF4euQG33lLBnfA4WYOvl7KkxvCIrlNRWR5PXmbF8zH2qtKvap8EWa197nZEykXQxyS0CU3DWbZMm5HVUW9IJdISwNTbZXc0VIVYcEjtuvY6CtaIpW9tjWHWqIwe9mQJF+jcGgeGRHSHXYLTBiIeFXs4fpSLT4LYNdTSdQtUqg0rHEJYX2cFsJ8dV6RYrnp7LOgUvfCtlRlzVIE6D5RvK2iCoDd3O/lEnjzUkbJg6EDYtCuAn62lcTY2CsgAuBeFEXlrfTHmYdTNpTZgQWzidnr/v7fTQISGx8pZ0BRH/rSV0QkCP4aJ7fhgjphr6srXmAaSQz9hhrbJurMkePYv684gzlKVo8OhhWW9TJPbPT2Uat0YkJnwmyzPiTCcvyxv1VKO/G5x2252DkqRAtoPHX8lhpnNN27OHfJaG4GjEMB6Cf/SzvNdXC4KucAprVGTQiKdt/5pQCbakWZ6W8HDxzsvWhVO3jPMJ9FJwW5AXY6x7wFBvIM/8czNytM0Nmd1Mew=
x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AM8PR07MB8294.eurprd07.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(366016)(1800799024)(376014)(38070700018);DIR:OUT;SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: lG3n97znQdWnj6Ebc/sOEzi3JR42Nv5Y6t50w0l/tcj+/NitNag0gCrU24d5xNl8yvMsz3hzOihOEDn+DxOHH+pBeTx2vGy72JBbKxkHog9uvyQdd/5HLCq2h1LP0P9wIpYU4TisELid6oJkRWlrqVe0vwyrKm/4krSUIHIog3VDV/+G5MxGWsU8TcBsilyXorHB6CgcmjBA/7A/ekxjo73wddGIKXIoxgSenQf83nKDj50JkYdGQZMNIE7/U+ZXKexymM3ei5XBUaIuKpuBHGAFqDeBjtoj/eVgOrJsHF/kXltJA6btJfTX1xf/GHTVyc6hZBz5e9+lw1GysN8ofDUBtDOsDoS/VI8AxVmfecWec3zCM8mRDp/BVb8l+rlY00snnNxT0W46+SXcHynNzWqkttovPvn9K9XnfEoEv25GSXzx1ty9UO9W3SBZ1+78sy8WmczYBl0DFdHRAfWK2SHOCMuq5RHM7SPwrTQXRabHqkmuDIl0AxcAbNzwKDa5QcfzPVaZ4jp2qff9ifAk4/kUW+P0T7W7iUmST+yxgV4750p+g1Z3Yj5YrhWLKljLRmsEHUWN5emI3DHd0AFDc5GgNVuBzhu0UZsxV61E4E0WTATMbLJhrHQS5oXTGp8iQir0ptPPShjYduZRBb6pTyRTp+mSjGY3j3AaQOfkPNSpNwhgoYLBl12a2uT4H28aUNJ+EkDu34ke1QhFidbxiKt/UhE3iDAPSkH6hFZ9PuIwWaHZ6Xsnh0Y0cVO0SIgpMjNtFesfDkum1wp957+XwAA50Wn0SuvfX0cii+5+Y1bPGFyndC1r94o//rzezKueFIyVzDx2bQWQy8ZNrKcyWsWbpGcs1NSgyqfpFvUtBIt9ea0CidIfN3YeblyaSCJWVTnLkM1xBiBCnKvJDwxFajkzFh8IJqICDmSc0AWXet/nJ+Z6XLeSD7eRXC/G7qkVpCiC7VxGrvYqEDbwlnYE+Qv51vbZ7b0Ll+zzkOYfm/LA4Iwf3Cgh7Zszis2oiZAVFouhyfP1u3kHLi4BA1liwStEjiPgYfqRLrqCbnhpyYITtC/OIt8rfHvrfmX43QAtwnFyamoQvYmUSEr0IQYRSPW7G3cZ4Vbpl8V4QiQHGTHsWPqGs66IU51zIYFxbm/sDSCKQiTPV7QtSa8ospO+JgTpPepVIn/D+illz9XYD2seAQSHhVkdhiXTwllzI7LpLwniqSN0ngWaA85+N2pjTmEpJDZXF7ZJtVfRJ+Ga6RXS/dqfL+vVU0an+XjQwuoLu0n9y+son+TpXYHzk14wDJDkf27Vu4ll7kmyUS0FFeXDDKCoHhQelem9H4V3T2Ot942XHI9jOo/YGvAg6D2ZvTGPCT7DxorH66ukLdEZ2/Ct6z53dhUA5F5Awdba9VYoi29Pj0jzfui0O2VxcD13lJkkLlArJ99UWA4Yx6EE7yj9NFxp1kf5JVM9xk+0jIt7ckfK6GZXp2KzgcbKo4c4VbA1FAuQIPMlSvuZw7QiXSv+yp3LzatFgdYluVZs7mfhvXvLsQwQNZHBkogBVnQ5fVYGk95uK29qOPG97415LzYz9qVh3gsdxIXB61BCTDLW
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: nokia.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM8PR07MB8294.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 23c7e4b9-4649-485f-8838-08dcc0f212a2
X-MS-Exchange-CrossTenant-originalarrivaltime: 20 Aug 2024 08:28:30.6713 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: kmiKFqISW/ZYfUJQBgRn7g8vDD9/wWn4VKB+CEAB3cVCj1slrJqyDvNXZLFb4Z/Ex+7R47xAABBf9f905vyjPA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS4PR07MB8481
Message-ID-Hash: KUAS2IWTMFQY4CSHVC3ZZCEPKRS5KU5Q
X-Message-ID-Hash: KUAS2IWTMFQY4CSHVC3ZZCEPKRS5KU5Q
X-MailFrom: lauri.ilola@nokia.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-avt.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: "draft-ietf-avtcore-rtp-v3c@ietf.org" <draft-ietf-avtcore-rtp-v3c@ietf.org>
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [AVTCORE] Re: Design question about the V3C codec
List-Id: Audio/Video Transport Core Maintenance <avt.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/avt/s5D2bROdVlx6UHeTh2zPzmD_4kg>
List-Archive: <https://mailarchive.ietf.org/arch/browse/avt>
List-Help: <mailto:avt-request@ietf.org?subject=help>
List-Owner: <mailto:avt-owner@ietf.org>
List-Post: <mailto:avt@ietf.org>
List-Subscribe: <mailto:avt-join@ietf.org>
List-Unsubscribe: <mailto:avt-leave@ietf.org>

Hi Christer, all,

I think you are right. Let me add some clarifying text to the next version. 

Kind Regards,
-Lauri

-----Original Message-----
From: Christer Holmberg <christer.holmberg@ericsson.com> 
Sent: Tuesday, August 13, 2024 2:57 PM
To: Lauri Ilola (Nokia) <lauri.ilola=40nokia.com@dmarc.ietf.org>; Lukasz Kondrad (Nokia) <lukasz.kondrad@nokia.com>; Jonathan Lennox <jonathan.lennox@8x8.com>; avt@ietf.org
Cc: draft-ietf-avtcore-rtp-v3c@ietf.org
Subject: RE: Design question about the V3C codec

Hi,

Even if the V3C-offerer decides to not send 2D video, it cannot prevent the V3C-ignorant-answerer from sending 2D video.

There are ways of performing the negotiation before anything is sent. I don't think the draft needs to mandate those, but it should at least make the readers aware of the issue.

Regards,

Christer


> -----Original Message-----
> From: Lauri Ilola (Nokia) <lauri.ilola=40nokia.com@dmarc.ietf.org>
> Sent: Friday, 19 July 2024 3.59
> To: Lukasz Kondrad (Nokia) <lukasz.kondrad@nokia.com>; Jonathan Lennox
> <jonathan.lennox@8x8.com>; avt@ietf.org
> Cc: draft-ietf-avtcore-rtp-v3c@ietf.org
> Subject: [AVTCORE] Re: Design question about the V3C codec
> 
> 	You don't often get email from
> lauri.ilola=40nokia.com@dmarc.ietf.org. Learn why this is important
> <https://aka.ms/LearnAboutSenderIdentification>
> 
> 
> Hi Jonathan, all,
> 
> 
> 
> Thanks for the review and question. I would agree with what Lukasz outlines
> below. It’s perhaps an implementation detail that don’t need additional
> restrictions. There are alternative implementation designs that will depend on
> the way the sender is setup, how the encoder is configured and the level of
> ignorance of the receiver.
> 
> 
> 
> 1.	Fully ignorant V3C receiver probably doesn’t want to receive any V3C
> specific media lines.
> 
> 	a.	But there may be scenarios, where the receiver will regardless
> want to see what the media lines contain. As these are just video, a receiver
> can indeed inspect the contents of these.
> 
> 2.	Partially ignorant (incompatible profile for example), could decide to
> receive part of the videos depending on its capabilities.
> 3.	There could be also a scenario, where the media description contains a
> pre-rendered 2D viewport of the volumetric information.
> 
> 
> 
> Should we clarify these designs for the specification or leave the freedom for
> implementers?
> 
> 
> 
> Kind Regards,
> 
> -Lauri
> 
> 
> 
> From: Lukasz Kondrad (Nokia) <lukasz.kondrad@nokia.com>
> Sent: Tuesday, July 9, 2024 4:34 PM
> To: Jonathan Lennox <jonathan.lennox@8x8.com>; avt@ietf.org
> Cc: draft-ietf-avtcore-rtp-v3c@ietf.org
> Subject: Re: Design question about the V3C codec
> 
> 
> 
> Dear Jonathan,
> 
> Thank you very much for the review.
> 
> 
> 
> When a V3C-capable offerer sends an offer to a V3C-ignorant answerer, the
> answerer will ignore the V3C atlas codec and V3C-related parameters, but as
> you wrote it will likely try negotiating the video streams.
> 
> 
> 
> I would think it is to the implementation of the V3C-capable offerer, it could:
> 
> *	say I do not provide alternative 2D version of the content so if
> answerer do not support atlas then I do not send him anything
> *	say I provide alternative 2D version so I can send him one 2D video
> representation of the content
> 
> 
> 
> May you elaborate what/where in the draft the codec’s signaling would need
> to change.
> 
> 
> 
> Br,
> 
> Lukasz
> 
> 
> 
> From: Jonathan Lennox <jonathan.lennox@8x8.com
> <mailto:jonathan.lennox@8x8.com> >
> Date: Monday, 24. June 2024 at 21:38
> To: avt@ietf.org <mailto:avt@ietf.org>  <avt@ietf.org <mailto:avt@ietf.org> >
> Cc: draft-ietf-avtcore-rtp-v3c@ietf.org <mailto:draft-ietf-avtcore-rtp-
> v3c@ietf.org>  <draft-ietf-avtcore-rtp-v3c@ietf.org <mailto:draft-ietf-avtcore-
> rtp-v3c@ietf.org> >
> Subject: Design question about the V3C codec
> 
> 
> CAUTION: This is an external email. Please be very careful when clicking links or
> opening attachments. See the URL nok.it/ext for additional information.
> 
> 
> 
> Hi all — I’ve read over the latest V3C codec draft, as I promised at the interim.
> 
> My biggest question about the draft is a design question, about how
> backward compatibility in offer/answer should be supported.
> 
> As the draft is currently written, when a V3C-capable offerer sends an offer to
> a V3C-ignorant answerer, the answerer will ignore the V3C atlas codec and
> V3C-related parameters, but it can (and likely will) negotiate the video streams
> as 2D streams without any volumetric component, thus establishing a call with
> 2D video.
> 
> Is this what you want?  Or would you rather define the payload such that a
> V3C-ignorant answerer will completely ignore the volumetric m-lines, and
> negotiate something with a cleaner fallback (e.g. audio-only, rejecting the call
> entirely, etc.)
> 
> If the latter is what you want, the codec’s signaling will need changes.
> 
> Jonathan Lennox
> As an individual