Re: [AVTCORE] Zaheduzzaman Sarker's Discuss on draft-ietf-avtcore-rtp-vvc-16: (with DISCUSS and COMMENT)

Stephan Wenger <stewe@stewe.org> Thu, 16 June 2022 14:35 UTC

Return-Path: <stewe@stewe.org>
X-Original-To: avt@ietfa.amsl.com
Delivered-To: avt@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 81333C14F727; Thu, 16 Jun 2022 07:35:33 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.907
X-Spam-Level:
X-Spam-Status: No, score=-1.907 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=steweorg.onmicrosoft.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xsdIM2A-THhM; Thu, 16 Jun 2022 07:35:29 -0700 (PDT)
Received: from NAM10-DM6-obe.outbound.protection.outlook.com (mail-dm6nam10on20708.outbound.protection.outlook.com [IPv6:2a01:111:f400:7e88::708]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7E88CC14CF03; Thu, 16 Jun 2022 07:35:28 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=hyzlNzP5FNKnF467F2v0coQI+OnDw2FexwsTyGRYO7kzRdNiKZm32c3OMYGBT1uUxfQzc4yUtl9A0VOP7aKHIdZrawnDvjTgPE6bC1AmgHvJPTYPB8e7NgJKOgR1fNLQJuUC3IJ2ZtDLKBdFQ6q00FjMpo+OO0qI0VkPplHws3wIK7SYX2OwadYxkbUzOTZ7PbkuDhL/N3xvhOkqWBsfsrgkS/0KFUgBagsDhHxEY0ImXJ6C/hbXPwTpBTYPGKyxrSzpyuq6yO2Xkm8Jscxgp/rno/PdxamCmOK5wcpvlCFJNFoi4p5sAxVmKBP5gI5Yv7mlVmJqdhOol5BHRQCKAQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=FJes6Mg8zt2dAgT0vIhpyDVs8f7Q68o+XmLFHEKjQcI=; b=FxDYthtlQv1Y4jzkNEm6iVqPs5I3DNWSEcwCnF8AL2oHX6dwJCDsCQoPenle5kRdKWzzNcTH2IscNbJ3fg03i/V2ZWIb1hYJLdf7oQD7dLcY5TO9RmYe+HFp/qg1SJqB6U6P4RRAWqH2dZv4ca+IP6yHLyZH8yWew/UQVOWaSi6gpoUJUG1zC8tyIbrUpwYN0CX2ipcrN8dxrcfG7OTGRqkK0BMzpRFSwtb316hGm2oEQi/jz0DwHyf3VscHMlM4TpogH56sCflTnTUN9q52SPCDREgaCe5PinuGitA7Vgw4poUHkcIOCpzC+k9RIPPlStfuf954voR9RR/DDRQs4w==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=stewe.org; dmarc=pass action=none header.from=stewe.org; dkim=pass header.d=stewe.org; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=steweorg.onmicrosoft.com; s=selector2-steweorg-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=FJes6Mg8zt2dAgT0vIhpyDVs8f7Q68o+XmLFHEKjQcI=; b=fxBiUpVnapLsZCJOpJcJbLpxDXVUwcQ5DGr39O8i1V4qI8YV73eAHSq2gWKLVcUzawU0boz6lFKb/CTTYkTDN3CpLChCJeW0UQ00NBP6m8bJF3wD3UicSVkSMwkC5SoF3K9fF6+uVcSSIByqJ36rdD7wHRomu2LCzrbcMQiepmc=
Received: from SJ0PR17MB4632.namprd17.prod.outlook.com (2603:10b6:a03:375::19) by BYAPR17MB2360.namprd17.prod.outlook.com (2603:10b6:a02:b3::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5332.16; Thu, 16 Jun 2022 14:35:23 +0000
Received: from SJ0PR17MB4632.namprd17.prod.outlook.com ([fe80::b0e7:e753:100c:3a73]) by SJ0PR17MB4632.namprd17.prod.outlook.com ([fe80::b0e7:e753:100c:3a73%4]) with mapi id 15.20.5353.015; Thu, 16 Jun 2022 14:35:23 +0000
From: Stephan Wenger <stewe@stewe.org>
To: Zaheduzzaman Sarker <Zaheduzzaman.Sarker@ericsson.com>, The IESG <iesg@ietf.org>
CC: "draft-ietf-avtcore-rtp-vvc@ietf.org" <draft-ietf-avtcore-rtp-vvc@ietf.org>, "avtcore-chairs@ietf.org" <avtcore-chairs@ietf.org>, "avt@ietf.org" <avt@ietf.org>, "bernard.aboba@gmail.com" <bernard.aboba@gmail.com>
Thread-Topic: Zaheduzzaman Sarker's Discuss on draft-ietf-avtcore-rtp-vvc-16: (with DISCUSS and COMMENT)
Thread-Index: AQHYgYD+3UJ1/LPEWkKtd76K2SHR861RpEKA
Date: Thu, 16 Jun 2022 14:35:22 +0000
Message-ID: <79069056-6118-498F-A668-E1EA07749222@stewe.org>
References: <165538438283.59868.1720292769194004033@ietfa.amsl.com>
In-Reply-To: <165538438283.59868.1720292769194004033@ietfa.amsl.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/16.61.22050700
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=stewe.org;
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: ddd9b4d7-e915-408b-994f-08da4fa57211
x-ms-traffictypediagnostic: BYAPR17MB2360:EE_
x-microsoft-antispam-prvs: <BYAPR17MB2360A8D219D2C075DB7EA2C6AEAC9@BYAPR17MB2360.namprd17.prod.outlook.com>
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: UE0kkd16yJjFaPc9Eqbo7oWHHVDXMzIL3GjoT2S0GR+qQSXVW2PGgMHICjKv5Zv0UNGmRwOin+Cz/wZ/+3pF4hDZE6j0uqTT+EU+dA32H42nZUF+EdnCPgApml1wCVsY2Lh/sCwEX8dxf5Wy5KW7ntiJDW09kjjEr1tl/VO9VjTUPD6hoMCCz9dyuUox7xV5jlYzqKPjUzDEdweZtslF+LW8PEobeVk3ajxia8YzEllCyN8r5ZbKqBfVAlK8eq7XDi1res97rle8iCvZ34ayvCkRhEG3mCppP4FxNt5KsjACvT1fj5L2rBr0fnAHWyHilIUTXv3G/S8EDKHwANCBHJ9OBZJ05Vx/72mqlr8+pZ2QFNaaNn7bNk1lw84Rhe2Gs0wSJcQkQuLzJqGG6/8AxQs+Lus96DnkQmRS6inedkcQD5uuUCMY92zTjVUdhuTaqHbLSOcSSL/wSdWzrE5bfOJY68mrLWBA2zZLNcIuZ0CpBLJ4haRy42+fnkaXhlFejLBNvJyJbK2Mc4FyWiU/87mCwGWd9H+e3NgRkXtSq3sJHFTvs/qJ30GO6YO7hN7hzjkvL2NfJg4Dgz7cdgKqkXo7phspAYIDv/CVuz4Kzl2hkTKTg7bV1soXrf0KTaJImdUIjnHEJ+jyT7nJwXVkc9SBOfIUpFqhi/Aa8/yFPftdVMJmr9+7E3N/QL82ZFSvj0v4T+ZbZiLvZ1w/FqUG7Rv7RtGjOjkHyJvJ8+jt0Ln7Waje8d3vZXL4gTGmmyLOAcjWLcAedmYk1sjYCUQK5ejmIUtxuYTH3WUS+e8kTFal7hi4eoHy4V1ZBz9gtZub
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SJ0PR17MB4632.namprd17.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230016)(396003)(39830400003)(136003)(346002)(366004)(33656002)(316002)(6506007)(186003)(8936002)(6512007)(38100700002)(71200400001)(26005)(83380400001)(54906003)(2616005)(122000001)(166002)(5660300002)(41300700001)(36756003)(8676002)(86362001)(9326002)(966005)(38070700005)(64756008)(66446008)(2906002)(66556008)(6486002)(110136005)(508600001)(66946007)(4326008)(66476007)(76116006)(45980500001); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: S06W18pqv1dAwzIHEjCjLtnF5py5D72wL029a+8+JoOf0xS92J30nzNcEiJhIB10297+rBXXwhOz5ludNdj4NSSNkrMAgfAmerOLe2kKRwqR8A4HYUptYxaCdFZO/7HCX27Jy8maJdEO4MwCJleURXwJw19s8j2iCX98r113EkWvCsSzqtyKK+fq5yW5kK6+RTHz1H+9JoCxNsQFUH54YNcgsHSe15VJFmKeN6uFmvtgEV++DUg8Pq2hygAtPh6yBaee3qVmmZGFZQ1IDIZOBpod7rydCaKKT3x6vaTNKns1Qn3rleYnncEipgTlUZV7dbGzxmIgB6sOTpyW9rcwbsI/LFaZVZ6p7yUoCloZ9FLSou4YrJ7XmMYrwk2ho4mvKvYTbGnQPszhnKPHqXWYih7kIyrqWE3FNjHnnOAnDnY9JGbFyWxbkhalpB2oCCDHDc2/PvVbG/L+dz5va15ryoUC0JpKqRO6/wNmdP9MzHsDKU4GIyes3O1Y+HCDX1QfnqGPjM/zTvP5wzhJ60vi1v0l8l1wjvCAy4DNKl3DUm5Y/PJaA3onVI3LGIVF6iH6dioAF8JFVDmz2WhgnQuSoPyZKJ357RLSvuYRdg9O4blXRPJU1wviCrcSOe6cm69RL0EbP7AX92/pmfNwyTOCGKoTkFWygJMdNC1qRocG8q9HiDjQfCiAYhNKJS1vCtaA9eVhULjke+cF6Vd826Kyb6Hh16Y0JH6cbQU+HLqLbX2aCAST81+2TlDvYFOiJmcdjNSZjm2pvb+L2Vm/xP2eXCt51b0sjDQnVmfVULmrJYLKYn4DcIU2AT65dTCVJQ7tN1HGga9oUxAnPhqfkEyjP8Z3+BdsidlYnViU/bdnxrGh+vj+J/5mK3BuHYjjqT7eQ8JpCVHhKwNvH6HTHd18KUtaJyxyTylZjKxS1pi+PYGXcps4KFpSmIJkGUNHEg4iPrpWIJERbzfgRFTEsvoTw/9mYJIpalvxkzMpuaa4hquLbzVrEZ8zrCH2r3MXGIFpQW84kW0YkJk53z03IgpOhMPPWUm0bMOQltvNxgF6nvRz2jhQIvMh0DNJYTXcg2CBWaFsAfvEh59EhFmgozjRNSuV91k9WEodoXIeq1tg4ffjgZKFurzyxlvCU/zEBINRzzS7d/qr7ARWwZDyQc7/Cu6/vFXutY+UD8n4pZxGfGndvjH/wZsbHdy2Jl/GRMpMO59amC2t4qlx/BMDxKTLVgInayRpi+C5YTe72aSfTqY5dkOssTrbJ5dzGm0fGF+FTNLcgue44zP3xjab6yqUgNLgSisjSMD6o4EpcKBoC/MYRpbJvxZN+1aIFr2uyImgireRlHTKOST+p3gboOT5mmV6xUmWJKi6qe6J4iPisadd2W2KJaWodA7B0FJ7A5mbeJlGGgsgSt8amCLgJpYyLN5sDvsrGP21vdbYjZ77bhvKC0NHX3rNroh73ReP8xbWOcKl0Oys/bx3OMvFBmJYyH6QHDC0zT1qSGV7+YveStHAUtd6jVh9pCM65iv0RqEOoGSUr3TKmkOaSWMWYAkAzUzmvxH1SvLOPnus7Fj7c5yn3pjfRHjCOtbrbKkz+GYiKBMBL1omBBVAWpLt5/DdDa7vaKa1Y6SDNQPC673hlE2CDfP74Vsq637d0hWkJbtUOvgW5Xf7cX3M78kZWpI6nuC/irUo/Db8bxZQPhS3ymtcIHEhMN/Hr9sm+m2CQKP4OfDqA+hHiEtkh2dArSNTdw==
Content-Type: multipart/alternative; boundary="_000_790690566118498FA668E1EA07749222steweorg_"
MIME-Version: 1.0
X-OriginatorOrg: stewe.org
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: SJ0PR17MB4632.namprd17.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: ddd9b4d7-e915-408b-994f-08da4fa57211
X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Jun 2022 14:35:22.7675 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 865fc51c-5fae-4322-98ef-0121a85df0b6
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 6jMbHif3MpbT/EeRPYaYzC7cwL0PmAI6OCns4WV66AhRPwx9MEeUwlZhQUY1RosT
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR17MB2360
Archived-At: <https://mailarchive.ietf.org/arch/msg/avt/PCdY4e7VAD6rqqBHf6ORuJpaxKM>
Subject: Re: [AVTCORE] Zaheduzzaman Sarker's Discuss on draft-ietf-avtcore-rtp-vvc-16: (with DISCUSS and COMMENT)
X-BeenThere: avt@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Audio/Video Transport Core Maintenance <avt.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/avt>, <mailto:avt-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/avt/>
List-Post: <mailto:avt@ietf.org>
List-Help: <mailto:avt-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/avt>, <mailto:avt-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 16 Jun 2022 14:35:33 -0000

Hi Zahed,

Thanks for your review.  Please see inline in blue.

Stephan



On 6/16/22, 06:00, "Zaheduzzaman Sarker via Datatracker" <noreply@ietf.org> wrote:



[…]



    The document, along with other ballot positions, can be found here:

    https://datatracker.ietf.org/doc/draft-ietf-avtcore-rtp-vvc/







    ----------------------------------------------------------------------

    DISCUSS:

    ----------------------------------------------------------------------



    I would like discuss if this specification should be making stronger statement

    to enforce the reinterpretation the SDP Offer/Answer model for parameters

    sprop-max-don-diff and sprop-depack-buf-bytes.



    In section 7.3.2.3, it says sprop-max-don-diff and sprop-depack-buf-bytes

    parameter should be interpreted differently than usual interpretation of the

    parameters according to RFC 3264. This is a significant change and kind of easy

    to miss. This section does not use any normative text to enforce the change

    either.



None of us authors is an SDP expert or has much interest in SDP (anymore).  Outside of the webrtc context, few use SDP for video nowadays.  The world has moved on to Jitsi and proprietary solutions and whatnot.  The webrtc guys still use SDP but seem to have subscribed to non-ITU video codecs and Opus, at least for last several years, and I do not see that their interest in ITU codecs comes back anytime soon.  I’m writing this not to justify shortcomings, but rather to explain that the energy that went into the signaling part of this draft was quite low.  We simply copied from RFC 7798 (RTP payload format for H.265) what we thought we needed, and adjusted what needed to be adjusted.  The latter was mostly names and references, and adjustments related to the few differences between H.265 and H.266.



If it were up to us authors, we would likely have omitted the signaling part of this payload format and/or moved it to a different document, to be processed if and when the need for it is shown, and by people who know what they are doing.  However, that would have gone against a standing agreement in the AVT working group.  (I personally have objected to that standing agreement in the past, noisily so, but do not plan to bang my head against this particular wall again.)



To the subject of the DISCUSS: The concept of sender-properties (sprop) and its diverging interpretation from traditional O/A exchanges was introduced by Magnus Westerlund, goes back to RFC3984 and, at the time, has led to long and hard discussions in AVT.  That was almost 20 years back and at a time when SDP still had relevance.  I think that the sprop concept was battle-proofed then; it was used in products, 3GPP specs referenced it, and so forth. Both sprop-max-don-diff and an equivalent to sprop-depack-buf-bytes (known as sprop-deint-buf-req)  were part of RFC 3984.  Like in the subject draft, also RFC3984 contains no normative language related to their use, and the relevant language explaining their purpose is virtually identical to what we have now.  See the second bullet of section 8.2.2 of RFC3984 if you are interested.  (https://datatracker.ietf.org/doc/html/rfc3984#section-8.2.2).  I do not recall having ever received inquiries about sprop, and I also do not recall that sprop-related issues ever came up in interop events (which were, at the time conducted in places like the IMTC).

Since then, sprop-style parameters, in essentially unmodified form have been copy-pasted into every RTP payload format for NAL-unit-based video codecs.  Given that SDP is essentiality legacy technology nowadays, I would think that the handful of people that may be reading this part of the payload format spec are likely familiar with it.  The rest (like us) doesn’t care, as (like us) they will focus almost exclusively on the media plane.



Therefore, I suggest no change.



If that were unacceptable to you, then please help us with identifying a solution that satisfies your request.  I assume this would be a sentence or two early in section 7.3.2.3.



    I am also supporting Francesca's discuss.



Please see my reply to Francesca’s review from yesterday.



    ----------------------------------------------------------------------

    COMMENT:

    ----------------------------------------------------------------------



    Thanks for working on this specification. This is a big task to define payload

    format for a video codec.



    I would note that the VVC specifications are behind paywall and we are heavily

    depended on the interpretation of the authors of the actual specification here.

    I hope the specification was somehow made available to the working group to

    have a look while developing this specification. Having said that I must thank

    the authors for providing details of the video codec specification that made

    this review possible.



One other AD also complained about the VVC spec not being publicly available for free.  That is not true.  Like all ITU Recs, also this one is available for free download.  H.266 is available from here: https://www.itu.int/itu-t/recommendations/rec.aspx?rec=14948  What’s currently tricky is that the newest version (V2) is only available with an ITU TIES account.  However, we cite V1, and that can be downloaded from above page.  One will be able to download V2 from the same link as soon as the pre-publication period for V2 ends (that is: once the ITU staff has finished their editorial editing round), which should be any day now.

Now, do I recommend a reviewer to download the 500+ pages of H.266V1 and attempt to wrap their head around it, to review a payload format?  No!  It’s way too complex, long, and dense a document.  But for those who insist: it’s there, and available for free.  And yes, in the AVT WG there are a number of people who are very familiar with eth doc as they contributing in writing it.



    I have some of observations -



    -  Section 4.3.1 : what is the PayloadHdr type for the single NAL unit packet?

    is this type not needed here?



Other ADs also found this confusing.  For single NAL unit packets, the NAL unit header co-serves as the payload header, and the type field values are taken from the values specified in H.266v1, section 7.4.2.2, table 5.  Let me note here also that implementers the payload format necessarily need to be familiar with at least the high-level syntax aspects of H.266 and the structure of the H.266 spec itself.  They are most likely also familiar with earlier video codecs that use the NAL unit concept, such as H.264 and H.265, and their respective payload formats including RFC 3984 and RFC 7798.  All these formats share the same mechanism, so we expect that implementers will most likely be familiar with it.

Regardless, as pointed out to other ADs also, we plan to add informative language to clarify the above.



    -  Section 7.3.2 : actually contains both unicast

    and multicast considerations but in the beginning of the section only mentioned

    unicast.



Francesca pointed that out as well.  The problem is a clerical error with the section numbering—what is currently 7.3.2.4 should be 7.3.3.  AFAIK, Offer/Answer is not defined for multicast.  We will correct the section numbering.



-  Section 10 : I think here AVPF (RFC 4584) is the proper profile

    example than 3551. But that for this section.



Per IETF dogma, congestion control needs to be applied to any RTP session regardless of any of the defined profiles.  (The real world does not necessarily concur in my experience, but that’s another story.). Insofar, what we wrote is not wrong.  However, we can (and should) add a reference to AVPF here as well.