Re: [dispatch] Draft on Discarding Priority of RTP Video Packets

Lijun Dong <lijun.dong@futurewei.com> Thu, 21 July 2022 02:19 UTC

Return-Path: <lijun.dong@futurewei.com>
X-Original-To: dispatch@ietfa.amsl.com
Delivered-To: dispatch@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 61CD4C1EDA8E for <dispatch@ietfa.amsl.com>; Wed, 20 Jul 2022 19:19:37 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.009
X-Spam-Level:
X-Spam-Status: No, score=-2.009 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=0.1, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=futurewei.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 8dzWO9KYmYI7 for <dispatch@ietfa.amsl.com>; Wed, 20 Jul 2022 19:19:32 -0700 (PDT)
Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12on20705.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe5a::705]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9B54FC15A72F for <dispatch@ietf.org>; Wed, 20 Jul 2022 19:19:32 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=NHpIPk/xyb1ka+uY5N5gnlErIYqz1iCA8qJE/uRLRNcqVGHbBh5ppCPhjLzpWibTYI/mvlQQJZT6M3bLpHbNF1VAARkhMWKU0spA3Pcs6Q3+PnYo6MDYOgQYern3LmL+fAoTIS4AP0/CFg9pJSpIVg25Y64i3umkY8bcf9xiAOqnwHGgvMFwU5AHKHM3I/kdLMQLwJZGEtWKRqtEdYNBxqvKbF2eTzJvKYH4+xeGd0SWIoy/mr2LsRS8euLG322uQ6rKoR63njAlbSdDLyJmUQwsHkZ/zAl+ZTjVRgcQkCpjBhtkYk727TaghjwfdCzL3/y6iwLfbx7s9EmTY9+NmQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=zKwOeAYsVuUtEcJ1xKw19cuvI5CLSaYTO4Sh4KZ/BYk=; b=QtelVX/EMHWlHPC+oXeUCow9K8ZWy7a13uJ7/c3xWhB2oFW2gCn4Z7RxkLrU4RSCGGWKBu2+E7S4tcZkVyXDQviWp068+B1qgoSp1MjW/fVGar0o8YL/Y3Lu4nIiFQUR3perYTFP2KQKk44X+vKr2DqFs+HLJqsSI/99zIKmV0pD0ZzdApHiCODpFTbm5qcdfMLwaqlVLn0zBZ7NRg7aB5jHQrw8CO4e7OVbb6xxa/NBbEsqMl1+EPhGlQwA78BxVpKznRU/AbYANc+gvoUz4WCQ/ayiTGIZx2mJplHivQPDToeG3ERI2x+FVyD/rlfpKDoCB4zAHfRfpQO9wRD7KA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=futurewei.com; dmarc=pass action=none header.from=futurewei.com; dkim=pass header.d=futurewei.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Futurewei.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=zKwOeAYsVuUtEcJ1xKw19cuvI5CLSaYTO4Sh4KZ/BYk=; b=MuBL/rUujC53P1Hk+71bmKa5ofG67iMOVyhyFtYuio/g4mfckL+GCjyf/lK4AX+QrR2jaaXVi4NB8y8O3rb6OcutvKb11O4HHQG8qV+9Yys9l8w46pnYqSfdW49A7dh8Z5D+md75Qd2M6/BkCxbx0NJc+P6ql0OvW4LgQXEW1+g=
Received: from BY5PR13MB3491.namprd13.prod.outlook.com (2603:10b6:a03:1a8::12) by SJ0PR13MB5622.namprd13.prod.outlook.com (2603:10b6:a03:425::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5482.1; Thu, 21 Jul 2022 02:19:27 +0000
Received: from BY5PR13MB3491.namprd13.prod.outlook.com ([fe80::21a4:28b9:927a:9727]) by BY5PR13MB3491.namprd13.prod.outlook.com ([fe80::21a4:28b9:927a:9727%7]) with mapi id 15.20.5482.001; Thu, 21 Jul 2022 02:19:19 +0000
From: Lijun Dong <lijun.dong@futurewei.com>
To: Ron Even <ron.even.tlv@gmail.com>
CC: "dispatch@ietf.org" <dispatch@ietf.org>, Stuart Clayman <s.clayman@ucl.ac.uk>, Muge Sayit <mugefesci@gmail.com>, Richard Li <richard.li@futurewei.com>
Thread-Topic: [dispatch] Draft on Discarding Priority of RTP Video Packets
Thread-Index: AQHYlktSPMI6bAI7k0KoM/nyaaAHya175PyAgAvJlQA=
Date: Thu, 21 Jul 2022 02:19:08 +0000
Message-ID: <3FDA25B3-B692-4281-AD4A-BE1E0395B016@futurewei.com>
References: <00C16072-6D43-44AB-AEFC-3A586DA28804@contoso.com> <CAHy0fzAmg3jhFwm7fptPGRTCEqX6FF-AiRH82f_hciy2HTjRtQ@mail.gmail.com>
In-Reply-To: <CAHy0fzAmg3jhFwm7fptPGRTCEqX6FF-AiRH82f_hciy2HTjRtQ@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/16.63.22070801
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=futurewei.com;
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 01f1b41a-1ba1-4871-c8b3-08da6abf6afe
x-ms-traffictypediagnostic: SJ0PR13MB5622:EE_
x-ms-exchange-atpmessageproperties: SA|SL
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: VhaaIsw/zsYCSiw64Q6l6xrj59m4tHbtY5FfWhwOlzKxJQqpg56zWyqYTYE3Z8Ecb1Hv1/x86WtFm10FIisB9AXRuNaf8mr9V7t3NG7NfR86ckdTCSObHA5LPly500bdLHM5fh14nFtI13s0xDmMGN4XVrMEvyypZ0uuJwMJ5tMqNdpbBvZXv+omz7S4w32UTN+1ggLqEmDSv7Ih5YhmKOLQeGpxkNl14fpi/uZR+V7vYlAXcOPOJ/W1yvilSDddYYcUaKK0B1KVCg/fmdL8hNZP8H1ajjc6tmG2aE+7+f5ngPR9RyopPEDKjZV5OBH8oHVSGhNZfB5BXIrgbV/MJK3SEX6r0GknvGCplT74RkCx2A8VsZjZzM2W4dvp8x6tJWJsVNPzGHMOhCgXTbS5+PhrqLE3OdkCt440Wudn1yY3VCoOYODanRNmCiP5QKCNEzcqDj6ZOEvbVm7Ij3f9IhFtz6/BdTZOaqxLwcrq0JzdrAAEQgE5dIKA09s8ocXmTGLzLZfNZaxaIWMnKAUvDgqh1WSumwCBM8aQxA2ODptRqbX4HIM1+tUzDiAKteKL2uIRl52gdy6FLv1M1FZXicgyCo3KaKBMG1Cg/lAv7XNpqkVPnzGwcIQ0bXaATxX/WdnFTRlmjHjnABBQV5N0pcW31WOGElXS60fCY0uIEL5ioJIp7/OGLCdmvkY7RoLElMOLQtAHMTbQaAZxQ30nm0kX/yVhIzQwVI/MRhlRBhXX3A5iPc+PHobv6I4N6hAaOCkTp/o0bKdCRANbIMl0wqZXuVGB3uDZAqsnCef2ydN1KJWKUm/krP3/sZPeI87ZmSGP5pumMo73IcXgWB3syx2Run5jlChSGWIfd+h+SCRqrV9utwhXjLVKMIXxXbgx0IwpADO/x7DVo5LIVjrMyQ==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BY5PR13MB3491.namprd13.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230016)(4636009)(396003)(376002)(136003)(346002)(366004)(39840400004)(44832011)(8936002)(2906002)(5660300002)(8676002)(107886003)(33656002)(166002)(186003)(76116006)(66556008)(66446008)(64756008)(66946007)(86362001)(66476007)(36756003)(4326008)(966005)(478600001)(6486002)(6506007)(71200400001)(83380400001)(6916009)(316002)(6666004)(41300700001)(54906003)(2616005)(26005)(38070700005)(6512007)(53546011)(122000001)(38100700002)(45980500001); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: +GmsijlMMXutyiIuqdEUWFnXo0l2p2OPUCyZ13QGeoyJFeAacZO+T2zvAHObcbX36+CdNyxF4oqU+/Ic1LSYSE0VkKkCUz/MOmu2MzCsSQL+K/2Pj/09cMtY9c8ULNLKLPfUP+20HpD6AMGdBNrYHsYdLVrLWmSptRiIRp5nEqM8GMkRnE0r7zuumNklzCfjDvRvFkn8H2ezf7Slr3KrD9eCfxrweyZ4fbeecNFhkg3keOrqCJM8i16uKHnZabBznT1H/jmUbI9FUyMy1p+gH1Ax68/K3B90ljhmVW4hCnI/+0EzRvZKnukd95cWfgBLqOnR6xOfLJac8gD26jzRHmtV8jkwelU27O/0XSoDBTlLu8M8G6xpUKzxe0ccP+vSO4lJ7foVqKxrVuyghKweaoxXheP5SDN4JkWWJ2+IhkJOuPjW5/rnw93oS2nUPvP+dBSsTqkYV6UVSBD/l7rgPg8eSpJA/0Emw3Sk8x61kpRkJfT7lqWTt6EkFrAHJe3dJKbnidAOEBGjc0EVosu7Qf6duJ33ELSgD78JFGiGtBJGBWmhXezb15MUEiK5MalmyKjDu+OoQl/+8M/uDenomVBUFOGp0vcJ8faqjrDyY9ZOgnMbrT48ex3w938+fGivnznke/fgJKnlAq4HpkWpDnFsZltYJHQyeB2uZnThuExE6nqIsifZKhErvuBkYmEjO2U84lTV6HVp4PGFioXzt7liMsJVkpre1cXQBItt8jrtzwd3i0pDo67xnja61BQbsS+e3BU/r3yJ/q+HTxyTQoBdgeBnkvsdQHONEYUlQ3Ex7zau5qkL3m5Opz4x8ZOVgU5u/R0FFnFLDPEPPj6VrgvwJoo0NA6HQLaTWJyHsDmMhL1W67atQWThgPNAx2rttziYpy5u1ByXKvgcQ2+JyZw941m25qdCXR8G5+jkgwPCpbSd8+RdZiHtNMxH/rrv9qwJ7e34kTZUBkZYcAbr+Nvgaw3jvAzUWsm0WJKvTIAC+2SZ0vhhIIGdZl98AoDr7Tyj2jBrGV7sX3GxKCsR+cdluNvoVp/zK5RyZ5U3epjwwjIP3177oeZxMWpiN1xIM+Kw/j4gO33VrLYFNz84ND00Gi87eKraYaNbLSoerZ2NzIrqj/q81lGDIAUbO7aCyNI7wacsoXn6KCEoPrme+567oG/GRjwvx8cD3nfRh6SJG/yPpVkm1+/2dJkfw21u4KeW4pkC+b/w/qHxVLNchqQ47OpP8CWSuGxf1yokbSSh6u/G/AOEQf4kbejKvhy9iMULJBKP+zn1qJVTZTp875mnPfDrVqVtYITleN4jd2AuEqAkFDjXnBPsqb7k04xk4IdaVKO9PDsp58PWiiDKINul8UwnS5Pfe+z2gP7YHhdMYPiTNkJkpyY8KSwNX0QpEgV7dqPXOb2QX8XmBHii8ADbNKBpHF3NumroZATmL03sIvCSD+zSNFsQE00m1WrB5kXWvkx7Nn/mFvxbGY5ZcdzoEBLi5zygRjwgn8NG0eR8IxDTLsnCffOp1tq9H2KpfeMGYsnHzl5cuZHB2jIsw5Gf/lbZE8gggd1NDYEwfeKwtz+fNc9dKOA4SN+v/ntb
Content-Type: multipart/alternative; boundary="_000_3FDA25B3B6924281AD4ABE1E0395B016futureweicom_"
MIME-Version: 1.0
X-OriginatorOrg: Futurewei.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BY5PR13MB3491.namprd13.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 01f1b41a-1ba1-4871-c8b3-08da6abf6afe
X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Jul 2022 02:19:19.2570 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 0fee8ff2-a3b2-4018-9c75-3a1d5591fedc
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: qvL9y135r9YSqPI8is2h5029lCjtAQa3q6OGcVHmCBWod5feA/vritcSBeMALqVU909fs4KF+2gJua7aAaw61Q==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR13MB5622
Archived-At: <https://mailarchive.ietf.org/arch/msg/dispatch/8enuBrw4r8-cuXZzlXfel8waXcE>
Subject: Re: [dispatch] Draft on Discarding Priority of RTP Video Packets
X-BeenThere: dispatch@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: DISPATCH Working Group Mail List <dispatch.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/dispatch>, <mailto:dispatch-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/dispatch/>
List-Post: <mailto:dispatch@ietf.org>
List-Help: <mailto:dispatch-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/dispatch>, <mailto:dispatch-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 21 Jul 2022 02:19:37 -0000

Hi Ron

As far as I understand the frame marking RTP header extension and your priority marking drafts, the meta-information from the video stream such as TID (temporal ID), LID (layer ID) for scalable streams, or 2 bits P field for either H.264 or scalable video codecs are included in this extension header.

The RTP header extension would not be visible to routers, because the RTP header is encapsulated by UDP and IP headers. Thus, routers when encountering congestion, would not apply dropping precedence for the packets from the same flow although they obviously differ in importance for decoding and user’s QoE.

My draft points out this priority difference at packet level, which I think you and many others already agree and support. And tries to find a way to let the routers utilize such information for dropping precedence when network congestion happens. I will have more discussions in the presentation whether mapping to DSCP is a good way to achieve this (honestly I do not think it is a very good way). I hope I would trigger your interest in considering other options and solutions.

Lijun

From: Ron Even <ron.even.tlv@gmail.com>
Date: Wednesday, July 13, 2022 at 12:19 AM
To: Lijun Dong <lijun.dong@futurewei.com>
Cc: "dispatch@ietf.org" <dispatch@ietf.org>, Stuart Clayman <s.clayman@ucl.ac.uk>, Muge Sayit <mugefesci@gmail.com>
Subject: Re: [dispatch] Draft on Discarding Priority of RTP Video Packets

Hi,
I had a proposal in the past to use https://datatracker.ietf.org/doc/html/draft-ietf-avtext-framemarking-13<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdatatracker.ietf.org%2Fdoc%2Fhtml%2Fdraft-ietf-avtext-framemarking-13&data=05%7C01%7Clijun.dong%40futurewei.com%7C1bcf58dbf9c34cf2425808da649ff5fa%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C1%7C637932935446599721%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=whCgSZiS5MclEhlMr7oPTzQiCPkeLikX7eqp61umP%2Bo%3D&reserved=0> for defining priority in the past. see https://datatracker.ietf.org/doc/html/draft-even-avtcore-priority-markings-03<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdatatracker.ietf.org%2Fdoc%2Fhtml%2Fdraft-even-avtcore-priority-markings-03&data=05%7C01%7Clijun.dong%40futurewei.com%7C1bcf58dbf9c34cf2425808da649ff5fa%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C1%7C637932935446599721%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=zOWAm6F2rEPRVAMvRDhpz00kHvdb8wh8EYaAlfJm%2Btc%3D&reserved=0>.
Roni Even

On Wed, Jul 13, 2022 at 2:59 AM Lijun Dong <lijun.dong@futurewei.com<mailto:lijun.dong@futurewei.com>> wrote:
Hi dispatch:

I want to share my recently submitted draft on “Discarding Priority of RTP Video Packets”.

https://datatracker.ietf.org/doc/draft-dong-priority-rtp-packet/<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdatatracker.ietf.org%2Fdoc%2Fdraft-dong-priority-rtp-packet%2F&data=05%7C01%7Clijun.dong%40futurewei.com%7C1bcf58dbf9c34cf2425808da649ff5fa%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C1%7C637932935446599721%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=jq%2BlyAeltH2vE1KkLGAiuAe3B59Ate9BNJeTj6woURI%3D&reserved=0>

It is observed that significance difference or discarding priority might exist among RTP packets which encapsulate video streaming data with the existing modern video codecs. So selectively dropping RTP packets according to their significances could be a complementary mechanism when dealing with network congestion and improve end user’s QoE. The draft proposes that the video source or edge node with media-awareness could perform mapping of RTP packet discarding priority carried in RTP NALU header to a DSCP value, such that the priority-based dropping could happen at the packet level when network congestion happens.

I look forward to your generous comments and suggestions.

Lijun



_______________________________________________
dispatch mailing list
dispatch@ietf.org<mailto:dispatch@ietf.org>
https://www.ietf.org/mailman/listinfo/dispatch<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ietf.org%2Fmailman%2Flistinfo%2Fdispatch&data=05%7C01%7Clijun.dong%40futurewei.com%7C1bcf58dbf9c34cf2425808da649ff5fa%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C1%7C637932935446755945%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=kC%2F%2BNyup3UMPCrYSp2vMYCooxW%2BMEnRKZ%2Bq1EW5MUdw%3D&reserved=0>