[Scone] Re: 64 steps

Abhishek Tiwari <atiwari@meta.com> Thu, 06 February 2025 06:52 UTC

Return-Path: <prvs=9132b1f901=atiwari@meta.com>
X-Original-To: scone@ietfa.amsl.com
Delivered-To: scone@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6F54EC1E723E for <scone@ietfa.amsl.com>; Wed, 5 Feb 2025 22:52:30 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=meta.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id mm-KUNvUqj_m for <scone@ietfa.amsl.com>; Wed, 5 Feb 2025 22:52:26 -0800 (PST)
Received: from mx0a-00082601.pphosted.com (mx0a-00082601.pphosted.com [67.231.145.42]) by ietfa.amsl.com (Postfix) with ESMTP id DF61DC14F706 for <scone@ietf.org>; Wed, 5 Feb 2025 22:52:23 -0800 (PST)
Received: from pps.filterd (m0044010.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 5166nxcO030634; Wed, 5 Feb 2025 22:52:23 -0800
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h= content-type:date:from:in-reply-to:message-id:mime-version :references:subject:to; s=s2048-2021-q4; bh=FzB1uu4EjKrCeiOFIwf6 jxTENWUghJqp7xGOZZnS+XE=; b=Ou5CoGlupWvUbYuxvz2JGYLf0udt+SD4qKD/ t9W83Ee/+tjk4xWktObsfO/jsR6N0vMpt/rFQYCqJfggm3tIHvhacw/sFu+0cMfM WsaLST7M5n3Lh68q8cQN8C9lOqstu3drX5icICXoYsOT2n11ebRbF2SfZUCQ8EpL rGVCtPNILsIbj7ji9J7f4/+yHzWwtW37P9vh1x71AgsXxyycbgDWgkxc+F+B6MLK hKC6r/Tz6zw496Gj+1aPwUpc7wywioUj/IeCYuHBzBxrgR4sIqfGVvm9eS7kR+jn f7rxCOGnuagp8s5Zf+s8KcE9rp4YQRkD95QDEPKLHwvvMH9WSA==
Received: from nam10-mw2-obe.outbound.protection.outlook.com (mail-mw2nam10lp2041.outbound.protection.outlook.com [104.47.55.41]) by mx0a-00082601.pphosted.com (PPS) with ESMTPS id 44mqm6g658-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 05 Feb 2025 22:52:23 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=AXod5X22qIDs2P6T4nCzHV/2xujG9LFr4c2Lw/KdtVLEcLb/G//NcIFu0IZ2XLAzggZqARFkj32H0/EfS6zDFJCfKdN1NWgi3h7sjC3QcKSee6650qmH2rC7eDbqxNO5Ww+792fEzah+YMY9KbEARxkiF2/m3+9szVz5x7Aa8WyphS9H8rLhdGu/07Rblf+YKQpGoN/MUA/pDUYcuFTi4UksZvYhi6MtQhqVy2ZKDniS/Obwp8tHhOOnbn8xrc0dZGY6kObSka42asGUM0kdmCBLD+5Uz41f3rBSh70Qco15l9StJpRXY8GQrXq8Tfj7mYON60hlt2niPUmmfcliWw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=xo/XfcaHiy59fFqMk+aFz612mFY2EsPhRHZ7BL1hSuA=; b=nxbw0JBFcfBkvSQryw/9Dh02oGWNa+Tfy7w3Vi9pxfMNeKW/A9mgSdLNgbzT7b3qEkvez4Pe8AAmc4wbgwOtwYE2LwvPjoc9HAzl3rRWRYCzyIPewVe6lwhpnio6Lp4b34J5cGKvAwdpS9ruVJ+X2T3K8Pep1D4vavWJKTQabg0cIW28kb+cFCZXFsXxGROLt7aQUiRN+rWB8k8K0bimqvaR/n2obhl8TY7lzAB0PD3Bglg6JYcBYrzN2IGDqDN9UK6X9R6GIttNt0w9yftfDqG8Kat3JPaRZq3LivO/DqFx0PUgQ4iVXzs6SgRv5a0Vu7EYKCKyqh/7nvjpydQsJQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=meta.com; dmarc=pass action=none header.from=meta.com; dkim=pass header.d=meta.com; arc=none
Received: from BY3PR15MB5044.namprd15.prod.outlook.com (2603:10b6:a03:3cb::22) by CH3PR15MB6379.namprd15.prod.outlook.com (2603:10b6:610:1b6::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8422.11; Thu, 6 Feb 2025 06:52:21 +0000
Received: from BY3PR15MB5044.namprd15.prod.outlook.com ([fe80::51bc:d9f2:89d6:4bbf]) by BY3PR15MB5044.namprd15.prod.outlook.com ([fe80::51bc:d9f2:89d6:4bbf%5]) with mapi id 15.20.8398.014; Thu, 6 Feb 2025 06:52:20 +0000
From: Abhishek Tiwari <atiwari@meta.com>
To: Martin Thomson <mt@lowentropy.net>, "scone@ietf.org" <scone@ietf.org>
Thread-Topic: [Scone] 64 steps
Thread-Index: AQHbeC9iTSbylhdkf0W+ntR8cRmtlbM51qPu
Date: Thu, 06 Feb 2025 06:52:20 +0000
Message-ID: <BY3PR15MB5044DAFCAE774CD73C68023ED9F62@BY3PR15MB5044.namprd15.prod.outlook.com>
References: <fd78838b-3f33-42f0-af0a-f2fda543cc99@betaapp.fastmail.com>
In-Reply-To: <fd78838b-3f33-42f0-af0a-f2fda543cc99@betaapp.fastmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-reactions: allow
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: BY3PR15MB5044:EE_|CH3PR15MB6379:EE_
x-ms-office365-filtering-correlation-id: 96fa9115-a706-4b6b-be2a-08dd467acda2
x-fb-source: Internal
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;ARA:13230040|366016|376014|1800799024|4022899009|10070799003|38070700018|8096899003;
x-microsoft-antispam-message-info: gwOr8GKpym3+5GM52Bq8R87m9XZeF4zQS3VxJYxgWIXOClSfhcsaAv6ZYDxTj6RQM47oqzHpRKSaHTy9zWUisIjuv76+gYhmfmvZrhcl3RyFn6hjwC471C8MZlfLtzWy987gLxEco/BrNiFQ1YQa0VGtHT+gl+mFwrUIH2V3Eo+5sxM5P4FU/2jhqK9Nnkv8UcDnAhWuaEGHrrqXpPa/D2s2sttpE54zfwlIYqjYORF6/OU4Xi2uirm10NblUavVTh7vx9Bup+CTqPax1pvjoO/+XcFC4OXKrqPsZ0pBIH0lco7EyvwLTLs0lNri07E/EijWOGEuw44cm3LfrGttYZdxuUY+RxMXWtidSAGTtt+DD7Vwy65K+K7yamauueS21KSytd6YuSwWF2Ti/EdaRcLwoJNIePQO47F84/XGYrP8SYId46hscNOMXN0d5HWO1LCsDLINCOOtiuy6bwAkk+9izG9rS8dV8ufJkKSH72GRyvaVBiqx21P2MLQoVJDoAXbJRaOuHhAEhEuRoxIoekzYN4eOwM5UWNecxyT/FQtqEPmVOD8i8CB7pLXfoqVkHrOSex4DOE4uRXPp2GDWaArw/OGF4RexKv9ssSlCM/UqxkpxcgW3xlVqxmLAz41MMoB4O+y6FWs9SXln3kGKTJUHCqMEjEGa+B7npJk8UWsAUFB23Ktuhb5PE0oI/sw1A9dRoXpc1RFnvEC59lTzvBTLBUNz4CAVlEugyo9CtDNZJpZupuQsWRw5x3USqtGFzZ830SIF2W+jSTuToRBl8Hrz1zUhT4/rlTrl8M5Mh5S5zfZgMeRcnokiSVEtk/BI/EINbd6W+FbB3knI/n4LDkfBnpucUi8VO7jBKQk9vQOPw57iyrCSQvjFoI+++XwcqmvOPvLdTCZir1IKqrYzC6f4zik+izlxg6JLxIlR4DUOIB9t3G86qSvnyhkqeypzPIqen98zz1WI6ynCvwN8Lx+wTApmnjCTb2GQjybfUCZAAxVyRcib3xFmdW6Ssm80oYEUGmAvggY5WT7DUnN6ua7qeMElh/FDPvCA0Esa6csMd7lKkDp/ZWyd9djYupaV8GP2WVYWC++q6o73r7muOiFFrm23K136VhlZm2ooKh20D8gf8Jr2Jx38Q5pZOJkYaPvl4e7yNNrfMW9WPfCSbxCFQ5TZV2X7lQA9AwFmfGpQO1HDLhN6NPWo7jeUawAUU4gAZho1/85f+kL8OwnB5rcznJO0YeWrqGco6QZoSTuSK4sMs1exY+0OGXZapHeWl03QyuxhrH7LwqeOnnPEODN2MZKUrK1e3WaqEzl3bMavksv7C7NI6Iq+0UlmtrpuaNqbQMSwQ8a7OeBZjaCovZClhyaUc4RX9CXnbVd/k+gR7eRC5mi7OghNy6Gty9FhC4cj3t/y+QkXv2MWbPSdNtTEQji24YbE0emDBakMvbOzi2BmE8AtHjZwVCDw3ccb
x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BY3PR15MB5044.namprd15.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(366016)(376014)(1800799024)(4022899009)(10070799003)(38070700018)(8096899003);DIR:OUT;SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: NXfjFqC4VcaYisn+wTGrdDQ/G6SH0rKZhg6uVFLAaawKC/ssMmMy4yfTnPhDfMcEwRVzMpD5ZDbgEZ1uYUG4JAdK2t8iDLyoaae+B1a59A3vRgRBM/Ht15utzAQ9iIQX3tvkmHIz7t2WyglFUzXsy2PXgnzTTrsbN0rNlGJJEr+6dXCH5lSw9nOemLcut6R//b4mwFKVISXGo36OSyffjHFKZbRMCbSnBeXf3iR2nHpiXmDfBhDk20AkxJYx1Ji9Jpxeh/WY+qxmskEs0Ay4/cLJ2aCtfesE//xTSVKIE6JuURlyejq/IKqUBu813OnIClCnW3ff/vCTXDRLtWN6ZJ7y1QwVX0zLJMF5g31rH2h1jbQg69qeyTQVhRRZqZ7KDzEJE/89OnM36YaWVTUB3Bw4FV2HVd/whd5JSEAar0IkLR4ZoxKimgz/KzsVnqfbqnVY5cXQrjoqUpewYmXMOqA1jA84b03N5pEDapjyv7q0fqOwiaoX9Cf3qjLnB+qprwFJrTvQPm4nVzc0ztOLMUCGzsetmtS7iQPrdMEbwuuQrzHDeTE+qvYG3e2eJbKjSiRbdaSwjKB/biNWP3vaZ55byUnZMm60RKcnChKAGwpcIVAH+HvEgKn9gGKtGD6ycATjYjXWTpusaTDI/c6rxrJBhsxyPi7w1NUGimvlQpRRYoQ/IejvuymcqEKnkPeShT8uMoxGDYqwBpvLIhzYxmrsyhX+8vWQU03bt3XLuoBnlg0tMLgqK/W6gh2ZKbzAGciF/qCzUc+l2cOyxtelqR5c3f7ZKen3srHkLuN+J1FigRbPP+gqoyRot6lidojQjDDs8GvcnTTCjMuwgpBpRG13ebfv41ego72h7n4znAYegwq3ioeF3LYo0iTOqtI2femO/qR+2PdR6lpIVakFkM88DDGbT9LQhONbOAG84dOrI3lZZCtoDfyuwH1HdyC3jDE/swyI4vZENzjVVaoedA3nHlxfAWLfPK1MXsQ6Ht2r/0HXx5p9opMZePkQxzyMeiYEBgWQaMc+hgnxUtoO+f/g2v14j3kTf3GCtAyWeGcBNDvTSHckwnvASeMrq3DbDPfjISfIar7kRycMuTlTV+uwehCeYIZXLaBtJx/gd9GDID6o/7t2+PTrg982j1u7U6LVBxCBeVGMYzTvGpXvtxrK3KX3+BhubZTalkFZjd28hCzvXq2lRHwaLHaZDY1IVKStPcaMgWTSiEwmbObsFMWh5+oVqWelF91xnPPfO6AoaSVClz9ZLhxlbb82+ZiypGrF7+sK11gwol14DkAPHPEdEXKEcN/9SibUcCJMZNUlR0BXtrTSyq71wH9UFV1boLg45j1TAjtKOl3DBDs2u2nZkyGgO3t5pUvAT5XtLsIA2mLfRsMVN+BZ1Dzvh0S+qjLXpdxs0nofZEBjqgS5v0sza+uC4NfUl3c+Eza7qtpjdjuwdX2J+//eAAjJK1VuIaW3vTxR0qIBGM7j/W0oRrFcKpvDJp3QWWkFoZf1+kGPITDks9vQkPTQqwhHmauDHovfEBf4f1VEgF8IWiq9WdGyk89K3q+tFnD0HmBbD4L1JzaPoQliDJQJduPT8NGf+njD5+EUWo7DkqGosSFlpK/mg7Tfdb+dX3fJdn7H7dM=
Content-Type: multipart/alternative; boundary="_000_BY3PR15MB5044DAFCAE774CD73C68023ED9F62BY3PR15MB5044namp_"
MIME-Version: 1.0
X-OriginatorOrg: meta.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BY3PR15MB5044.namprd15.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 96fa9115-a706-4b6b-be2a-08dd467acda2
X-MS-Exchange-CrossTenant-originalarrivaltime: 06 Feb 2025 06:52:20.6015 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 8ae927fe-1255-47a7-a2af-5f3a069daaa2
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: ZfX1jB7o0WwZygQEVOFNvOCLBRzLlfhWVS0Zdcfsg9tjSD5GD9vk4EEOQeHKHkkpNVAriLtfc2SVHGjWbjc82w==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH3PR15MB6379
X-Proofpoint-ORIG-GUID: nm2tFbGP8gMZMCwA1aPqzeCd0fAcOp7B
X-Proofpoint-GUID: nm2tFbGP8gMZMCwA1aPqzeCd0fAcOp7B
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1057,Hydra:6.0.680,FMLib:17.12.68.34 definitions=2025-02-06_01,2025-02-05_03,2024-11-22_01
Message-ID-Hash: 5D5IPF2ORFCZIES2VKOSLMSEQUF4HLMT
X-Message-ID-Hash: 5D5IPF2ORFCZIES2VKOSLMSEQUF4HLMT
X-MailFrom: prvs=9132b1f901=atiwari@meta.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [Scone] Re: 64 steps
List-Id: Standard Communication with Network Elements WG <scone.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/scone/mOXuCYx5CwbJQzX0BHsFCsWujh8>
List-Archive: <https://mailarchive.ietf.org/arch/browse/scone>
List-Help: <mailto:scone-request@ietf.org?subject=help>
List-Owner: <mailto:scone-owner@ietf.org>
List-Post: <mailto:scone@ietf.org>
List-Subscribe: <mailto:scone-join@ietf.org>
List-Unsubscribe: <mailto:scone-leave@ietf.org>

Hi Martin:


Thank you for beginning this discussion.


Let’s consider the question:  “How many bits do we need to codify the rate advice?”


In my opinion the methodical way of answering this question will be for the working group to first understand all the requirements and necessary data that have bearing on this question. I am going to start stating some of the requirements and required data below that have come up in my various discussions with content providers, communication service providers and equipment manufacturers:



  1.  Need to specify how to measure the rate advice in addition to the rate advice itself: Since we intend to send rate advice from the network to the endpoint, we need to make sure that the procedure of measuring that rate advice is clear and consistently interpreted by the two parties: (1) the network and (2) the endpoint. From a scale deployment and adoption point of view, the two parties should be able to independently measure the same rate. Otherwise this can lead to confusion and render the rate advice signal useless. To achieve this unambiguity we need to also codify answers to the following questions:

     *   What is the time averaging window used to measure the rate?

     *   Since video traffic is bursty, will this time averaging window stay the same or be variable? If variable, how do we specify it?

     *   Are we specifying the average rate, Median rate, 75th percentile rate, 95th percentile rate?

     *   Do we specify both the median rate and the peak rate?

  1.  Global survey of current network throttling policies: The working group needs to have this data to make sure that the number of bits we allocate can work in practice. I was given an action by the chairs in the December interim to bring this data to the working group in 2025. Using our existing http connections, we (Meta) have CDN/client based measuring techniques that enable us to estimate the throttling policies over several ASNs around the world. We are planning to compile this into a report (with anonymized ASNs) that we will publish prior to the IETF 122 meeting in Bangkok. I am sure other large content providers can also measure this data and I encourage collaboration on collecting this data. These throttling policies are derived from subscriber plans and/or network management considerations and/or network investment considerations, and/or radio access network efficiency considerations. If we do not use this data, we may end up ignoring some of these considerations, which could later hamper the scale deployment of the standard that we create.
  2.  Application considerations: Currently the driving application for the working group is video traffic but a growing and very important format here is Short Form Video for which as Matt pointed out pre-fetching is necessary to maintain user QoE. Such applications will need burst allowance. Similarly we also need to forecast what kinds of rates will be minimally required for decent QoE of new application classes like AR/VR, Metaverse, 3D video streaming that may become viral in the coming years. I think the quantitative analysis that you presented is a good first step to understand application considerations.
  3.  Network considerations: Christian has pointed out CPU consideration for processing a large number of bits by the network device.


I encourage others to bring up considerations that I may have missed.



At this time, all of us can agree that the number of bits to codify rate advice has to be bounded, but I think we should decide exactly what that bound should be once we have all the above data.

Best Regards

Abhishek Tiwari Ph.D.
Systems Lead
Meta Network Infrastructure
Meta Platforms Inc.
atiwari@meta.com<mailto:atiwari@meta.com>






From: Martin Thomson <mt@lowentropy.net>
Date: Wednesday, February 5, 2025 at 4:38 PM
To: scone@ietf.org <scone@ietf.org>
Subject: [Scone] 64 steps
I appreciate that there is a desire to have great expressiveness in signals.  I sat down today and did some basic sketching to see what 64 codepoints might get us in terms of concrete rate signals.

Let's start with the assumption that this is video delivery.  I found a paper suggesting that you could do video in 64kbps, so let's put that as the low point.  8k video at 120fps in 4:4:4 uncompressed is 120 Gbps, which might be a reasonable high point, but let's just round up to a clean 1Tbps.

Hitting powers of two across this range (2^16 to 2^40) takes 25 codepoints, but that might be limiting in those areas where we see a lot of real-world activity.  I doubt that anyone is happy with rate limiting at the ends of those ranges.  Still, we can start with assigning codepoints across those powers of 2.

More realistically, video is compressed and runs in a fairly narrow range around sort of 2-20 Mbps.  I found some suggestions that 40Mbps of AV1 gets you pretty reasonable 8k performance.  Video performance at 1/100th of that is pretty grim and the 25 points above already cover that 0.5Mbps and 1Mbps, but you can take the remaining codepoints and dedicate 11 to the range from 0.5Mbps to 8Mbps in 0.5Mbps increments, skipping those that are already powers of two.  Then add 11 more to the populate the gaps between 8Mbps and 20Mbps and 9 more to take it up to 40Mbps in 2Mbps increments.

That's 56 values, with 7 spare (we need one for "infinity" or no signal).  And I was being generous.  64kbps is low enough that no self-respecting network operator would be capping that low.  Similarly, the likelihood that we'll see this sort of signaling for network throughput of 1Tbps seems like a bit of a stretch.  There's probably room to cut in several places and recover a few of these.  And we could spend those spare values to get more resolving power somewhere, extending the range above 40Mbps, below 1Mbps, or inserting finer resolving power elsewhere.

Does someone have a case for greater precision than this?

_______________________________________________
Scone mailing list -- scone@ietf.org
To unsubscribe send an email to scone-leave@ietf.org