Re: [tsvwg] I-D Action: draft-ietf-tsvwg-nqb-19.txt

Greg White <g.white@CableLabs.com> Mon, 09 October 2023 22:23 UTC

Return-Path: <g.white@CableLabs.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 27001C151070 for <tsvwg@ietfa.amsl.com>; Mon, 9 Oct 2023 15:23:44 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.108
X-Spam-Level:
X-Spam-Status: No, score=-7.108 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=cablelabs.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id gh-Rm1q5fx46 for <tsvwg@ietfa.amsl.com>; Mon, 9 Oct 2023 15:23:39 -0700 (PDT)
Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12on2109.outbound.protection.outlook.com [40.107.244.109]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id AA0B1C15106E for <tsvwg@ietf.org>; Mon, 9 Oct 2023 15:23:39 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=GdwUVULjM8IjwE8+ElqAcmBqVrUchVL1EY6b4TKE+9EiImHIrv/AwKN7w3wRwMtyByiiJRb+Av0+P/kPJpjsyhLEpCtodjlMuQzOXK+Z0z7JYupFuHqObsi+zI5HmiAF0iisZa3Xav7XX385YQ+t8xTo4HWowzpAiwoJznvilLOp5OwQEGw4/QSwFTTgGMWDGnErCg7gz64poVyf+VFvt/lTGHU/lq4yqpFRD44IVOfNGXmCyRqDH9/BHnuLomaiMKlk/XDTDiNNzH5zDXBrqKpGAKSkyxwC2QDwsPZIOy6NTWWBhay3UkUpg/FROY3GVYifD1YV0C9QVCpU2mTDVA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=9GXadfLBUu79jkqk4wkRjf9ZqH7nwt11cQ02L5GtaTg=; b=mnIrD5Zcq6h5uipH6waphDDuvJp3ispHRh3fhgxMGsvXdfaF/rliEkPrWDcLTnlETQlFS+c8YByYSlDPGYZ4PHqRdLOCU4cegoPO/PuP8po0WKDmBbEDmseMbUqxTbd/Kiy2fZ+pPPjE4QehbOYeGTylDzfYqQwb2cNRCyJiAnrj3h/DWoxyZHc369hSIedVi7x4CVK8DHk6IMemDFxloo2ZG6ZMeZdpM7emqNPgEUt8YbPh2/6RKkTGz423The+g2IntIJoYC/bPC/AeQNjMm43K+wBwF2HutaWkypnHafObw0m91erIhhDK5c9JTJvH6L9XMWHZK5BkQnJGA7P6g==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cablelabs.com; dmarc=pass action=none header.from=cablelabs.com; dkim=pass header.d=cablelabs.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cablelabs.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9GXadfLBUu79jkqk4wkRjf9ZqH7nwt11cQ02L5GtaTg=; b=OC+7wrHBSaYjNtLsMwPFdsrWbU36DuuQCzs9Z7Yilo7XESihgqvYs30XX8eKabGUP/0mMSIJlwm9j27QGMA+GSejmxcISW/g7WPsen0ksyVqVGUVWmnkLl/2wdhafYvj6oUC6QjV7T0RPVv0LeB1Dc6UALAXfx5HUk5EVqOOSrbbov79M/f4Ewi6wPRGBCqT/0GibdUYOFfZR+cs0ETun6aWnOkLhx2CjRwoGckixTiHmQiZmmW71KqT21tgpOkc38vqf5UyUKkxCNCPp/E43GKy8YMTl++EGrXFLXK+w6QiVYPXQGiE/S2+FFh+tSDEbuNdFBLGOBnJuTwfHDfVNw==
Received: from BYAPR06MB5893.namprd06.prod.outlook.com (2603:10b6:a03:14e::22) by SA0PR06MB6891.namprd06.prod.outlook.com (2603:10b6:806:ba::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6863.37; Mon, 9 Oct 2023 22:23:37 +0000
Received: from BYAPR06MB5893.namprd06.prod.outlook.com ([fe80::ea5c:2a13:19f4:20]) by BYAPR06MB5893.namprd06.prod.outlook.com ([fe80::ea5c:2a13:19f4:20%6]) with mapi id 15.20.6863.032; Mon, 9 Oct 2023 22:23:37 +0000
From: Greg White <g.white@CableLabs.com>
To: "Ruediger.Geib@telekom.de" <Ruediger.Geib@telekom.de>
CC: "tsvwg@ietf.org" <tsvwg@ietf.org>
Thread-Topic: [tsvwg] I-D Action: draft-ietf-tsvwg-nqb-19.txt
Thread-Index: AQHZv+PdHVv8Vf6utEiMXiEeyJLNSa/XABcAgCwu+YCAK+c6AIADHmIAgAeLiQCAAIX0AIAA+oQAgAC6PwCABYEGgIAAni4A
Date: Mon, 09 Oct 2023 22:23:36 +0000
Message-ID: <FCE3FD68-C7A9-49A3-826D-7FB5C889D059@CableLabs.com>
References: <169039129927.3244.8784605239288349316@ietfa.amsl.com> <FR2P281MB1527DC4707D08819E2CB2C5C9C0BA@FR2P281MB1527.DEUP281.PROD.OUTLOOK.COM> <09229EDF-FC35-4B7D-8FDC-9DE6FC52F4BB@cablelabs.com> <FR2P281MB15275C371CEABAAE45A8D04D9CC2A@FR2P281MB1527.DEUP281.PROD.OUTLOOK.COM> <AEAC6797-B696-44B6-8B11-47FE301FDBB6@cablelabs.com> <FR2P281MB1527DEED986145655AE29EF49CCBA@FR2P281MB1527.DEUP281.PROD.OUTLOOK.COM> <77508B12-34AF-4FCD-AB99-0122763EF3BD@CableLabs.com> <FR2P281MB15279778CA14AF10A4E3133F9CCAA@FR2P281MB1527.DEUP281.PROD.OUTLOOK.COM> <9EC98251-A85C-4906-8EC0-F7F949F7CCD0@CableLabs.com> <FR2P281MB1527295624EC620CB12A9C2A9CCEA@FR2P281MB1527.DEUP281.PROD.OUTLOOK.COM>
In-Reply-To: <FR2P281MB1527295624EC620CB12A9C2A9CCEA@FR2P281MB1527.DEUP281.PROD.OUTLOOK.COM>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/16.77.23091703
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=CableLabs.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: BYAPR06MB5893:EE_|SA0PR06MB6891:EE_
x-ms-office365-filtering-correlation-id: b24fd106-2868-40ee-aab9-08dbc91661c8
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: XEzWLLJIxAbzVPUDcDIEtCcmsoUTsAFznzo9OrM6aLJVQ8JwhG0gk0e2YXkrZ9FVxooVm0b4TBMx3o6UhGkYaB4koDTTLHneer/gTQ5+0pRtVli68otazsXskuEc4mn+QPOgbVq8YAVC2FJ5hnHGh6IE4vtF2ynRsUDtIeqgD2azZxBkcs+PDtFBLmanqh2rfCRo1BeBhUlwUjgf1BvGRcaS9PNvFSn35kBylZ0MONHD6LXf1goCMol0TW8A0x3kOoNeMr++lRtake9dbawxjNG2L3dve2Fsti0MRepAqNznz1SeQzcl0pxMbB5P0tvKt2hvuQtRDd5ymb4EHlvtsR7Ah/nezqjlbULYOsl6vOK6pFQqPLrzpRmSXbj9DGQ9YkVzXAeac5oIC00CuXItIICcdSEDC82LV+GbNh5Q8BIOm+KRuOFGe7muqpxJ7tU6aHgqHx9HDcPfQBqC9wtRAAy3V+OTkWz+CEG1FYwRiG5GDtQiHDtS9P5TMWkHG0HwhtEwLFRnPieYoaN5B/PhxtSMiuK9aNROT2ysoQI70kPTEEZEvvO7DbSDcHpL4/WyUOHI7T2PSz7SJ7Z5x6a/uL1BlAsSPKDqQx3+0djmeU4wqid6jYNe8XDifXpdEfhIx/wFNMSJWO8wY/uqkrdKSDvphk3qmD6FWcSD6bp/iQE=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BYAPR06MB5893.namprd06.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(366004)(396003)(346002)(136003)(376002)(39850400004)(230922051799003)(451199024)(186009)(64100799003)(1800799009)(66899024)(6506007)(53546011)(2616005)(6512007)(38070700005)(36756003)(86362001)(33656002)(122000001)(38100700002)(83380400001)(6486002)(2906002)(66574015)(71200400001)(41300700001)(478600001)(316002)(8676002)(8936002)(4326008)(26005)(5660300002)(66446008)(66476007)(91956017)(66556008)(76116006)(66946007)(64756008)(6916009)(45980500001)(85282002); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: dhQ3j4AJnmJLEuosEIl36wJnhSm0IZ5XRwdFuO2bnGT01zA6XQ+ulVuTzR8NkYXtG17yg+uHig99jukBdGG10hfqdEjG63ypvqgpKLxZ5XB3eBxPxO3dDAJFrAx0zduauk4yaa9uZGNqYOiB54uzZrWE4l5Iw3deBdVd4qCOKwiFTQw46QysSBv92CGHdX6/BGU3UAnAttgszn/q7929f4XuyKwYFNDA4EWHtnyyL6WC+SyXGdukul3QDTOO4hspB0IOdsZq1lDr43u28B4kEORbJfqy7tViwPKAwcH3M5YxDqNwnyjRe9jO3Kku8jAC/KbLbE8ST3pmG1wRn2qQ0GIFkPJ9U30Wq10ntC+ldNpnA79qg8zxBqq1iVo9YC2GQpubfL/6oJK2co5yk4c/gMYpiILPTq+GpP+5FjYPkCwGGpUZnOPDqINBS9WDlHMHx92Oobjv4Gn7ex8sMmcyNlviHAFkod1Bgiht31tjQZ0pv0pKH+7hsnJXpBevLIj3wuIbHM/Ypn7+I2dC5m+eT+kWaf90SO/jyT1VJIOTIzq+34QfTvIzwHayeDRh+w7GzvM+t+H6Tu7cAoPYkc4OYnyo6SI7sz6GPoLAFm2uo5K5aJyOmgm7Rnu6Vnh4cWRKBp1vG5XzfIM9UgLFROUagGVLsr6m4/thfHWneV/JWu7kiy+cH4Ms38GHK+Fbgw7GcR/H0hJW0bJeu/ZcEvn9NVhsnT625/2uZsbi2LuUpds7jgjkQF11IyTX5RQD9wW4tIGjrWv/H7Jgw2e2N9ZFevDWBNjy/4gvUaniKVz3LGlfNYOkPSR3moGqgRD3pjJy9wgFNh/D1M7BqOOkKUKRWjR+PbGO9GUqXVJmfYGxubGfyDz8elGhHAZ1oKLldNgWFiNhF8YSodBnO1onmf1/+AZZFgNW++Se8OOCEBYHPn8WccuR6WH+lR5P59bPXABJbUUmIDyT5dXvNt6W1sisuqy7xeBkYhlLadQYcNqA7+S54G2C7jGNktOBoroJ2qalMRm9KtVh3wsbTh30Nr3sx6cb+PQBjnq7mvXuy73bfN7Cb3LaIWt+NuTvou8U3T3Kr48s8KgQB40yobBFLcL4yWZNIb+LwBanGH5/q5RumsTocwkFn/T5UIBtIUaBPPRbSCjpjc/45cxlMTC+oAD/AHz5B2QrkxbWAgfC3vrzNklc/HsLHvuRjc+EA2pnxlJNbpqbqRueEVVV8ObQ2u6RED8VDV8925JXsrQo6ShEyl5eizycbB9Bv2BHPvdvGhDyNFOfkMFGuvVO7hcXK2X+JeOykDwvaeopMtuWT+Wk1oSnhjubBwbtL0iCcVqiilGSnDzPvlJvmHJEENnFt2MvFt+OgQeLV0qfGkdDkO8Ill78UBOFYqaMOZ6xW98L/up8dgvZixiA4euuaTOecvmDbkwDhfe/192k6T4bwtKciCbQJQaxrAZOLe5zJHIQfvkN9/EaVlOM5iShNMCD3KAPtImgOwxtbkiLAPsUu0NoHe/vt2t3L9metDNJJuUOH75lNeBTzxDlM6PNpLueCXWY2vvk8PvvkK1F3R9jt9tJNzuZjNWkQXmlz5VI34DMuQPPJuddFL8PUNr30zsCuxJCiw==
Content-Type: text/plain; charset="utf-8"
Content-ID: <8AAE109613061744883EBD69AB341DC3@namprd06.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: cablelabs.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BYAPR06MB5893.namprd06.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: b24fd106-2868-40ee-aab9-08dbc91661c8
X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Oct 2023 22:23:36.9690 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: ce4fbcd1-1d81-4af0-ad0b-2998c441e160
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: K/VFyTRUFnegXsSEVteFUTfTWnv3LEWdNn/fFpNAPYXP8Bv1CpgrfsTJ/JwwUlmxDNGK/wb5FXVzMBSha3Z7jw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA0PR06MB6891
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/OY4nYYQkhm4cHwCz_zLwwcUtQzY>
Subject: Re: [tsvwg] I-D Action: draft-ietf-tsvwg-nqb-19.txt
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 09 Oct 2023 22:23:44 -0000

How about:

A node supporting the NQB PHB that provides rate limits or rate guarantees for Default traffic SHOULD ensure that such limits and/or guarantees are shared with NQB traffic in a fair manner. This could be supported using a hierarchical scheduler where the rate limits and guarantees are configured on a parent class, and the two queues (Default and NQB) are arranged as the children of the parent class and given equal access to the capacity configured for the parent class (e.g. with equal DRR scheduling).

-Greg





On 10/9/23, 12:57 AM, "Ruediger.Geib@telekom.de <mailto:Ruediger.Geib@telekom.de>" <Ruediger.Geib@telekom.de <mailto:Ruediger.Geib@telekom.de>> wrote:


Hi Greg,


thanks. You write:


"The NQB PHB describes a hierarchical structure that associates the two queues, provides rate shaping/guarantees to the aggregate, and provides DRR scheduling between them."


Please change or add text in the draft clarifying that. I've yet missed text or at least a hint, that the design is preferably by a hierarchical scheduler. If other options are valid but not recommended, please be sufficiently clear in the text. An example:


Hierarchical
Parent Default: 10% of linerate
NQB: 50% of parent rate
Default: 50% of parent rate


Assuming the aim is to operate Default traffic in sum by 10% of the linerate, an alternative (largely identical by scheduling) to me is 
NQB: 5% of linerate
Default: 5% of linerate


If this draft is to technology agnostic, the functionality should be described, text example (:
The parent Default scheduler capacity is shared equally by Default and NQB traffic (e.g., by configuring equal DRR scheduling between them). 
Pick a different term, if "parent Default scheduler capacity" isn't your preferred one - it just should be clear, what it is called.


If you prefer NQB not to be technology agnostic, the text should state that explicitely. Example: NQB is preferably implemented by weight based scheduling mechanisms, like DRR.


Regards,


Ruediger




-----Ursprüngliche Nachricht-----
Von: Greg White <g.white@CableLabs.com <mailto:g.white@CableLabs.com>> 
Gesendet: Freitag, 6. Oktober 2023 02:54
An: Geib, Rüdiger <Ruediger.Geib@telekom.de <mailto:Ruediger.Geib@telekom.de>>
Cc: tsvwg@ietf.org <mailto:tsvwg@ietf.org>
Betreff: Re: [tsvwg] I-D Action: draft-ietf-tsvwg-nqb-19.txt


Hi Ruediger,


Please see below. 
BTW I'm trimming some of the earlier messages from this post.


-Greg




On 10/5/23, 1:47 AM, "Ruediger.Geib@telekom.de <mailto:Ruediger.Geib@telekom.de> <mailto:Ruediger.Geib@telekom.de <mailto:Ruediger.Geib@telekom.de>>" <Ruediger.Geib@telekom.de <mailto:Ruediger.Geib@telekom.de> <mailto:Ruediger.Geib@telekom.de <mailto:Ruediger.Geib@telekom.de>>> wrote:


Hi Greg,


thanks, the proposed text is better.


Proposed GW:
As a result any rate R that is configured for the NQB PHB is shared equally with Default traffic.


Alternative proposed RG:
As a result any rate or weight R that is configured for the NQB PHB is identically configured equally for the Default PHB. Also the access to spare excess capacity is configured identical for both PHBs, if explicit configuration is supported.


RG: Sharing: I agree, that by identical configuration and picking a suitable queuing mechanism (e.g., D/WRR, WFQ), two identically configured queues share resources. But I think the point is "identical" configuration. I further extended that to access to excess capacity (unused by another queue, if present). Some vendors offer explicit commands, like access-to-spare-capacity-priority "low/high" for a particular queue. 


[GW] I don't believe that is true in general (or in the case of the equipment that you are concerned with). For example, two queues that are each identically given a guaranteed 10% of the egress link rate don't (in general) share that guarantee. When they are both saturated and the link is saturated, the aggregate of the two will be guaranteed 20% of the egress link rate, not 10%. Similarly, two queues that are each configured identically with a rate limit of 30% of the link rate will not generally share that limit. When they are both saturated and the link is not saturated, they will in aggregate consume 60% of the link rate, not 30%. The NQB PHB describes a hierarchical structure that associates the two queues, provides rate shaping/guarantees to the aggregate, and provides DRR scheduling between them. Linux htb and DOCSIS ASFs and many network devices implement this hierarchical mechanism explicitly (some call it 'hierarchical class of service' or 'hierarchical quality of service'). In some cases, the same end result can be achieved in equipment that does not support hierarchical structures - but it is not possible in all situations, and it requires more than simply setting the parameters to be the same between the queues. I am comfortable with defining the NQB PHB under the assumption that a hierarchical mechanism exists in the node, and not spending a lot of time on the details of configuration (and limitations) in the case that it doesn't.


[GW] To that end, would you agree with a statement in 5.1 such as:
Support for the NQB PHB can be achieved in a hierarchical scheduling system by configuring two queues (one for NQB, the other for Default) that equally share the rate (limit and/or guarantee) of a parent class, and don't themselves have a rate (limit or guarantee) configured. In certain situations, it may also be possible to support the NQB PHB in equipment that does not support hierarchical scheduling. 








RG: I'm having trouble with the following sentence and prefer it to be deleted:
Thus, the NQB PHB does not guarantee any serving rate for NQB-marked traffic that is independent of the offered load of Default traffic.




RG: If there's a minimum bandwidth guarantee for Default PHB, there's a minimum bandwidth guarantee for NQB PHB too. A configuration where this doesn't hold would consist of an NQB/Default PHB based on access permission to excess bandwidth only AND the consumption of all spare resources up to full line capacity by suitable configuration other PHBs. No doubt, such a configuration is feasible. But assuming it to be present and a pre-condition before NQB is deployed requires an explicit statement by the draft, I think. I'd like to point to the RFCs I've referenced to again, stating that Default PHB config should avoid starvation or have a small guaranteed bandwidth, respectively. In that case, the same would obviously hold for NQB (which then receives a *limited but existing* bandwidth served independent of the load of the Default PHB).




If you partially agree, on the upper part hopefully, let's separate issues and discuss the latter issue (independence of NQB bandwidth from Default load) in a separate thread.




Regards,




Ruediger