Re: [tsvwg] TSVWG: WG adoption of draft-white-tsvwg-nqb!

<> Wed, 11 September 2019 12:30 UTC

Return-Path: <>
Received: from localhost (localhost []) by (Postfix) with ESMTP id 4A4B21208AC for <>; Wed, 11 Sep 2019 05:30:26 -0700 (PDT)
X-Virus-Scanned: amavisd-new at
X-Spam-Flag: NO
X-Spam-Score: -4.297
X-Spam-Status: No, score=-4.297 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_MED=-2.3, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: (amavisd-new); dkim=pass (2048-bit key)
Received: from ([]) by localhost ( []) (amavisd-new, port 10024) with ESMTP id eqkjrYiLKOCp for <>; Wed, 11 Sep 2019 05:30:21 -0700 (PDT)
Received: from ( []) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by (Postfix) with ESMTPS id 497021208A7 for <>; Wed, 11 Sep 2019 05:30:20 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;;; q=dns/txt; s=dtag1; t=1568205017; x=1599741017; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=69HVLZVIAC4PASsWHiIgvE/PZEyqjqxbwUhWxQDwwLw=; b=yiioyOAkpkwMKb/Ihsb76/GcBvZ7SQqMZLJDJBR0fidUt2rRJV5sL2BA yfg5YChUzRv5xS/BlJ4Q7CUKZ5Zmybc35KR8ZNmEpfCYO41w5OvhQWoS9 y5C/sv4eU9RkHOSuKZIO6xCp92sTqsp1YL+/V7r1EAeRaqCwuTy6ndReJ aeRB0q6y0pdgC7AwFK+fmDaxxDuMgIhDuPqiUoY9cKV2VznIKJFJOV2dj vlzcZJtaL1pPJg1zwSRXgn7Smd6t9/bW7qJGh5VqHUZb5uYhvOMNvNkeo wLpkXRhZnhW5MBAyOszc7i9yOj1QcPq2qSNWGh00xliTFIc3xXIWQvd0g g==;
Received: from ([]) by with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 11 Sep 2019 14:30:14 +0200
X-MGA-submission: =?us-ascii?q?MDGiWfi6Fa6HKQudzjpt5be+hGRQWEKjvYWE8E?= =?us-ascii?q?UvCe1/ksoLNDxxZBYWnuTiAPaGFAxaXAK1YK7JP7KKe/BzrFLLCWn4bk?= =?us-ascii?q?OzoiIinfSNEwEapPxnqGGrCuKA71DRuI0p9QzgflRj5Ln76PI8dVP9cs?= =?us-ascii?q?i0UPAJKUEH6o+CI8z+X9yw9w=3D=3D?=
Received: from ([]) by with ESMTP/TLS/AES256-SHA; 11 Sep 2019 14:30:16 +0200
Received: from ( by ( with Microsoft SMTP Server (TLS) id 15.0.1497.2; Wed, 11 Sep 2019 14:30:00 +0200
Received: from ( by ( with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Wed, 11 Sep 2019 14:30:00 +0200
Received: from ( by ( with Microsoft SMTP Server (TLS) id 15.0.1497.2; Wed, 11 Sep 2019 14:30:00 +0200
Received: from LEJPR01MB1178.DEUPRD01.PROD.OUTLOOK.DE ( by LEJPR01MB0010.DEUPRD01.PROD.OUTLOOK.DE ( with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2241.18; Wed, 11 Sep 2019 12:29:59 +0000
Received: from LEJPR01MB1178.DEUPRD01.PROD.OUTLOOK.DE ([fe80::987d:70fa:4d72:d6da]) by LEJPR01MB1178.DEUPRD01.PROD.OUTLOOK.DE ([fe80::987d:70fa:4d72:d6da%5]) with mapi id 15.20.2241.018; Wed, 11 Sep 2019 12:29:59 +0000
From: <>
To: <>
CC: <>
Thread-Topic: [tsvwg] TSVWG: WG adoption of draft-white-tsvwg-nqb!
Thread-Index: AdVfSTsXh/eMA9Y2RLeop2cZ3ij2ZAD+TSWAAB2l37AAOvCoAACNW7egAD5LIIAAMdNDcA==
Date: Wed, 11 Sep 2019 12:29:59 +0000
References: <> <> <LEJPR01MB1178B6C102455F1F9886D49A9CBB0@LEJPR01MB1178.DEUPRD01.PROD.OUTLOOK.DE> <> <LEJPR01MB11789EE6D8B7C732393BD1439CB70@LEJPR01MB1178.DEUPRD01.PROD.OUTLOOK.DE> <>
In-Reply-To: <>
Accept-Language: de-DE, en-US
Content-Language: de-DE
authentication-results: spf=none (sender IP is );
x-originating-ip: []
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 775ffdba-bf09-480a-4a86-08d736b3c321
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600166)(711020)(4605104)(1401327)(2017052603328)(7193020); SRVR:LEJPR01MB0010;
x-ms-traffictypediagnostic: LEJPR01MB0010:
x-ms-exchange-purlcount: 1
x-microsoft-antispam-prvs: <LEJPR01MB0010F3255875EEB68D75075F9CB10@LEJPR01MB0010.DEUPRD01.PROD.OUTLOOK.DE>
x-ms-oob-tlc-oobclassifiers: OLM:8882;
x-forefront-prvs: 0157DEB61B
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(396003)(366004)(39860400002)(376002)(346002)(136003)(199004)(189003)(86362001)(14444005)(790700001)(3846002)(26005)(6116002)(66066001)(53936002)(446003)(102836004)(2906002)(66556008)(64756008)(30864003)(53946003)(236005)(66446008)(66946007)(66574012)(71190400001)(486006)(4326008)(71200400001)(53546011)(11346002)(81166006)(316002)(76176011)(8676002)(14454004)(81156014)(476003)(6916009)(52396003)(606006)(7696005)(76116006)(8936002)(19627235002)(186003)(85182001)(5660300002)(7736002)(54896002)(6306002)(55016002)(9686003)(256004)(478600001)(66476007)(85202003)(33656002)(47264003)(777600001)(21314003); DIR:OUT; SFP:1101; SCL:1; SRVR:LEJPR01MB0010; H:LEJPR01MB1178.DEUPRD01.PROD.OUTLOOK.DE; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1;
received-spf: None ( does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: felIrKaeZuCns3eQ7dL6o5ht9DIhvCOjMwVZ1WcZkhXStgTk6EnvBFGM9EyfNIl7R7GMyNPMCwZ5QH6xYJIxLoa8/cJqLN/cQjsyNm9fZSNca33fvQ9v4cNMK/miSb+ZiX7waiXz7vhZ/XSjXkbiqPnXM6jSLabRAGkEF3n0tj6H52kFg0xTaAkThMk4yALs/FuwQcEnswuAcanH+UOxruTxttDEBL5wpWGw0GUnvSzAujo1h4ueH1Qn/j+gXzNkz8iMmb14TYqddEskhJJN24iUXICM5qd2m/R1j1t7Lbv+0czwKJvHaR1jzgavV2P3Z8KieGOT5ZJjUpw0n11hyYvDwBRcqN/oL2Mzap1TehKZZW9j1lXvFuwwXGC1bMEgmsCLL4PUhnpz7q3k7+vVHaMkQqM5QR8fF5pW5fdLFlE=
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_LEJPR01MB1178D2DCD24874E8AE47202D9CB10LEJPR01MB1178DEUP_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 775ffdba-bf09-480a-4a86-08d736b3c321
X-MS-Exchange-CrossTenant-originalarrivaltime: 11 Sep 2019 12:29:59.6229 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bde4dffc-4b60-4cf6-8b04-a5eeb25f5c4f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: bVzjwnNFHw7w9yLeyu2vBx9AtbY/xZpVVlzHINR57RQfGH5KHY2vUeMPjSMnDRm+UAr5TDtsBzd0evAtlclh6YAqg7KjnFiovn4XX9gKC8M=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: LEJPR01MB0010
Archived-At: <>
Subject: Re: [tsvwg] TSVWG: WG adoption of draft-white-tsvwg-nqb!
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <>
List-Unsubscribe: <>, <>
List-Archive: <>
List-Post: <>
List-Help: <>
List-Subscribe: <>, <>
X-List-Received-Date: Wed, 11 Sep 2019 12:30:26 -0000

Hi Greg,

backbone routers handle bulk traffic to the extent that I can tell. Finer grained traffic treatment may be found at network edges terminating consumer access. That is to say: a peer or a customer should agree which DSCPs are exchanged at interconnection or expect re-marking.

And to add (as that has been discussed too): don’t expect per flow treatment at a congested backbone link. That’s to say, that I don’t expect NQB support by a backbone router in the same way, as by an edge router. The next generation interfaces are n*100 Gbit/s and I’m not sure how these perform trying to identify the “least NQB like flow” in the case of congestion.

Regards, Ruediger

Von: Greg White <>
Gesendet: Dienstag, 10. September 2019 20:30
An: Geib, Rüdiger <>
Betreff: Re: [tsvwg] TSVWG: WG adoption of draft-white-tsvwg-nqb!

Hi Ruediger,

Yes, my focus (both from the perspective of the systems that I work on, and from the perspective of where I think NQB differentiation is most valuable) is on last mile and WiFi.  In terms of interconnection, there could be multiple ways to handle this.  My view is that the endpoint application has the best a priori knowledge of its sending behavior, so it is good to leverage that (and either validate it or not, depending on what is most appropriate for the situation).   This would argue for networks to adopt a policy of not bleaching the NQB value on traffic arriving from interconnections, and utilizing queue protection if necessary to validate NQB behavior.   That said, there are other ways that network operators can identify NQB traffic without solely relying on endpoint marking (and DSCP preservation across interconnects).  I know some operators are investigating such techniques.


From: "<>" <<>>
Date: Monday, September 9, 2019 at 12:57 AM
To: Greg White <<>>
Cc: "<>" <<>>
Subject: AW: [tsvwg] TSVWG: WG adoption of draft-white-tsvwg-nqb!

Hi Greg,

to me that reads as if you are mainly interested in a specified NQB DSCP for the last mile. A packet received at interconnection with a DSCP which hasn’t been agreed between sending and receiving domain will be re-written (speaking for the part of the network I work with).

That’s ok, as DiffServ involves policy management anyway.



Von: Greg White <<>>
Gesendet: Freitag, 6. September 2019 19:18
An: Geib, Rüdiger <<>>
Betreff: Re: [tsvwg] TSVWG: WG adoption of draft-white-tsvwg-nqb!

Hi Ruediger,

Many networks can (and do) configure the DSCP to PHB mappings and policies in accordance with their own intended usage.  In particular, DOCSIS links and LTE links (likely others as well) can be configured in a manner that complies with the PHB definition.  In other cases, it may be either necessary or sufficient (or both) to support NQB traffic without fully complying with the PHB (of course this isn’t new with NQB).

One of the high level goals is to ensure that the benefits of differentiating NQB traffic are not lost when that traffic traverses a WiFi link (since in many of the target use cases it does).  WiFi gear will likely not support all of the aspects of the PHB definition (at least current equipment will not).  We are essentially limited to 4 queues (BK, BE, VI, VO) and their associated CSMA parameters.  An additional constraint that we’re faced with is that in many cases the mapping from DSCP to AC is essentially fixed – it is either operationally hard or impossible to change.

Of the WiFi APs that we’ve tested (a sample of current generation .11ac devices, covering several chipsets) 100% of them use the “default mapping” of DSCP to AC as follows.

WMM Access Category
001xxx, 010xxx
Background (AC_BK)
000xxx, 011xxx
Best Effort (AC_BE)
Video (AC_VI)
Voice (AC_VO)

Living within this constraint, and trying to make the best of it, we’ve selected as a default DSCP the 0b101010 value, which would get mapped into the Video Access Category (along with CS4, AF41, AF42, AF43, CS5, VA, EF).  This would ensure that, in large part, NQB traffic is handled in a separate queue from the queue-building bulk data traffic (the vast majority of which uses AC_BE or AC_BK).

I would not expect that it would be important for NQB marked traffic to be differentiated in core network switches or routers, which in many cases do not provide deep (10’s to 100’s of ms) buffers.  So, in these switches NQB would likely be treated the same as Default (or whichever local use codepoint is used for best effort).

A characteristic of the NQB PHB as implemented in DOCSIS is that it provides low latency, low latency variation, and low loss for an NQB marked flow as long as the flow is “well behaved”.  If an NQB-marked flow is not well behaved then it experiences greater latency variation, greater loss, and potential re-ordering.   A well behaved flow is one that does not materially cause queue build-up in the network, i.e. its instantaneous rate does not materially exceed the instantaneous available bandwidth of the path.

In managed networks, or in cases where SLAs are provided, it seems to me that an operator should determine whether traffic that is already in a defined service class would benefit from being further differentiated based on QB vs NQB behavior (like, as you suggested using various AF marks), or whether certain existing service classes can be grouped into QB vs NQB meta-classes, depending on the technology limitations at each hop (MPLS, Ethernet, WiFi, LTE, DOCSIS, etc).  The result of this determination could require the use of non-default (i.e. non-standard) marking of NQB traffic in some cases.


From: "<>" <<>>
Date: Thursday, September 5, 2019 at 2:03 AM
To: Greg White <<>>
Cc: "<>" <<>>
Subject: AW: [tsvwg] TSVWG: WG adoption of draft-white-tsvwg-nqb!

Hi Greg,

the policy of the company I work for is: EF marked traffic received on a peering interface is remarked. DiffServ traffic destined to a retail access is subject to admission control, if that traffic is not expected to experience congestion.

The latter might change with high-speed access links. If the users and the above traffic have a hard time congesting these access links, the admission control requirement may not be strictly required.

If NQB traffic is supposed to be sent to third parties without an SLA at peering links being in place, proper selection of the DSCP matters. Without a deeper thought, a DSCP 000xx1 may be a proper choice in that case. Without an SLA being in place, the forwarding to be expected is default forwarding. If NQB is supposed to define a default-like behavior for a serious traffic share, it should be marked by a DSCP in the range 000 xxx at interconnection.

If an SLA is expected to be in place at peerings, any traffic without admission control should face a higher packet drop probability if destined to a retail access, than admission controlled traffic. If I assume the admission controlled traffic to be marked AFx1, NQB traffic in the same queue should be marked AFx2 (or AFx3). I’m open to discuss queue depths and expected traffic properties for a suitable AF class. RFC 8100 proposes to specify DSCPs only at interconnection. That may be a starting point, should SLAs on NQB at peerings be within commercial scope (that’s a non-technical issue, of course).

The choice of a DSCP for traffic which is created and terminated within a single domain doesn’t need to specified – here the PHB specification is important and the behavior of that traffic in the presence of traffic from other PHBs. I’d again opt for AFx2 or AFx3 (hoping that the NQB PHB specification allows for a useful implementation suiting AFx1 and NQB traffic in the same queue, expecting both to expect no congestion, AFx1 traffic to be admission controlled if present and NQB having features to reduce bandwidth if congestion is imminent).

I’m not sure what is expected from a backbone network supporting NQB (and other DiffServ PHBs). MPLS supports 8 traffic classes or codepoints, respectively. This coding space includes the codepoints required for ECN (codepoints, not bits).

I appreciate more standard DSCPs based on a clear and consented definition of the corresponding PHBs. Default marking, LE, EF and Network Management are good examples.

My take – sorry if I misunderstood some of your design aims, should that be the case.



Von: tsvwg <<>> Im Auftrag von Greg White
Gesendet: Donnerstag, 5. September 2019 01:02
An: Black, David <<>>;<>
Betreff: Re: [tsvwg] TSVWG: WG adoption of draft-white-tsvwg-nqb!

Thanks David.

On your item 3, could you clarify what you mean?   RFC 8325 does not discuss a “non queue building” service class, and so I don’t see a technical inconsistency between the NQB draft and RFC8325.  There has been some discussion on the list as to whether IETF should recommend that NQB be mapped to UP_6/AC_VO or UP_5/AC_VI, but in at least one of those cases where it was suggested to change the draft, the rationale for doing so was based on an incorrect assumption that NQB-marked traffic would by definition include capacity-seeking flows (e.g. L4S).  As I stated on list, I don’t have a problem with changing it to UP_5/AC_VI if that is the consensus.  But, the reason for mapping NQB to UP_6/AC_VO is so that both RFC8325 and “default mapping” 802.11 devices map EF, VA and NQB together to the same UP/AC, and so that both types of devices map these traffic types one AC level “higher” than elastic traffic sources (e.g. AF3x).  I’d like to see a more reasoned argument as to why NQB should be grouped with AF3x traffic as opposed to EF & VA before making a change.


From: tsvwg <<>> on behalf of David Black <<>>
Date: Friday, August 30, 2019 at 9:41 AM
To: "<>" <<>>
Subject: [tsvwg] TSVWG: WG adoption of draft-white-tsvwg-nqb!

In the Montreal TSVWG meeting, there was a strong sense of the room that the TSVWG WG should adopt draft-white-tsvwg-nqb as a starting point for work on an NQB PHB.   The WG call for adoption on this list has been open for over a week, since August 21, and having seen only one objection on the list to adoption of the draft (from Dave Taht), the WG chairs (Gorry, Wes and David) have concluded that the WG rough consensus is to adopt this draft.  It’s important to emphasize that the draft is adopted as a *starting point* for TSVWG work, i.e., the current draft content does not represent the rough consensus of the WG.  Significant work will be required to produce an actual PHB spec that is suitable for implementation – see the recent RFC 8622 on the LE PHB ( for an example of what a PHB spec looks like.

There are a few items that will need attention before the initial -00 WG version of the NQB draft is submitted – these are to avoid confusion about what the WG intends to do:

1)      The draft needs to be clear that the use of the 0x2A DSCP value as the default for this PHB is a *suggestion by the authors that is subject to change*.  Whether to use that DSCP or a different one is a WG decision; the plan is to discuss and select the default DSCP value starting (and hopefully concluding) in September.

2)      The criticisms on this list of the “queue protection” requirement in the draft are largely accurate.   The draft needs at least an Editor’s Note that this material will be revised, as while the DOCSIS mechanism is an example of how to do queue protection, it is not appropriate to require implementation of that mechanism.   A plausible plan that I have discussed with the authors is to write a set of functional/behavioral requirements for NQB “traffic protection” that can be satisfied by a “queue protection” mechanism such as the DOCSIS mechanism, or by a suitably configured FQ AQM implementation.

3)      RFC 8325 reflects the IETF consensus on how to map between Diffserv and WiFi QoS, hence the 8.3 section of the NQB draft needs to be modified to be consistent with RFC 8325.

4)      Similarly, the 8.2 section of the NQB draft needs to be modified to reflect the conclusion of discussion on this topic in Montreal.
Those 4 changes are necessary in the -00 WG version of the NQB draft.

In addition, related to item 2), my expectation (which is open to further discussion) that “traffic protection” will be a “MUST” requirement, perhaps with some well-specified exceptions (including explanations of why the exceptions are ok).   This is because “traffic protection” (e.g., “queue protection” or a suitably configured FQ AQM) appears to be necessary in general to keep queue-building traffic out of the NQB traffic aggregate, as allowing such traffic degrades the properties of the NQB PHB.

Thanks, --David (TSVWG co-chair, will be shepherd for NQB draft).
David L. Black, Senior Distinguished Engineer
Dell EMC, 176 South St., Hopkinton, MA  01748
+1 (774) 350-9323 New    Mobile: +1 (978) 394-7754<>