Re: [tsvwg] Review of draft-white-tsvwg-l4sops-02

Greg White <g.white@CableLabs.com> Mon, 12 April 2021 23:10 UTC

Return-Path: <g.white@CableLabs.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 05B743A15C0 for <tsvwg@ietfa.amsl.com>; Mon, 12 Apr 2021 16:10:46 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=cablelabs.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xoBt-pPL8_CO for <tsvwg@ietfa.amsl.com>; Mon, 12 Apr 2021 16:10:41 -0700 (PDT)
Received: from NAM12-BN8-obe.outbound.protection.outlook.com (mail-bn8nam12on2125.outbound.protection.outlook.com [40.107.237.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A29213A15BD for <tsvwg@ietf.org>; Mon, 12 Apr 2021 16:10:40 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=ii2X1IyHKiRkGH/1V/C3hfSqtu7W3hFvPVozlQMy8gWifo8CELnGLA10azYqXkesZUQd/7BJFCPIA3/1n0Mhk7AOyIUkRAPG4BKepEkOikk4JDEKcBYxJ0wVHpsN7XMA9CtFPI0g/mpfyAVKzUugz2upltGfR5qYLV4d+OXkw1chT/S3U/mFSrvG9nQ26JL6j+jJxE6hFg/4rOJl3bWyZRd/U6hb+D01SIzBaDekUrwmGabHJK/HYy5ZyER4pMqmhigMxKBOf/zM2Ny+1J37Kyy673C7y1lbGw3gZ1ood3yt8wg/IVHKUZQN68WqY5c0jtvbCJXfAuv+9Qwf1hupVw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=0mQuuXnQlCaSX8TeoKjNtlLiCujloYKeYSVxmyEi7lc=; b=gUoaFqPXkvP1nVLlMYRyWwVVD9DMDPzU7ZLuzsqt9S1QxdlEX1gV/dXWQ4Dwoxx8Y+QNYPIFgiVsndAJrQZkzNzqz3Wh6qHXBTsCvEklX8m4hxObHKd571BBfrQN7VgQWcFHoTbQmjWx0MPglurJuVBaoR5Jj9TtjUbAD8rNiYe6ZRZo856eem2e60sJi+6SUCiSAONyWq4QsbtAxP+Z7dCzAEIl90Q1p6JIVt0Y6kV7fcsykJXuqv8MGnf5HJupJo4b4pwIoBMc/i4UnO+b4d0oLcsJPuCa0sBXyrmNvqB09stwReDAAPJfJAgX4alLv2D+e7VjwfnFLvP69jNF7g==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cablelabs.com; dmarc=pass action=none header.from=cablelabs.com; dkim=pass header.d=cablelabs.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cablelabs.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=0mQuuXnQlCaSX8TeoKjNtlLiCujloYKeYSVxmyEi7lc=; b=flJ3xu4CcWmHE72/2VJekE7EDEgccZ+66lTxzf9eTqsgz7OMoTLzqgyiik/8aSvuBst+GbzqTNhZAEc4Tw87gU5ptKKX4jh2FEcym+r/rORzZNC8qN+6WzjSVvypbj4zBfLFEgukxiexgK6F6WgfbBxQ/k/2eM+0iS5h5bCQXHLKZW8mGFfyO3+WYeo3C1Xu5swgPi58bnRLDqq9LImg2YY1Kun6ZcEmYIH8JjigY5wcGZym6erFB/D11uGE36Y/p2ECSuCDZB3ISRVIyAIZlmGYgKd4oVxAu8lglhlEwt/0ysOpnryf1X7p91oLHumHykGsW95Ixs38Vmu49dk6qQ==
Received: from CY4PR06MB2821.namprd06.prod.outlook.com (2603:10b6:903:130::11) by CY4PR06MB2567.namprd06.prod.outlook.com (2603:10b6:903:6c::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4020.18; Mon, 12 Apr 2021 23:10:37 +0000
Received: from CY4PR06MB2821.namprd06.prod.outlook.com ([fe80::8161:6d07:dea0:8696]) by CY4PR06MB2821.namprd06.prod.outlook.com ([fe80::8161:6d07:dea0:8696%8]) with mapi id 15.20.4020.022; Mon, 12 Apr 2021 23:10:36 +0000
From: Greg White <g.white@CableLabs.com>
To: Bob Briscoe <ietf@bobbriscoe.net>
CC: tsvwg IETF list <tsvwg@ietf.org>
Thread-Topic: Review of draft-white-tsvwg-l4sops-02
Thread-Index: AQHXL6o/fULtjzOZyk6ucjTxAZSSr6qxHi0A
Date: Mon, 12 Apr 2021 23:10:36 +0000
Message-ID: <F83B7CDC-73CD-47F1-BAEE-B8C636FD8C80@cablelabs.com>
References: <494E6D6A-B42A-458E-A79E-88C4830F1E90@cablelabs.com> <48e41c7f-205f-c8a5-7a4b-256a7df75fca@bobbriscoe.net>
In-Reply-To: <48e41c7f-205f-c8a5-7a4b-256a7df75fca@bobbriscoe.net>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/16.44.20121301
authentication-results: bobbriscoe.net; dkim=none (message not signed) header.d=none;bobbriscoe.net; dmarc=none action=none header.from=CableLabs.com;
x-originating-ip: [73.243.9.160]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 8bab869a-8881-401a-4845-08d8fe082eaf
x-ms-traffictypediagnostic: CY4PR06MB2567:
x-microsoft-antispam-prvs: <CY4PR06MB2567CCFAD41E27B200888511EE709@CY4PR06MB2567.namprd06.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:6108;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: lWN1q6LSq0YVHAROkwdyEuO1koCe899Zz+L9BcSzNlRmLajo6vBEx71I0Fh7LS8Zj5AFBtWnFgZ6d8lBLDEcvXCtTVocawqAa0K9gITIUSFMuLUbcf+BYfmRR67p/rapRG8UQ5xFlZMFmotgF5PxH8+CYLhXfVvtKQXsWQi62Bc2pRazRQC+6rswI8llHPjOX3e+cYlfSDnIomCu9D5BU7ksFE4QhHypGDN5lX3vCTPlSkZ1HNFuc6x07QaCV2Kw+0xJtRKt6tfeIvVyqhs1frHHHLcZG21IJynneACvW4ZEMVg7bbsd+19Myw6ZcJdsT1/D8pl+V5lry9Ru00JwdrbkyGkPzwJoMb534mgOmb/TF8CSodeMquCyP+j3EU+qqMaFsiK1wdvAOmlQQJHkhdlQN/Z5VBWk0fEWrcu3HOZQ7KPMpwS/787LhQUS/00XZNBTGg/3OH99DP3SF16cU1yGg2FX9wdQmZnNbDi+EYo3B6Ik7p2SIPSPmPL1dzSkK7aAQ3ZvMF+vxY9x/u4BVsBskCMLvJcKdATyPMeJUmjBnH/El5v9K76Iz7ji9Prj5By7cJc8z+ME/Q+LPOXOttGtpVzkbuxgOrxJjhlgcg0QRw5ksc/0mpliYRdoyOaC25rnuE7+XzrGHuB14tis9MMgwezszQONeGBfc4/Rb6FPxZo9/OmWbOOgiMM+WgiHP3y5ZiLycZFdq2YBKzXNB+usBrT9GYSN3ASXwxqXf8WEUayGe/xpX8t+a1mzKHNmSHW2gzowGeLW+JEMJDKRRw==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CY4PR06MB2821.namprd06.prod.outlook.com; PTR:; CAT:NONE; SFS:(39850400004)(136003)(396003)(376002)(366004)(346002)(6506007)(53546011)(76116006)(2906002)(71200400001)(66476007)(66446008)(166002)(66556008)(4326008)(6512007)(66946007)(186003)(2616005)(64756008)(36756003)(8936002)(26005)(33656002)(66574015)(6916009)(966005)(316002)(38100700002)(5660300002)(478600001)(6486002)(8676002)(86362001)(83380400001)(45980500001)(85282002); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata: OdPlAXCntGPivGqHpoOZYk/5mjgiJ1NOQM2iyjs/ZVXDaiUwajolSIVwVPSe61R4phqRndY0KDbEIb4TcS0ITLyIJHgIOxSZslxdyhuli3imSubMDdAxD/hGElcV9DJqahxNhQvC1qSG1AdhvCto9KK97gZLy06yCiL2G9FVpn5nUO6Q688FA5gT2CbNY5/oBtv1giHfxr3f3FvspiHeKmYk3fauv8RisJujYcEHtIJVGSbABkeyDdViBdcOlWklqbTubCyyCJl+jG8Savuvr0Qa1kEL6YBKggjH1T/CHpXLD964BJkF0GnUTQTrqKGFVGbEBIwkq9LUFx+9IbOWNHg9x/v2wMtiVzVSI17f6B4Cx+JPgAWFkbxcq226wLPJtJ3XtmkGkRtuitRlzYe6oD1WQTmBVMR0tIscVqms4gxIUZoDK8/OoZdeLRHhfQ6QcJqdaPnCrQQz6RmUoOUF/k+hkPbKfMfQp2aRRJgefc9N+9c6seRE0RElg3gRv7hpFACHMTNasLxBuk54bvwWuudfj65s26REwJJqy5v75NNTCbHK4NzO4aErGPwYT9RCZdGV8V/t+6OQKNabydHDENaLTGwiAlH/Z7YalLYJrBsByuLbAvbRyj8Dpc/v2SeHDvsEDB7xnPsG6q0zIqprTxncnjdVv8T1nAWmUnXkfRgkqg8J32Ad1ydSeJpx4Gvz5npVIc8LdVS4U+MMF8Z8Uj+n0UCCUEvWN3h1P8LcfRSrm+cFzA3UziMmeFCayfaVswhtxR4xd5tCchaldOQ70P+1HxQdj2E1ORQ1w7cyxNmt0JcKrov9boTr8EXDZhJOmCIKomzKJhmL++5kA9NOp3iF+tzgmMHRd230g3iiouZWZ5lac88JQw+4ERi4f27Te+5AJWLlR/Fao65xcJk8cNovgl4XoPL8/E5SwpLE2DUjdzTaAm86rZZswLSCe4Ixf1/F830yImH0okOim2yXIlfZrE7KrJkmpcpzD1xmN6g3V5VNqnrVcF+8IguUDcTjT6L0fnJKQp4CIuloNpk4dTUGWUlKgjHqYS08Hi8gWkbeHeD8Ykor+l5PXB0u/9GGiZjWEBvM7M8GsD5JOuNriZXa0OZMbQzMSOmxk7WhXqklRXpG+PfWfCHIzHFFFzK1o5oKrVbV1h0cdr/4UHw7TgJMbsDENFpfiiK+6BSaRoAJVuvXGyWEa8YJmvmDzo8GKSF+0F8N02jJZh3Aec1d4kdUGPSaNSd3NP/WrzLamnjEHcNBhHvdFmrVMiyAc3CPAIHifp2N9HltwwexJpuM201HDiwcMG66FC+e0XYzWbl4Z1aTZpDbj7FvmztgYsrW
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_F83B7CDC73CD47F1BAEEB8C636FD8C80cablelabscom_"
MIME-Version: 1.0
X-OriginatorOrg: cablelabs.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: CY4PR06MB2821.namprd06.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 8bab869a-8881-401a-4845-08d8fe082eaf
X-MS-Exchange-CrossTenant-originalarrivaltime: 12 Apr 2021 23:10:36.8088 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: ce4fbcd1-1d81-4af0-ad0b-2998c441e160
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: dk863WVQ5xD69ZjmrTnWgsB2tPZZlkvTnXJf2bOrS1HkPTNFlpaxL8mYyVc819JiNEWt+ZkBpRegcAs7IUucbw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR06MB2567
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/8Uv_XSyhwOaMhyfWqpyHxNSXhUw>
Subject: Re: [tsvwg] Review of draft-white-tsvwg-l4sops-02
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 12 Apr 2021 23:10:46 -0000

Bob,

Thanks for the detailed review and suggested edits.  I am working on a WG draft 00 and will take these suggestions (along with others provided on the list and a few offline comments) into account for that version.

-Greg


From: Bob Briscoe <ietf@bobbriscoe.net>
Date: Monday, April 12, 2021 at 8:43 AM
To: Greg White <g.white@CableLabs.com>
Cc: tsvwg IETF list <tsvwg@ietf.org>
Subject: Review of draft-white-tsvwg-l4sops-02

Greg,

Here's a review of draft-white-tsvwg-l4sops-02 that was recently adopted by the WG.

Abstract:
CURRENT:
This document is intended to provide additional guidance to operators of end-systems, operators of networks, and researchers beyond that provided in [I-D.ietf-tsvwg-ecn-l4s-id] and [I-D.ietf-tsvwg-aqm-dualq-coupled] in order to ensure successful deployment of L4S [I-D.ietf-tsvwg-l4s-arch] in the Internet. The focus of this document is on potential interactions between L4S flows and Classic ECN ([RFC3168]) flows in Classic ECN bottleneck links. The document discusses the potential outcomes of these interactions, describes mechanisms to detect the presence of [RFC3168] bottlenecks, and identifies opportunites to prevent and/or detect and resolve fairness problems in such networks.
PROPOSED:
This document is intended to provide guidance in order to ensure successful deployment of Low Latency Low Loss Scalable throughput (L4S) in the Internet. Other L4S documents provide guidance for running an L4S experiment, but this document is focused solely on potential interactions between L4S flows and flows using the original ('Classic') ECN over a Classic ECN bottleneck link. The document discusses the potential outcomes of these interactions, describes mechanisms to detect the presence of Classic ECN bottlenecks, and identifies opportunities to prevent and/or detect and resolve fairness problems in such networks. This guidance is aimed at operators of end-systems, operators of networks, and researchers.
Rationale: Broken down first sentence into three more manageable chunks, and order changed to improve the logical progression.
Also
·         expanded L4S,
·         'opportunites' mistyped
·         citations removed (RFC style guide deprecates citations in the abstract).
1. Intro

CURRENT:
Although RFC3168 has been ... specified in [I-D.ietf-tsvwg-ecn-l4s-id], not all deployed queues have been updated accordingly ...
PROPOSED:
RFC3168 has been ... specified in [I-D.ietf-tsvwg-ecn-l4s-id]. However, any deployed RFC 3168 AQMs might not be updated, ...
Rationale: Shouldn't imply that equipment will ever be updated. Also, broken down long sentence.

"The root cause of the unfairness is ..."
Consider switching the order of the sentence, so that the new L4S is the root cause, not the old RFC3168.

s/implement legacy RFC3168 ECN/
 /implement RFC3168 ECN/
Rationale: RFC3168 is the stds track.

s/can also potentially occur in fq_codel [RFC8290] bottlenecks /
 /can also potentially occur with per-flow queuing, e.g. fq_codel [RFC8290], /

s/Additionally, this issue was considered and is discussed in Appendix B.1 of [I-D.ietf-tsvwg-ecn-l4s-id]./
 /<New para>This issue was considered when the WG decided on the identifier to use for L4S, as recorded in Appendix B.1 of [I-D.ietf-tsvwg-ecn-l4s-id]./

2. Per-Flow Fairness

s/capacity sharing between the applications used by one customer./
 /capacity sharing between the applications used by one customer site./
(The whole doc could refer to l4s-arch for terminology, which includes a definition of 'site'.)

I don't find the HotNets paper on harm a very useful reference. It overlooks large tracts of the existing literature which already said similar things, and it also overlooks other areas of the literature that said different things.
RFC5290 might be a better reference, altho not specifically about harm. It's on the independent stream, so that ought to be stated (i.e. it reflects only the opinions of the authors, not the IETF). It gives a lot of reasons why flow-rate fairness may not be correct or optimal, but it's just convenient.

CURRENT:
Most importantly, if there are situations in which the introduction of L4S traffic would degrade classic traffic performance significantly, i.e. to the point that it would be considered starvation, these situations need to be understood and either remedied or avoided.
PROPOSED:
Most importantly, if there are situations in which the introduction of L4S traffic would degrade both the absolute and relative performance of classic traffic significantly, i.e. to the point that it would be considered starvation while L4S was not starved, these situations need to be understood and either remedied or avoided.
Rationale: Distinguish between starvation of Classic when L4S is starving as well vs. when L4S isnt'.

3. Detection of Classic ECN Bottlenecks

s/VPN tunnels remain an issue for fq_codel deployments/
 /VPN tunnels remain an issue for FQ deployments/

s/in which case fq_codel implementations /
 /in which case FQ implementations /

========================================
Jumping over Section 4 for now...
========================================

 5.2. ECT(1) Tunnel Bypass

CURRENT:
Using an [RFC6040] compatibility mode tunnel, tunnel ECT(1) traffic through the [RFC3168] bottleneck with the outer header indicating Not-ECT.
PROPOSED:
Tunnel ECT(1) traffic through the [RFC3168] bottleneck with the outer header indicating Not-ECT, by using either an ECN tunnel ingress in Compatibility Mode [RFC6040] or a Limited Functionality ECN tunnel [RFC3168].
RATIONALE: If there's a legacy RFC3168 AQM on the node, there might be RFC3168 tunnelling code too.
Note that RFC6040 is a property of the tunnel ingress alone, whereas RFC3168 is a property of the tunnel (both ends).

5.3. Configure Non-Coupled Dual Queue

s/As a result it is a less prefered option./
 /As a result it is the less preferred option./
(Note: prefered was also misspelled)

5.5. Disable RFC3168 Support

s/Disabling [RFC3168] CE marking for both ECT(0) traffic and ECT(1) traffic/
 /Disabling an [RFC3168] AQM from CE marking both ECT(0) traffic and ECT(1) traffic/
Rationale: To be unambiguous that this does not mean wiping the ECT codepoints.

s/Clearly a downside to this approach is that .../
 /This is not recommended, given a downside to this approach is that clearly .../
Then add "This alternative is only mentioned in case there is no other way to reconfigure an RFC3168 AQM."

5.6 Re-mark ECT(1) to NotECT Prior to AQM

CURRENT:
While not a recommended alternative, remarking ECT(1) packets as NotECT (i.e. bleaching ECT(1)) ensures that they are treated identically to classic NotECT senders. However, this also eliminates the possibility of downstream L4S bottlenecks providing high fidelity congestion signals.
PROPOSED:
Remarking ECT(1) packets as NotECT (i.e. bleaching ECT(1)) ensures that they are treated identically to classic NotECT senders. However, this action is not a recommended because a) it would also prevent downstream L4S bottlenecks from providing high fidelity congestion signals; and b) it could lead to problems with future experiments that use ECT(1) in alternative ways to L4S. This alternative is only mentioned in case there is no other way to reconfigure an RFC3168 AQM.<New para>Note that the CE codepoint must never be bleached, otherwise it would black-hole congestion indications.
Rationale:
·         Makes the link between the recommendation and the reason for the recommendation.
·         Clarifies that ECT(1) means only ECT(1).
For both 5.5. & 5.6., I think it's necessary to say why the draft is even mentioning these options, given they are not recommended.


Bob


--

________________________________________________________________

Bob Briscoe                               http://bobbriscoe.net/