Re: [Detnet] Alvaro Retana's No Objection on draft-ietf-detnet-mpls-11: (with COMMENT)

Balázs Varga A <balazs.a.varga@ericsson.com> Wed, 09 September 2020 13:37 UTC

Return-Path: <balazs.a.varga@ericsson.com>
X-Original-To: detnet@ietfa.amsl.com
Delivered-To: detnet@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C32113A0BD7; Wed, 9 Sep 2020 06:37:41 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.091
X-Spam-Level:
X-Spam-Status: No, score=-2.091 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, T_KAM_HTML_FONT_INVALID=0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id eluyanpZVDQs; Wed, 9 Sep 2020 06:37:39 -0700 (PDT)
Received: from EUR04-DB3-obe.outbound.protection.outlook.com (mail-eopbgr60065.outbound.protection.outlook.com [40.107.6.65]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id AFAAA3A0BA1; Wed, 9 Sep 2020 06:37:38 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=NytZt9annAiXtRcjxDn6f8U/Xz6nF2bS97TEGro+ldhHtcD1DpwpQAsQVsUpdVOfSXV8C6y+1vX86S97DOZec+ZdUibiG22HRVp6U3dNnF+XNBi767RaBd45fll+JfrD4e5FwSGMHlSOPZ+t4zomgN+SInUzNMk9sPUVy/4L8SycNnqD7X5mnoPRWY9oiQX3sKvS5tOeOZ904ZvfExqCI14DmxqqiSrPcbz6qdhLCyvqx8NF69cbsiLz3KDSR2utD6HfHHVNYreyE6BVsjzD7qC0zMDy6KGYE2RCvW8J0l1oHGwhqmbG2tj6T7jDIYI1kP77xo7bZT+syyLRW92X0A==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=KeHmYhG41EqlmeN1a1cEStw0p8pd5hVIbgNmg6ytksY=; b=CX7QmaiFPwv9+EKVHPdjmHU0709QJwc/9Ih1B1rPBrCwRBeyFDMPoMvhZxXlE7Xqgzbx2HdTCOBwiqKO87RZ8vHj5OJYBiLcKHsHaW9O61fbmxAVVZP7D3z7jIvmN4Mvj2te0+LDcGfuiDfjq0g+whGlptWfbJs5U7Sqn4t9RA6KexlQ85CXjz+lu1vqMbbbl2bZgRmMHEWlolSVlGumeqeUxqJahvWsiK0rcRPAshTx7UTeBv1GnamzYMUGlGi7ia4gS7k55+jyQNu8YKW7AdZcFUZ4truQM9gE7PH73WW2nWQCAjgVLG5LAH4P4tbGJmSCtEFB5219/IyKHyjq5w==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=KeHmYhG41EqlmeN1a1cEStw0p8pd5hVIbgNmg6ytksY=; b=KtoAfCECQD5JpYb3XUTl1lABB/X+qnvprlUulJIR141M69aknjeGPbEFma5KXt4QtB6dqk1pPs6koh/kgU0prfxTRGm9diEfF9QoX3shUuTWUzBOTH2RsrJHBKN4Br23VBiRLuxhRW2KPyzezrJbE3Dysug60QmQ8Heax/cQR3g=
Received: from AM0PR0702MB3603.eurprd07.prod.outlook.com (2603:10a6:208:22::25) by AM0PR07MB4769.eurprd07.prod.outlook.com (2603:10a6:208:72::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3370.12; Wed, 9 Sep 2020 13:37:34 +0000
Received: from AM0PR0702MB3603.eurprd07.prod.outlook.com ([fe80::59ca:540d:b7f3:58b9]) by AM0PR0702MB3603.eurprd07.prod.outlook.com ([fe80::59ca:540d:b7f3:58b9%6]) with mapi id 15.20.3370.016; Wed, 9 Sep 2020 13:37:34 +0000
From: Balázs Varga A <balazs.a.varga@ericsson.com>
To: Alvaro Retana <aretana.ietf@gmail.com>, The IESG <iesg@ietf.org>
CC: "draft-ietf-detnet-mpls@ietf.org" <draft-ietf-detnet-mpls@ietf.org>, "detnet-chairs@ietf.org" <detnet-chairs@ietf.org>, "detnet@ietf.org" <detnet@ietf.org>, Ethan Grossman <eagros@dolby.com>
Thread-Topic: Alvaro Retana's No Objection on draft-ietf-detnet-mpls-11: (with COMMENT)
Thread-Index: AQHWhindNdkY/DSrREK4q9c+dH2SxalgReqg
Date: Wed, 09 Sep 2020 13:37:33 +0000
Message-ID: <AM0PR0702MB3603366D4A89CC015B267E6FAC260@AM0PR0702MB3603.eurprd07.prod.outlook.com>
References: <159960173275.11282.2076238992765872016@ietfa.amsl.com>
In-Reply-To: <159960173275.11282.2076238992765872016@ietfa.amsl.com>
Accept-Language: hu-HU, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: gmail.com; dkim=none (message not signed) header.d=none;gmail.com; dmarc=none action=none header.from=ericsson.com;
x-originating-ip: [185.29.82.162]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 8807cb0d-3773-42e3-96f6-08d854c5825e
x-ms-traffictypediagnostic: AM0PR07MB4769:
x-microsoft-antispam-prvs: <AM0PR07MB4769BACDEBDFA52F74CDD706AC260@AM0PR07MB4769.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 1py//eajSXxlBlzN2zR1aEKtnnv0vXMcshg+dDxz9l5wHdoq3eeZwJenQ09FDzHdHjk0XaHYpWJfJiwEcFE0Dge97LdhEmNw7D2N4WlNu06b51bKUmrEUPJlL9jI2leZYmJv9XkrCmUp6Pz1p45Rnbo/2Z3+Ooj7A5CEvjShB7/lzt35WeBeRW4BVmESki9QpJ0JiPqX/0xhf7mEszsKadeTLtMkHBGx0797mW6DPUy/EHEWSO0rOTxYE6kfPt5JYsaFTqU+NarphrYTx4KRT02+hWL6nA+aaE32CBcRBRNNB3x2onQfylRUVOsTPdJRXjlU0Mb5ppsghekqcDKtKy8iQr9iMQr8u/V3MbzRw4b8A4MLBl9Vjh+1mHTog+a+HVXljNhzTqNQV63u/Vzgig==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM0PR0702MB3603.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(136003)(396003)(366004)(39860400002)(346002)(376002)(478600001)(55016002)(9686003)(83380400001)(64756008)(66556008)(66946007)(66446008)(66476007)(52536014)(110136005)(186003)(166002)(5660300002)(76116006)(7696005)(316002)(26005)(53546011)(6506007)(71200400001)(33656002)(21615005)(54906003)(4326008)(966005)(85182001)(8676002)(8936002)(86362001)(2906002)(85202003)(9326002); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata: KS3m4E2iTPIB73TVZ+ZKjO/J/yhH7+AkmQUYBc/VRJEbwtGjrKhCVhvps2vH68ukpYENL5JWzWZQ7qmxdeH8QP6cfbTPQO1uvgUJHvM4q4mYSL8vsazM4Smtv+6bTCkmRkeT3K6MzI33zOIQTZCZodvbhqH8gjTbxiY8MVbNIkuKRGr1PIOXGaXarkfnj9PAGCFSVq8y84SjVk/1p1+Op2nzdyOl9RJtJGo60NeVTw9FNQVZaC9zLKzVj49q4KAvu+vmYSAYiEMYLJ80IPhdBBcn7I+hYf4WhNtb6vqx8NnoywfvATD704VGMQHJhpYDwDz1frZQKCmwVQPaqlPDjz5oc5y8oiJPld3UF1k4YYzKT83Wqu6uZrrDTDnj0qNRioS57rnhbhtdWoLEWuIreysUIVfjvgAQ4nTFaNgUC8uK/KTk8jBsYsf8G0zwAxUuA8FY3dJ1pNNebbj5NNlMzBKCDIHjA5anb+69/IcxRBV+a+fRRgd4hzl1zfc5Zm/FpjJbm6atCAeD3e4u1zQpTPcu866p0j4vg2GdreVxq8M1uMdhiNUlKOVIzgBq/KTb7PThocW+o5Ug1BPsTJ/XBYclNzfGepd9LzQmJGTubiV2CPXN3taPV+ihqiQAu/Je3wzDaoev8lLSsERYpHJdgw==
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_AM0PR0702MB3603366D4A89CC015B267E6FAC260AM0PR0702MB3603_"
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM0PR0702MB3603.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 8807cb0d-3773-42e3-96f6-08d854c5825e
X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Sep 2020 13:37:34.3563 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: qwke1yW1AwntXvkOJLELkyCo34H1Td3SsneQmjMKjnJ0WJVXL1ccgRbzo6puJs5E3UwaRS3sElFmfqjt/tIALGkNoQnMNP1MaXkRvkBeEuI=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR07MB4769
Archived-At: <https://mailarchive.ietf.org/arch/msg/detnet/AyAjx230egwo5wc0EAMyDnlsGyw>
Subject: Re: [Detnet] Alvaro Retana's No Objection on draft-ietf-detnet-mpls-11: (with COMMENT)
X-BeenThere: detnet@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Discussions on Deterministic Networking BoF and Proposed WG <detnet.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/detnet>, <mailto:detnet-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/detnet/>
List-Post: <mailto:detnet@ietf.org>
List-Help: <mailto:detnet-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/detnet>, <mailto:detnet-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 09 Sep 2020 13:37:42 -0000

Hi Alvaro,



Thanks for the detailed review. My comments are below inline.



Thanks & Cheers

Bala'zs



-----Original Message-----
From: Alvaro Retana via Datatracker <noreply@ietf.org>
Sent: Tuesday, September 8, 2020 11:49 PM
To: The IESG <iesg@ietf.org>
Cc: draft-ietf-detnet-mpls@ietf.org; detnet-chairs@ietf.org; detnet@ietf.org; Ethan Grossman <eagros@dolby.com>
Subject: Alvaro Retana's No Objection on draft-ietf-detnet-mpls-11: (with COMMENT)



Alvaro Retana has entered the following ballot position for

draft-ietf-detnet-mpls-11: No Objection



When responding, please keep the subject line intact and reply to all email addresses included in the To and CC lines. (Feel free to cut this introductory paragraph, however.)





Please refer to https://www.ietf.org/iesg/statement/discuss-criteria.html

for more information about IESG DISCUSS and COMMENT positions.





The document, along with other ballot positions, can be found here:

https://datatracker.ietf.org/doc/draft-ietf-detnet-mpls/







----------------------------------------------------------------------

COMMENT:

----------------------------------------------------------------------



(0) I support Magnus' DISCUSS.  [I also have some comments about

§4.2.2.2/§4.2.2.3 below.]



<Bala'zs> OK. Sizing the buffer of PEF and POF is the result of end-to-end DetNet design for a given flow.

The design process is out-of-scope in this draft. Both §4.2.2.2/§4.2.2.3 below has a note in the last paragraph

what supports the sizing of the buffer ("maximum number of sequence numbers that are tracked" and

"maximum number of out of order packets that can be processed"). Furthermore the flow-information-model

(https://tools.ietf.org/html/draft-ietf-detnet-flow-information-model-10) and the YANG draft defines the

flow related parameters (MaxPayloadSize). Via these parameters buffer size is defined.





(1) §4.6.2: "DetNet provides zero congestion loss and bounded latency and jitter"



This phrase is a variation of the general statement in the Introduction:

"DetNet provides these flows with extremely low packet loss rates and assured maximum end-to-end delivery latency."  Specific to this document, how does DetNet guarantee this behavior while operating on an MPLS network?



I see that §4.5/rfc8655 focuses a series of examples on TSN (which is not required by the architecture, right?), and this document mentions other technology as examples. Still, there is no explicit indication of how the "zero congestion loss and bounded latency and jitter" can be achieved.  Instead, the use of these mechanisms is left to the implementation/operator without any guidance.  I think that not offering any guidance is a significant gap in a Standards Track document.



Most of the mechanisms mentioned as examples in §4.6.2 are "old", for example, RSVP-TE.  Pretty much the same mechanisms are listed in §4.2.3.2 when talking about the option of using DetNEt unaware nodes to deliver the same "service

parameters":



   When the DetNet service parameters of the DetNet flow or flows carried in

   an LSP represented by an F-Label can be met by an existing TE mechanism,

   the forwarding sub-layer processing node MAY be a DetNet unaware, i.e.,

   standard, MPLS LSR.  Such TE LSPs may provide LSP forwarding service as

   defined in, but not limited to, [RFC3209], [RFC3270], [RFC3272], [RFC3473],

   [RFC4875], [RFC5440], and [RFC8306].



How does DetNet guarantee "zero congestion loss and bounded latency and jitter"

while operating on an MPLS network?  The more I read, the more it seems to me that the examples provided support the concept that the same results can be obtained in an MPLS network without DetNet.



[I am out of my depth and feel like I'm probably missing something, which is why I am not balloting DISCUSS on this point.  However, I believe that the issue of specific guidance remains.]



<Bala'zs> DetNet was designed to reuse as much as possible from existing mechanisms.

For example, PREOF is a tool that does not exists in legacy MPLS networks. We have a dedicated

draft dealing with bounded latency. This document focuses on the data plane and does not intend

to cover all the end-to-end design aspects. RFC8655 and draft-ietf-detnet-data-plane-framework

intends to provide a more complete picture.



(2) Figure 4 shows the encapsulation of a DetNet App-Flow, which includes several labels + CW...  Figure 6 shows an even bigger stack (also with several F-Labels and the new A-Label, S-Label, CWs...).



What are the considerations related to the nodes' ability to support the label stack needed for DetNet operation and aggregation?  What is the relationship between the maximum number of labels supported in the network and the ability to push the required label stack onto the packet?  [Take a look at rfc8491 for a sample definition related to the Max SID Depth (MSD).]



<Bala'zs> Right. DetNet defines a single service label (S-Label) what is similar to existing PW and

VPN services. Aggregation is usually used within the network pushing an additional label.

Plus DetNet may use the TE capabilities provided by the network. So, there are no extra

requirements.



(3) §4.2.1



   A 0 bit sequence number field length indicates that there is no

   DetNet sequence number used for the flow.  When the length is zero,

   the sequence number field MUST be set to zero (0) on all packets sent

   for the flow.



   ...and ignored by the receiver??



There are several other "MUST be set to zero" phrases in the text.



<Bala'zs> Right. Receivers (sub-layer aware nodes) are configured with service specifics

(see §5.1) and process the packets accordingly.



(4) §4.2.2



   An S-Label will normally be at the bottom of the label stack once the

   last F-Label is removed, immediately preceding the d-CW.  To support

   service sub-layer level OAM, an OAM Associated Channel Header (ACH)

   [RFC4385] together with a Generic Associated Channel Label (GAL)

   [RFC5586] MAY be used in place of a d-CW.



§4.2.1 says that the d-CW "MUST be present in all DetNet packets containing app-flow data".  What are the cases when the d-CW may be substituted by the ACH/GAL combination?  The PEF/POF functions are specified in terms of the d-CW

-- is that functionality lost if the ACH/GAL are used instead?



<Bala'zs> Right, this is a topic under discussion. We have a dedicated document

dealing with OAM for DetNet MPLS. https://datatracker.ietf.org/doc/draft-ietf-detnet-mpls-oam/

Current OAM capabilities are limited.



(5) §4.2.2



   "...zero or more F-Labels and optionally, the incoming interface,

   proceeding the S-Label MUST be used together with the S-Label to

   uniquely identify the DetNet service associated with a received

   packet.  The incoming interface MAY also be used together with any

   present F-Label(s) and the S-Label to uniquely identify an incoming

   DetNet service..."



These two phrases seem to say the same thing, but with different normative expectations.



<Bala'zs> Right, I will fix this.



(6) §4.2.2.2:



The interoperable action is not "MUST check", or "MUST ensure", but "MUST discard".



OLD>

   After a DetNet service is identified for a received DetNet MPLS

   packet, as described above, an implementation MUST check if PEF is

   configured for that DetNet service.  When configured, the

   implementation MUST track the sequence number contained in received

   d-CWs and MUST ensure that duplicate (replicated) instances of a

   particular sequence number are discarded.



NEW>

   After a DetNet service is identified for a received DetNet MPLS packet,

   as described above, if PEF is configured for that DetNet service,

   duplicate (replicated) instances of a particular sequence number MUST be

   discarded.


<Bala'zs> Thanks, I will fix this.



(7) §4.2.2.2:



"MAY wish" is not an action that can be enforced



OLD>

   Note that an implementation MAY wish to constrain the maximum number

   of sequence numbers that are tracked, on platform-wide or per flow

   basis.  Some implementations MAY support the provisioning of the

   maximum number of sequence numbers that are tracked on either a

   platform-wide or per flow basis.



NEW>

   An implementation MAY constrain the maximum number of sequence numbers

   that are tracked on either a platform-wide or per flow basis.



<Bala'zs> Thanks, I will fix this.



(8) §4.2.2.3:



The interoperable action is not "MUST check", or "MUST ensure", but "MUST process in order".



OLD>

   After a DetNet service is identified for a received DetNet MPLS

   packet, as described above, an implementation MUST check if POF is

   configured for that DetNet service.  When configured, the

   implementation MUST track the sequence number contained in received

   d-CWs and MUST ensure that packets are processed in the order

   indicated in the received d-CW sequence number field, which may not

   be in the order the packets are received.



NEW>

   After a DetNet service is identified for a received DetNet MPLS packet,

   as described above, if POF is configured for that DetNet service, packets

   MUST be processed in the order indicated in the received d-CW sequence

   number field, which may not be in the order the packets are received.



<Bala'zs> Thanks, I will fix this.



(9) §4.2.2.3:



"MAY wish" is not an action that can be enforced



OLD>

   Note that an implementation MAY wish to constrain the maximum number

   of out of order packets that can be processed, on platform-wide or

   per flow basis.  Some implementations MAY support the provisioning of

   this number on either a platform-wide or per flow basis.  The number

   of out of order packets that can be processed also impacts the

   latency of a flow.



NEW>

   An implementation MAY constrain the maximum number of out of order

   packets that can be processed, on either a platform-wide or per flow

   basis.  The number of out of order packets that can be processed also

   impacts the latency of a flow.



<Bala'zs> Thanks, I will fix this.



(10) [nits]



s/MAY required/MAY require



s/otherwise received/otherwise receive



s/a service parameters that dictates/service parameters that dictate



s/that maybe used/that may be used



<Bala'zs> Thanks, I will fix this.