Re: [Detnet] Magnus Westerlund's Discuss on draft-ietf-detnet-mpls-11: (with DISCUSS)

Magnus Westerlund <magnus.westerlund@ericsson.com> Wed, 09 September 2020 07:42 UTC

Return-Path: <magnus.westerlund@ericsson.com>
X-Original-To: detnet@ietfa.amsl.com
Delivered-To: detnet@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9F7EA3A0C5E; Wed, 9 Sep 2020 00:42:07 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.102
X-Spam-Level:
X-Spam-Status: No, score=-2.102 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qC4M7G7PEN1P; Wed, 9 Sep 2020 00:42:06 -0700 (PDT)
Received: from EUR04-DB3-obe.outbound.protection.outlook.com (mail-eopbgr60047.outbound.protection.outlook.com [40.107.6.47]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id D72F33A0C33; Wed, 9 Sep 2020 00:42:05 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=SOpan3o6e+fLkYR99hNCiOppQSZknegpuNcv5igywOw5mhYBL6d/yJhmFbqZI7maMRWXs+qDzt416qemCneDio1sDUDDxoqdmxgrCppxhm8BrapvdgrJHBlG7FFSFA7/twk51j1vIktxxK9iqWZY2YS+nBJfo153rpZGYqnoWnsQk5FtFrBbybjav2/yntIHMYczUIwRh4S+PNms+qVM+ov8JAakCJA1oem4dxMnJYyIXzMxg8vJs0v9vSRTi26a4JAFT7gmLUBoXCZvVQxJdZMeW3NS86iXr4ZnVFTe1NINrAlNV62ivFupPtHPnGQ2DEUPXzXy+8ADSqwAUMKOaA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=IPeBFx3UIbbAbDBPbcZUuSfiHUrThFMP9iRUss5A7CE=; b=dfEoQj5ee9KJzjlLdWBBElzaVFRxrY/2RGpMYJUzzc1s7BqUtLI3CtgyM9AZoe72e0p9LX9EAF2YcbsL/3dwTCdF2yEAkRCRbH8+8PRmTIat6GNl1aPBw/mKDbucv9SZ0AUzebzvk7RIXUoUnCY5EVHHtha7MeP9B7+7oIbbUHcsYQ8XpYzN7vGc7o3wJqdmC/WVOQwa/IJHeofc1KE/gfW9jsN+j+PMuRUnl7ldhu2u14NP1SsJVQyxY85KOYUUET45uuYRNGwb1eWkHVkvuYWO1eUWewaQnm0PjMb5o93lyFF4rxblQ8y15tGy9VIekLNRRrPi5j8iOzF6CXqhww==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=IPeBFx3UIbbAbDBPbcZUuSfiHUrThFMP9iRUss5A7CE=; b=dCNrN8Rx12akPx/boZEFT84vmb5Arivy64TuxJ+naTk1p4w8reKoqkRXzq3LKeFD4DXGLdvc5BSLOpnaOz8etMFD7msIoLfYYe6A5m63ikQcRWyLPIRUXMhdbrQr0GHzPsLyn1wC0Nvh1Av2cyQZMR2/seI0MaSfIQoBm8s616k=
Received: from HE1PR0702MB3772.eurprd07.prod.outlook.com (2603:10a6:7:8e::14) by HE1PR07MB3227.eurprd07.prod.outlook.com (2603:10a6:7:2c::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3370.12; Wed, 9 Sep 2020 07:42:02 +0000
Received: from HE1PR0702MB3772.eurprd07.prod.outlook.com ([fe80::b56f:9a8e:3399:aaa3]) by HE1PR0702MB3772.eurprd07.prod.outlook.com ([fe80::b56f:9a8e:3399:aaa3%7]) with mapi id 15.20.3370.016; Wed, 9 Sep 2020 07:42:02 +0000
From: Magnus Westerlund <magnus.westerlund@ericsson.com>
To: "stewart.bryant@gmail.com" <stewart.bryant@gmail.com>
CC: "detnet@ietf.org" <detnet@ietf.org>, "eagros@dolby.com" <eagros@dolby.com>, "iesg@ietf.org" <iesg@ietf.org>, "draft-ietf-detnet-mpls@ietf.org" <draft-ietf-detnet-mpls@ietf.org>, "detnet-chairs@ietf.org" <detnet-chairs@ietf.org>
Thread-Topic: Magnus Westerlund's Discuss on draft-ietf-detnet-mpls-11: (with DISCUSS)
Thread-Index: AQHWhfIOBHD39JgsGkyX4+SnXUz1aale7F6AgAEBJoA=
Date: Wed, 09 Sep 2020 07:42:02 +0000
Message-ID: <49d44f8d3b2fb1d8fa3a1ef9710a2f96ab1c4874.camel@ericsson.com>
References: <159957776121.26189.12459072134609921207@ietfa.amsl.com> <DD83469A-312D-47A3-AEBC-4539B9F36B25@gmail.com>
In-Reply-To: <DD83469A-312D-47A3-AEBC-4539B9F36B25@gmail.com>
Accept-Language: sv-SE, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-mailer: Evolution 3.28.5-0ubuntu0.18.04.2
authentication-results: gmail.com; dkim=none (message not signed) header.d=none;gmail.com; dmarc=none action=none header.from=ericsson.com;
x-originating-ip: [158.174.116.90]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 5ed23817-7b0a-4a3a-f3ab-08d85493d77d
x-ms-traffictypediagnostic: HE1PR07MB3227:
x-microsoft-antispam-prvs: <HE1PR07MB322776DB3EE11B548A85A62395260@HE1PR07MB3227.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: Ux/fThybWEloiRg5b9WjlNoc4w2RWvcWXvlpNfQovC1px3hRLJw9s9+ULa9/QJ1YFe+/KrwirF/ElaGp4gmHHiqC4OA847tbm9mAGm/MB7pt15L1Th5dARAig0WEKu46H6VWdNoxLYuu4fkZwXz3JDcCgTZ4gmN7f6jtE+6LsYAoKwY/BsucedP89emj+31SR+cImE9+A85Eou/F5Tdm8cuE97bLYHhZWL+8mZUqALWFX8Kij5SLw5Olzy/Va3ORbLKQNNN12mDKwXGsn1HcYZqKxk7+YS7YFjDly3MnNZmKLD2OWEvh6Jj8uEWnqk1aFuVOtTsVBPTa4gZG+mLsWw1hsfm9fnaBE6KIMOrhFHBWcfC1vjum0DhSQjwNjNiD
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:HE1PR0702MB3772.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(136003)(366004)(39860400002)(346002)(376002)(396003)(66476007)(66946007)(6916009)(66556008)(76116006)(8676002)(83380400001)(2906002)(66446008)(64756008)(8936002)(4326008)(6506007)(478600001)(86362001)(6486002)(53546011)(36756003)(44832011)(71200400001)(26005)(5660300002)(54906003)(316002)(6512007)(2616005)(186003)(99106002); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata: fDhTCCZVXdv9Mt3h03Pd6xi+HbMUWnlQE2QN4huFIwomVosLmFV0IhxEi8St/UfuN00430Y9XPUVLZkAv3R28JdeJv8cn+1bN6890cJh9uATIr30Oqmk/3szkrfKWnn6D9IOgtcFHEXS1pJfIq84rgaxsk3G/FKCIECKd0IwZLImaRYhBDPCV8LG8yyyFsrFVQiazDafKfgJfV+fZCwenRpiYSmpQcUuKv+C52W+mSdf+W8OXfrJBGmWcO026z7RMoJVqeEuyVBXBPVybD8cmVb3HiHrdFRZzR/aZ4+/X+w+WqX0fnYWjU2a3QYcWER43HCFJQ0Y7dE9wkaZymUV8nEb08R0QkpPVBJ5ijxxJOuve7hOBWn0aB6sZ2b2t3ScKpEcIy9eSoFBTLIimlVSa2GJdkj1+QhBLrgT7jsPdfCq0eXTIOZCcCwXOAf8BXo0g8zmw8HTeHd9Rlpbee9PFQCKLM7GF4UNG+UQYbp5ur/+0JFj5qSAhrkv00aMRMeTD05PI0O/eBc049wtyyYWAfupRV60rdZmZJEKAzbkwNrx+AEd+B8zdsqC2r8dEdw8EMQb4lOExUaZREXB6+v0zLYV2WlQ48RmDjdU+OvcQfZyDvrIKgZDExPpLjgtN5WeVoyipeTsm/Hx3F2epqsSKg==
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="utf-8"
Content-ID: <F848D675D1F30B4F95E081DFF77CFD7B@eurprd07.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: HE1PR0702MB3772.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 5ed23817-7b0a-4a3a-f3ab-08d85493d77d
X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Sep 2020 07:42:02.3627 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: Gh6INA8ut9ANNq5QJufi31ske2b+jEc20S8UtJJJztJqf1n8re75qoukZzNGO/XqS5Qk8QoAVR9q4Sttnxg5BTyfXBRn6J7xNMCrzweEQ2E=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR07MB3227
Archived-At: <https://mailarchive.ietf.org/arch/msg/detnet/7JGCjAGfERxYUZqWisfTsB5StRc>
Subject: Re: [Detnet] Magnus Westerlund's Discuss on draft-ietf-detnet-mpls-11: (with DISCUSS)
X-BeenThere: detnet@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Discussions on Deterministic Networking BoF and Proposed WG <detnet.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/detnet>, <mailto:detnet-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/detnet/>
List-Post: <mailto:detnet@ietf.org>
List-Help: <mailto:detnet-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/detnet>, <mailto:detnet-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 09 Sep 2020 07:42:08 -0000

On Tue, 2020-09-08 at 17:21 +0100, Stewart Bryant wrote:
> 
> 
> > On 8 Sep 2020, at 16:09, Magnus Westerlund via Datatracker <noreply@ietf.org
> > > wrote:
> > 
> > So both of these section discuss the use of the sequence number for removing
> > packet duplicates and handling reorder. As the text discusses there can be a
> > configured limit for how deep the buffer and state are for performing these
> > operations. We all know that the implementation of this will have a
> > practical
> > limit in both buffer space for reordering as well as state for tracking
> > which
> > sequence numbers that have been forwarded. I think that should be more
> > clearly
> > expressed in the document that these practical limits exists. Thus, the
> > implementations will have tracking and determination of what are new packets
> > (increasing sequence number within a window higher than previous largest
> > seen.
> > And consider sequence number form currently highest seen and a bit backwards
> > as
> > older packets. Thus how this is implemented will impact how this acts in
> > cases
> > of disruptions of the packet flow. Thus, I wonder if there is actually need
> > to
> > be  a bit more specific in how classification should be done. Especially if
> > the
> > wrap-around of the sequence number space approaches a small multiple of
> > round
> > trip times for the path which is likely for the 16-bit space.
> > 
> > Then  sections fails to discuss how the duplication removal, the reordering
> > buffering and bound latency interacts and affet each other.  So if the
> > latency
> > is bounded then the reordering has an hard time limit for the maximum delay.
> > If
> > there is a boundary for reordering then there are no point in de-duplicating
> > packets that will not be forwarded due to the reordering. And even if there
> > are
> > no bounded latency the reordering buffer size will still impact the depth of
> > de-duplication. These practical limits will also be limitations on the
> > guarantees that can be provided.
> > 
> > Thus, from my perspective there is need for more text on the requirements of
> > the implementation of these functions and their interactions of creating
> > limitations.
> 
> The text seems to line up well with the work that we did on pseudowire
> sequence numbers and we have had no reports from implementors or operators
> that we need to increase the text and provide implementation guidance.
> 
> I am always worried about overprescribing the operation of such systems since
> it is easy to rule out legitimate implementation optimisations, or
> inadvertently prevent the use of the technology in some way that we have not
> yet considered but which would be valid.

So, I think any issues would only really show up when your close to the
boundaries of how many packets are in flight. And with current technolghy and
link rates the 28-bit sequence number supports rates for DETNET flows into the
terrabit range if I calcualted correctly unless the path is very long (>>100
ms). The 16-bit field has much more restriction and could be pushed into
wrapping on the time scales packets has some chance of later showing up. Likely
the application are not pushing that amount of bits, but I want to bet on that.
This might be used in particla physic or simiarl field which produces stupendous
amount of data that needs to be processed in order. 

> 
> I would argue that the buffer sizing, constraints and management is more
> properly a discussion between the vendor and the operator.

The issue I see here from an interoperability stand point is if the
configuration option for example buffer depth needs to be set differently due to
how the buffering and processing is done for different vendor. That is not great
for interoperbility or ease of management for the operator. 

> 
> On latency we are not in this design providing precision latency management,
> just best effort mitigation of the natural latency of the network. This may
> change if we introduce queue management or other services, but I do not think
> we are there yet, and suspect that once we get to latency management we will
> need more metadata in the packet.

I think this comes back to the previous email. The document is not properly
expressing the limitation in what actual properties it can ensure. And when it
comes to latency the theoretical boundaries appears to be much worse than what
the practical ones likely are for the wast majority. 
 
Cheers

Magnus Westerlund 


----------------------------------------------------------------------
Networks, Ericsson Research
----------------------------------------------------------------------
Ericsson AB                 | Phone  +46 10 7148287
Torshamnsgatan 23           | Mobile +46 73 0949079
SE-164 80 Stockholm, Sweden | mailto: magnus.westerlund@ericsson.com
----------------------------------------------------------------------