Re: [Detnet] Review of draft-ietf-detnet-pof-04 for the RTGDIR

Balázs Varga A <balazs.a.varga@ericsson.com> Wed, 08 November 2023 17:21 UTC

Return-Path: <balazs.a.varga@ericsson.com>
X-Original-To: detnet@ietfa.amsl.com
Delivered-To: detnet@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 201C2C151989; Wed, 8 Nov 2023 09:21:12 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.109
X-Spam-Level:
X-Spam-Status: No, score=-2.109 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id oEu0ebpPXFyO; Wed, 8 Nov 2023 09:21:08 -0800 (PST)
Received: from EUR04-HE1-obe.outbound.protection.outlook.com (mail-he1eur04on2045.outbound.protection.outlook.com [40.107.7.45]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id CF374C14F726; Wed, 8 Nov 2023 09:21:07 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=ePJZB3XwfjKBHYhYMZmYJrfbVRu2BNRqoCjcGm/D2+cvukg9Nlnie3Q6fMh5BFBpsJsPD7eEVH6GR8hskMUgBTqvhV7Kinx0NF4Txo/4+JS3VTMQfJySNFrcQafPLnYSQDrhenVI8wQ7Rkcf49kbKq1pLBHyBQ2hB1N3tPVNkNk5isilZmFKu9fJ2Jbh2Rt6f5szx0e0Ev/yDWm3iI/330iSuUS0OFVR+5qOcTVuZ615SklMV9UVRQqw3gFwyd/q/bOxuD2DX6oJGGkAuqWF92J50Hoznpg+5Syq5Rb0+ETnBc54ysF1VhAfZVMVqreo7UOFNJTDJxH0i05g9Cfsdw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=jadWin1eIgtDeeywsT36hEpLa6fA29VxN+BONMjLmY4=; b=N+tjHufDA0tQoSB5I03DKL0eAzIrGVtazqvGtDvM/KR5HZiOmZsPt52RxAjKGzARh98DF5U8yKmw55Dcq6gp5t0kQi0gw1TlRJ6aMQSERsYCCN09WU/PoMaj1kgqaQWFJbxse1J7Tfh/BjxAupcPqPoBONcQ5Z+M70c1XamqN5LEi+OLaxhHfiI2tsVViAow/5MCP/lsordJW129AaL40C6dIG2zSnykaRnU2L0xEGSxlvC+JvhWLWncg7bxkwdn8wDWi3IsT3jrYNy2J2WFGmihd1EcfFqebXtIXsSFz9Pgr7kTQDgMZuJNn+WFW8FAmq0tW6J4G2Wevx/kfdyKKw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jadWin1eIgtDeeywsT36hEpLa6fA29VxN+BONMjLmY4=; b=oR2xPfBTdxZfjCyUy+S08Yp7H2H+QKmyU4RWxjVXur4OPVVj4d7mgU+744JVKIQxDZITVhMweIlddPZyKrmhwrsSy/gR1FhQtL/XdVU9lytSjXTTLm2IyvAU7/CqOIU5QOh7Lvq+1IU0Ay7TfF87//bGtXBB1M6W1BhikTpytJe3qN3ZamIdlB8id1xIRCGW/bL4b543DSJBhip/hNJQmkITZVWQYPy/0A7Vhr6YpEjHnidQybtoj7a4craSwwQVzMOwMNNtQR42YPDqqkD9wiKhMb0uX5p41p390jTHChob/Zlwk1x7BMbFrR3AwGg73yCDEbtslvenWcXFpRJyLQ==
Received: from AM0PR07MB5347.eurprd07.prod.outlook.com (2603:10a6:208:e7::31) by AS2PR07MB9184.eurprd07.prod.outlook.com (2603:10a6:20b:5e8::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6977.18; Wed, 8 Nov 2023 17:21:04 +0000
Received: from AM0PR07MB5347.eurprd07.prod.outlook.com ([fe80::a62d:d09d:94ab:2a3d]) by AM0PR07MB5347.eurprd07.prod.outlook.com ([fe80::a62d:d09d:94ab:2a3d%5]) with mapi id 15.20.6954.028; Wed, 8 Nov 2023 17:21:04 +0000
From: Balázs Varga A <balazs.a.varga@ericsson.com>
To: Henning Rogge <hrogge@gmail.com>
CC: "detnet@ietf.org" <detnet@ietf.org>, "rtg-dir@ietf.org" <rtg-dir@ietf.org>, Daniam Henriques <daniam.henriques@liquid.tech>
Thread-Topic: [Detnet] Review of draft-ietf-detnet-pof-04 for the RTGDIR
Thread-Index: AQHaBYeWDqaWdeJoVEu3XursrenXAbBuu3gwgAFzVgCAAAYFoIAACqiAgAB+g6A=
Date: Wed, 08 Nov 2023 17:21:04 +0000
Message-ID: <AM0PR07MB53479DF84A70981BC2285033ACA8A@AM0PR07MB5347.eurprd07.prod.outlook.com>
References: <CAGnRvupkK2t95t=PKLBL9vWE5ijzN582O6itxQFribc_=rQKXw@mail.gmail.com> <AM0PR07MB53472B014677EF0AA09950E1ACA9A@AM0PR07MB5347.eurprd07.prod.outlook.com> <CAGnRvupxSBavoWuWn+20Gn+1uqTVATr7Q2SrpRJoNW3KicpstQ@mail.gmail.com> <AM0PR07MB53472B1B6A4EC8CB543E44C8ACA8A@AM0PR07MB5347.eurprd07.prod.outlook.com> <CAGnRvuqjNbXyD_LFi44LVPsQKKiwRL2Ei5JHydCGra8P75f5Yw@mail.gmail.com>
In-Reply-To: <CAGnRvuqjNbXyD_LFi44LVPsQKKiwRL2Ei5JHydCGra8P75f5Yw@mail.gmail.com>
Accept-Language: hu-HU, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=ericsson.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: AM0PR07MB5347:EE_|AS2PR07MB9184:EE_
x-ms-office365-filtering-correlation-id: ff2aa756-80ec-44c6-9c2b-08dbe07f163d
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: KC5HAP6Q432swHUTYDtdep1fneJkNF7odColWQiK081+gRmjyAl9P/dZ21cbPGb3AbbCy7Ngxi4pbwLUC+XIT8Mxc2E973EvAyuB6vyPbWgaVSXmZBdPPfqvWooo1eRK/Jz51RsoQOxzaQCWrv0AlOxd6f/3vMaLv31VuHoICTdzHUsf042PAW7RjKTuldVrQRW+AD2DgBFZyPxPEMn7es4MCnF/e7oDCZ/rjsL5/RtsU4DzLJl9YT6ocqoFlKV7TqzMQofh7ipkI/PQ//0ngJK4L/gGVDulqcH6k3k8FlvxQYEE5MWWzgbRaWgseG0B54GqdZ4FOp01ZEw8adp35lXItpRDHL5abfbvT91ldCI7tqpvF+odU0z1cRMue5BSjOVvv3xOriDorBfDAkCZ6yFgHAFo5HXuxferkjul7eKHdooc/yy8K4XFyBGGtVKKp2GHzvfR853i3v5soO1cAbCpoXUmGVly01MGVLt+n5s0x9rLJAckQwNnCo6lUNX5Fptne2SqFuGonttHTAR80WmSH2ujEPdFpcmQAOOEIPi90miBctmS4KyVvuNorzUQEa2o12OKkWT26rhU3Urae3y3o2/APRko50YPEpI7eddIMVZoXjAnNjVuiZ9zI/wkfGiuJp9p9bdgSlSbWbsydqiC9jBpI3qQtjabb+5Vle0=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM0PR07MB5347.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(39860400002)(396003)(366004)(376002)(136003)(346002)(230922051799003)(186009)(1800799009)(64100799003)(451199024)(316002)(6916009)(66556008)(66476007)(66946007)(66446008)(54906003)(64756008)(76116006)(9686003)(85182001)(53546011)(71200400001)(85202003)(7696005)(6506007)(66574015)(38070700009)(26005)(478600001)(38100700002)(82960400001)(122000001)(33656002)(83380400001)(86362001)(52536014)(41300700001)(2906002)(55016003)(5660300002)(8676002)(8936002)(4326008); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: XuwdrBII7udAi4vM8fhjJtBAdF7mmq0oYNLwYx8k/U29fgnBlLQ/Bo6huX1CIRyq61LJ2+fm1jysckyVV0XJthrkarLMogz1HFbeuIOK9Jy/SdjvlFUZnkmaYidXvhmYWZ5Jedx32cN6dfVH08CXHeKA5SNPCDALGAh5X+ZpjYgRfR4L7z5k+ZsbrWIzs1Z7ENCXTtTrl2bmAcKLb1PKGCQBSFNn49iZyH8ydTLKgywzC/Zbozfu27c7mnie5N2YDiAHidD2IYFwzWZ+sPRu1yg0ZSfXpgV4xawEqo9YdCVFNnHtKW91T0l+IbSMgxTCqniWoCnuiGGA7a5ReAE+pK8jPcAeF9pdknD19rzc8x2FmYn1Obz/q70pIx0vOv4oxUCBAt8YY4ao183uAeb8dGXdF0N1s8HTBqgNJSqciWFJ07o6kDHjCzTFEBS0RD+nQYpeJ/5LATwXpOGNbqDIuMHvF2aQp/qve9J6nG56g2OMK42WcFFzO0EqSXgvPyeHP74z7UxT0yXj+RVURYpOppNeWbh4Ls9ahbNKaGqbEJFBi1Ffn7+7Y9t4/F/s2kPiX1LSJbPygG4Rp+9mA/yHs3CIRn+xEvGQZEWZybNbh1ul41dM6OvEEn+NnwW5YM/M2DP7lPk6beSK2AFPT9VsZnDwRDR4Hc1NkMrtIYrVkh0inFoyDEnJ5FRaQO/TOIDWCIaus8WIvRjcvIr0XtLSh+ipLuB5V9yk9HkRBCc8NgeaeF68we6kXq8/tHgRjLJ3z9JBBtMNq7l/OqiD3mIEEcf3Ilbsyg9HgD6KnMbjm00Nr42hHLyFhXsy+GrSDwS0v1w7BewxMaB+JEprQDHS/qIj5cDqWZV7kRSY4pPleVcZr1f/apOKKuBqmkG/qq2vgsXAaCr0TMOPBfR2IHum720S9SG5QxiuVBLRXF/Wbij4lX3aKGyxh67Y41SvREp/TO82M2ZWY9uBNSnEKTygy2AToG65GcIknpXZAMCpUwpGdSxIzMOuXR0Qb7ecP+6iTnwInflseozqnT2pIcrAqyNA/V+5eCeHgsp8b0MuxqIbpIyvCrSdDoNIlfyefxq9uz3Ev2/ApXl2BzjOLq7ct3QTgPhLTbEmz/R7IKKPpur3JjuY+7ZPixcjc5sn5wChW05RU1sk6+uQBUFMAClfKoxAedo4oOkKWb5QeC7he3zjlrtwhaKS5iTuDNBnBVHstpyaygHLMX0c6TuR0Avdf+lFOW3+LtdkwTTSHwOxSxjVccknkXeK+4IJKLr5EwiaBscAq5OZDab6nv/LCvZx/HrUCv3y4qVKUXzX90+G/KAabd5gz5+mK3IHmdRF0sLxWJl/Aq2Vt+1lb1MVgPP9MllyUWSL32dkpTdFuI6lVd2Oogw0B5ijsdoK0FOYYjOVvUjRIprpKHrmdSdnmTLXGL9Sz5EGrrIRDypEB38ImqpHGsNa/QLIV36YxATmEMqpwlORwC5ENIR2tM8xqwDSlq83C365tdmjDqaiaNUALpUtH7sNPxlQMuw2KsftHfMVcpbxOcy66e+hFNLC+He2sC0TXYQfeWvT3u0//i3R9y6PqzXr56ZOwmB40T3gPm8UGcPhr7mhb7gFDVCsZat6sw==
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM0PR07MB5347.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: ff2aa756-80ec-44c6-9c2b-08dbe07f163d
X-MS-Exchange-CrossTenant-originalarrivaltime: 08 Nov 2023 17:21:04.1554 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: aOJpfb6ukKmyLEyBKwg0TGGMN/cIHNkyO2mBZe32nBmQl6vLAwv/BdF8AjxScFEOTQ3p9A+YQjBtbPyAeYzYn04ZfwoBu0T6MDffAm2rsGU=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS2PR07MB9184
Archived-At: <https://mailarchive.ietf.org/arch/msg/detnet/ASZXHHLJdh2r0t6hwUzf0h95440>
Subject: Re: [Detnet] Review of draft-ietf-detnet-pof-04 for the RTGDIR
X-BeenThere: detnet@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Discussions on Deterministic Networking BoF and Proposed WG <detnet.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/detnet>, <mailto:detnet-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/detnet/>
List-Post: <mailto:detnet@ietf.org>
List-Help: <mailto:detnet-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/detnet>, <mailto:detnet-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 08 Nov 2023 17:21:12 -0000

Hi Henning,

I think my clarification was not detailed and clear enough or I
have missed something in your example.

DetNet has defined many building blocks. Some are responsible for 
bounded latency, some are focusing on reliability. PREOF is 
targeting lossless delivery. None of the PREOF functions care 
whether a packet is too-late or in-time. It is not their 
task.

The only occasion when latency matters for PREOF is during the network 
design. When configuring PREOF components (their network location,
used paths over the network, etc.) the network designer must 
consider the "delay budget" of the communication (e.g., excluding 
paths with too much delay).

As multiple paths are used simultaneously by PREOF, some paths are 
faster, some are slower. POF is not able to decide whether a packet 
is too-late or not, but that is not needed for POF to work. 

POF always forwards packets, it never drops any packet. 

POF intends to give a chance for a missing packet to arrive over the
slow path. If it happens it will forward packets with correct order.
If it does not happen or the missing packet arrives too-late (compared 
to the intended design (see above)), then POF cannot correct the order, 
but will forward the packet.

Regarding your example:
- it is a severely unhealthy scenario from DetNet perspective
- several packets are missing (2,3,4,5,6,7,9)
- if seq_num 10 and 8 are too-late POF cannot make the situation 
better (but it is not a task for POF).
- seq_num 10 and 8 are always forwarded by POF
- yes, seq_num 11 will be buffered, but if it is "in-time" it does 
not matter as the buffering time is designed according to the "delay 
budget" (again see above). So it will be delivered "in-time".

Cheers
Bala'zs

-----Original Message-----
From: Henning Rogge <hrogge@gmail.com> 
Sent: Wednesday, November 8, 2023 10:24 AM
To: Balázs Varga A <balazs.a.varga@ericsson.com>
Cc: detnet@ietf.org; rtg-dir@ietf.org; Daniam Henriques <daniam.henriques@liquid.tech>
Subject: Re: [Detnet] Review of draft-ietf-detnet-pof-04 for the RTGDIR

On Wed, Nov 8, 2023 at 10:07 AM Balázs Varga A <balazs.a.varga@ericsson.com> wrote:
>
> Hi Henning,
>
> Thanks for further clarifications. I think that highlights the 
> somewhat different mindset deterministic communication related 
> functions follow. The per packet replication and elimination are used 
> for applications those require extreme parameters on loss, i.e., practically lossless communication.
> Replication (PRF) and Elimination (PEF) are doing their job to ensure 
> this lossless communication. POF is intended to correct the rare 
> side-effect (i.e., out-of-order
> delivery) resulted from PRF/PEF.
>
> With those in mind, POF should never drop any packet as it would harm 
> the application (requiring lossless communication). If POF configured 
> incorrectly (like in your example), then it will not correct 
> out-of-order delivery. However dropping packets would make the 
> situation even worst for the application. Dropping out-of-order packets is a task for the application, if it decides to do so for too late or out-of-order packets.
>
> I hope these clarifies your concerns.

Sorry, I have my problem with this point of view...

If out-of-order packets arriving too late are an invalid state, you should not modify your protocol control variable, regardless of the decision if you want to forward them or not. Protocols should be robust against failures of communication partners.

Imagine the following sequence of packets.

seq 1: arriving in time
seq 10: arriving too late (invalid state?) seq 8: arriving out-of-order AND too late (also invalid state?), this will set POFLastSent to 8 seq 11: arriving in time, but will be delayed by buffer because POFLastSent is 8.

regardless of the decision if sequence number 10 and 8 are delivered or not (which should be defined in the document), sequence number 11 should not be buffered.

Henning Rogge