Re: [Detnet] TSN scheduling/queuing algorithms and DetNet

Toerless Eckert <tte@cs.fau.de> Thu, 05 October 2023 16:40 UTC

Return-Path: <eckert@i4.informatik.uni-erlangen.de>
X-Original-To: detnet@ietfa.amsl.com
Delivered-To: detnet@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 369F3C15107C for <detnet@ietfa.amsl.com>; Thu, 5 Oct 2023 09:40:03 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.657
X-Spam-Level:
X-Spam-Status: No, score=-1.657 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HEADER_FROM_DIFFERENT_DOMAINS=0.249, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=no autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id pkunygoMI_gM for <detnet@ietfa.amsl.com>; Thu, 5 Oct 2023 09:39:58 -0700 (PDT)
Received: from faui40.informatik.uni-erlangen.de (faui40.informatik.uni-erlangen.de [IPv6:2001:638:a000:4134::ffff:40]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9ADA3C151073 for <detnet@ietf.org>; Thu, 5 Oct 2023 09:39:57 -0700 (PDT)
Received: from faui48e.informatik.uni-erlangen.de (faui48e.informatik.uni-erlangen.de [131.188.34.51]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by faui40.informatik.uni-erlangen.de (Postfix) with ESMTPS id 4S1cjG4yhmznkTd; Thu, 5 Oct 2023 18:39:46 +0200 (CEST)
Received: by faui48e.informatik.uni-erlangen.de (Postfix, from userid 10463) id 4S1cjG3xt7zkZgL; Thu, 5 Oct 2023 18:39:46 +0200 (CEST)
Date: Thu, 05 Oct 2023 18:39:46 +0200
From: Toerless Eckert <tte@cs.fau.de>
To: "Black, David" <David.Black@dell.com>
Cc: Florian Kauer <florian.kauer@linutronix.de>, "detnet@ietf.org" <detnet@ietf.org>
Message-ID: <ZR7m0rH68zb8QHoE@faui48e.informatik.uni-erlangen.de>
References: <MN2PR19MB4045CBDF2D8B625E829FE8F683CBA@MN2PR19MB4045.namprd19.prod.outlook.com> <68403079-acaf-4f80-b6df-90f7ddaf2b86@linutronix.de> <MN2PR19MB40459C10008810862FB701CA83CAA@MN2PR19MB4045.namprd19.prod.outlook.com>
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Disposition: inline
Content-Transfer-Encoding: 8bit
In-Reply-To: <MN2PR19MB40459C10008810862FB701CA83CAA@MN2PR19MB4045.namprd19.prod.outlook.com>
Archived-At: <https://mailarchive.ietf.org/arch/msg/detnet/6SfPxCcxT1Q7-l-NGVnxIEBikOI>
Subject: Re: [Detnet] TSN scheduling/queuing algorithms and DetNet
X-BeenThere: detnet@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Discussions on Deterministic Networking BoF and Proposed WG <detnet.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/detnet>, <mailto:detnet-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/detnet/>
List-Post: <mailto:detnet@ietf.org>
List-Help: <mailto:detnet-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/detnet>, <mailto:detnet-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 05 Oct 2023 16:40:03 -0000

As i tried to explain in the last email reply to Florian:

I think for large-scale/high-speed detnets, that the TSN algorithms will not work well,
but with proposal like we have on the tavble, i think we know how to adopt what we learned from TSN.
(aka: TCQF/CSQF vs. CQF/ECQF).

Even if something like timed gates on ingres is something we could reuse directly from TSN, i still
prefer we have IETF docs explaining how to adopt to IETF networks.

For low-speed/limited-bandwdith DetNet, such as in manufacturing floors, i wonder if we are going to see
any insance where we need to adopt TSN mechanisms directly to L3:

I do not think we are going to see any such limited-scale networks without L2 switches involved. I for
once am not aware of any campus/industrial environments where sender/receivers directly attach to
a router. IETF has just done a (sh#$y - censored) job to make deployment of L3 easy. You immediately
need an IP/IPv6 addrssing expert, manage addressing space, and if you want to have device mobility you
need complex solutions that most likely will break any services guarantees (like TSN or DetNet).

Aka: between any sender/receiver and any router will be L2 switches whcih would then have to be TSN
anyhow. And we have the RFCs explaining how to run DetNet "over" such L2 TSN subnets.

How about a larger industrial network/campus: 

    Src --- L2sw --- Rtr1 ---- backbone --- Rtr2 --- L2sw -- Rcvr

Would we not we need "DetNet only" between Rtr1 and Rtr2  - no TSN involved ?

No. Because any Rtr equipment that vendors would sell into such environment will already have an
L2 switch integrated inyo any of these routers. So in reality the actual forwarding would be:

    Src --- L2sw --- [L2sw-Rtr1-L2sw] ---- backbone --- [L2sw-Rtr2-L2sw] --- L2sw -- Rcvr

In effect we do have 3 TSN domains where Rtr1 / Rtr2 really just need to do non-queuing
forwarding, make sure that queuing happens on the outgoing TSN L2sw side on the same box,
and the only DetNet job on the sending side is to aply the right L2 tagging to ensure the
packet is put into th right TSN service instance.

Only when the "backbone" links become fast / lage enough that the L2sw approach on the box
won't work would we need "direct L3" interface queuing. 

Cheers
    toerless


On Thu, Oct 05, 2023 at 01:46:44PM +0000, Black, David wrote:
> Hi Florian,
> 
> Still posting as an individual - the two of us are on the same page ...
> 
> > Since I was not able to attend the meeting and I can not find any minutes or recording, I would love to get more background about this question, especially why you explicitly marked **algorithms** as bold.
> 
> I was drawing a distinction between the entire scope of TSN technology, which is a layer-2 subnet when fully deployed, versus just the TSN scheduling/queuing algorithms (e.g., Qbv) which are readily deployable at layer 3.
> 
> > And for those scenarios my current working assumption is actually that all DetNet nodes that route on L3 between L2 TSN
> > networks would be able to directly apply all TSN techniques (like Qbv and CQF) without any special consideration for them on L3.
> 
> +1 on "directly apply all TSN techniques (like Qbv and CQF) without any special consideration for them on L3" - and in particular, I believe that this direct application is possible now (i.e., no need to wait for IETF to publish a detnet RFC that says it's ok to do this obvious thing ...).
> 
> > The only exception is that the L3 processing MIGHT take more time than L2 bridging and this might have to be taken into account e.g. when calculating a Qbv schedule.
> > Do you agree or is there something I overlook?
> 
> I don't think you've missed anything major ...
> 
> Thanks, --David
> 
> -----Original Message-----
> From: Florian Kauer <florian.kauer@linutronix.de> 
> Sent: Thursday, October 5, 2023 3:22 AM
> To: Black, David; detnet@ietf.org
> Cc: Black, David
> Subject: Re: [Detnet] TSN scheduling/queuing algorithms and DetNet
> 
> 
> [EXTERNAL EMAIL] 
> 
> Hi David,
> thanks for bringing up this point!
> Since I was not able to attend the meeting and I can not find any minutes or recording, I would love to get more background about this question, especially why you explicitly marked **algorithms** as bold.
> 
> For the use cases I am currently considering for DetNet (industrial control/vPLC and pro audio) the scaling requirements (time asynchrony, propagation latency...) are IMHO of lower importance at the moment. And for those scenarios my current working assumption is actually that all DetNet nodes that route on L3 between L2 TSN networks would be able to directly apply all TSN techniques (like Qbv and CQF) without any special consideration for them on L3. The only exception is that the L3 processing MIGHT take more time than L2 bridging and this might have to be taken into account e.g. when calculating a Qbv schedule. Do you agree or is there something I overlook?
> 
> Thanks,
> Florian
> 
> On 04.10.23 23:30, Black, David wrote:
> > For clarity, this is posted as an individual contributor …
> > 
> >  
> > 
> > In the most recent open working meeting, Toerless and I had a discussion about whether DetNet nodes could use the TSN scheduling/queuing algorithms.
> > 
> >  
> > 
> > Checking the DetNet RFCs, what I believe I see is:
> > 
> >   * Toerless’s assertion that all DetNet RFC references to TSN refer to layer-2 TSN subnets appears to be correct.
> >   * OTOH, I did not see anything that prohibits implementation and use of the TSN scheduling/queuing **algorithms** at layer 3 in DetNet nodes.
> > 
> >  
> > 
> > I would hope that it’s not necessary to publish an RFC to bless the use of the TSN scheduling/queuing algorithms at layer 3 in DetNet Nodes …
> > 
> >  
> > 
> > Thanks, --David
> > 
> > * *
> > 
> > *David L. Black, *Sr. Distinguished Engineer, Technology & Standards
> > 
> > Infrastructure Solutions Group,*Dell Technologies*
> > 
> > mobile +1 978-394-7754 David.Black@dell.com <mailto:David.Black@dell.com>
> > 
> >  
> > 
> > 
> > _______________________________________________
> > detnet mailing list
> > detnet@ietf.org
> > https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/detnet__;!!LpKI!nabqKqkaJqASqxUmFFXsdWshrCNzaQHg7m-v-hGX_vjxDkaPwEjaN_7LLu4bVsAoreoYzg2j8oO_zNFgpKpK_IqND_rO3Q$ [ietf[.]org]

-- 
---
tte@cs.fau.de