Re: [Detnet] TSN scheduling/queuing algorithms and DetNet

Toerless Eckert <tte@cs.fau.de> Thu, 05 October 2023 16:26 UTC

Return-Path: <eckert@i4.informatik.uni-erlangen.de>
X-Original-To: detnet@ietfa.amsl.com
Delivered-To: detnet@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 954F1C1522C4 for <detnet@ietfa.amsl.com>; Thu, 5 Oct 2023 09:26:24 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.657
X-Spam-Level:
X-Spam-Status: No, score=-1.657 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HEADER_FROM_DIFFERENT_DOMAINS=0.249, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=no autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ABTHKBccY9VH for <detnet@ietfa.amsl.com>; Thu, 5 Oct 2023 09:26:20 -0700 (PDT)
Received: from faui40.informatik.uni-erlangen.de (faui40.informatik.uni-erlangen.de [131.188.34.40]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BE786C151538 for <detnet@ietf.org>; Thu, 5 Oct 2023 09:25:48 -0700 (PDT)
Received: from faui48e.informatik.uni-erlangen.de (faui48e.informatik.uni-erlangen.de [IPv6:2001:638:a000:4134::ffff:51]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by faui40.informatik.uni-erlangen.de (Postfix) with ESMTPS id 4S1cP50R4TznkTd; Thu, 5 Oct 2023 18:25:45 +0200 (CEST)
Received: by faui48e.informatik.uni-erlangen.de (Postfix, from userid 10463) id 4S1cP46gq0zkZgL; Thu, 5 Oct 2023 18:25:44 +0200 (CEST)
Date: Thu, 05 Oct 2023 18:25:44 +0200
From: Toerless Eckert <tte@cs.fau.de>
To: Florian Kauer <florian.kauer@linutronix.de>
Cc: "Black, David" <David.Black=40dell.com@dmarc.ietf.org>, "detnet@ietf.org" <detnet@ietf.org>, "Black, David" <David.Black@dell.com>
Message-ID: <ZR7jiGLr4ohJjB4o@faui48e.informatik.uni-erlangen.de>
References: <MN2PR19MB4045CBDF2D8B625E829FE8F683CBA@MN2PR19MB4045.namprd19.prod.outlook.com> <68403079-acaf-4f80-b6df-90f7ddaf2b86@linutronix.de>
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Disposition: inline
Content-Transfer-Encoding: 8bit
In-Reply-To: <68403079-acaf-4f80-b6df-90f7ddaf2b86@linutronix.de>
Archived-At: <https://mailarchive.ietf.org/arch/msg/detnet/u9FMKQB-K30pnMIFUg3WUWsGvro>
Subject: Re: [Detnet] TSN scheduling/queuing algorithms and DetNet
X-BeenThere: detnet@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Discussions on Deterministic Networking BoF and Proposed WG <detnet.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/detnet>, <mailto:detnet-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/detnet/>
List-Post: <mailto:detnet@ietf.org>
List-Help: <mailto:detnet-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/detnet>, <mailto:detnet-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 05 Oct 2023 16:26:24 -0000

Florian,

As i tried to explain in draft-eckert-detnet-bounded-latency-problems, and as we now try to formalize
better in draft-ietf-detnet-scaling-requirements, there is a huge difference in problems between
what i would call the typical TSN deployment target and what we would need to allow SPs to operate
DetNet in a shared services network with e.g.: 400Gbps interfaces across e.g. a metropolitan area.

Taking CQF at high-speed for example: The cost of putting bounded latency mechanisms into high-speed ASIC/FPGA
of maybe 400 Gbps speed based queuing is not necessarily the same as in 1/10 Gbps interfaces. Relative to
individual frames/packets there is a lot more propagation variation, and the integration of clock synchronization
is equally posing different challenges. This is specifically whay we proposed to decouple the clock synchronization
from the cycle timing much better by putting the cycle-identifier into the packet. Thats the one core
simplification over th TSN approaches, but it is crucial for ease of adoption in high-speed hardware.

I have also recently come to a better understanding that the strict cycle aproach of *CQF should not only
be seen as a problem, but that instead it can serve very much as a benefit, because it does allow
to do a lot easier flow-interleaving (draft-eckert-detnet-flow-interleaving) to raise utilization of
DetNet traffic in the network while simultaneously minimizing per-hop queuing latency.

This flow-interleaving consideration is btw. not fundamentally different from the logic that made TAS
an attractive option in TSN deployments, except that in those deployment it is possible to calculate the
timing of packets such that they can be passed through multiple switches without any queue building, and
hence with pass-through-switches one can get really low end-to-end latencies. Luckily, if speed-of-light
propagation latency of a DetNet path is already in the order of 1msec, then we do have relatively
speaking some usec that we can use for queuing, so we do not need to get that fancy (and complex),
but still: there are some IMHO simple high-level criteria why i think we would want to pick some
specific DetNet queuing mechanism - such as TCQF/CSQF...

Cheers
    Toerless

On Thu, Oct 05, 2023 at 09:22:10AM +0200, Florian Kauer wrote:
> Hi David,
> thanks for bringing up this point!
> Since I was not able to attend the meeting and I can not find any minutes or recording, I would love to get more background about this question, especially why you explicitly marked **algorithms** as bold.
> 
> For the use cases I am currently considering for DetNet (industrial control/vPLC and pro audio) the scaling requirements (time asynchrony, propagation latency...) are IMHO of lower importance at the moment. And for those scenarios my current working assumption is actually that all DetNet nodes that route on L3 between L2 TSN networks would be able to directly apply all TSN techniques (like Qbv and CQF) without any special consideration for them on L3. The only exception is that the L3 processing MIGHT take more time than L2 bridging and this might have to be taken into account e.g. when calculating a Qbv schedule. Do you agree or is there something I overlook?
> 
> Thanks,
> Florian
> 
> On 04.10.23 23:30, Black, David wrote:
> > For clarity, this is posted as an individual contributor …
> > 
> >  
> > 
> > In the most recent open working meeting, Toerless and I had a discussion about whether DetNet nodes could use the TSN scheduling/queuing algorithms.
> > 
> >  
> > 
> > Checking the DetNet RFCs, what I believe I see is:
> > 
> >   * Toerless’s assertion that all DetNet RFC references to TSN refer to layer-2 TSN subnets appears to be correct.
> >   * OTOH, I did not see anything that prohibits implementation and use of the TSN scheduling/queuing **algorithms** at layer 3 in DetNet nodes.
> > 
> >  
> > 
> > I would hope that it’s not necessary to publish an RFC to bless the use of the TSN scheduling/queuing algorithms at layer 3 in DetNet Nodes …
> > 
> >  
> > 
> > Thanks, --David
> > 
> > * *
> > 
> > *David L. Black, *Sr. Distinguished Engineer, Technology & Standards
> > 
> > Infrastructure Solutions Group,*Dell Technologies*
> > 
> > mobile +1 978-394-7754 David.Black@dell.com <mailto:David.Black@dell.com>
> > 
> >  
> > 
> > 
> > _______________________________________________
> > detnet mailing list
> > detnet@ietf.org
> > https://www.ietf.org/mailman/listinfo/detnet
> 

-- 
---
tte@cs.fau.de