[Detnet] The scalabilities of the queuing solutions in ADN

정진우_교수_휴먼지능정보공학전공 <jjoung@smu.ac.kr> Tue, 13 December 2022 05:22 UTC

Return-Path: <jjoung@smu.ac.kr>
X-Original-To: detnet@ietfa.amsl.com
Delivered-To: detnet@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E2A0DC1516E8 for <detnet@ietfa.amsl.com>; Mon, 12 Dec 2022 21:22:01 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.896
X-Spam-Level:
X-Spam-Status: No, score=-6.896 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=smu-ac-kr.20210112.gappssmtp.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id hEuOAtnj-l-g for <detnet@ietfa.amsl.com>; Mon, 12 Dec 2022 21:22:00 -0800 (PST)
Received: from mail-pl1-x634.google.com (mail-pl1-x634.google.com [IPv6:2607:f8b0:4864:20::634]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 60F06C1516E6 for <detnet@ietf.org>; Mon, 12 Dec 2022 21:21:59 -0800 (PST)
Received: by mail-pl1-x634.google.com with SMTP id t2so11472080ply.2 for <detnet@ietf.org>; Mon, 12 Dec 2022 21:21:59 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smu-ac-kr.20210112.gappssmtp.com; s=20210112; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=SvNALoN9B3EgpnCZXnL4kQR0P4oE/fQ+HpDjwuezxxU=; b=EuXL8VV7Xo1sPV09199qRAslootMIBeObUpneKr3G07y9gZbx14ncpAnkx6SzqhoX2 K2zZiqxkzK2k9xhmB9o2R9ilvpmP6Rv0z4zraehAmnbW8MwWi20IbTW5lAewivvOyqaM bPahHy9tuLtZtSvL6ufaojsWTgXrMkmbm8Z0eT9y6VKaq7rDgZQYGVoAPDI6tRraPf2g Uf6yP1ovvOBomZW3/CK+bz+pJo0UuZdkFQmXEPF51AKrtLyRCMDPj4mvU/Noi0ERHjgj nldsIoaLMR2UCObMYh8tDOmTfLW3iesXJOnZLtbFZZRxLXGJToy8mCen3zoMc/JkT0KZ rxkw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=SvNALoN9B3EgpnCZXnL4kQR0P4oE/fQ+HpDjwuezxxU=; b=c2/3hnvuctl5wEffr8RkeareZyhMXuGcFlj1SUoOmKRfjCk4WeMnNoj3m0YUJJqv0A PECZp7j58b7LmpJlBtYeLkR6PqVr+4pL1BJqqZGpWGpynrDB751swweaJv8X9K58AcMT Svz92f2MYDbQ8gC+tfuhTYdzC9+AJghj1bJFGQGpYv98MomefMVPQre7oOOssJT0qshw 04mFkMovEPzg9ZX2ia0mS4lwEcvZZZrfk0j4DUupa1IkRd8vz3HtRTSjeKXUtUBBdrBm 4O+aKTcXdSI90fz2iK+50TodCCvxY8uQ0+UqnEYHil/dQhekv40vuwjwJbdNvjR6VRNO AE/w==
X-Gm-Message-State: ANoB5plBxXD+oTPTWw1OOKX7+wizHyurbp2KXmNJjfr6V3dpNtGtiqCl BnwNg2KmrTlqrFoKnwFezW0Dk0ctH/SyRDQSXlAKd5vWeN1qn9TL
X-Google-Smtp-Source: AA0mqf79AzZ8zTnKOtIbzcNONbVHzZbbhQDPjsU5F1eQgCTt3wv7o9Vefu4oVoFtflXT8iMvSZBfwoDAg3IxqD9OLpc=
X-Received: by 2002:a17:903:230b:b0:189:6cb1:a65e with SMTP id d11-20020a170903230b00b001896cb1a65emr43945387plh.125.1670908918085; Mon, 12 Dec 2022 21:21:58 -0800 (PST)
MIME-Version: 1.0
From: 정진우_교수_휴먼지능정보공학전공 <jjoung@smu.ac.kr>
Date: Tue, 13 Dec 2022 14:21:48 +0900
Message-ID: <CA+8ZkcR30kCSnAu02sEb3kN93XgP1xsXeqShp3BQ2W2c2Ctx9Q@mail.gmail.com>
To: detnet@ietf.org
Content-Type: multipart/alternative; boundary="00000000000083cc1e05efaecc13"
Archived-At: <https://mailarchive.ietf.org/arch/msg/detnet/BJDgcfIn1nNDKZri6qwqHMhkwak>
Subject: [Detnet] The scalabilities of the queuing solutions in ADN
X-BeenThere: detnet@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Discussions on Deterministic Networking BoF and Proposed WG <detnet.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/detnet>, <mailto:detnet-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/detnet/>
List-Post: <mailto:detnet@ietf.org>
List-Help: <mailto:detnet-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/detnet>, <mailto:detnet-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 13 Dec 2022 05:22:02 -0000

Dear Toerless, and members of DetNet WG,

Thanks for pointing out the scalability issue on the queuing solutions,
at yesterday's interim meeting.
I would like to add some comments, which I couldn't make due to limited
time.
We have to always be deterministic, you know :)

The ATS IR has to maintain individual flow states, and it is the limiting
factor on its scalability.
However, the IR has only one queue per input port,
therefore I think it is feasible to be implemented in core routers.
The only real-time operation here is to look up the flow table and to
overwrite once per packet,
no matter how many the flows are active. (This was also stated by the
authors of ATS.)
But I understand if there are millions of flows, then simply looking up can
take time.

The FAIR (Flow aggregate - IR) framework can be considered as a generalized
ATS.
Therefore it has the same scalability as the ATS.
However, in the FAIR framework, the IRs can be placed only where they are
necessary.
Moreover, the IR can be implemented independently of queuing and forwarding
functions,
for example in a separate device, in a more flexible way.

The PFAR (Per port FA regulator) has only one queue per input port,
and maintains a flow aggregate (FA) state (per input port),
instead of individual flow states. It is therefore more scalable.
As flows become active and inactive, the FA state parameters
have to be modified, but the modification process is not a real-time
operation
and can be executed in bulk.

The C-SCORE (Work-conserving stateless core)
enjoys the best flow protection and the best scalability.
Usually the classical fair queuing algorithms (like Virtual Clock) require
per-flow queue,
but the C-SCORE can be implemented, as it is suggested in the
draft-joung-detnet-asynch-detnet-framework-01, with per-input port queues.
The scheduler only has to decide which HoQ packet has the smallest finish
time.

The drawback of C-SCORE is that packets are required to carry metadata.
And that metadata has to be updated in real-time as the packet is being
transmitted,
just like the flow state in ATS has to be updated.

The CQF and its variations seem to be scalable in packet level,
but I think the difficulty is in the schedulability.
I just wonder how the millions of dynamic flows can be scheduled to fit in
the slots,
in real operating environments.
Larger slots would make the slot scheduling easier, but introduce more
latency and jitter.

Best regards,
Jinoo