Re: [mpls] Concerns about ISD

Tony Li <tony.li@tony.li> Tue, 19 April 2022 00:51 UTC

Return-Path: <tony1athome@gmail.com>
X-Original-To: mpls@ietfa.amsl.com
Delivered-To: mpls@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0DAA13A19EB for <mpls@ietfa.amsl.com>; Mon, 18 Apr 2022 17:51:49 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.512
X-Spam-Level:
X-Spam-Status: No, score=-1.512 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FORGED_FROMDOMAIN=0.248, FREEMAIL_FROM=0.001, HEADER_FROM_DIFFERENT_DOMAINS=0.248, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id k9v4qAw3so0c for <mpls@ietfa.amsl.com>; Mon, 18 Apr 2022 17:51:46 -0700 (PDT)
Received: from mail-pj1-x102d.google.com (mail-pj1-x102d.google.com [IPv6:2607:f8b0:4864:20::102d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id EDF273A19E3 for <mpls@ietf.org>; Mon, 18 Apr 2022 17:51:45 -0700 (PDT)
Received: by mail-pj1-x102d.google.com with SMTP id n33-20020a17090a5aa400b001d28f5ee3f9so810446pji.4 for <mpls@ietf.org>; Mon, 18 Apr 2022 17:51:45 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=sender:from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=4xaAbqHZj68CzbmdM0nflsrYKwFLVMM4IgfdfZHEiYQ=; b=L2x4S7d5ELQeMUMaLacaIVOVj5cJ2Bvike4D300+C0tBAVEVFeb252T7eKlJyyzBbW MQqu9ZmnfGfK8GleXCBhqPjKimJkLbylG6l3+dpHaw5uNxHI+WEsfuE4E2aXG2W/guzO 3++DkkxQ5a5crfTUDxYun9vC1vEJlYaArNj6sOyN0MOXJgJIqw6LB9nK3QDqqtVWDtnw 8jaLVyIYYvl9m2o3Crl/c/GRbsyAVg561g4JQlgnFpF4i3HlWslJgsn2VlvhaIvfL33M 0IU7NJk10eaY4lUmv/u0TvgA6HF2TvUmPnjK5zvPY6PIy06PCuzfSuSRCqoB1TrCBoBL JIAw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:sender:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=4xaAbqHZj68CzbmdM0nflsrYKwFLVMM4IgfdfZHEiYQ=; b=XnjTBM79tALlvLJXyin+VhhEOXXdr/xOT9iOe4dvpf8LmNucicrh1sL6BdmXj1HlDD Onh2l9DT8rIfw08PjczwQVIaxgQahsoBaIRZG760WrLH2h0MMqyWi8oUm8jbw5IQJhzJ 8av0ff648iLIg5t0oS+YH/cERmE6VzUYOiihzYdr57ZzmdBmGw42yqlvDXDhJFspsJ/r YV7x5a4CcOv1HFuXkRDCRt1XeiRuLi5T2Jfie1OzLLr9NCJ/r9Kio4PuMxRzjPTLnoaU LtYWgVM2AbVnxj69TJcNtGJ3ePvMtJnSltTsWEcpy0XETMpFKfqTpiCzC8ZK8qVxA5l9 UJ8A==
X-Gm-Message-State: AOAM530LONpEOkx1I4kxyttC/w5o39YxGtfyik2REZs8OSmxWEJZDHzf UNy50LMsNBuqeUVShYm+o3s=
X-Google-Smtp-Source: ABdhPJyEYo4k596Bzxh+A3Ial7B2NJI7as/xypjafbkoG17QNN85j+mgih4a7r/6sm55g+E8CxYcWA==
X-Received: by 2002:a17:902:8214:b0:158:b5c2:1d02 with SMTP id x20-20020a170902821400b00158b5c21d02mr13715331pln.27.1650329504836; Mon, 18 Apr 2022 17:51:44 -0700 (PDT)
Received: from smtpclient.apple (c-67-169-103-239.hsd1.ca.comcast.net. [67.169.103.239]) by smtp.gmail.com with ESMTPSA id cp19-20020a056a00349300b0050a890c8c16sm2817428pfb.19.2022.04.18.17.51.43 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 18 Apr 2022 17:51:43 -0700 (PDT)
Sender: Tony Li <tony1athome@gmail.com>
From: Tony Li <tony.li@tony.li>
Message-Id: <1D4FF599-60CB-4AE5-92D0-32B8E0FAB2BA@tony.li>
Content-Type: multipart/alternative; boundary="Apple-Mail=_B35A61A0-2651-47A2-82B6-B3A6C412B71A"
Mime-Version: 1.0 (Mac OS X Mail 15.0 \(3693.60.0.1.1\))
Date: Mon, 18 Apr 2022 17:51:42 -0700
In-Reply-To: <BY3PR13MB47870541CD630290759A43D49AF39@BY3PR13MB4787.namprd13.prod.outlook.com>
Cc: John E Drake <jdrake=40juniper.net@dmarc.ietf.org>, Tianran Zhou <zhoutianran=40huawei.com@dmarc.ietf.org>, "mpls@ietf.org" <mpls@ietf.org>
To: Haoyu Song <haoyu.song@futurewei.com>
References: <6cc272447d2f4c779e85d5c42d3b3c6c@huawei.com> <8623637D-A32E-47A4-B5FC-4D2CF40BEDD1@tony.li> <6199e0e886f9437c95ef9b70719b00ec@huawei.com> <BCFD3F4A-36D6-47C2-B907-FC40B402F97C@tony.li> <3fb1f261ddff48deb0c2ea083cdbd16f@huawei.com> <6B96F21B-9331-4FA8-AD7B-84A4CA8B6FAB@tony.li> <903c57a48280454091495673ec2fe275@huawei.com> <BD5C1BE7-4633-4B51-BAC1-B2AE1C537F36@tony.li> <ad6b8c42b0aa4880b9dee02516f5e46f@huawei.com> <F5BB2CEB-CC8C-4E71-A2E7-B4212878C3B1@tony.li> <aa9c4b913d844410b2af90c8db78c194@huawei.com> <BY3PR05MB8081937B52E657713E8293BFC7ED9@BY3PR05MB8081.namprd05.prod.outlook.com> <a29c96be774845e582a66700d2264f7b@huawei.com> <BY3PR05MB8081870EF67C551727BBE2CFC7EC9@BY3PR05MB8081.namprd05.prod.outlook.com> <d5521b3972dd43e38276afbbdc7c2bda@huawei.com> <BY3PR05MB80813C7CAD7F2C12C36FB513C7EE9@BY3PR05MB8081.namprd05.prod.outlook.com> <BY3PR13MB47879EB8A582437DE936688C9AEE9@BY3PR13MB4787.namprd13.prod.outlook.com> <C493D0B8-4B57-4D19-BC27-70ABD7F50356@tony.li> <BY3PR13MB47878B227A37AAA06625194B9AEE9@BY3PR13MB4787.namprd13.prod.outlook.com> <0318B3A3-2884-4FD6-B5EF-377481D2657B@tony.li> <BY3PR13MB4787752FB6D147281A7150789AEE9@BY3PR13MB4787.namprd13.prod.outlook.com> <602D6128-3BE3-4A2D-B5C2-019AE0FADF09@tony.li> <BY3PR13MB47876188B5927A51BD4F4E739AEE9@BY3PR13MB4787.namprd13.prod.outlook.com> <BCB99042-ECA3-40C6-8581-FA1656DDF987@tony.li> <BY3PR13MB4787468DAA96610B9933E1659AF19@BY3PR13MB4787.namprd13.prod.outlook.com> <EB04096F-70B7-4FF0-973F-6C7C1FDDE837@tony.li> <BY3PR13MB47874EBD4E397AB18CD8AF819AF39@BY3PR13MB4787.namprd13.prod.outlook.com> <7451CC1D-88A7-4D13-9BE5-44BCBE95337A@tony.li> <BY3PR13MB478725F22B60E681ABF94BC79AF39@BY3PR13MB4787.namprd13.prod.outlook.com> <90F25F5A-E953-45F4-A594-CC56DA796309@tony.li> <BY3PR13MB47870541CD630290759A43D49AF39@BY3PR13MB4787.namprd13.prod.outlook.com>
X-Mailer: Apple Mail (2.3693.60.0.1.1)
Archived-At: <https://mailarchive.ietf.org/arch/msg/mpls/LFjvn0CnZne9RtbDH6Io211I0-A>
Subject: Re: [mpls] Concerns about ISD
X-BeenThere: mpls@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Multi-Protocol Label Switching WG <mpls.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/mpls>, <mailto:mpls-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/mpls/>
List-Post: <mailto:mpls@ietf.org>
List-Help: <mailto:mpls-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/mpls>, <mailto:mpls-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 19 Apr 2022 00:51:49 -0000

Hi Haoyu,


> First off, network processors and switches are ASICs.  It’s all just silicon. How you get there may vary, but at the end of the day, the performance that you get out given a specific process technology corresponds directly to the effort that you put into optimizing it.
>  
> Yes, you’re correct, every cycle is precious.  Memory reads are also precious. And in most every modern architecture, a memory read is far more expensive than an ALU operation. For example, in my history, memory reads took around 12ns and operations took 1ns.  Thus, spending a memory read to save a compute operation was a bad trade-off.
>  
> As a result, memorizing the memory reads is far more important that worrying about operations.
>  
> [HS2] You are talking about accessing DRAM perhaps. The embedded SRAM today can be read in 1ns, and such header processing operations would use SRAM exclusively if memory is needed.


No, DRAM is up around 70ns. My process technology may well be dated, but even so, if we ignore process differences, a read still takes time.

A bit of web surfing shows that current SRAM access times are around 10ns. If you have relevant public citations that can improve on this, that would be most welcome.


> [HS2] The chip keeps the header buffer in SRAM/register, so the access to it is at the same speed of the system clock.


I will believe that it’s in SRAM.  Legacy nodes may not support that as they may not have enough SRAM and may be forced to DRAM accesses to reach PSD. SRAM typically doesn’t run at processor cycle times as there is time for the address to propagate and for the result to come back.

I have a very hard time believing that anything has 1000s of bytes of registers per packet.

If you have public references, again, please post them.

> Well, I prefer proposals where there is more flexibility.
>  
> [HS] Header chain is more flexible and extensible. It’s used for all the headers AFAIK.
>  
>  
> Except that now you’ve decided that SOME operations get taken out of a fixed number of bits, not out of the header chain.  And once we’ve used that number of bits, we’re stuck, back having this same argument again in 10 years.  No thank you.
>  
> [HS2] An 8-bit field can support up to 256 extension headers. I think it’s more than enough for data plane functions.


You’re talking at cross purposes.  We were discussing where you would hide one bit for implementing NFFRR. You proposed hiding it in the EHI. AFAICT, there are at most 11 bits available there.

If you want to put NFFRR in its own extension header, then that would be an additional memory read and 4 octets more of packet overhead.

Tony