Re: [mpls] Concerns about ISD

Haoyu Song <haoyu.song@futurewei.com> Tue, 19 April 2022 01:03 UTC

Return-Path: <haoyu.song@futurewei.com>
X-Original-To: mpls@ietfa.amsl.com
Delivered-To: mpls@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 144193A1A87 for <mpls@ietfa.amsl.com>; Mon, 18 Apr 2022 18:03:56 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.11
X-Spam-Level:
X-Spam-Status: No, score=-2.11 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=futurewei.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Nv2BiymgvyqV for <mpls@ietfa.amsl.com>; Mon, 18 Apr 2022 18:03:49 -0700 (PDT)
Received: from NAM11-CO1-obe.outbound.protection.outlook.com (mail-co1nam11on2128.outbound.protection.outlook.com [40.107.220.128]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9DC603A1A80 for <mpls@ietf.org>; Mon, 18 Apr 2022 18:03:49 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=oYAC4ZoMu7SXXKjCgivdaH89DihlTP2O44sSa62wdN6h2HX08mtwDUYjumpPBkfyExoXiZ7GRHC+2xJfzu2iOLs+LL0cyw6n1VHI+OTsa3vH8g/TtnG+ZSs/PFOMT1315DbBwj1P+Bwxacz0AbFTVBAUG0SqtelRv4t2k9Dp1rPi9PZLg4aO1VJw+1cDHeecKmuV844J+OBwarcNRoaexRvnV5TlZ0j8PjxRy49qDIGRnTlzXJuRjC4oxScQmTjSRibYd5DfaD/Iu+dix98G+h40N0NfcwHZRzy7n7UZVyNsZp04xhaoBv8E1l9ZIUdyAGqJO0VU4Bz1SUVPI/8qiw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=jfrAN/l6bR4POs/w7NRyzPUcGSYcbkBJdUH9wGVdqzk=; b=IkjVIYLW5OTfEPpa14+pYdigoWDGDigrQK+usaf/dxfdUvXE++auxrnJEBP6KNbNJZVCL7z1bmAzTBFTktR8h+lTOpzk22wtAyWGLgQAO6/eerRh8gT0S5tuJTB543AOrk1MyybW4NqIpJ/vDTd90bLlLKiciSrT56+8QLqf6E4yLwcTOEpF6+EhKwDlZWHh0YF7JaZVLa93820jpI9/X0zCTi/Cj0PdmzFQlGVuEahqEXxlaHiYBxS0DH1T2a3wQkjAcUKvqVzfqvFxezgvtQWmaBxzJ7OD6GB1BRu+c/MbYwYwOJy2BC4S7D/v40HwSdY04vSVHgoBAqcSNN1TLw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=futurewei.com; dmarc=pass action=none header.from=futurewei.com; dkim=pass header.d=futurewei.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Futurewei.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jfrAN/l6bR4POs/w7NRyzPUcGSYcbkBJdUH9wGVdqzk=; b=KDzTVDh18OMsMr3BruQUsE9qSbUVEFJna3YFilJSNNUYdhGxlhyeDg4DR/IIZ9TDyq33LLd4md1Il8vS5FshOoJO7wv2VEkou+PiaulVoRRcAy/x3L0sxn4LZSSzglPXceydcCPxQ2zAHbAw72F9BRtgxjOgbE9mfTs1QET4XLE=
Received: from BY3PR13MB4787.namprd13.prod.outlook.com (2603:10b6:a03:357::13) by DM6PR13MB2649.namprd13.prod.outlook.com (2603:10b6:5:139::29) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5186.13; Tue, 19 Apr 2022 01:03:46 +0000
Received: from BY3PR13MB4787.namprd13.prod.outlook.com ([fe80::e8d4:7243:fc90:1ccb]) by BY3PR13MB4787.namprd13.prod.outlook.com ([fe80::e8d4:7243:fc90:1ccb%6]) with mapi id 15.20.5186.013; Tue, 19 Apr 2022 01:03:46 +0000
From: Haoyu Song <haoyu.song@futurewei.com>
To: Tony Li <tony.li@tony.li>
CC: John E Drake <jdrake=40juniper.net@dmarc.ietf.org>, Tianran Zhou <zhoutianran=40huawei.com@dmarc.ietf.org>, "mpls@ietf.org" <mpls@ietf.org>
Thread-Topic: [mpls] Concerns about ISD
Thread-Index: AdhKc4fdvDv9lzMNTfy5c++8iNI9iwAFlCaAACI+zQAAElacgACACe8AAAMwSQAAA2mogAAQuiYAABYeS4AACDOSgAABJpkAAAwjTIAAGwXoAAAX3NOgAE5MNAAAFZNHwAAI4aFAAAJwyYAAADi+cAAAowwAAAAxoxAAAXaagAAAGigAAAJG2gAABnV2AAAEn7kAAIOJKRAAAxCVAAACz7wgAANdboAABojbwAAChLgAAAAYLDA=
Date: Tue, 19 Apr 2022 01:03:45 +0000
Message-ID: <BY3PR13MB4787C1FFB660DDB02AA87AF19AF29@BY3PR13MB4787.namprd13.prod.outlook.com>
References: <6cc272447d2f4c779e85d5c42d3b3c6c@huawei.com> <8623637D-A32E-47A4-B5FC-4D2CF40BEDD1@tony.li> <6199e0e886f9437c95ef9b70719b00ec@huawei.com> <BCFD3F4A-36D6-47C2-B907-FC40B402F97C@tony.li> <3fb1f261ddff48deb0c2ea083cdbd16f@huawei.com> <6B96F21B-9331-4FA8-AD7B-84A4CA8B6FAB@tony.li> <903c57a48280454091495673ec2fe275@huawei.com> <BD5C1BE7-4633-4B51-BAC1-B2AE1C537F36@tony.li> <ad6b8c42b0aa4880b9dee02516f5e46f@huawei.com> <F5BB2CEB-CC8C-4E71-A2E7-B4212878C3B1@tony.li> <aa9c4b913d844410b2af90c8db78c194@huawei.com> <BY3PR05MB8081937B52E657713E8293BFC7ED9@BY3PR05MB8081.namprd05.prod.outlook.com> <a29c96be774845e582a66700d2264f7b@huawei.com> <BY3PR05MB8081870EF67C551727BBE2CFC7EC9@BY3PR05MB8081.namprd05.prod.outlook.com> <d5521b3972dd43e38276afbbdc7c2bda@huawei.com> <BY3PR05MB80813C7CAD7F2C12C36FB513C7EE9@BY3PR05MB8081.namprd05.prod.outlook.com> <BY3PR13MB47879EB8A582437DE936688C9AEE9@BY3PR13MB4787.namprd13.prod.outlook.com> <C493D0B8-4B57-4D19-BC27-70ABD7F50356@tony.li> <BY3PR13MB47878B227A37AAA06625194B9AEE9@BY3PR13MB4787.namprd13.prod.outlook.com> <0318B3A3-2884-4FD6-B5EF-377481D2657B@tony.li> <BY3PR13MB4787752FB6D147281A7150789AEE9@BY3PR13MB4787.namprd13.prod.outlook.com> <602D6128-3BE3-4A2D-B5C2-019AE0FADF09@tony.li> <BY3PR13MB47876188B5927A51BD4F4E739AEE9@BY3PR13MB4787.namprd13.prod.outlook.com> <BCB99042-ECA3-40C6-8581-FA1656DDF987@tony.li> <BY3PR13MB4787468DAA96610B9933E1659AF19@BY3PR13MB4787.namprd13.prod.outlook.com> <EB04096F-70B7-4FF0-973F-6C7C1FDDE837@tony.li> <BY3PR13MB47874EBD4E397AB18CD8AF819AF39@BY3PR13MB4787.namprd13.prod.outlook.com> <7451CC1D-88A7-4D13-9BE5-44BCBE95337A@tony.li> <BY3PR13MB478725F22B60E681ABF94BC79AF39@BY3PR13MB4787.namprd13.prod.outlook.com> <90F25F5A-E953-45F4-A594-CC56DA796309@tony.li> <BY3PR13MB47870541CD630290759A43D49AF39@BY3PR13MB4787.namprd13.prod.outlook.com> <1D4FF599-60CB-4AE5-92D0-32B8E0FAB2BA@tony.li>
In-Reply-To: <1D4FF599-60CB-4AE5-92D0-32B8E0FAB2BA@tony.li>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=futurewei.com;
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 9cfdb1be-ed1c-413b-12bc-08da21a0748b
x-ms-traffictypediagnostic: DM6PR13MB2649:EE_
x-ms-exchange-atpmessageproperties: SA|SL
x-microsoft-antispam-prvs: <DM6PR13MB2649E6331A9AE19C1775D7309AF29@DM6PR13MB2649.namprd13.prod.outlook.com>
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 4pF5Bg+pvUV+xWSYlep7XCI6X2SZ1+wQG7k/Z+5a2gGzgfosMN/0fuYLrfdAKML/qdCzATo8zmm9DeBULaxDTCWDcj4GrCC9aIYLyDPaDas/oxKI2OulP0/RGdbCWv168h9fVAgkdH/w3dbWXwrIx22m01LmvhfuSzuymYUalKgS2jVAVOOcNEMyn85zMCJDP+Wmhbr1zEK3U2TC/DmSyeLuFzCzskcNiv59SiF4XpN6Vh4Tv5O+yWTvAwsCDzsVn1LMgqWispf4ZV8LP8Q6E2rZx21Ynda5ZBMn0vsgHVJbNo2Zhn+Nyu47OuCIFENHd628T0jkQ6CY4dRC7K2qoIr4iI1u7Q24+ug/95E8JZ/yusQgXUKMH2Whut60gr2OrMz+qucef9PIadZUdbO2WfSnK765erW28/zD3mstxWtpVzNBNTEDop/nt8YKSrqkeRAm9mZM1gWkDUtynmqRfpmlS4DBQNnNjA3qmhsJKh7Jl38dRMdxMT8NbWrUVqRfcNLIPZ6vj9gL6IRNnnpSdbOFI9boZhk5Ka/YQ/fW3dywQjqsIYzbrDcbXoafk360cihwxKSKaJb/JesSU24vzVle1xTq169ot4P1tdP/91p7QI9gjh9ZIM0wHdrJpjBd/KZj7AAtG/0/XgxnCnmLCRHlDqHdIVMYSLQUubudpm4h2V7Tocurac32SPLyxkcbbmlZVmvXQc09VQl498GygrvLkKSQBuRe0yBZJ3eXvYiSuvLc82MlkyQs4vbu3+rB
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BY3PR13MB4787.namprd13.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230001)(4636009)(366004)(55016003)(44832011)(38070700005)(83380400001)(186003)(33656002)(6916009)(2906002)(316002)(64756008)(66946007)(66476007)(66556008)(66446008)(76116006)(38100700002)(52536014)(6506007)(53546011)(508600001)(54906003)(8676002)(7696005)(86362001)(122000001)(4326008)(5660300002)(71200400001)(9326002)(8936002)(9686003); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 2
x-ms-exchange-antispam-messagedata-0: 020TsWyL+WdnqtQms6OdEzk6I/IHwNraOgVTJFycfxeytSvwvCeBitnsf2hAbubO22c9REs7k2dwscmH96YPnyWTqulSw4UroOqSIY/4h9f60uYNpINBcnmD7W8/2YX6AzHlZ/aUOw6Tpts4tNvcehpIda+m54cw0By0Uthr3VFBOSjiiYKeQmiV09CgZiqRMl7XBMpRFZK9FwNHjeTNW+13zAz5/CqaUqDpMPPvehtV31IqmDsukVI2CJjDJzvBgGCYL4jsc67CjxgzNzcE2DETAMzUA5fxxwyILsbnHrN+py5BSribNQVImRMNJlYixIH4ObwQPlZjMm+QmnpfwfoM9jwBtnB4d09lS3smvM0lG5wEKHwiWTxD2WrKSZ3gSsxyrU3hue26I7E9vNMXe0898rMB+Unr0yFiP4No/9dpSJ0lbI6W7R6KORXx+Y51jMMfWdTx6V6iFDfJKdnr5mustXB2Wc9OtOPuJ5hmG0gxOW9Tng2lcvb/rGLNmNxbP/9XzMkUFJxgUu03ZK3qpEs2g3bVk3VsiGZPAxZgfGy7y0nhR9JgpAAYprRLZKnafHfVgCjCVpBoRtpZx76SBBx9fnW5+Deuy7jXTOE0BYdxcMetPeIqz39BD7YkmaFlP/MeYVojsr0d5rS0Vj/pTG1MusiqdqeEnqKgYCFOccyu7CllGlNhMljLew5hVh9dQZdkFY1JhMB4QEXGKoa9Xdo5UnDYt1Cse9+l3mEihYeHNSVTTfoOwzkQYCaYJq4wHcPjmTunXH11t4UysTl20lHHXj0LTGnvN/tPcuZkCztGv1LLGwghf2H86DSoAiZ+9r9CrTC6d7c78FSq7JM2EmdGMGwRKvO9Nzk27pBrHfYOak3fLXCGFibU18IwPeNOFI29B5jKry84YXPR5uTd+uwgShXeLuV7cTr5Jd/czoBnH9a0XACQ7/BsCCMMDauIDJDxIcBRzwzOhT2LBa81jiaxxirwD9G71JcIHnkEJb+ahallu/SMODhIyjIFexfLNM/0IKOBtwsyJX9RxgQcEOJkPaFxFf2rBB9rLoMe5Ec+RTgnMFlCAlNfeDaHKk1pnHYK6B+hwxsAsp7ixHLeoMnIvpEAPptfBh9uv0z4SDlft6SCe4ygRQI0dTifIlqtPgGNf3Yx26Db9MvtNK3I5ezKlYpc6CWyfUVOhH6MqNqZjx5/WzP93obKYCQ8/dcX1lLVAzNqw9OIoMNAJLKIUXgvEpXi+v5NhLcTmmwGeaEXzJ8LGnorzPz7kyfbzpvJsmuP5Jl+jRV9cRE5J2kUwxGH5k7ccvlJX2IiPFeJWRvmQOS5BRM8fWSWouDVsNYW44D58VS/Yl22qMmPHMUTkKWs6LrxMkICKVlpZ6XcTLplNbIVHctMlGx5mpr6WWfg02YqhWR8W1cuscipfCgmUlgOnXvd96JmZzVuhq+FdHQIrewx8co9mmqLvo+mclYSgNrnc64TD/OFGq2QNCo14ssRrfWyM3To7WmljMY8ZB4w0Slrm4SdrszQMJN7jEsxheLI3RqvmzGBWvWmJJID+NSK94/mlFCjzRsCMwYt2T0PLPZDHM8gDJve5J+iHnCac3pnq9an5sZXMYihlmqggHnEFtKdv3E+bsFqF9KECaHwdfnT5Nctqu8SwJiOm/feNajmFm1lp+njZW/bEJFHXt0Frdkr2XgD2tKrWuWTxQpLn9B9ypeKz7hw1XNKlEa3sJAMJhx5WesoYKTc82+DqvVrc8LcKsGAgF5vtL1DogHMEDZEk5/KuaouNxS4MVmnEAi9WOIv
x-ms-exchange-antispam-messagedata-1: F9wmnwVN9UnQbQ==
Content-Type: multipart/alternative; boundary="_000_BY3PR13MB4787C1FFB660DDB02AA87AF19AF29BY3PR13MB4787namp_"
MIME-Version: 1.0
X-OriginatorOrg: Futurewei.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BY3PR13MB4787.namprd13.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 9cfdb1be-ed1c-413b-12bc-08da21a0748b
X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Apr 2022 01:03:45.9476 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 0fee8ff2-a3b2-4018-9c75-3a1d5591fedc
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 1DWG/cfaAd3JrvpfoVPytUVBzp6ahHOhXewXCOd4QuJTKutgBH2AAnjoQw3e1P3WCS1tlP03onceDVhR5c2/AQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR13MB2649
Archived-At: <https://mailarchive.ietf.org/arch/msg/mpls/bbnBtfAO1owv1IT-iGkUabCXOMM>
Subject: Re: [mpls] Concerns about ISD
X-BeenThere: mpls@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Multi-Protocol Label Switching WG <mpls.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/mpls>, <mailto:mpls-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/mpls/>
List-Post: <mailto:mpls@ietf.org>
List-Help: <mailto:mpls-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/mpls>, <mailto:mpls-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 19 Apr 2022 01:03:56 -0000

Hi Tony,

1~2GHz embedded SRAM is common today and used in switch chips, meaning less than 1ns access latency.

Registers for a few hundred bytes are also very common today. (I know chips with the number ranging from 128 to 512 bytes).

You can check the switch chip specifications from BCM and Intel or do a google search on gigahertz SRAM.

Best regards,
Haoyu

From: Tony Li <tony1athome@gmail.com> On Behalf Of Tony Li
Sent: Monday, April 18, 2022 5:52 PM
To: Haoyu Song <haoyu.song@futurewei.com>
Cc: John E Drake <jdrake=40juniper.net@dmarc.ietf.org>; Tianran Zhou <zhoutianran=40huawei.com@dmarc.ietf.org>; mpls@ietf.org
Subject: Re: [mpls] Concerns about ISD


Hi Haoyu,


First off, network processors and switches are ASICs.  It’s all just silicon. How you get there may vary, but at the end of the day, the performance that you get out given a specific process technology corresponds directly to the effort that you put into optimizing it.

Yes, you’re correct, every cycle is precious.  Memory reads are also precious. And in most every modern architecture, a memory read is far more expensive than an ALU operation. For example, in my history, memory reads took around 12ns and operations took 1ns.  Thus, spending a memory read to save a compute operation was a bad trade-off.

As a result, memorizing the memory reads is far more important that worrying about operations.

[HS2] You are talking about accessing DRAM perhaps. The embedded SRAM today can be read in 1ns, and such header processing operations would use SRAM exclusively if memory is needed.


No, DRAM is up around 70ns. My process technology may well be dated, but even so, if we ignore process differences, a read still takes time.

A bit of web surfing shows that current SRAM access times are around 10ns. If you have relevant public citations that can improve on this, that would be most welcome.



[HS2] The chip keeps the header buffer in SRAM/register, so the access to it is at the same speed of the system clock.


I will believe that it’s in SRAM.  Legacy nodes may not support that as they may not have enough SRAM and may be forced to DRAM accesses to reach PSD. SRAM typically doesn’t run at processor cycle times as there is time for the address to propagate and for the result to come back.

I have a very hard time believing that anything has 1000s of bytes of registers per packet.

If you have public references, again, please post them.


Well, I prefer proposals where there is more flexibility.

[HS] Header chain is more flexible and extensible. It’s used for all the headers AFAIK.


Except that now you’ve decided that SOME operations get taken out of a fixed number of bits, not out of the header chain.  And once we’ve used that number of bits, we’re stuck, back having this same argument again in 10 years.  No thank you.

[HS2] An 8-bit field can support up to 256 extension headers. I think it’s more than enough for data plane functions.


You’re talking at cross purposes.  We were discussing where you would hide one bit for implementing NFFRR. You proposed hiding it in the EHI. AFAICT, there are at most 11 bits available there.

If you want to put NFFRR in its own extension header, then that would be an additional memory read and 4 octets more of packet overhead.

Tony