[bess] ECMP, equal/unequal Load-Balancing, and https://datatracker.ietf.org/doc/html/draft-ietf-bess-evpn-unequal-lb-21

"Jeffrey (Zhaohui) Zhang" <zzhang@juniper.net> Sat, 09 December 2023 17:27 UTC

Return-Path: <zzhang@juniper.net>
X-Original-To: bess@ietfa.amsl.com
Delivered-To: bess@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A0CEFC15106B for <bess@ietfa.amsl.com>; Sat, 9 Dec 2023 09:27:35 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.806
X-Spam-Level:
X-Spam-Status: No, score=-2.806 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=juniper.net header.b="GdU9+TMa"; dkim=pass (1024-bit key) header.d=juniper.net header.b="SanztlAJ"
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YfgibnqfSaop for <bess@ietfa.amsl.com>; Sat, 9 Dec 2023 09:27:31 -0800 (PST)
Received: from mx0a-00273201.pphosted.com (mx0a-00273201.pphosted.com [208.84.65.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BDE48C14CEFA for <bess@ietf.org>; Sat, 9 Dec 2023 09:27:31 -0800 (PST)
Received: from pps.filterd (m0108156.ppops.net [127.0.0.1]) by mx0a-00273201.pphosted.com (8.17.1.24/8.17.1.24) with ESMTP id 3B9GTK9q020176; Sat, 9 Dec 2023 09:27:30 -0800
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h= from:to:subject:date:message-id:content-type :content-transfer-encoding:mime-version; s=PPS1017; bh=+ZUBdWRhr TyCPLC9BXuYRm038Q2ekwMTDbIw9IbOM6I=; b=GdU9+TMax12lA64vtI6Kr5mpH uq34jW7nUj/IaV/jj62tXxbtZisMdZhQjTcrx2VtRO7MVI7bxjx7EdmMgamlMGyq obRYkjkuWc8asoz9kMKIM9hfthsgkrXPL4W7kifF4ZBJTsY3KmiT8AxZdJeEWpUX 2aSH6iJnjZG2818FKOeNf7YvspOiEGWmo2W0lsbpOT5tL7ZGZkRWoczZssVjgKOc knMkmXotrWCPl/XMei7/7I9dvTHBKI3cdZOVP/CCEmVjZ8zaTeFwDWvK9VOO1THR 0lKiihL9+HU+TyIoEEk8yk3InT1WsRP/058NOHw8YZeGN0vIiHUpz6ZdSeIkA==
Received: from cy4pr02cu008.outbound.protection.outlook.com (mail-westcentralusazlp17012025.outbound.protection.outlook.com [40.93.6.25]) by mx0a-00273201.pphosted.com (PPS) with ESMTPS id 3uvr4mg7r3-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sat, 09 Dec 2023 09:27:30 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Kiak6IHzz6BoVqPPy+qm8DxjeNj6rSI2E25KbEmdITlcBCJG1fM5d9sGJdnKcmQd/PfmpOnASh+EW2+2dogDT/wdiWthXmSJLEif+tSkhNXdrHcWqSePTnmk5T87TTpBtCXMqZoljtvp5aG730uB408EhHDWE76JA4SKyP6btKY+y+8LTbmg8sn3QE2Nmd1KOlGNzluwpX6mgQe6CKePj0Y7I9FN+MllAwB8oSodCdEkF6TPingodtz2CAkZvsS+vNktcIROK/9XD5BklwE7bdGgOvzJg9gFawNEfZMLdpmmXSnP2RJmeHLkc6lXms28QEOSttMO8wetpUwfODsjVw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=+ZUBdWRhrTyCPLC9BXuYRm038Q2ekwMTDbIw9IbOM6I=; b=kuhNQ46Brjjtw0mbRqyzQ3O6ljSFPNnvgrwOPpRvAcKxC+qbSTBgFP2sFunI75YMeB+WBmAWRNTqj5TDpeXcJ/eONEnGw6MfrvhSgXHcULfa8p/NY/IevDtp+z2OMMXpjsivIKCzFNjhh+cJKfSq35pkh0r6SygvwNEzGT3eJdLEXy3Px90fI6At7TQinWVe+P6vFSGhf2HhyDaOoQ8+9fbxpz9Cx9G5PFg5Y0NpE7aWiYACuFt6ngItYGzF5QeFzPpZy44EHD31+nGawjsDl+5ak8fCNbihflaw4HA0FOWkbVv3AybmqzIqF4c4prYkoy0Br3CQLoer0OhZa4gZzA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=+ZUBdWRhrTyCPLC9BXuYRm038Q2ekwMTDbIw9IbOM6I=; b=SanztlAJLP/yKl44phHGucraKoS9p42LujqLVcLoIH1A1PWpl42/glFaltObk+CUKyCFSrhTj1P8Xpc/kftx2JhdN+Jxwim7I0jtuegBYYZQWS0qq7eBnvj9szv6/fvCt3o6cAIiy+QBjg3lsIzjDPiT8kunwlXdObag+b4uiQw=
Received: from IA1PR05MB9550.namprd05.prod.outlook.com (2603:10b6:208:426::16) by PH0PR05MB8302.namprd05.prod.outlook.com (2603:10b6:510:ac::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7068.30; Sat, 9 Dec 2023 17:27:26 +0000
Received: from IA1PR05MB9550.namprd05.prod.outlook.com ([fe80::c683:c1f1:27d:3b03]) by IA1PR05MB9550.namprd05.prod.outlook.com ([fe80::c683:c1f1:27d:3b03%5]) with mapi id 15.20.7068.029; Sat, 9 Dec 2023 17:27:26 +0000
From: "Jeffrey (Zhaohui) Zhang" <zzhang@juniper.net>
To: 'BESS' <bess@ietf.org>, "nmalhotr@cisco.com" <nmalhotr@cisco.com>
Thread-Topic: ECMP, equal/unequal Load-Balancing, and https://datatracker.ietf.org/doc/html/draft-ietf-bess-evpn-unequal-lb-21
Thread-Index: Adoqv8+CCCDmW1nRQSmvJiREndTeQA==
Date: Sat, 09 Dec 2023 17:27:26 +0000
Message-ID: <IA1PR05MB9550E649A896CB8F9C24B486D489A@IA1PR05MB9550.namprd05.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ActionId=63145320-6966-49bd-b492-01233c261af5; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ContentBits=0; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=true; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Method=Standard; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Name=0633b888-ae0d-4341-a75f-06e04137d755; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2023-12-09T13:39:25Z; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: IA1PR05MB9550:EE_|PH0PR05MB8302:EE_
x-ms-office365-filtering-correlation-id: c9e28e17-0834-4675-d89d-08dbf8dc1ccb
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 4vi0FMLeBkO6rmqPU2KQ+f1jDWc+U5tM5iGhig/FcgYuUw755WKKbj1oPpTNrYXHhBR7Q6HEE/wjSc4fqsGfetwKszBwKPsmCGdJwgEuXF//cXwisuCt8xtCuKIgPhI9yPzEBTJP3RQwmKc49LSChMjZ2Xn7nGHPtbuJNfcfBuuJvNzN8O+P12/2wk0KirQIwiGSnHwdZ1N0c8FnGkfC4EO94PY9wwEd4xHroWYsXAa6owF4j3UBK1Gl9HAw6tFb5yHC+uS4lJ515GEwP9PFboOFTrBc1rfBCZbVGP1nqqbbu7qN28QHWYZnmbGz/GZJnrv9dyUjjqcf+N+pyL7VG8wACQDipKOROBrlZsGzRFu+UAJ/A17bCDyYLnx2/0Hpi66ja5R0o1toeQcXNIrlwSHxSe3ko/KSyMHMxXF/wB5F0pyUusun2/YbZPZu9sRRz9rLER6zUS3BzAvwrsA3JN69K8fNoL4w5PzJOovu7AD+5tscrBHysyfP+4o2mj4j6BQazeb1cAJhUpZgD3NbLU9j7sXmUN62/HtnGgRpQryNMjusvAcY6mebgvKW+eCVVLGw9+4+oTGhE/2V3MXY5Mr4luzt1GcpGM0UdPF/H+uP2Ju+HG/TDxfQY4ObYJdvG3lLVh+0t/73FqiZoUnsHw==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:IA1PR05MB9550.namprd05.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(136003)(39860400002)(346002)(376002)(366004)(396003)(230922051799003)(451199024)(186009)(64100799003)(1800799012)(41300700001)(26005)(83380400001)(38070700009)(33656002)(86362001)(38100700002)(122000001)(5660300002)(316002)(8936002)(8676002)(52536014)(2906002)(7696005)(6506007)(9686003)(71200400001)(66946007)(66556008)(66476007)(66446008)(64756008)(76116006)(110136005)(478600001)(55016003); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: LIKhRTs/w7Tpt1GE9KGmyhemRRctiNMqzH6OQE0uCs/riAqXfzVrPNJet4TJyb/wiTTX4qlJBrA1DrHNQEf6hEnOvkVSobNAABOjtQzX2AjDAOKLAKGyHBRrufzDNlsDcBN3yCGa0hXjCB05ItFhJ+Xp7qd4w473O1tbJ070USwOwIiv8DYVzwiVN05codyLFGDV+nsoVo+QJMNTQW+zAXZsDcWS9cqumfcyeC2xv7ZgC7MqhORXUoB/Ugdq6qsXTAMhFCq9VJSL/udJJYr7NmIICA3luwfcK8dlBxWGJtaC78AlrUNHn/t7nMLHBu9pSCODfDIsF4LLaAbml/z+gcGJsIiUhZlzPEbF5r55INsSyb4oDbuefm6JFCdR2MnhA34nzafexABlex8QqiiCLjpGND10JjVQzDjcHtU8cLHzACE5NT5/0x29LcIvaRPccwPztMKgcemph0B6DZjOGVvtk2oq32wZ17Yerv6wy7r4piQQm2Egp/EX2Ak4YHEbT1wz0vjjSxD7C1iCjXSmYAYfYp5241TFnYyA5rrVy/dq2a1e2LMS4/vOgGJofZcY4kEbFyrvMtXyV3o/zD0Qi1uwd3i9C7ayUqRrLenG+0SQ7m/UHPIPpqqHd3kg3+7eF7IesL1vZUFA/QurIfUVt9T2+obVHmH2uD17NvEMfxqIWeLVvqOXT6UylqOakZaFr1BuoW1SffgIsEB0LexxKD56yKSnMteVGctRREchq7KxX0stllqMgohOdKMnVc/L8n8cukTrCKb/zSb7Rdn3GPdJTrT3TEwObUi1vf/3DsGMc6GWxTYH6ikCLYj2Baxsd0JjZauY/q5rBdyTCQja5kZa+Nhlakuu6oPnHIZnmygTmzEF0B9RS+wxQvCDPnEAmEVX65s8RwrHiwFpkao7VAAgrp/89LDdSXgWFUhg+JHw2kQOgcg603jCwnGFQAIzJZMYU1fZA19XY5gufIMtYOZ1MWvR3FLTLFULfiKPs6szcv5qjVpub+l4T7u9dwpd0q9UWtxpY0HkP5HqSdYBrOIJlweBNhsyzVNsUSpZ77YtGT9SR4DxbL5bVlAOcBcXsekFuvice1XrE1yOGVdQ00mgK13HTygRORlvyEpyBvbhgEy7AZDFncQuQdX+ed9Ba7bAeKmbsIg9IqK3DB83b+wV2N4O+PM+vmeiZP3p7vaecvoMbpRxalXpYFKpICh9DnXfmqbEkrwO45BModzgjcsuQM+3djrlMst/7lMPzAqTTiKu2zbc6EV/FbuF+172nTUdWsritx2NKfi/aS6CWg+oVU8anP2hTsfDHzRn4aUDsSwGhoAdjRcFoUcItakr+TqDxriO7KwyeiRMtOd1zO5wrt5L2DH4YG+h7LqkdAuqfIUMr3jGDZUFsYKcbLY2ZxZt3eZyOTAeDopeIWGb1YFy4jDod1u+dhNEmX36y6MEUjFyO67EQGinDT+gKAG3eoiTcnJncVTb9Zt8HZdHfcT/Az0c+64ZWNoFyEgXpU/YiURmlXbQdJ2Uy5xTtoWZpByWBnj0sadYQQCLX4IS65XzFNFt3N80bD8TXVg0xmc3fXVS/MEe3OJ5xc3Vl9P8
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: juniper.net
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: IA1PR05MB9550.namprd05.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: c9e28e17-0834-4675-d89d-08dbf8dc1ccb
X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Dec 2023 17:27:26.2106 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: hjyG2ci1vKjREHqfRf2jsPHFcWri82DHWWdNozewlDJspUByEtAXTj4zML7Kok57lw3YFRerjKSp8QuwvhQDvw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR05MB8302
X-Proofpoint-GUID: RvpWjSaCZunz1GZGY8PWwKLB3VLdS7D_
X-Proofpoint-ORIG-GUID: RvpWjSaCZunz1GZGY8PWwKLB3VLdS7D_
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.272,Aquarius:18.0.997,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2023-12-09_01,2023-12-07_01,2023-05-22_02
X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 priorityscore=1501 impostorscore=0 bulkscore=0 phishscore=0 spamscore=0 suspectscore=0 mlxlogscore=838 clxscore=1011 mlxscore=0 adultscore=0 malwarescore=0 lowpriorityscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.19.0-2311290000 definitions=main-2312090152
Archived-At: <https://mailarchive.ietf.org/arch/msg/bess/nkFfv6P9-6XuqqaFTTXrJxmmBmw>
Subject: [bess] ECMP, equal/unequal Load-Balancing, and https://datatracker.ietf.org/doc/html/draft-ietf-bess-evpn-unequal-lb-21
X-BeenThere: bess@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: BGP-Enabled ServiceS working group discussion list <bess.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bess>, <mailto:bess-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bess/>
List-Post: <mailto:bess@ietf.org>
List-Help: <mailto:bess-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bess>, <mailto:bess-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 09 Dec 2023 17:27:35 -0000

Hi Neeraj,

ECMP is mentioned many times in the draft. It seems to be used somewhat inconsistently.

My understanding is that ECMP, spelled as Equal Cost Multi-Path, is about the underlay paths to egress MHES PEs. If an ingress PE does not have equal cost paths to those PEs, then load-balancing will not be used at all by default - the closest PE is always used. This is to optimize the traffic delivery in the core network.

Of course, one may choose to do load-balancing even w/o ECMP, for better utilization of MHES ACs.

The above is regardless of whether equal or non-equal distribution of load to different PEs is used or not.

I suppose the document is mainly about equal or unequal (weighted) load-balancing, which can be applied regardless of whether ECMP exists or not (depending on the operator's choice).

If my understanding is correct, the document should minimize the use of ECMP term. Perhaps just mention it once or twice - either that ECMP is the prerequisite, or load-balancing (equal or unequal) can be used whether ECMP exists or not.

Some examples of inconsistent uses:

   Once consistency of 'Value-Units' is validated, ingress PE SHOULD use
   the 'Value-Weight' received from each egress PE to compute a relative
   (normalized) weight for each egress PE, per ES, and then use this
   relative weight to compute a weighted path-list to be used for load
   balancing, as opposed to using an ECMP path-list for load balancing
   across the egress PE paths.  Egress PE Weight and resulting weighted
   path-list computation at ingress PEs is a local matter.

The above paragraph says, "a weighted path-list ... as opposed to an ECMP path-list". It implies that ECMP refers to "equal" load balancing.

   While incorporating link bandwidth into the DF election process
   provides optimal BUM traffic distribution across the ES links, it
   also implies that DF elections are re-adjusted on link failures or
   bandwidth changes.  If the operator does not wish to have this level
   of churn in their DF election, then they should not advertise the BW
   capability.  Not advertising BW capability may result in less than
   optimal BUM traffic distribution while still retaining the ability to
   allow an ingress PE to do weighted ECMP for its unicast traffic to a
   set of egress PEs.

The "weighted ECMP" above implies ECMP is about the ECMP in the underlay.

   In an EVPN IRB (Integrated Routing and Bridging) overlay network as
   described in [RFC9135], with a CE multi-homed via a EVPN all-active
   multi-homing, bridged and routed traffic from ingress PEs can be
   equally load balanced (ECMPed) across the multi-homing egress PEs:

   *  ECMP Load-balancing for bridged unicast traffic is enabled via
      aliasing and mass-withdraw procedures detailed in [RFC7432].

   *  ECMP Load-balancing for routed unicast traffic is enabled via
      existing L3 ECMP mechanisms.

The above seems to refer to equal load-balancing.

Jeffrey

Juniper Business Use Only