Operator LB entropy hash changes without a stable address

Gyan Mishra <hayabusagsm@gmail.com> Sun, 02 February 2020 12:42 UTC

Return-Path: <hayabusagsm@gmail.com>
X-Original-To: ipv6@ietfa.amsl.com
Delivered-To: ipv6@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B68911200F3 for <ipv6@ietfa.amsl.com>; Sun, 2 Feb 2020 04:42:02 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.997
X-Spam-Level:
X-Spam-Status: No, score=-1.997 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Dnh1yFQiIE4O for <ipv6@ietfa.amsl.com>; Sun, 2 Feb 2020 04:42:00 -0800 (PST)
Received: from mail-il1-x12d.google.com (mail-il1-x12d.google.com [IPv6:2607:f8b0:4864:20::12d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 23F4512008B for <6man@ietf.org>; Sun, 2 Feb 2020 04:42:00 -0800 (PST)
Received: by mail-il1-x12d.google.com with SMTP id t17so10228761ilm.13 for <6man@ietf.org>; Sun, 02 Feb 2020 04:42:00 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=DOvy1/bhIB1+R+sqgbVBZeFGjH/G0DexWd4PmNhH8LE=; b=Ftk5D9xW9kXUnkP5FZriu2cHj+2/v8JxLgQlvq42Kfa1+UroySGPSHIIONVzHAJHy+ ScyQnEHKt97ax+/VlsEpGca1KRuGnqWh97YYU4Qodleo8ZXE15DzNZH/iGSqCp3LYmgx nIMqSUZFM/fi4ocolR+N65p6Fd1EyJKMUtGXeW/hc+vEjtBsnHp+5UV1BLEgSKhFeb0F +Cal9u5ypwYJ8qJLqSdkk+EN2WlCeKIAiom2p65X+GhWIK+360JomqKGzgOgN5RZ9u4u Xtxic6lvtS1HBr2e3jQJ3ytkkIEgB1MH/c2MVJoAEJQGxOs8ZKXfE8Uz0tUvbjZITAi1 dVIw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=DOvy1/bhIB1+R+sqgbVBZeFGjH/G0DexWd4PmNhH8LE=; b=tFbllOZwsO1x/kHtvjiZ6rkeuN4PRltc1Jefd0u+eHCk/px4qx/nXHm13e1chWYosp vZ0sTxwYm8aIBHIvXMliskTQB5nbKxBoEuiwWTcLIOutPBa+oGOw3zpEOq2YsA5amSeS DxlGhi8zJYeVeVvsx2EgaKtM/h00w/p1JczAA54M8WvR0ZZ8gxa04qMnrqoQAXVQQXtn FZUUifej/ABg8+sfMknOOEHwQ6S3nttUuKntP9JL1WZ2kKZWyC3mcbaENrtgwYi0NvyH xHQ3K20sA31zwslPjHleNf8oUKn1xFGyb47Ul44xMcqbmP7AyxvoF4QLK3GVT0P/OfHU 7ENA==
X-Gm-Message-State: APjAAAUWaZNHRMA4KMHOfJqgwoAY273igPIKxUn9bleZXIJBDYsGYEpv bydj8m9bhUJf3osRgNkGh/l+zZ8E/GOSeht5nY7Tr7M2
X-Google-Smtp-Source: APXvYqwgjkVY44rKddt1vvZ4IvUikD96mOWGCm04XmsWWo8071StxK/lqiIelMbqgtofFO0Xhlhwxrb0Xlopr30FOKk=
X-Received: by 2002:a92:350d:: with SMTP id c13mr18342686ila.205.1580647319122; Sun, 02 Feb 2020 04:41:59 -0800 (PST)
MIME-Version: 1.0
From: Gyan Mishra <hayabusagsm@gmail.com>
Date: Sun, 02 Feb 2020 07:41:48 -0500
Message-ID: <CABNhwV2TD6Tt_K-0LgEOuJhZqTzQ6J83bRWoBGr8RMJizfDxag@mail.gmail.com>
Subject: Operator LB entropy hash changes without a stable address
To: 6MAN <6man@ietf.org>, Fernando Gont <fgont@si6networks.com>
Content-Type: multipart/alternative; boundary="000000000000f8b671059d9721c7"
Archived-At: <https://mailarchive.ietf.org/arch/msg/ipv6/VkgRwWVMmZy0RG6ZmorP2tpZsLQ>
X-BeenThere: ipv6@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "IPv6 Maintenance Working Group \(6man\)" <ipv6.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ipv6>, <mailto:ipv6-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ipv6/>
List-Post: <mailto:ipv6@ietf.org>
List-Help: <mailto:ipv6-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ipv6>, <mailto:ipv6-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 02 Feb 2020 12:42:03 -0000

Fernando

Can we add txt related to this topic of L2 Ethernet bundle hash or L3 multi
parallel links ECMP hash changes when temporary address is employed.  This
is commonly used by all operators:

L2 hash load balancing hash entropy:
802.1ad is a QinQ  technology used by providers for backbone bridges
Ethernet relay services instances.  Inner tag is provider label and outer
tag is customer label.  The flow hash entropy is based on
source/destination hash, however if the address is not stable and changing,
that changes the hash entropy for load balancing flows.  That throws off
the lb entropy and now you don’t get close to 50/50 lb entropy with 2 links
in an Ethernet bundle. There are many instances when bundled ethernet
aggregation or MLAG is employed where a Src/dest hash is used to create
entropy for load balancing of flows ; as well as in MPLS L2 vpn  and NG L2
VPN ethernet service instance e-line, e-lan, e-tree where a fat pseudo
wire” is deployed requiring stable IP for lb entropy to work properly.

L3 ECMP hash load balancing entropy:
Another instance where stable IP is necessary is related along those same
lines of thought to BGP IGP ISIS or OSPF ECMP flow based load balancing
hash hash where flows lb entropy is created to get the even load balancing
over multiple parallel L3 links in a enterprise or provider operators
network.  When the address keeps changing that changes the load balancing
entropy for the hash.  So now instead of the flow going over L3 link A it
is now going over link B.

So this is an operational impact consequence on a operators network
enterprise or service provider from address changing.  Thinking about this
further if let’s say all addresses change based on current valid 9 days /
preferred 1 day you have a new preferred address daily.  So let’s say their
are thousands of flows on a particular L2 or L3 path the hash is constantly
changing.  It’s possible with the randomness off all the addresses
constantly changing some may or may not rehash to a different path so load
balancing may or may not be impacted.  However the larger impact is now
troubleshooting an operators network to trace a flow and determine which
link is carrying a particular flow which is now ever changing.  So added
MTTR (mean time to recovery) during an outage for operations to debug and
troubleshooting  tracing a flow.
-- 

Gyan  Mishra

Network Engineering & Technology

Verizon

Silver Spring, MD 20904

Phone: 301 502-1347

Email: gyan.s.mishra@verizon.com