Re: I-D Action: draft-filsfils-6man-structured-flow-label-00.txt

Tom Herbert <tom@herbertland.com> Sat, 10 April 2021 04:38 UTC

Return-Path: <tom@herbertland.com>
X-Original-To: ipv6@ietfa.amsl.com
Delivered-To: ipv6@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3C9773A2199 for <ipv6@ietfa.amsl.com>; Fri, 9 Apr 2021 21:38:20 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.897
X-Spam-Level:
X-Spam-Status: No, score=-1.897 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=herbertland-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zJMirjQ5OhQl for <ipv6@ietfa.amsl.com>; Fri, 9 Apr 2021 21:38:15 -0700 (PDT)
Received: from mail-ej1-x632.google.com (mail-ej1-x632.google.com [IPv6:2a00:1450:4864:20::632]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id AAAEB3A2195 for <6man@ietf.org>; Fri, 9 Apr 2021 21:38:15 -0700 (PDT)
Received: by mail-ej1-x632.google.com with SMTP id g5so5035442ejx.0 for <6man@ietf.org>; Fri, 09 Apr 2021 21:38:15 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=herbertland-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=QHkUhEsVIHgQ0YP9Bwj/NKfXWou9HhQc18hNbIyFsbM=; b=fd2njzqE8kL/pxo/prome9Ep/iAKtEct1s+sqZeQRb9PL+KKCaV+Nqt/Im7+DK+BQA U74gidpaVj0D/yIEJsYpQlZSN633IRrL1Ak1HZ02M0JXs32QSFVpN6mJo+jd8ChRFOJm ein4ZlrHR/OM5CWyLmgqKSRR4APPVf6VdQlu7LKrHqgM/ddrorR2UPt/mZpxoGuUcFXY Guz1PUuGPSDz8Pjv95nmXx/7m22UDA+4C/uxkQ5yO32KUmVvKsbY9xM9zg4YRpM2hJHy sj9fE1VVqGM8eEzvuvugLCXkpbRIlo7sLFbA7skQM4IkZYUyColKvMDx6Ps0jb/jhszs rH9w==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=QHkUhEsVIHgQ0YP9Bwj/NKfXWou9HhQc18hNbIyFsbM=; b=rZMPcUWYZCVZMK71MVLZAEzg4woP7SM4oY9v9YuvcZzQjvhCYeMo1k+yDaLmfQ49Nt UIMXpPa2E8oQ/qjGhQ/I/ViizZWNKndgZYrefudgoRaps6YzbTdekgnnbxKSAU4+MT2k JNJ3D0VdXCSoNY4QyG9W3xKFAJGusW9rYpgE+eQb65KavLK+0pS4Iugl1oGnFO9Af5jx PRbo7AyXzxLXsp+CQ9tXHrDLx8Lug9FRHOvHxdF7jYRno0fh/vGSeYvzJ8PDxfKvTguo hqtSL8UpmqbZJZOiO1thVedBBn3rtSQGoXZXQ+4ML0ZDUrMAR/XPbBLn+VIQvn9VkACq RGhA==
X-Gm-Message-State: AOAM532DwKzTwE+mk5uHXOqLQzH+kIIMutdFDjy3CXKwZ8fbXUIclGFa 6MYEzt20r96oBpUvLgMir9vuYf48CnQKyCSXvRZwJw==
X-Google-Smtp-Source: ABdhPJzztS3JXs+znU4INppLaCtY9T4qw2tzreOiWbtoevH42tY4YvqAUBNFxhdXvHc7Ctk9joG2tr9ksEB4qySqWec=
X-Received: by 2002:a17:906:6789:: with SMTP id q9mr19348607ejp.295.1618029492546; Fri, 09 Apr 2021 21:38:12 -0700 (PDT)
MIME-Version: 1.0
References: <34787b4f-fdfb-953a-4458-ca410ba70c08@gmail.com> <C7967B60-1491-46A9-8A1C-5D494D60689F@gmail.com>
In-Reply-To: <C7967B60-1491-46A9-8A1C-5D494D60689F@gmail.com>
From: Tom Herbert <tom@herbertland.com>
Date: Fri, 09 Apr 2021 21:38:01 -0700
Message-ID: <CALx6S36OzjVEND0m4WTGYtwKFpzpK+MmTfw3m4+cSrVkazKi0g@mail.gmail.com>
Subject: Re: I-D Action: draft-filsfils-6man-structured-flow-label-00.txt
To: Jeff Tantsura <jefftant.ietf@gmail.com>
Cc: Brian E Carpenter <brian.e.carpenter@gmail.com>, Ron Bonica <rbonica=40juniper.net@dmarc.ietf.org>, draft-filsfils-6man-structured-flow-label@ietf.org, 6MAN <6man@ietf.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: <https://mailarchive.ietf.org/arch/msg/ipv6/E-ajvmBilyoFKE8w6152M9JtEkw>
X-BeenThere: ipv6@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "IPv6 Maintenance Working Group \(6man\)" <ipv6.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ipv6>, <mailto:ipv6-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ipv6/>
List-Post: <mailto:ipv6@ietf.org>
List-Help: <mailto:ipv6-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ipv6>, <mailto:ipv6-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 10 Apr 2021 04:38:20 -0000

On Fri, Apr 9, 2021 at 9:22 PM Jeff Tantsura <jefftant.ietf@gmail.com> wrote:
>
> To my memory, around 2015 Tom Herbert submitted a kernel patch that would change flow label based on RTO, and this has been successfully used for “self healing fabrics” in large DCs to rebalance flows. Since every piece of silicon in DC that takes flow label into consideration when hashing the  traffic uses full 20 bits - repurposing part of it would break it.
> This and similar solutions would need to be addressed.

Jeff,

Yes, flow labels are commonly set by all the major OSes now, all
twenty bits are used, and there are deployed intermediate nodes that
act on those bts. The opportunity to repurpose flow label bits is long
gone, and it probably wouldn't even work in a limited domain. The best
direction is a HBH option.

Tom

>
> Regards,
> Jeff
>
> > On Apr 9, 2021, at 20:39, Brian E Carpenter <brian.e.carpenter@gmail.com> wrote:
> >
> > On 09-Apr-21 10:12, Ron Bonica wrote:
> >> Clarence,
> >>
> >> Draft-filsfils-6man-structured-flow-label addresses a real problem. However, it may have issues with regard to backwards compatibility and IPv6 extensibility. Each is addressed below.
> >>
> >> Backwards Compatibility
> >> ====================
> >> In the draft, you divide the flow label into 4 FLC bits and 16 FLE bits. The 4 FLC bits carry per-packet control information and are not used for ECMP load-balancing. The 16 FLE bits are as defined in RFC 6437.
> >>
> >> This raises the issue of backwards compatibility. Many legacy devices IPv6 devices use all 20 bits of the flow label as defined in RFC 6437. As you say in  Section 4, this could cause packets belonging to a single flow to be distributed among multiple paths. So, the degree of packet reordering at the ultimate destination node will increase to an unacceptable level.
> >
> > And the use of the flow label for server-farm load balancing will be completely broken. That's why this idea is a non-starter outside a limited domain.
> >
> >    Brian
> >
> >>
> >> IPv6 Extensibility
> >> ==============
> >>
> >> Over the past decade, there have been several proposals that take the following form:
> >>
> >> - An IPv6 source node needs to convey some piece of information to every node along the packet's delivery path
> >> - Field X in the IPv6 header is longer than it needs to be
> >> - So, we can borrow a few bits from Field X to convey this information.
> >>
> >> This approach is flawed for the following reasons:
> >>
> >> - It can cause backwards compatibility issues, as described above
> >> - It only works a few times, until there are no more bits to be borrowed in the base IPv6 header
> >>
> >> IPv6 includes a Hop-by-hop Options header. It's purpose is to convey information from the source node to every node along the packet's delivery path. Sadly, it was implemented badly so that it can be used as a DoS vector. Therefore, network operators generally filter it.
> >>
> >> A better approach would be:
> >>
> >> - to avoid borrowing bits from the IPv6 header
> >> - to use the HBH Option for its intended purpose
> >>
> >> This will require rehabilitation of the HBH option. Bob Hinden and Gorry Fairhurst have made a good start towards this goal in draft-hinden-6man-hbh-processing. We vendors will also need to get behind the rehabilitation effort, revising our implementations so that it can no longer be used as a DoS vector. In turn, network operators will also need to get behind the rehabilitation effort.
> >>
> >> While this may not be the path of least resistance, it will contribute to the future extensibility of IPv6. Let's do the right thing.
> >>
> >>                                                                                                   Ron
> >>
> >>
> >>
> >>
> >>
> >>> On 17-Mar-21 05:49, internet-drafts@ietf.org wrote:
> >>>
> >>> A New Internet-Draft is available from the on-line Internet-Drafts directories.
> >>>
> >>>
> >>>        Title           : Structured Flow Label
> >>>        Authors         : Clarence Filsfils
> >>>                          Ahmed Abdelsalam
> >>>                          Shay Zadok
> >>>                          Xiaohu Xu
> >>>                          Weiqiang Cheng
> >>>                          Daniel Voyer
> >>>                          Pablo Camarillo Garvia
> >>>      Filename        : draft-filsfils-6man-structured-flow-label-00.txt
> >>>      Pages           : 12
> >>>      Date            : 2021-03-16
> >>>
> >>
> >>
> >> Juniper Business Use Only
> >>
> >> --------------------------------------------------------------------
> >> IETF IPv6 working group mailing list
> >> ipv6@ietf.org
> >> Administrative Requests: https://www.ietf.org/mailman/listinfo/ipv6
> >> --------------------------------------------------------------------
> >>
> >
> > --------------------------------------------------------------------
> > IETF IPv6 working group mailing list
> > ipv6@ietf.org
> > Administrative Requests: https://www.ietf.org/mailman/listinfo/ipv6
> > --------------------------------------------------------------------
>
> --------------------------------------------------------------------
> IETF IPv6 working group mailing list
> ipv6@ietf.org
> Administrative Requests: https://www.ietf.org/mailman/listinfo/ipv6
> --------------------------------------------------------------------