Re: IPv6 Anycast has been killed by LINUX patch in 2016 - who cares?

Tom Herbert <tom@herbertland.com> Mon, 09 August 2021 18:24 UTC

Return-Path: <tom@herbertland.com>
X-Original-To: ipv6@ietfa.amsl.com
Delivered-To: ipv6@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6359E3A10DA for <ipv6@ietfa.amsl.com>; Mon, 9 Aug 2021 11:24:16 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.297
X-Spam-Level:
X-Spam-Status: No, score=-1.297 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001, URIBL_SBL=0.5, URIBL_SBL_A=0.1] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=herbertland-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qS1E-hu_guXL for <ipv6@ietfa.amsl.com>; Mon, 9 Aug 2021 11:24:11 -0700 (PDT)
Received: from mail-ed1-x535.google.com (mail-ed1-x535.google.com [IPv6:2a00:1450:4864:20::535]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id F3CCC3A10C5 for <ipv6@ietf.org>; Mon, 9 Aug 2021 11:24:10 -0700 (PDT)
Received: by mail-ed1-x535.google.com with SMTP id n12so2152592edx.8 for <ipv6@ietf.org>; Mon, 09 Aug 2021 11:24:10 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=herbertland-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=+aogPgXImMnm2AEL8VqzYTKXynubkiHk3q/wZixQrV0=; b=0gyNsLI4wYQGJHyaDVmcwSvbMOddzsbnPmpdlvPOOPKIeSuHLJLHp1zuI4pnNCgjjS MYmez9G6YbShf2cqmHuKj8POk8QzlBfXf92tsB5ITplVZLWX2wjg9/QIoeBrndby/9BV FcyJBWjgU7cpUuewV7BcIGo5MY5RUHpJelskzv985u5iRrO6z9PAsMVG24xlV4E3eGVc k8YwZaTNBwyFF+OcxzYrNJiHdOdMs85e+r58+9+u7v4m73eKnpEUXp92kXX4obgxoVTT NTWhMVmS5Qce9EGOpVyq7ud8iKkqrq9Zc+xDmG9abSk+6DkCuwvMrbeg2o6+ngCfLcx0 x6bg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=+aogPgXImMnm2AEL8VqzYTKXynubkiHk3q/wZixQrV0=; b=RMHj+YnQwdP2n32nzuq3GUZgOibxlKfHnQg5pSt2Wqgty6KYXSsUVOKSpT4MK1JYuh 1kDMm1tam7DtGQ+bFpqtRDgNE6zGkkeY/f8IA1RjHa1iaasrdrvqMkVmRU9241TMFEWl A1wmywTQHh/DAtfiZXYhSKFzhvGsYOxWZp7cqgLlHG1eO2ygLJGslyvEy8X5Dh5Aa3Qo PVv/kKof+wyI47eAIzVrbxBa/HhpcliIeT7pb9DLYbEcblqO1R48nWHs1nZC6rWkfoD+ UqSjazenCINAyD9VFCqKVMqEqwjqfMjKSYAlmc7dlJXVlQKe1yJ7dB7ukHup7f915/Pr ljgA==
X-Gm-Message-State: AOAM532JQtbWQlOKdPxczhGEHElfhbaSN1y3nw5cvwUBS0ofr2izHZZq VdOeBPZYAXi+x1jhhCckH1fBPfXnDIQDewL0E7ECog==
X-Google-Smtp-Source: ABdhPJxKeDn3x8YOhfdq84fYcoYcbRJJbDKo7RrdoMKo6JSWVpGPyshsp3qlF9iAOqA3LjsO57N8xwwOetNX/Q3j6Oc=
X-Received: by 2002:a05:6402:550:: with SMTP id i16mr31628823edx.177.1628533444213; Mon, 09 Aug 2021 11:24:04 -0700 (PDT)
MIME-Version: 1.0
References: <CALx6S36pbw2angEmDpu5DnX2nix9KgxFs7ExU17x+JXQFs23TA@mail.gmail.com> <CALZ3u+Yt2X3faSVW7K0eaxmaQy6iA6p4=f0c4E_F4CP0tfjHYw@mail.gmail.com> <CALx6S343sL0=5wUTRSXMnhSamjTTZU=DzA9Y+dbJ4NRTu0_83w@mail.gmail.com> <CALZ3u+ad6Cecp4T+wfuKVJ4ZmnQvaCSX2njFPCN8DuctrU6uew@mail.gmail.com> <CALx6S37u=y1wX8+6d8aX-6=N1MFEqO9RwxQN5zhZnS4DLM8DcA@mail.gmail.com> <CALZ3u+bHbsdzQsHOHx-6nEe6yQBbHMDhH9_PWB=WHTchB8tj5w@mail.gmail.com> <CALx6S36MpCOh2mR+cfM__ASTdn9c4CuhxUrCnUgEv1WhORLyRg@mail.gmail.com> <CALZ3u+ZyQKUJc__HWu6drNyLSCJJ8bOsLfg1B18xwB9+HMe8GA@mail.gmail.com> <CALx6S366bXkCsyEkWCONBX5kcB9JzHU=aNF9hd+wT9FcTdShFw@mail.gmail.com> <CALZ3u+aP=v_1=w1xqfEKof7Cc6Ba3pwOYV3O=0b=NxS4hRWhiA@mail.gmail.com> <YRBdZrKV+MrrhUCG@mit.edu> <CALZ3u+aBdE3Bw3_ry+CuV4tS016c4mWewJFpr0aCbBnwj70Vzg@mail.gmail.com> <a3833e04-c123-ef52-95f9-cae80a1390e7@foobar.org> <CAMm+LwiAbiK618+kY9JTLr7_mQd-E5TKyNsGqOLrGQoLzjJo=A@mail.gmail.com> <CALZ3u+bLVUZf1fTHQvAVzOnToiPcsXEyTNt56hNAXz4=-G5-6w@mail.gmail.com> <CAHw9_i+k9x1g3bcst6rHcXpesEVwnPtV6DzsFAxi8dC6CRMZPw@mail.gmail.com>
In-Reply-To: <CAHw9_i+k9x1g3bcst6rHcXpesEVwnPtV6DzsFAxi8dC6CRMZPw@mail.gmail.com>
From: Tom Herbert <tom@herbertland.com>
Date: Mon, 09 Aug 2021 11:23:53 -0700
Message-ID: <CALx6S346mqNaE+s1DH7S7RutTpzfrC5oX1No5Jb72sTvVQjtpQ@mail.gmail.com>
Subject: Re: IPv6 Anycast has been killed by LINUX patch in 2016 - who cares?
To: Warren Kumari <warren@kumari.net>
Cc: Töma Gavrichenkov <ximaera@gmail.com>, 6man WG <ipv6@ietf.org>, Phillip Hallam-Baker <phill@hallambaker.com>, Theodore Ts'o <tytso@mit.edu>, IETF discussion list <ietf@ietf.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: <https://mailarchive.ietf.org/arch/msg/ipv6/bUNaG1m4djCH-uVpzL7U13cvNE0>
X-BeenThere: ipv6@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "IPv6 Maintenance Working Group \(6man\)" <ipv6.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ipv6>, <mailto:ipv6-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ipv6/>
List-Post: <mailto:ipv6@ietf.org>
List-Help: <mailto:ipv6-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ipv6>, <mailto:ipv6-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 09 Aug 2021 18:24:23 -0000

On Mon, Aug 9, 2021 at 11:09 AM Warren Kumari <warren@kumari.net> wrote:
>
>
>
> On Mon, Aug 9, 2021 at 1:08 PM Töma Gavrichenkov <ximaera@gmail.com> wrote:
>>
>> Peace,
>>
>> On Mon, Aug 9, 2021, 7:47 PM Phillip Hallam-Baker <phill@hallambaker.com> wrote:
>>>
>>> We have people vigorously asserting that Linux broke IPv6 TCP over Anycast five years ago and this is serious.
>>>
>>> And We have people vigorously asserting that TCP over Anycast works absolutely perfectly and there are no issues.
>>>
>>> And they are the same people.
>>
>>
>> a) they're not really the same people,
>>
>> b) no one said that TCP works _perfectly_ over anycast per se, because it's understood that perfectionism just doesn't belong in the area or engineering.
>> What's been actually said is that it works just fine in a number of applications, including almost every popular application, and these applications use it this way on purpose,
>
>
> ... including a number of content providers.
> As examples (many aren't really documented), Fastly (https://docs.fastly.com/en/guides/using-fastly-with-apex-domains) and CloudFlare (https://www.cloudflare.com/learning/cdn/glossary/anycast-network/, https://blog.cloudflare.com/cloudflares-architecture-eliminating-single-p/) have offered this.
> Fastly and CloudFlare both have some really smart people working for them, and they collect and analyze lots of transport level stats. I suspect that they'd be surprised to hear that what they've built doesn't work reliably...
>
> I'm often surprised just how often we end up in discussions in the IETF where people make an assertion like "Foo will never work. Can't be done, no way, no how.", and then someone else points at a bunch of existing implementations. This feels like another instance of this.

Warren,

That logic works both ways. The fact that these patches in question
are over five years old and no one has reported a production issue
with them is inconsistent with some of the dire proclamations in this
thread that anycast is broken. Note that the concerns were raised by a
researcher not by any production data, and also note that the authors
of the patches were from Google and Facebook which obviously have a
vested interest in not creating problems on the Internet. In fact,
these points are likely to be counter arguments brought up on LKML if
we try to change the Linux behavior, Linux maintainers are often
loathe to change a deployed default without a strong rationale that
there's a real problem in deployment.

Tom

>
> W
>
>>
>>
>> c) also, the impact of IPv6 deployment and performance issues is perfectly limited by the current poor scale of IPv6 deployment.
>> And, when the existing behaviour of applications working just fine in IPv4 breaks during transition to IPv6, that's not really going to speed the transition up.
>>
>> --
>> Töma
>
>
>
> --
> The computing scientist’s main challenge is not to get confused by the
> complexities of his own making.
>   -- E. W. Dijkstra
> --------------------------------------------------------------------
> IETF IPv6 working group mailing list
> ipv6@ietf.org
> Administrative Requests: https://www.ietf.org/mailman/listinfo/ipv6
> --------------------------------------------------------------------