Re: [Ntp] NTPv5 and anycasting

Watson Ladd <watsonbladd@gmail.com> Thu, 03 December 2020 15:24 UTC

Return-Path: <watsonbladd@gmail.com>
X-Original-To: ntp@ietfa.amsl.com
Delivered-To: ntp@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7B2293A0FAD for <ntp@ietfa.amsl.com>; Thu, 3 Dec 2020 07:24:07 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id CbxfJIuGHCED for <ntp@ietfa.amsl.com>; Thu, 3 Dec 2020 07:24:06 -0800 (PST)
Received: from mail-lj1-x22d.google.com (mail-lj1-x22d.google.com [IPv6:2a00:1450:4864:20::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 937EF3A0E28 for <ntp@ietf.org>; Thu, 3 Dec 2020 07:24:03 -0800 (PST)
Received: by mail-lj1-x22d.google.com with SMTP id y16so2962002ljk.1 for <ntp@ietf.org>; Thu, 03 Dec 2020 07:24:03 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=g2673QYYPbe1J3Mq8tiicAbZVusJRLfk7pgHBCyrpRI=; b=q1APaPmVSr3OLKb4hLnjKXPdNm8lJMIy6jN4q8gpd4RLgkXGdttAlUzY8RoDZ/fJbT D9CvVOxD4oxo1L+KQVwLO7HlXfa6fSt/WibHSWYZ3URUyRaWBFzTaaRXFzxZc9SXaVjd UyVZDEQ4SE4p7JhBtCfNKJgp8+3CVRlXEaaCFy6LeM2Nqa+15kZjO5+BoTiBViQkG6iq ZBrxaIBUv3wVLZoRcRUfPlda7VgW08Rre7pmuo6N8QJzDyaVOYKrrln25Nz6S7wAtGgs IttPEwj9eE9NWbAh/gbh+xMBGTg/gqheN3jxXINquNPkhJrSu0d/Xco1/VVFXyU/nSil KVAA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=g2673QYYPbe1J3Mq8tiicAbZVusJRLfk7pgHBCyrpRI=; b=GchrSyafd04FYr30TIFtBNH1oOgW6qiQGIqduRx2dPOXdsWZmNjGmx85NMAVK067gj 2FQBejOLNJdq4CfpEK5LyQuCqarMGjo0Eg3dNtRO8ddTaDWGMrH3+4HuhLUB1YZmSs7s e7L06K2iM3hODnBjRAUM9ICQNjRsZOOFU1hQII4uXYZR24IZyvCPxyN7FFBpRbabpTeK BmCyL3T/HTwNEdRycIyh5C1euHXWJqXMI9vJV2LpWS9usPxMGUV+DDN+j3fU4S7BQyA9 ugnDei/Hv+7iDuY0SGJCh6dvC94S6nC7VWHTK0mTPmVx9726hrnZ5zOFlUGtAhXsPI3U W8VQ==
X-Gm-Message-State: AOAM530TfZHqKc2EJJB2115g+kGeaB+OUegFtKxwPy/V8M5zGQu519Jq biqQ+yW32wQUD7JX2WhcX1yOcRTi0GJvaewbvzQ4snHMEEo=
X-Google-Smtp-Source: ABdhPJw2JTcqRdKMMKodJbG2s96ahMCzBiwMcEP+Ym1w1j+XcGF9tGyCYeB2RnD6Guc5tZdz7v5+3xGT0UxYmgkVv3I=
X-Received: by 2002:a2e:8053:: with SMTP id p19mr1401984ljg.321.1607009041600; Thu, 03 Dec 2020 07:24:01 -0800 (PST)
MIME-Version: 1.0
References: <F2AD65AD-3403-486E-AEF9-3EF07F88A7FF@redfish-solutions.com>
In-Reply-To: <F2AD65AD-3403-486E-AEF9-3EF07F88A7FF@redfish-solutions.com>
From: Watson Ladd <watsonbladd@gmail.com>
Date: Thu, 03 Dec 2020 07:23:50 -0800
Message-ID: <CACsn0c=+qq55Wpsiz+VrTu3rSwmgaoK7yuw139o3tMxqOTfXNQ@mail.gmail.com>
To: Philip Prindeville <philipp@redfish-solutions.com>
Cc: NTP WG <ntp@ietf.org>
Content-Type: text/plain; charset="UTF-8"
Archived-At: <https://mailarchive.ietf.org/arch/msg/ntp/yWjMdCfXFzv16-gm5p6PQHCD5Bo>
Subject: Re: [Ntp] NTPv5 and anycasting
X-BeenThere: ntp@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: <ntp.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ntp>, <mailto:ntp-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ntp/>
List-Post: <mailto:ntp@ietf.org>
List-Help: <mailto:ntp-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ntp>, <mailto:ntp-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 03 Dec 2020 15:24:15 -0000

As the operator of one of the biggest anycast NTP deployments in the
world, how about not?

At least in our case,  we use ECMP on the router, so if an association
uses a persistent port, it will get to the same server modulo
announcement changes due to server failure. I'd be happy to
collaborate in measurement research to quantify the magnitude of any
such effects when this is not the case. Route flaps are pretty rare,
so that's not much of an issue. I know the synchronization inside the
datacenter is quite good.

If we had to use DNS based load balancing that would be equally
nondeterministic, but would be significantly slower to adapt to server
faults, more susceptible to improper DNS or association caching by
clients, and complicated for boring architectural reasons. Anycast
scales much better without IP address consumption (for v4), while DNS
gives more flexibility in load balancing in the working case. DNS
would enable clients to use multiple different points of presence, and
figure out which has the best time, vs. being subject to the whims of
BGP. I don't know how much of an advantage that gives in realistic
scenarios.

In practice I think many single-homed servers are in fact anycasted
over a small number of servers behind a single Internet facing router
to provide redundancy. Once you're in the world of uptimes greater
than that of a single server, these sorts of setups are essential.

We also would not be able to join the pool without lots of operational issues.

I'm happy to collaborate in answering these questions: there are no
real secrets in the time service, and the NTP community has been very
helpful. We'd love to return the favor.

Sincerely,
Watson Ladd