Re: [Sidrops] Publication Point -> RP synchronization in bandwidth constrained environments (note for RRDP v2)

Job Snijders <job@fastly.com> Tue, 30 May 2023 19:30 UTC

Return-Path: <job@fastly.com>
X-Original-To: sidrops@ietfa.amsl.com
Delivered-To: sidrops@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 67C5BC1519B2 for <sidrops@ietfa.amsl.com>; Tue, 30 May 2023 12:30:38 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.094
X-Spam-Level:
X-Spam-Status: No, score=-2.094 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=fastly.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id V7iKOdaARVVl for <sidrops@ietfa.amsl.com>; Tue, 30 May 2023 12:30:34 -0700 (PDT)
Received: from mail-ej1-x634.google.com (mail-ej1-x634.google.com [IPv6:2a00:1450:4864:20::634]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B805CC151B1E for <sidrops@ietf.org>; Tue, 30 May 2023 12:30:34 -0700 (PDT)
Received: by mail-ej1-x634.google.com with SMTP id a640c23a62f3a-9741a0fd134so245316666b.0 for <sidrops@ietf.org>; Tue, 30 May 2023 12:30:34 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fastly.com; s=google; t=1685475032; x=1688067032; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:from:to :cc:subject:date:message-id:reply-to; bh=a6iOOLFkzvXKRTVh1n3/iTGcpLPRxXgoImOtIK6vo1k=; b=xcH6qU2BFMHA6Q0smWfxqE0E1LcS5mYZZ91cGrkpMOoUovjyMNz2mnO3hSVirvUhR8 yTBPY1lLBbKiui3Z1jfFLiGRxPIjuGmqTD4U0jwggUAZE+gVfXLgF+Y6JAH4nWA2ZJXL PUHmVAmIThlNuNYpqfBkXC2WPQGLxdHGaIFHc=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1685475032; x=1688067032; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=a6iOOLFkzvXKRTVh1n3/iTGcpLPRxXgoImOtIK6vo1k=; b=lctLGkgPCgvWy5xkJ+n9QuQhpMmMZ/AlpUVJxtjz7QIkGvof8Yc5GGQiq3j9FXTNgV 24w90ln13rsCAoWOEd88/Eo14oUU+NxiFpulwpjwtqsCpGmSYzm+9995UaKxWseQPA5x /0A2i2juz3VxBeZr8vMpbpegAJdUTfZWDTMUzyzMSkr2O0xubxZ3lbelxWkRmmdNZ0GO OdZOV0xIxL0BCtpkk3uJkY9sAq4jT/3o2Q8jAXK/aRZ0FuPVMlg74Y1dsCISLOmic0nS HtcVvR9cDiVGlvMxr6OY0jPFe0hQ82VQhWCf01P1MuclmjCoWGGC+zAq2VGCsaW+Km9J oATw==
X-Gm-Message-State: AC+VfDxO/loKY97VALafXIeEz2JSl71TfG6igb6t5Z89aLs4vzhOLw5q Br6SvrgcdOllrF4k5QCOjXEnbw==
X-Google-Smtp-Source: ACHHUZ6aFbv0TiJtcpcE7QomFio21RolPmhw6x4RMMQML65Qm9+0mz3hx8I2TC2bqI3PhS60ijsqKQ==
X-Received: by 2002:a17:907:6e06:b0:94e:d951:d4e7 with SMTP id sd6-20020a1709076e0600b0094ed951d4e7mr3282544ejc.59.1685475032544; Tue, 30 May 2023 12:30:32 -0700 (PDT)
Received: from snel ([2a10:3781:276:1:16f6:d8ff:fe47:2eb7]) by smtp.gmail.com with ESMTPSA id t7-20020a1709064f0700b009531d9efcc4sm7823126eju.133.2023.05.30.12.30.31 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 30 May 2023 12:30:32 -0700 (PDT)
Date: Tue, 30 May 2023 21:30:30 +0200
From: Job Snijders <job@fastly.com>
To: Christopher Morrow <christopher.morrow@gmail.com>
Cc: sidrops@ietf.org
Message-ID: <ZHZO1lHa2PEvKVQQ@snel>
References: <ZHYYt77xdtrkNV1a@snel> <CAL9jLabBTWYS7B-_uyeq_e8DeqMiWXSg7bE0Tv2O31n2MX=Vsg@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Disposition: inline
Content-Transfer-Encoding: 8bit
In-Reply-To: <CAL9jLabBTWYS7B-_uyeq_e8DeqMiWXSg7bE0Tv2O31n2MX=Vsg@mail.gmail.com>
X-Clacks-Overhead: GNU Terry Pratchett
Archived-At: <https://mailarchive.ietf.org/arch/msg/sidrops/abNamyJs9r8vMykTQQa_RkOxEoQ>
Subject: Re: [Sidrops] Publication Point -> RP synchronization in bandwidth constrained environments (note for RRDP v2)
X-BeenThere: sidrops@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: A list for the SIDR Operations WG <sidrops.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/sidrops>, <mailto:sidrops-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/sidrops/>
List-Post: <mailto:sidrops@ietf.org>
List-Help: <mailto:sidrops-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/sidrops>, <mailto:sidrops-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 30 May 2023 19:30:38 -0000

On Tue, May 30, 2023 at 03:21:19PM -0400, Christopher Morrow wrote:
> On Tue, May 30, 2023 at 11:39 AM Job Snijders
> <job=40fastly.com@dmarc.ietf.org> wrote:
> > I wanted to share a note that if work ever starts on RRDP v2, that
> > design team should consider conservation of bandwidth a priority.
> >
> > Recently one of the RIRs ran into a network congestion issue
> > noticable on intercontinental transfers: their 36 megabyte RRDP
> > snapshot was being served at a rate of ~ 25 kilobytes per second,
> > and worse the TCP connections often timed out.
> 
> wait, I thought the reason (one of the reasons) that rrdp was great
> was it was cacheable and all of this would be behind CDNs?

I take your comment as a humoristic reflection :-)

Be that as it may be (I wasn't part of the RRDP design team),
introducing an extra layer of caching introduces an extra layer of
complexity.

For example special care needs to be taken to avoid the CDN
inadvertently caching 404s for URLs for future RRDP deltas. If you use a
CDN, you should use non-predictable filenames for the deltas. Also, CDNs
oftentimes cost money, and even can congest. CDNs simply might not be
for everyone.

Kind regards,

Job