[Sidrops] Re: some preliminary RRDP analysis (Was: Easter gift: introducing the RPKIViews Raw RRDP Archive!)

Job Snijders <job@bsd.nl> Tue, 21 April 2026 18:36 UTC

Return-Path: <job@bsd.nl>
X-Original-To: sidrops@mail2.ietf.org
Delivered-To: sidrops@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 0E4F2E04211D for <sidrops@mail2.ietf.org>; Tue, 21 Apr 2026 11:36:49 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1776796609; bh=ryVmR+MJwrkDpceRcQnu5fpjy9vrgQqMEIezlDAOws0=; h=Date:From:To:Subject:References:In-Reply-To; b=B0cZYIPspwVobcqUUnMltdMxvcvqIFmqEUdDxy8/d+6vZQ9Jt09MfgbJjXWd7xbuE da+IMrAXnpNv70EgZIOq8IaPw2iqrKISSsqAo/p8BNPMxlECDRWnbXQLoKiB9d9+UP QTxUdEbYWqk+8TgplwtjiU4Z+Mhoj3A4FOxu8Q1s=
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -2.798
X-Spam-Level:
X-Spam-Status: No, score=-2.798 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_VALIDITY_CERTIFIED_BLOCKED=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=bsd.nl
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id uT_D06XonwJS for <sidrops@mail2.ietf.org>; Tue, 21 Apr 2026 11:36:47 -0700 (PDT)
Received: from dane.soverin.net (dane.soverin.net [185.233.34.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id E0196E041FFE for <sidrops@ietf.org>; Tue, 21 Apr 2026 11:35:11 -0700 (PDT)
Received: from smtp.soverin.net (unknown [10.10.4.99]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by dane.soverin.net (Postfix) with ESMTPS id 4g0WHY4ZXhzdt; Tue, 21 Apr 2026 18:35:05 +0000 (UTC)
Received: from smtp.soverin.net (smtp.soverin.net [10.10.4.99]) by soverin.net (Postfix) with ESMTPSA id 4g0WHY2N1Qz1g; Tue, 21 Apr 2026 18:35:05 +0000 (UTC)
Authentication-Results: smtp.soverin.net; dkim=pass (2048-bit key; unprotected) header.d=bsd.nl header.i=@bsd.nl header.a=rsa-sha256 header.s=soverin1 header.b=UN/+tjno; dkim-atps=neutral
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsd.nl; s=soverin1; t=1776796505; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=iJLD/7v0veuGb1oMkmXwD+2lK5JlH1vV2rFDL3ZMKeA=; b=UN/+tjnoPT9Ncq7EWbAtGYhpMZSrMPYCWg09vioSzihHVUjkI9B5K2vyesnXbR2UUhIjPx N+/VMZT0LTmri3vY44BXOAU3cvEAupR17/2eMNYUQMAW7gu3WdxHEBg5S8gfq5DAMMYAQw om1Ffcg7ItD30GIZsh503DqvOAbP95cyV/Y9zQhP7Cqs+bnvNeKyJAUBYKDrgKJp8h0nbK +6GCyWro0f1SezNc7hEPnBb+nCfXDiiVq03SJGs3D0SUXQQF7iVdUgll3R/wU0zFWBxUln GMDR2C1u2GtBwductAbRrk/h6vri+V5J+0rdpGV9Ea04+r4ij2W4+8olUDerog==
X-CM-Envelope: MS4xfPhsOT9+VIyftxjzQUJM+Qjn8clC6C/QnaGOv1sN4epPL65aJBOXp+T1P1yXHcDu3pANLZfnwaPEvSXnaPSmTxNXm2rm5nN4vCymLBHh6Y0PIHbeALg8 d1IPpuBPi5kaY7D2HfI9Nyj9UUTwBVytepDRUp/auTBqcgyhDazlLQfu7nescR24PFA1tsCWEpZ64i6pJehu1GugMI3LH9HZmT0=
X-Soverin-Id: 019db153-13a8-7492-a90d-3019e641fe57
Date: Tue, 21 Apr 2026 18:35:01 +0000
From: Job Snijders <job@bsd.nl>
To: sidrops@ietf.org
Message-ID: <aefDVdN7skadyOYu@feather.sobornost.net>
References: <adIprSWpWRR9ugJ1@feather.sobornost.net> <aeIp_eUklI2FvwV9@feather.sobornost.net> <CAGPuK+7YMSPbLTPqrbCUMxv8mgRddHNLVBp-Cva6KiYpb3MnGw@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <CAGPuK+7YMSPbLTPqrbCUMxv8mgRddHNLVBp-Cva6KiYpb3MnGw@mail.gmail.com>
X-Clacks-Overhead: GNU Erik Bais
X-Spampanel-Class: ham
Message-ID-Hash: 3BVCYDTVCPRO47EF6T2OV7ZKICPOPN4Z
X-Message-ID-Hash: 3BVCYDTVCPRO47EF6T2OV7ZKICPOPN4Z
X-MailFrom: job@bsd.nl
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-sidrops.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [Sidrops] Re: some preliminary RRDP analysis (Was: Easter gift: introducing the RPKIViews Raw RRDP Archive!)
List-Id: A list for the SIDR Operations WG <sidrops.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/sidrops/LVdTy8ye-uD3zpkKdNS6sweGY3w>
List-Archive: <https://mailarchive.ietf.org/arch/browse/sidrops>
List-Help: <mailto:sidrops-request@ietf.org?subject=help>
List-Owner: <mailto:sidrops-owner@ietf.org>
List-Post: <mailto:sidrops@ietf.org>
List-Subscribe: <mailto:sidrops-join@ietf.org>
List-Unsubscribe: <mailto:sidrops-leave@ietf.org>

On Tue, Apr 21, 2026 at 12:19:43PM +0200, Mikhail Puzanov wrote:
> > I also was surprised by the 'low' withdraw numbers overall. Intuitively,
> > I did not at all expect many weeks to go by in which so many FQDNs
> > never send any withdraws. I guess a lot of the data movement in the
> > distributed RPKI database is compare and swap operations?
> 
> My assumption would be that majority of object updates are "publish
> with hash to replace".

Looking at the period April 1st 00:00 - April 20th, 2026 23:59 (UTC),
here are more statistics.

Total number of RRDP Notifications:          63,893
Total size of RRDP Notifications:              1.45 (GB)
Total number of RRDP Deltas:                120,697
Total size of RRDP Deltas:                     19.2 (GB)

Publish elems without hash attribute:        23,571
Publish elems with hash attribute:        3,695,295
Total number of publish elements:         3,718,866
Total number of unique objects:           3,584,623 (deduplicated elements)

Note that a given RPKI object can appear in multiple different RRDP
publish elements, for example, because of instantiation of new RRDP
sessions.

For the same period of time, now looking at _validated_ data (as
recorded in Rpkiviews' rpkispools), the following was observed:

Total number of new unique RPKI objects:  3,546,274 (after validation)
Total size of new unique RPKI objects:         12.7 (GB)

The Venn diagram is as follows:

Objects unique to rrdp.rpkiviews.org:        40,357 (junk data?)
Objects unique to Rpkiviews:                  2,008 (likely discovered through Rsync)
Overlap between raw RRDP and RPKIViews:   3,544,266 (~99% overlap, yay!)

Two key takeaways: most RRDP publish operations are replace operations,
and the rpkiviews.org rpkispools appears to be quite complete (compared
to pre-validated state captured by rrdp.rpkiviews.org)

Kind regards,

Job