Re: [Sidrops] XML in RRDP (Was: mft/ee validity time window alignment issue)

Julian Reschke <julian.reschke@gmx.de> Fri, 09 July 2021 12:46 UTC

Return-Path: <julian.reschke@gmx.de>
X-Original-To: sidrops@ietfa.amsl.com
Delivered-To: sidrops@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 25B8D3A2027 for <sidrops@ietfa.amsl.com>; Fri, 9 Jul 2021 05:46:32 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.236
X-Spam-Level:
X-Spam-Status: No, score=-2.236 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_FROM=0.001, NICE_REPLY_A=-0.338, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=gmx.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id x45-mf6ztZP2 for <sidrops@ietfa.amsl.com>; Fri, 9 Jul 2021 05:46:27 -0700 (PDT)
Received: from mout.gmx.net (mout.gmx.net [212.227.15.18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5626C3A2025 for <sidrops@ietf.org>; Fri, 9 Jul 2021 05:46:27 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1625834783; bh=UpMCy0D3RqEISHT0EsLFrz4ldsVg6PaZT/lT5kvsixQ=; h=X-UI-Sender-Class:Subject:To:Cc:References:From:Date:In-Reply-To; b=QiUmvlus8eK/B443yGQ0U5ikWaoIzdrFBrhpQtJ25Zf8zsgJqLv0ZNTn1vAQ8ApjW 5fW/DgOHrFhlmIotcMrtM9XjLKBdCdvIU/vh1Ur90hI9MMFVUgjZxmga5Hi/OtP4HN U203Woco6S4rh6+pjaitAI266cX5DA85UmDkYN9M=
X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c
Received: from [192.168.1.236] ([5.10.171.186]) by mail.gmx.net (mrgmx005 [212.227.17.190]) with ESMTPSA (Nemesis) id 1MgesQ-1lW66d2hCO-00h5eN; Fri, 09 Jul 2021 14:46:23 +0200
To: Job Snijders <job@fastly.com>
Cc: sidrops@ietf.org
References: <YOg+5DAdpHPINTM8@snel>
From: Julian Reschke <julian.reschke@gmx.de>
Message-ID: <4246a652-d39c-a66a-1c66-36b878e845ff@gmx.de>
Date: Fri, 09 Jul 2021 14:46:23 +0200
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0
MIME-Version: 1.0
In-Reply-To: <YOg+5DAdpHPINTM8@snel>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Transfer-Encoding: quoted-printable
X-Provags-ID: V03:K1:O2Skx7eyQlyanJHLEowCn+7D75sDRZXKBfQr+gXV3t9TKJV5i+D 08k85WYfRkfGnmy3LCY5wpBqlaEvWEi2WcdtMVbU0XlMXrwLUvM1FdRDfYsD7j43t1XPvqE 8NVcvp3LAj4njwf8sJqQhFl/K6WvsP8N7MvlbmtqpOww6rlp6pepepHP/PmWFC9ajMa0r9p q8qqgLF5z00Uk6B5Rzvvg==
X-UI-Out-Filterresults: notjunk:1;V03:K0:/+b55AZfONE=:r9I2KNFlFcRqmzh6viRj3p EReSDJshOYiC/j8Royi6vypf3CDPin2OCNZsBv5pmvoFpnDi9YYCSdnQOlmY89Y0W02npAigo Xo7MT8xAp8P4854hAKjS9wOsC2nq4yJcJojw7gKJC6XUv84GP01RNqsCPeR1GpBdfFJO9BFjJ wRKNm0by1gO3j622LjiWpIuIQr2X1TWAVd/xeTOmbQumOiWoE0B9NYn2ODRH6Efn3UYfAnHdF aMlms9OcPEuidA4mA/PKKWegwZK2Qcahh11qHiNNT4ftlVEX4F73Il7YkFzVlSK6Q8UNzApfY Z7ptAzfrMi/GnLnQHovqbGZsZE+nRwj1QePUYM/JIOLlQXxpfLKSga21FSoelcwUtRqk2ZQMw 38CCYJWfJVPj/l5k7I6BijtTm4i5FBkgLbNsW0SSbpKVyh55HRUg/8CsrQaPMtK6ayrx27qUA i7HGHzFDdBa1BjYGBK0I0hIqLqN0us8o3e1JwbrMqSV6u+ysZ2GTmLp8oiWzRsd7622jgoaxj EAVUtkXrjUNaZ+7cbIRQY3GI3NQxz0FJexUbwlkzZaLg1vgVkCWvQcamT3wSkh4ISBdi1qeGe fkxjp65BDafeqGFmHLbyB9lGsdXii/hTBAxh9ToVILHK6tnSxgscdU4OVPoaMAZND6w4bi77y pUm+gXsUIh1+tlySnVquQLqERnrBKt04XDN4Nhi9N7BjPxOBAYuUL6Cg5ddFUVpSoxmmfwSoY Ad3HATNcGZQgf37NwL7lW8cVD+it0qiWm60eLV0s+x+4OC09MLSBd95CxvOeuKDD+/Qhh2kDh iXUbaqgOA74rEui63zV4oMXWWbt4j3f4ivoXHFq6CfcpKpNp5SFPWATsmNXt69d3vG71m8Nkd 4uLiYbJvWJmQyi8B10it2+cGyK6PlcRde2AoqYyzuwCglmeRGgRzYfY9E4yef0pEownQ3O7ed sHR7wQXKkkoBrXDqzduJtrGR/+bP11/Uvi2K0EYLZETZ4UggauishLRrB5LONXOj+z0sN1f4W dbcQ5kweth0U4Su/mvZXKVPAE2880PQYN/8iVxebNlcuS20MZKxXIQ2uiWzf2JsC8ngB+nWGd 3nBoYfbNfvAZvdiPRaopn5OZw4VqwHUxolSFAn9GuXRqwyceYu5b2yx+Q==
Archived-At: <https://mailarchive.ietf.org/arch/msg/sidrops/dHJVwiFSuEiRGko1Hg4fgalZx14>
Subject: Re: [Sidrops] XML in RRDP (Was: mft/ee validity time window alignment issue)
X-BeenThere: sidrops@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: A list for the SIDR Operations WG <sidrops.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/sidrops>, <mailto:sidrops-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/sidrops/>
List-Post: <mailto:sidrops@ietf.org>
List-Help: <mailto:sidrops-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/sidrops>, <mailto:sidrops-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 09 Jul 2021 12:46:32 -0000

Am 09.07.2021 um 14:19 schrieb Job Snijders:
> On Fri, Jul 09, 2021 at 01:31:01PM +0200, Julian Reschke wrote:
>> Am 09.07.2021 um 12:59 schrieb Job Snijders:
>>> ... > If we are looking to decrease traffic, I'd first remove XML from RRDP as
>>> that appears a 50% bloat compared to using DER as container :-)
>>> ...
>>
>> 1) Even with Content-Coding gzip?
>
> Supporting gzip encoding is not a requirement for RPKI RPs. But indeed,
> it helps reduce transfer size:
>
>      https://rrdp.ripe.net/c85a5e87-ad1a-4b5a-b73f-8325877826fd/3059/snapshot.xml
>      gzip encoded transfer: 67.9M
>      non-gzip transfer: 141M
>
> However, if we jokingly entertain 'tar' as a container format instead of
> XML, the raw DER data can be gzip compressed to 57.5M! ~ 20% reduction :-)

But that would require a change in the protocol, right?

> My beef with the XML in RRDP is more than just the size: the requirement
> to have to link a full blown XML parser library into an RP
> implementation, while each RP already has a DER decoder, is bloat of
> some sorts. XML in RRDP is merely used as a very expensive field
> separator.

That is true, but then, XML parsers are mature and widely available.

> I know the original RRDP author was not specifically attached to XML,
> and perhaps it was useful in the proof-of-concept phase. In the next
> version of RRDP I'd recommend to get rid of the XML dependency.
>
>> 2) How many RRDP requests are currently 304s, or could be 304s if
>> clients and servers would take advantage of it?
>
> Probably the majority. As far as I know most RPs implemented support for
> 'If-Modified-Since'.
>
> A quick'n'dirty inspection of my publication webserver access log
> searching for '304' requests shows that the most RPs support this
> functionality:
>
>      Apache-HttpClient/4.3.6 (java 1.5)   <-- unsure which RP this is
>      OpenBSD rpki-client
>      Routinator/0.8.0 - 0.10.0-dev
>      fort/1.4.0 - 1.5.0

...good to know. Now is this true for the servers in use as well?

> OctoRPKI & RIPE NCC's Validator don't appear to have If-Modified-Since
> support.

One EOLd, one currently without maintainers...

Best regards, Julian