Re: [Tzdist-bis] [calsify] tzdist and IANA -- estimating the operational parameters

Ken Murchison <murch@fastmail.com> Thu, 18 July 2019 20:26 UTC

Return-Path: <murch@fastmail.com>
X-Original-To: tzdist-bis@ietfa.amsl.com
Delivered-To: tzdist-bis@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A7DA8120074; Thu, 18 Jul 2019 13:26:18 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.699
X-Spam-Level:
X-Spam-Status: No, score=-2.699 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=fastmail.com header.b=rUJOOpov; dkim=pass (2048-bit key) header.d=messagingengine.com header.b=BYmeUE8Y
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id owj1CRLW1mCq; Thu, 18 Jul 2019 13:26:16 -0700 (PDT)
Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 664D1120033; Thu, 18 Jul 2019 13:26:16 -0700 (PDT)
Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id F00E12206E; Thu, 18 Jul 2019 16:26:14 -0400 (EDT)
Received: from mailfrontend2 ([10.202.2.163]) by compute5.internal (MEProxy); Thu, 18 Jul 2019 16:26:14 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fastmail.com; h= subject:to:cc:references:from:message-id:date:mime-version :in-reply-to:content-type; s=fm3; bh=IiLAc3f44ODT0xVozMAxSeFctfj y0avcDIdOsBP3TGM=; b=rUJOOpovsF1FA6Cc122SKBXm0Z8ZWku3eQxAQls0g3c 2eqF3PNQoCcPdLmiMWEpwkXvNAhBtNqXlKvS4nurybO21Gf9qcYbyCB+ivTH54s4 l4eXUWi2kC3hSdMP2Zm4AzBdFq/3cAmUEfg7BjdsxWMrDP0UkeAtbN9aOZSupR4b N7IslVVxJ9NO9OJjlIGTA+Y1Tib/fDSqfX3EdrVCbBmyozk2JO77GlkltxMJnFXD Gw9bt6tjur8M6P6JdRQyc3Z64LHEJulmGYEmRTz1VkziIHq4VsGDu953OAPS5GbH Yk4poAWLysQ9IX7QvgXoUcefX9yuWiz4+ok+swOCgCw==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=IiLAc3 f44ODT0xVozMAxSeFctfjy0avcDIdOsBP3TGM=; b=BYmeUE8Yju7szKuOzBSB+U AI0XU7aa7Cq2RN+6heGC8pYCynKDGx2ZRFgqGW8t2gVrOkAnhEZ+SvRSmxYIM0zI 0IjEZA3MKd4/AcCoV+/GK7JkAfO2a/5I/fFcX8OAOqmtjQRa1HoH0QGmq09lDYKE DMmt+tbotMgwW9/hkjPds+HF4IC6ey9UB9NWac2rS0CxSSJHiu6miUu7kqHqP547 hkQWAb7XRzgiihUG7eXqbgEcM51Pi2QtiuY3kfbdX3An/FoxGZf9PuwgILF0Vdk5 YSwjJhvPvJRnLXHUYO1K47ozEW2ccpW/a7Blsrj3MfdChP8PXtZjbMOPTlnmcNow ==
X-ME-Sender: <xms:5tUwXen1A0GbOS-OxWeJYFsfQDFIqWD10NG0tGwXpyP4oKSmA3dSUw>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduvddrieehgdduhedvucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepuffvfhfhohfkffgfgggjtgesmhdtreertdefjeenucfhrhhomhepmfgvnhcu ofhurhgthhhishhonhcuoehmuhhrtghhsehfrghsthhmrghilhdrtghomheqnecuffhomh grihhnpehivghtfhdrohhrghenucfkphepjeegrdejjedrkeehrddvhedtnecurfgrrhgr mhepmhgrihhlfhhrohhmpehmuhhrtghhsehfrghsthhmrghilhdrtghomhenucevlhhush htvghrufhiiigvpedt
X-ME-Proxy: <xmx:5tUwXQty0CrfIGRc529gBsb8B0X_vs7U0hjjBgBOfeF5MbLNxWO4zw> <xmx:5tUwXdlQYpvbH9PllLfcr_O9CMUIFQlS-Bh-NIkjE4iCGVJRcFE_gA> <xmx:5tUwXZnAYS4Vwwp2x6ndu4f_7DDfaqPdtHUBS-pht4x3rpVFU67Zaw> <xmx:5tUwXSqcs3pkd88LP6inx-R2nefHE-4iqqoxGKvZR_4QmsQTSkiHcQ>
Received: from localhost.localdomain (cpe-74-77-85-250.buffalo.res.rr.com [74.77.85.250]) by mail.messagingengine.com (Postfix) with ESMTPA id C297D380084; Thu, 18 Jul 2019 16:26:13 -0400 (EDT)
To: Paul Eggert <eggert@cs.ucla.edu>, Steve Crocker <steve@shinkuro.com>, Time zone mailing list <tz@iana.org>, IETF-Calsify <calsify@ietf.org>
Cc: tzdist-bis@ietf.org, Daniel Migault <daniel.migault@ericsson.com>, Martin Burnicki <martin.burnicki@burnicki.net>
References: <CADZyTkkNuenOTx77cB8vFzWaSjp_fqtEgaYd00t5e2+Kk6MtRA@mail.gmail.com> <47038bd0-210a-4dbc-173c-15bfa89ac54f@cs.ucla.edu> <6a50708d-5fac-1da9-56b3-ed1cea793752@fastmail.com> <6b1616e3-bfc0-a22a-2aa9-11033c525ff3@cs.ucla.edu> <CADZyTkms=skOgqfoDxTF6TSZBsWbfaCmfPBWCG0E9qb4-qA0Uw@mail.gmail.com> <6e243cf0-a3ff-82a1-3cae-70fbf699f1f7@gmail.com> <98A352CD-3386-49FB-B6C1-D4EC61BB79EC@cisco.com> <caf6c792-3bb0-c9ec-9ac1-1e7b7c1b6bfd@burnicki.net> <B5E14F98-5CD1-4FFE-92FF-082301BC60F2@cisco.com> <e80eea72-04fa-fe94-c7aa-3c17daedbe9d@burnicki.net> <CADZyTknTp212k7ZLFsw51r=KZcz==UGKw0Z+BWT0fVs4-cYMNw@mail.gmail.com> <CABf5zvK=KcW0YMtevmR3A01xMNbxF1nwE5ib2jj3482FFt75UA@mail.gmail.com> <118a452c-25ba-8427-4401-5465270da738@cs.ucla.edu>
From: Ken Murchison <murch@fastmail.com>
Organization: FastMail US LLC
Message-ID: <5a63c02a-5ae1-15c3-fbb5-7baba149dbfa@fastmail.com>
Date: Thu, 18 Jul 2019 16:26:11 -0400
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.7.2
MIME-Version: 1.0
In-Reply-To: <118a452c-25ba-8427-4401-5465270da738@cs.ucla.edu>
Content-Type: multipart/mixed; boundary="------------A833717AE33B1BE238FCDF48"
Content-Language: en-US
Archived-At: <https://mailarchive.ietf.org/arch/msg/tzdist-bis/yl6PXAduMelKAAl86Mh4lgdu3hs>
Subject: Re: [Tzdist-bis] [calsify] tzdist and IANA -- estimating the operational parameters
X-BeenThere: tzdist-bis@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Extensions to Time Zone Data Distribution Service <tzdist-bis.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tzdist-bis>, <mailto:tzdist-bis-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tzdist-bis/>
List-Post: <mailto:tzdist-bis@ietf.org>
List-Help: <mailto:tzdist-bis-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tzdist-bis>, <mailto:tzdist-bis-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Jul 2019 20:26:19 -0000

On 7/18/19 4:15 PM, Paul Eggert wrote:
> Steve Crocker wrote:
>> Early in this thread it was mentioned the the time zone database 
>> should be
>> served in a fashion similar to DNS.  My first thought was the numbers 
>> are
>> wildly different.  I jotted down a first cut at identifying the relevant
>> operational parameters.  Perhaps the people proposing this service can
>> flesh out the quantitative aspects.
>
> Here are some estimates. There is no central TZDIST server now, so all 
> the non-size estimates are for if/when that happens. The estimated 
> rate of change for these numbers is all zero, except for the database 
> size where I'd estimate a growth of 5%/year (this is just off the top 
> of my head).
>
>
> Frequency of database update: 18 times per year has been the worst 
> case since the project started in the 1980s. Recently updates have 
> occurred three to ten times per year.
>
> Frequency of access: If we're assuming a pull model like TZDIST with 
> primary and secondary servers, I would expect queries once every 
> hour-or-so from each downstream server that wants to be up-to-date. 
> Usually the response will be "nothing has changed".
>
> Required response time: Most clients and servers can be expected to 
> have a (possibly-stale) copy of the data already, which they can fall 
> back on. So I would say "minutes".
>
> Required uptime: Again, not crucial. I would say 90% would be enough.
>
>
> For sizes, it depends on data format and whether you want all the data.
>
> Size of entire tzdb database (including all time zone history, version 
> info, and legal notices), in minimal source-code (text) form: 111 kB 
> uncompressed, 27 kB compressed via gzip, 22 kB compressed via lzip.
>
> Size of entire tzdb database in binary (TZif) form in traditional 
> form: 456 kB uncompressed, 152 kB tar+gzip, 68 kB tar+lzip. This 
> includes all time zone history but omits version info and legal notices.
>
> Same size, but with zic's new '-b slim' option that relies on Internet 
> RFC 8536 instead of attempting to work around bugs in older 
> applications: 216 kB uncompressed, 77 kB tar+gzip, 43 kB tar+lzip.
>
> I don't know how to compute the size of tzdb converted into iCalendar 
> form, but my guess is that it'd be the same order-of-magnitude as the 
> TZif files.


My current set of iCalendar VTIMEZONEs (using symlinks for aliases) is 
also 77kB tar+gz.



>
> All sizes are for ordinary (POSIX) tzdb, not for the rarely-used 
> leapsecond variant.
>
> _______________________________________________
> Tzdist-bis mailing list
> Tzdist-bis@ietf.org
> https://www.ietf.org/mailman/listinfo/tzdist-bis

-- 
Ken Murchison
Cyrus Development Team
Fastmail US LLC