Re: [Tzdist-bis] [calsify] tzdist and IANA -- estimating the operational parameters

Steve Crocker <steve@shinkuro.com> Thu, 18 July 2019 20:30 UTC

Return-Path: <steve@shinkuro.com>
X-Original-To: tzdist-bis@ietfa.amsl.com
Delivered-To: tzdist-bis@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5A72B120033 for <tzdist-bis@ietfa.amsl.com>; Thu, 18 Jul 2019 13:30:15 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.897
X-Spam-Level:
X-Spam-Status: No, score=-1.897 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=shinkuro-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id vX27gxZ3LXdk for <tzdist-bis@ietfa.amsl.com>; Thu, 18 Jul 2019 13:30:11 -0700 (PDT)
Received: from mail-qk1-x72f.google.com (mail-qk1-x72f.google.com [IPv6:2607:f8b0:4864:20::72f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3122E120074 for <tzdist-bis@ietf.org>; Thu, 18 Jul 2019 13:30:11 -0700 (PDT)
Received: by mail-qk1-x72f.google.com with SMTP id t8so21571462qkt.1 for <tzdist-bis@ietf.org>; Thu, 18 Jul 2019 13:30:11 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=shinkuro-com.20150623.gappssmtp.com; s=20150623; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=hPcucLzL7jAeZtHF/tWwmZxdoMFBWnbDvvC5FLxAh9A=; b=fXa9lqguTTIURX4Gzf6EMHz/w/zGaibSwk15JRvqX6WOCEflTePgWQOjZph2G2mxQ4 eGnSG9AyqFnnpN3iq/Dh6ia2FvA0BAaykb54Nr2ptQKiOHosc8QTsOQj/elEfB+yVx2Y bujP74t6YKMFG0Cbknl/N1TG3TY/Fh8hg5JuN5SxQfVabmtJ0qt4/Dm4RHZmF76jUM7s QDy00JutsSymbun78rPn+T6ogLh1S1sdbZZz4qyQfs5moPU6aqJEuv+MxIGwMJ+wN7gv ojs3abt6omI6+vL7wRLcnjY50I/2bwlL7lrS6uGZ21m1OCNHLHNLFhXrbolt5cFV6vSK 1qJA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=hPcucLzL7jAeZtHF/tWwmZxdoMFBWnbDvvC5FLxAh9A=; b=TzItYPiMq9T9VgrU2ftakgamqA1uuw6bYI1wB/Lofxon2CmzVgIrkVxvIJYZmDPalq dZjDhN9LoZEX6lUQSPkHhUJ/NG+xSfp2D927cN4FsqHMDjBwfb59j1WwENahsrurFF3o JEFy4EZ4AmwSfJIfMhE0ENo7E/h6j9tcntyxXZRW+gr9wgE2QtbjbCGSGlOLnLCtt6Dz 12GajbUZHGFbKeHoN+uw1fHmz1IVYuT6wewaE9dN+P+hvz6gRDLQB72WIul/tBX32kv9 FbdQKmWMHXixZ6k1kZu7dXiEYqSPu3psdjj6r/yc8/KC2U6amPn/NU67SdI+2dBVE7r8 MUlQ==
X-Gm-Message-State: APjAAAVDt0iACwixPNLUhDULERY1tdBIQslAowLQ5BkuvrELxgyB4A0k /xCgaLq5N+pOgqLHWUExpCHlVvbo
X-Google-Smtp-Source: APXvYqx5woNmxUfDec7IEV7d0WelltO6+AkB2j5zYzYVaUIP3Dw6pTAugPwTeb1IdLCD0G51aSpMqg==
X-Received: by 2002:a05:620a:1447:: with SMTP id i7mr32790725qkl.254.1563481810047; Thu, 18 Jul 2019 13:30:10 -0700 (PDT)
Received: from ?IPv6:2600:380:927c:5de8:f58d:ec9c:c9ec:1e2e? ([2600:380:927c:5de8:f58d:ec9c:c9ec:1e2e]) by smtp.gmail.com with ESMTPSA id l63sm12733713qkb.124.2019.07.18.13.30.09 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 18 Jul 2019 13:30:09 -0700 (PDT)
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (1.0)
From: Steve Crocker <steve@shinkuro.com>
X-Mailer: iPhone Mail (16F203)
In-Reply-To: <5a63c02a-5ae1-15c3-fbb5-7baba149dbfa@fastmail.com>
Date: Thu, 18 Jul 2019 16:30:08 -0400
Cc: Paul Eggert <eggert@cs.ucla.edu>, Time zone mailing list <tz@iana.org>, IETF-Calsify <calsify@ietf.org>, tzdist-bis@ietf.org, Daniel Migault <daniel.migault@ericsson.com>, Martin Burnicki <martin.burnicki@burnicki.net>, Steve Crocker <steve@shinkuro.com>
Content-Transfer-Encoding: quoted-printable
Message-Id: <F0A52F53-8E88-4AF5-969F-B334F951FC06@shinkuro.com>
References: <CADZyTkkNuenOTx77cB8vFzWaSjp_fqtEgaYd00t5e2+Kk6MtRA@mail.gmail.com> <47038bd0-210a-4dbc-173c-15bfa89ac54f@cs.ucla.edu> <6a50708d-5fac-1da9-56b3-ed1cea793752@fastmail.com> <6b1616e3-bfc0-a22a-2aa9-11033c525ff3@cs.ucla.edu> <CADZyTkms=skOgqfoDxTF6TSZBsWbfaCmfPBWCG0E9qb4-qA0Uw@mail.gmail.com> <6e243cf0-a3ff-82a1-3cae-70fbf699f1f7@gmail.com> <98A352CD-3386-49FB-B6C1-D4EC61BB79EC@cisco.com> <caf6c792-3bb0-c9ec-9ac1-1e7b7c1b6bfd@burnicki.net> <B5E14F98-5CD1-4FFE-92FF-082301BC60F2@cisco.com> <e80eea72-04fa-fe94-c7aa-3c17daedbe9d@burnicki.net> <CADZyTknTp212k7ZLFsw51r=KZcz==UGKw0Z+BWT0fVs4-cYMNw@mail.gmail.com> <CABf5zvK=KcW0YMtevmR3A01xMNbxF1nwE5ib2jj3482FFt75UA@mail.gmail.com> <118a452c-25ba-8427-4401-5465270da738@cs.ucla.edu> <5a63c02a-5ae1-15c3-fbb5-7baba149dbfa@fastmail.com>
To: Ken Murchison <murch@fastmail.com>
Archived-At: <https://mailarchive.ietf.org/arch/msg/tzdist-bis/RngyoCOswcu3Cy6qpSfK30fjXxg>
Subject: Re: [Tzdist-bis] [calsify] tzdist and IANA -- estimating the operational parameters
X-BeenThere: tzdist-bis@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Extensions to Time Zone Data Distribution Service <tzdist-bis.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tzdist-bis>, <mailto:tzdist-bis-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tzdist-bis/>
List-Post: <mailto:tzdist-bis@ietf.org>
List-Help: <mailto:tzdist-bis-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tzdist-bis>, <mailto:tzdist-bis-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Jul 2019 20:30:16 -0000

Paul and Ken,

Thanks for these estimates.

It doesn’t seem to me the legal verbiage would be part of the regular download, so that would reduce the payload a bit.

Steve

Sent from my iPhone

> On Jul 18, 2019, at 4:26 PM, Ken Murchison <murch@fastmail.com> wrote:
> 
> 
>> On 7/18/19 4:15 PM, Paul Eggert wrote:
>> Steve Crocker wrote:
>>> Early in this thread it was mentioned the the time zone database should be
>>> served in a fashion similar to DNS.  My first thought was the numbers are
>>> wildly different.  I jotted down a first cut at identifying the relevant
>>> operational parameters.  Perhaps the people proposing this service can
>>> flesh out the quantitative aspects.
>> 
>> Here are some estimates. There is no central TZDIST server now, so all the non-size estimates are for if/when that happens. The estimated rate of change for these numbers is all zero, except for the database size where I'd estimate a growth of 5%/year (this is just off the top of my head).
>> 
>> 
>> Frequency of database update: 18 times per year has been the worst case since the project started in the 1980s. Recently updates have occurred three to ten times per year.
>> 
>> Frequency of access: If we're assuming a pull model like TZDIST with primary and secondary servers, I would expect queries once every hour-or-so from each downstream server that wants to be up-to-date. Usually the response will be "nothing has changed".
>> 
>> Required response time: Most clients and servers can be expected to have a (possibly-stale) copy of the data already, which they can fall back on. So I would say "minutes".
>> 
>> Required uptime: Again, not crucial. I would say 90% would be enough.
>> 
>> 
>> For sizes, it depends on data format and whether you want all the data.
>> 
>> Size of entire tzdb database (including all time zone history, version info, and legal notices), in minimal source-code (text) form: 111 kB uncompressed, 27 kB compressed via gzip, 22 kB compressed via lzip.
>> 
>> Size of entire tzdb database in binary (TZif) form in traditional form: 456 kB uncompressed, 152 kB tar+gzip, 68 kB tar+lzip. This includes all time zone history but omits version info and legal notices.
>> 
>> Same size, but with zic's new '-b slim' option that relies on Internet RFC 8536 instead of attempting to work around bugs in older applications: 216 kB uncompressed, 77 kB tar+gzip, 43 kB tar+lzip.
>> 
>> I don't know how to compute the size of tzdb converted into iCalendar form, but my guess is that it'd be the same order-of-magnitude as the TZif files.
> 
> 
> My current set of iCalendar VTIMEZONEs (using symlinks for aliases) is also 77kB tar+gz.
> 
> 
> 
>> 
>> All sizes are for ordinary (POSIX) tzdb, not for the rarely-used leapsecond variant.
>> 
>> _______________________________________________
>> Tzdist-bis mailing list
>> Tzdist-bis@ietf.org
>> https://www.ietf.org/mailman/listinfo/tzdist-bis
> 
> -- 
> Ken Murchison
> Cyrus Development Team
> Fastmail US LLC
> 
> <murch.vcf>