Re: [Tzdist] [tzdist] #32 (service): managing historical data

Lester Caine <lester@lsces.co.uk> Fri, 24 October 2014 17:14 UTC

Return-Path: <lester@lsces.co.uk>
X-Original-To: tzdist@ietfa.amsl.com
Delivered-To: tzdist@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E63E21A8726 for <tzdist@ietfa.amsl.com>; Fri, 24 Oct 2014 10:14:07 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level:
X-Spam-Status: No, score=-1.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id mAkcqc9dVwDo for <tzdist@ietfa.amsl.com>; Fri, 24 Oct 2014 10:14:05 -0700 (PDT)
Received: from mail4.serversure.net (mail4-2.serversure.net [217.147.176.214]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DACDD1A871E for <tzdist@ietf.org>; Fri, 24 Oct 2014 10:14:04 -0700 (PDT)
Received: (qmail 3466 invoked by uid 89); 24 Oct 2014 17:14:03 -0000
Received: by simscan 1.3.1 ppid: 3455, pid: 3463, t: 1.3028s scanners: attach: 1.3.1 clamav: 0.96/m:52/d:10677
Received: from unknown (HELO ?10.0.0.8?) (lester@rainbowdigitalmedia.org.uk@86.163.78.127) by mail4.serversure.net with ESMTPA; 24 Oct 2014 17:14:01 -0000
Message-ID: <544A88D8.7010108@lsces.co.uk>
Date: Fri, 24 Oct 2014 18:14:00 +0100
From: Lester Caine <lester@lsces.co.uk>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.1.0
MIME-Version: 1.0
To: tzdist@ietf.org
References: <059.5da79d7c9d394e20e3c22513cfe04c33@tools.ietf.org> <074.141a9388d35dbdf392fcdf7384321e4e@tools.ietf.org>
In-Reply-To: <074.141a9388d35dbdf392fcdf7384321e4e@tools.ietf.org>
Content-Type: text/plain; charset="windows-1252"
Content-Transfer-Encoding: 7bit
Archived-At: http://mailarchive.ietf.org/arch/msg/tzdist/6DB2J6NpenA5b4yis-rk0r-YEGg
Subject: Re: [Tzdist] [tzdist] #32 (service): managing historical data
X-BeenThere: tzdist@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <tzdist.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tzdist>, <mailto:tzdist-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tzdist/>
List-Post: <mailto:tzdist@ietf.org>
List-Help: <mailto:tzdist-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tzdist>, <mailto:tzdist-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 24 Oct 2014 17:14:08 -0000

On 24/10/14 17:13, tzdist issue tracker wrote:
>  Looking for elaboration from Lester on this point, as well as whether it
>  needs into a base spec.

The current problem with maintaining historic data is that while most
sources of TZ are reasonably similar, there is a lack of clarity at
times as to just which version of data is being used. In order to review
legacy material it has at times been necessary to reverse engineer the
correct view of the data used. Which is one of the reasons I've been
building a selectable database of tz data. UTC normalized data has been
in use for some time, but exact local time it was normalize from may be
difficult to establish.

Once a more reliable source of data is available it should be easier to
maintain this type of material going forward, but it is essential that
having used a current version of the tz data it is possible to recall
the same view of the data in order to work with the same local offsets
that the data was created with.

Since there are only ever perhaps 1 update per month, there are only a
small number of versions of data to keep track off, and on the whole the
majority of TZ records never change, so only a small set of differences
need to be managed. Adding a version field to the url structure solves
the problem, and would allow material being processed to be tagged with
the appropriate data version.

I would probably view this as optional, EXCEPT that if one takes the
situation of a simple device which is also creating a log of it's data
now correctly using UTC timestamps, it also needs to log any change in
version of data set used while creating that log. To that end even a
simple device only perhaps using 'expand' to obtain its local time data
needs to be able to provide a monitoring site with the correct set of TZ
data with which to view the file. Encoding TZ data into the timestamp
simply does not work, a separate cleanly defined TZ id is essential,
especially when one starts looking at a mobile device moving between
timezones.

( I'll rework the other thread about 'generic' TZ datasets in order to
hopefully explain that side of the problem better, although I did think
it was already pretty good )

-- 
Lester Caine - G8HFL
-----------------------------
Contact - http://lsces.co.uk/wiki/?page=contact
L.S.Caine Electronic Services - http://lsces.co.uk
EnquirySolve - http://enquirysolve.com/
Model Engineers Digital Workshop - http://medw.co.uk
Rainbow Digital Media - http://rainbowdigitalmedia.co.uk