Re: [Tools-discuss] A major restructure to the datatracker database will be deployed soon

Robert Sparks <rjsparks@nostrum.com> Mon, 27 November 2023 14:49 UTC

Return-Path: <rjsparks@nostrum.com>
X-Original-To: tools-discuss@ietfa.amsl.com
Delivered-To: tools-discuss@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 930BBC151089 for <tools-discuss@ietfa.amsl.com>; Mon, 27 Nov 2023 06:49:19 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.087
X-Spam-Level:
X-Spam-Status: No, score=-7.087 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, T_SCC_BODY_TEXT_LINE=-0.01, T_SPF_HELO_PERMERROR=0.01, T_SPF_PERMERROR=0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nostrum.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Y0mO74pweFkp for <tools-discuss@ietfa.amsl.com>; Mon, 27 Nov 2023 06:49:15 -0800 (PST)
Received: from nostrum.com (raven-v6.nostrum.com [IPv6:2001:470:d:1130::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DED2BC151081 for <tools-discuss@ietf.org>; Mon, 27 Nov 2023 06:49:15 -0800 (PST)
Received: from [192.168.1.102] ([47.186.48.51]) (authenticated bits=0) by nostrum.com (8.17.2/8.17.1) with ESMTPSA id 3AREnUrL004653 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Mon, 27 Nov 2023 08:49:31 -0600 (CST) (envelope-from rjsparks@nostrum.com)
DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=nostrum.com; s=default; t=1701096571; bh=pdbnEGNx9Je7J8kzMYXo2ki+alAaA+wsEV38HC54TpU=; h=Date:Subject:To:References:From:In-Reply-To; b=skD3LLuEFKZ4dkVxe4IrzLaUZbOtHAnb8NQijFKeZ467hfYX0nOfBDQjLtWD8SEq7 4xYVIK1QLmEaHjSzEatMT7AbTQ+DiHz+hFhsrmObnFrwr19aqHvKbjabo4+9ibB08u 5l6pyoo8Ill0HuwzV34GH+wFIKJbh0GXNoe1g7OA=
X-Authentication-Warning: raven.nostrum.com: Host [47.186.48.51] claimed to be [192.168.1.102]
Message-ID: <64bd5368-3166-48c3-af4b-2ac8be01aa25@nostrum.com>
Date: Mon, 27 Nov 2023 08:49:07 -0600
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Content-Language: en-US
To: John C Klensin <john-ietf@jck.com>, tools-discuss <tools-discuss@ietf.org>
References: <c7d5236e-4c57-41d4-aaae-226c40756b34@nostrum.com> <08987514D56CA271AA033930@PSB>
From: Robert Sparks <rjsparks@nostrum.com>
Autocrypt: addr=rjsparks@nostrum.com; keydata= xsDNBFx4PQwBDADIIJqFKIeYNmVR3iH8YnNqwApV+ci83VqFaPg0UXZAZ1utH/2O2LOLJKmV Ol11+lOSfH4OJgpARt37PWbqfG2TzzGfEucRBPMAV8TEDmzKL+7/OUMLEoPeexgxz6ADxK2Q ACKKzHhF30y4fx2fn9rYZrCvYHV9HDKcfFotNLna0U6P6wu70L0mT2hcjQgZ7+8HSZCpK2XG PTya1mEiMklH6+UHfcTLoAxd3chQiseRi19/TQZZCD3LuuaGFWyTIeF9ZNWV9yL0HQeb/XMs tmZnObSSHSUbZwn5PR9Uf+3iW7jdG5JuXBvNbDpAHfLyPXRqxErM/nCLrbwGB6AgNSKFCwkL lb3uxsGFWcOt6sedrjixoVUO2k4zQWVnCUCwFHGrgIxUK24dI8oqydGPctXAKj5VqoCVJBv6 4JxSpiR+V8fl3A8gksBUnuIMLNlRjB5RAgZaSUpaOkXsWUBA8Z75wQWoIzkJIeMm29w2l1kB B9kGMdyiXGr2JV8VQZ4lAscAEQEAAc0kUm9iZXJ0IFNwYXJrcyA8cmpzcGFya3NAbm9zdHJ1 bS5jb20+wsEUBBMBCAA+FiEEGNywdGDCHUYBwWN3bipqV3X5ExgFAlx4PQwCGwMFCQlmAYAF CwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQbipqV3X5ExiaZgv/Y3sqxlspxro19QTSwyDY aB3V2y7TVqiDieymgSIVL4QHwLunsyHDxOq6K9DKQUzEfsNk2KNeUWcpsbuSVaKDYiJ/xHXc n7t/MyevnJVRLZGG334RmmeYMs8PeFvA/OecCmgPSm0lioSobzprcy6R6Z5DeNoJWXARbuf6 QPPt844eMEwwQOvpnh98pWFtEut9WSXzK54wLEambs8ftUrSLTAW6vW9rwqyF+fx4PpsWcgm WbFrMSE3NYuYt8biRICZMehElPaHgrXkX4s6qfl7pkNyeXWrF7SkjBNDX+5atgxi5AoR5SQ2 3m0wcvl504IsLlndFAXrQdRLICaUyVZ3FrwbGvaqJ5yh9VUz9iH31KpuqpicuE2jjghggTHf v2l5FlHyPnwhaKTIlYnNwpoX17VVRU7hIM2zROaBjLGz8Zrr1JDfduImgecoXorQDNtPVwOB GdySIhdwU7sohMZt03q99RxATd7pDaOf8dWCJ6ofxR0ciPoGvUO7ghi/A4oRzsDNBFx4PQwB DAC03e1kk41e9Z9FuVW8UKWIkVUBeH3gfJMsb94d/c0cqBMRw5rulSY7+U76rw4AXo792LZn ydjDfoL0GQxGqkrZh397Sn9P/sLCb5I+wC14251nkmh5tmU2sQqCk+g9nykcE/NJft/zFkeb HHCKAosK6glO+W0YPHc/k7nXt/fLz7dMRpFpmqFXWjeN2VtwKr9znMg9+iX6XfgAJPMdDNH8 fn30Cp5TIsn5WCI70+JztgvfjFhD15Eb3rtDdOfOydjGCV2ZVxfM8ECmc8Z3DrThyiC2M3uo 2Y50rs6MH+TmVCtpHkISnH7B+80Vy2SC60K9l2xgCaezN1SlkQy3ZpprzcDrNTI8FcJa/UUM ayMGvSDGEGuHZRaNUyXP3jQ8oss+067axmNr5vgjpf01kmE1RJtiGEDWmCr8u1SbVQjdax6C pDqq3RKoX2ZVGLtkdDYZbsqSq4TgmFukoijWRbLxsFBdeEgruTViWRw4PKZav0piLxrhHUGI m6F6JFngapUAEQEAAcLA/AQYAQgAJhYhBBjcsHRgwh1GAcFjd24qald1+RMYBQJceD0MAhsM BQkJZgGAAAoJEG4qald1+RMYcP8L/RZIVADCvt4/sN64U7VJ+21BiGJiLmHjjwdWZi0DwBal xMNGUv7H7t4cr9e138CLLrlBPK5su7OB+i3ZId9nLlEX3uBNP8XYEyvku1h5MqPvkZSv6N1b tRfKoWFKTS0Dm6Ssya5H/KswscCshupJ/nKYdzHJgO968E8wq5Lchh1D8KNGVC23v5Ta91HN M6aaD957snoesEAGIu0QY98TROJo6gY/9CZputa5RuLWQoNY6Sr5ybr6TfPrh0JCXrKd00on 5lzt+momPp42TyHUXCVlppa6qaTVe8CBlIONpJIgD0Cmlqv6Pn6kiVUSGbExj/SXIf0qDf0r hFWt44UdE4tTp4U7aBhvgUe29sSlnEbvWwZrXLzznxwxB4KxXF8m9H410jDlM4iyeKXLMa+J WVzB01Jl0W34myhm9vaJ6oEkc/A3XzP4gZ4Xfzu01BJ3x5rlOLdV5rV6pZlzc6jrWN12Wfwg xX+wtDKpXcbZknc00d9bwEu+w24vvlci5G5C6g==
In-Reply-To: <08987514D56CA271AA033930@PSB>
Content-Type: text/plain; charset="UTF-8"; format="flowed"
Content-Transfer-Encoding: 8bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/tools-discuss/0uAheV4g7CEXT9YoI8BclZ1CBBs>
Subject: Re: [Tools-discuss] A major restructure to the datatracker database will be deployed soon
X-BeenThere: tools-discuss@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IETF Tools Discussion <tools-discuss.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tools-discuss>, <mailto:tools-discuss-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tools-discuss/>
List-Post: <mailto:tools-discuss@ietf.org>
List-Help: <mailto:tools-discuss-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-discuss>, <mailto:tools-discuss-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 27 Nov 2023 14:49:19 -0000

On 11/20/23 9:41 PM, John C Klensin wrote:
> Robert,
>
> Tiny apparent glitch with a link that leads to itself.
>
> Example:
>
> Look up RFC5321.  Everything looks fine except there is a "Was"
> entry listing draft-klensin-rfc2821bis.  That is correct, except
> it is a link leading to
> <https://dt-rfc.dev.ietf.org/doc/draft-klensin-rfc2821bis/11/>.
> And that immediately redirect to
> <https://dt-rfc.dev.ietf.org/doc/rfc5321/>, which is where I
> started.   Confusing and time-wasting at best.

Captured at #6699

This is actually an issue with older documents not having correctly 
populated DocHistory. While we'll make an immediate change to more 
closely follow what the datatracker main branch currently does,  we will 
be addressing better using the data we _do_ have with the cluster of 
issues similar to #6059

>
> Based on a small sample, the problem is not unique to that
> document.
No, but it isn't _all_ documents.
>
> Comment (I don't know if this is a Tools issue or an RSWG one,
> but let's start here): Since before there was a datatracker,
> before there were streams, and, indeed, before there was an
> IETF, the authoritative source of information about RFCs has
> been the RFC Editor, including their web site since that web
> site was established.  This revision and interface seems to take
> us much closer to the datatracker being the authoritative source
> or, perhaps, a redundant authoritative source (almost
> universally considered a bad idea among those with database
> management expertise).  If that is not your intention, it seems
> to me that the display pages could use some disclaimers.  If it
> is, it seems to be to be a strategic change, not just a tooling
> one.

I am aware of the concern you point to. I disagree that this increases 
the potential confusion for what's authoritative beyond what the 
datatracker currently displays. The model changes will make it _easier_ 
to build UI that steers people to the right places as the datatracker 
and the rfc-editor website evolve. The RPC and the RSCE are steering 
that evolution already.

>
>     john
>
>
> --On Monday, November 20, 2023 17:04 -0600 Robert Sparks
> <rjsparks@nostrum.com> wrote:
>
>> We've been working for several months on making RFCs
>> first-class objects in the datatracker instead of modeling
>> them as an artificial version of a draft.
>>
>> This change lets us simplify some code and query constructs
>> (*), resulting in quicker datatracker response, and makes it
>> possible to start modeling the subseries, such as BCP and STD.
>>
>> Most views won't change, but a few change significantly. The
>> history view for documents splits the history of the RFC and
>> the history of the draft into separate tabs. A few things
>> (like internal-to-the-ietf metadata for the processing of the
>> draft) won't be visible when looking at the RFC - you'll have
>> to browse to the linked draft to see that.
>>
>> We're in the last stages of preparing to release this, and
>> expect to have it in production two to three weeks from now.
>>
>> Please take some time to look at the development instance at
>>
>> https://dt-rfc.dev.ietf.org
>>
>> and watch for things that don't seem right. Raise any issues
>> you find by mail to tool-discuss or opening a github issue -
>> please mention that you're looking at dt-rfc in the issue
>> description so we know it's a issue with that branch and not
>> main.
>>
>> RjS
>>
>> * For those using the v1 API - this change removes the
>> DocAlias model, and adds a RelatedDocument object of type
>> "became_rfc" between the Document of type "draft" and the
>> related document of type "rfc".  Note in particular that the
>> RelatedDocument model changes such that target points to
>> Document objects and not DocAlias objects. See the changes to
>> the model files at
>> https://github.com/ietf-tools/datatracker/compare/main...feat/
>> rfc for details.
>>
>>
>> ___________________________________________________________
>> Tools-discuss mailing list - Tools-discuss@ietf.org -
>> https://www.ietf.org/mailman/listinfo/tools-discuss
>
> ___________________________________________________________
> Tools-discuss mailing list - Tools-discuss@ietf.org - https://www.ietf.org/mailman/listinfo/tools-discuss