Re: [rfc-i] 3rd party SDO cross-referencing of IETF work (was: Re: Chair/datatracker tracking expired WG documents ?)

Brian E Carpenter <brian.e.carpenter@gmail.com> Mon, 28 March 2022 21:23 UTC

Return-Path: <rfc-interest-bounces@rfc-editor.org>
X-Original-To: ietfarch-rfc-interest-archive@ietfa.amsl.com
Delivered-To: ietfarch-rfc-interest-archive@ietfa.amsl.com
Received: from ietfa.amsl.com (localhost [IPv6:::1]) by ietfa.amsl.com (Postfix) with ESMTP id 8C7853A1972 for <ietfarch-rfc-interest-archive@ietfa.amsl.com>; Mon, 28 Mar 2022 14:23:51 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1648502631; bh=2prvd9OLvospYUpJjR6ufy5ER4EvF8VtK5AjSlHhvxk=; h=To:References:From:Date:In-Reply-To:Subject:List-Id: List-Unsubscribe:List-Archive:List-Post:List-Help:List-Subscribe: Cc; b=Cbi4qNHDn1t7W5R0k6TIpqcQPB3VyTx30ZRUNc42NdZAttJogerYeU7gTBNG1VC2l mgIs8vyNqDZn97z33Bl8N1p4yJgyLZ+zdYEbN69Q6etDMmPiretedbT02Li344yljk ujyjcBSsCRPBmwSpnLd6Z8IkXV+MOOVudrErJjPY=
X-Mailbox-Line: From rfc-interest-bounces@rfc-editor.org Mon Mar 28 14:23:49 2022
Received: from ietfa.amsl.com (localhost [IPv6:::1]) by ietfa.amsl.com (Postfix) with ESMTP id 967973A1978; Mon, 28 Mar 2022 14:23:49 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1648502629; bh=2prvd9OLvospYUpJjR6ufy5ER4EvF8VtK5AjSlHhvxk=; h=To:References:From:Date:In-Reply-To:Subject:List-Id: List-Unsubscribe:List-Archive:List-Post:List-Help:List-Subscribe: Cc; b=t6183vSy/VDBhzr+/+ETvGIrUe9+kqHJgKne/6ZvnGxmiZkNCunAdTiCZyQXYcftR 5Znp97VUTIR4LHIb94SU1GDyKlh+BYMkrYf0rZq9EMyYwIzAajzJIZeoz9vQfCXxjv G0xPVyWs+VBAHUJIqQxAHSFLk5ixQRhzvKxd8r4A=
X-Original-To: rfc-interest@ietfa.amsl.com
Delivered-To: rfc-interest@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7986C3A1981 for <rfc-interest@ietfa.amsl.com>; Mon, 28 Mar 2022 14:23:47 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.108
X-Spam-Level:
X-Spam-Status: No, score=-2.108 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, NICE_REPLY_A=-0.001, RCVD_IN_DNSWL_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id myRPmK39TlLt for <rfc-interest@ietfa.amsl.com>; Mon, 28 Mar 2022 14:23:41 -0700 (PDT)
Received: from mail-pj1-x102b.google.com (mail-pj1-x102b.google.com [IPv6:2607:f8b0:4864:20::102b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A85663A1979 for <rfc-interest@rfc-editor.org>; Mon, 28 Mar 2022 14:23:41 -0700 (PDT)
Received: by mail-pj1-x102b.google.com with SMTP id h23-20020a17090a051700b001c9c1dd3acbso715798pjh.3 for <rfc-interest@rfc-editor.org>; Mon, 28 Mar 2022 14:23:41 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=+du/U31a+LWlQCvu0OlBsL0Ii5tedfCOcGP+fjL5ra8=; b=DgOwL9qyUk+xBfYwguVfVjNS/M1ePn08KkhAllXbVDUQ3Avev2As8Q8ao/WQu4oP0v HF3c6Si+3rBVoamnrTcVH2jkVnTFKtD+Yepqe/XZMamx2GmU3z1KJktWTiKSvV6R0Zxn 5RuYxET/ldnc0Ih1nYjXGpbgxXvdtuO7lcy7MOkscKay1mpUSc8vh7tBrKj3BDW7ejVM KBW0cXAxz46TT7X3JPSXBMKIosYvikOG+Lncup21+97+t53jOJI/oIytixWXx6asJWBB nuhuL61+MZUmpJcHGMQvj7sc2+kUqiPdeHVEDZre23j7Z6BfLC4laqwm8wIzaR1MNWHR FNbw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=+du/U31a+LWlQCvu0OlBsL0Ii5tedfCOcGP+fjL5ra8=; b=j4eOLnzNpCyY4FYxxU00pvuT1IIeH8OCXZU3Mlcz1rBet7J8NFk/rC5c6qvsalQGPK +GZP8xdazvKRwwfdxatf4lWTWbHaX3TC4nKI6xRnJqnItXXM3XLgbIyXIlKTmvPPyh/q 1/Teh4k3HcHYCn+PORODroFhDnmhCKCyWJzXcUehHIvvULFu5k5/6YMPdZXGzK9NyHEn qM+mz84dmutExG6otmHA6WYodXJvmQyAXQFeUiwlKzglLnyW5CrYkHLL+aJJ9V2VnMWA ogK0BIaDy7ECb/60p+z8wiojXNjDBJ5mUoRtNq9D4RVLjvEarex2S/RHfmcMkIeXIpE4 NHdw==
X-Gm-Message-State: AOAM532AnTr3n7O2QUGaMZKcw7ov1NKNMqoiYmYzrVJKYMqBj9qrnU+H 0QQRlAynVWZXh8pWdhlYhFgVX1FASYitJA==
X-Google-Smtp-Source: ABdhPJx08qCEdkGocuKfqFN96vkVetgMH7bHJyf9Ds/yAbWx2AGlF5ppHt1xq6wnmp5ayov7MzAW+A==
X-Received: by 2002:a17:90b:4c92:b0:1c7:a9a3:6274 with SMTP id my18-20020a17090b4c9200b001c7a9a36274mr1083971pjb.148.1648502620396; Mon, 28 Mar 2022 14:23:40 -0700 (PDT)
Received: from ?IPv6:2406:e003:1005:b501:80b2:5c79:2266:e431? ([2406:e003:1005:b501:80b2:5c79:2266:e431]) by smtp.gmail.com with ESMTPSA id k22-20020aa788d6000000b004faaf897064sm16868721pff.106.2022.03.28.14.23.37 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 28 Mar 2022 14:23:39 -0700 (PDT)
To: "Pascal Thubert (pthubert)" <pthubert@cisco.com>, Eric Rescorla <ekr@rtfm.com>, Joel Halpern Direct <jmh.direct@joelhalpern.com>
References: <Yj2d4DJMFWJOxoZa@faui48e.informatik.uni-erlangen.de> <317196df-3363-36c9-2421-02d9e229f664@joelhalpern.com> <CO1PR11MB488130CFF42A9F309AE1E212D81A9@CO1PR11MB4881.namprd11.prod.outlook.com> <95b5dab0-3eb5-536d-85fc-d428f26364ed@joelhalpern.com> <CABcZeBOSMRffY6cXjwn7A6d=JWDJmmBrgHxiPD-XRMTMazOjLw@mail.gmail.com> <CO1PR11MB48812B0C5B88C190FB4A28ECD81D9@CO1PR11MB4881.namprd11.prod.outlook.com>
From: Brian E Carpenter <brian.e.carpenter@gmail.com>
Message-ID: <7042bc99-5d14-993c-198b-1080b4ff5636@gmail.com>
Date: Tue, 29 Mar 2022 10:23:35 +1300
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0
MIME-Version: 1.0
In-Reply-To: <CO1PR11MB48812B0C5B88C190FB4A28ECD81D9@CO1PR11MB4881.namprd11.prod.outlook.com>
Content-Language: en-US
Archived-At: <https://mailarchive.ietf.org/arch/msg/rfc-interest/hpjodsdpjQ0IZ8PKpW2qC5k01xc>
Subject: Re: [rfc-i] 3rd party SDO cross-referencing of IETF work (was: Re: Chair/datatracker tracking expired WG documents ?)
X-BeenThere: rfc-interest@rfc-editor.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "A list for discussion of the RFC series and RFC Editor functions." <rfc-interest.rfc-editor.org>
List-Unsubscribe: <https://mailman.rfc-editor.org/mailman/options/rfc-interest>, <mailto:rfc-interest-request@rfc-editor.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rfc-interest/>
List-Post: <mailto:rfc-interest@rfc-editor.org>
List-Help: <mailto:rfc-interest-request@rfc-editor.org?subject=help>
List-Subscribe: <https://mailman.rfc-editor.org/mailman/listinfo/rfc-interest>, <mailto:rfc-interest-request@rfc-editor.org?subject=subscribe>
Cc: "wgchairs@ietf.org" <wgchairs@ietf.org>, "rfc-interest@rfc-editor.org" <rfc-interest@rfc-editor.org>
Content-Transfer-Encoding: base64
Content-Type: text/plain; charset="utf-8"; Format="flowed"
Errors-To: rfc-interest-bounces@rfc-editor.org
Sender: "rfc-interest" <rfc-interest-bounces@rfc-editor.org>

Pascal,

On 28-Mar-22 18:35, Pascal Thubert (pthubert) wrote:
> Hello Eric,
> 
> The initial question was about referencing I-Ds and that focus seems now lost.
> 
> If I may return to subject: The issue is with RFC 3160 that says:
> 
>        An Internet Draft is NOT a means of "publishing" a specification;
>        specifications are published through the RFC mechanism ...
>        Internet Drafts have no formal status, and are subject to change
>        or removal at any time.  Under no circumstances should an Internet
>        Draft be referenced by any paper, report, or Request-for-Proposal,
>        nor should a vendor claim compliance with an Internet Draft.
> 
> Many people outside the IETF read this literally. Never reference an I-D. Though we do reference I-Ds in our own RFCs. This is inconsistent.

We cite them as "work in progress" and as informative references, in accordance with RFC 2026, which is the actual origin of the above text. In RFC 2026 it is immediately followed by the "work in progress" exception, so 
there is no real inconsistency. (Though for the full story one should also consult BCP97.)

Also, RFC 3160 was obsoleted by RFC 4677 which was obsoleted by RFC 6722. 
The valid Tao is now https://www.ietf.org/tao.html. If you think the Tao should also mention the "work in progress" exception, write to tao-discuss@ietf.org.

> 
> The ask is that we reword RFC 3160 to say something like : “ANY 
normative document inside or outside the IETF MAY reference non-normatively an I-D but MUST NOT reference an I-D normatively.”

(We don't use normative language in the Tao.)

> I fail to see why non-normative document should be barred to reference I-Ds. Many times they do and we have no control nor say on that. We make it possible by retaining the drafts on the datatracker.

This is not forbidden at all. In fact, non-normative references to I-Ds are allowed in normative documents too.

> Sometimes someone raises the issue with the status of I-Ds and we get into endless discussions, I faced that again recently at ETSI.

Don't people *read* the status section of such I-Ds? It is perfectly explicit. I really can't see anything unclear in 'It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work 
in progress."' Why is that hard to understand?

    Brian

> 
> What so you think?
> 
> Pascal
> 
> *From:* Eric Rescorla <ekr@rtfm.com>
> *Sent:* vendredi 25 mars 2022 18:23
> *To:* Joel Halpern Direct <jmh.direct@joelhalpern.com>
> *Cc:* Pascal Thubert (pthubert) <pthubert@cisco.com>om>; wgchairs@ietf.org; rfc-interest@rfc-editor.org
> *Subject:* Re: [rfc-i] 3rd party SDO cross-referencing of IETF work (was: Re: Chair/datatracker tracking expired WG documents ?)
> 
> I agree with Joel. This will necessarily be incomplete (I suspect very incomplete).
> 
> If we were to do anything here it would be to ask if there was some action we could take to get Google Scholar or the like to accurately detect this case and note it.
> 
> -Ekr
> 
> On Fri, Mar 25, 2022 at 6:42 AM Joel Halpern Direct <jmh.direct@joelhalpern.com <mailto:jmh.direct@joelhalpern.com>> wrote:
> 
>     I consider that tracking in-pointing references is not a task we want to
>     take on.
>     Unless you are running something like ResearchGate, it is almost
>     impossible to get right and current.
> 
>     Making sure other folks point to the right thing is not something we can
>     do.  Heck, the bigger issue of getting folks to make changes when we
>     obsolete RFCs is outside our ability.
> 
>     Yours,
>     Joel
> 
>     On 3/25/2022 8:56 AM, Pascal Thubert (pthubert) wrote:
>     > Hello Joel
>     > 
>     > You got the proposal wrong.
>     > 
>     > The proposal was:
>     > 
>     > ANY standard in or out IETF MAY reference non-normatively an I-D but MUST NOT reference them normatively. Non-IETF standards SHOULD register their use of I-Ds, be it to be informed if the draft becomes RFC so they can decide when and how to append their standard.
>     > 
>     > This seems fully compatible with your words below, so I see that we are in fact in agreement. Do I miss something?
>     > 
>     > Pascal
>     > 
>     >> -----Original Message-----
>     >> From: Joel M. Halpern <jmh@joelhalpern.com <mailto:jmh@joelhalpern.com>>
>     >> Sent: vendredi 25 mars 2022 12:02
>     >> To: 'Toerless Eckert' <tte@cs.fau.de <mailto:tte@cs.fau.de>>; Pascal Thubert (pthubert)
>     >> <pthubert@cisco.com <mailto:pthubert@cisco.com>>
>     >> Cc: wgchairs@ietf.org <mailto:wgchairs@ietf.org>; rfc-interest@rfc-editor.org <mailto:rfc-interest@rfc-editor.org>
>     >> Subject: Re: 3rd party SDO cross-referencing of IETF work (was: Re:
>     >> Chair/datatracker tracking expired WG documents ?)
>     >>
>     >> You have missed the big problem.
>     >>
>     >> There is a reason that having external standards normatively reference I-Ds
>     >> is difficult / problematic.  (And I hav edone it even though it is against
>     >> the rules.) There may well be significant, even incompatible changes between
>     >> even a late stage I-D and an RFC.  An external reference relying on the I-D
>     >> would be incorrect.  And it is not enough to just say "well 
they should write
>     >> it so as to reference whatever the I-D becomes, since they would 
need to look
>     >> at the changes to see if they were wanted.
>     >>
>     >> Yours,
>     >> Joel
>     >>
>     >> On 3/25/2022 6:48 AM, 'Toerless Eckert' wrote:
>     >>> Added rfc-interest. Not sure this is ideal set of lists, but hopefully
>     >>> better
>     >>>
>     >>> I think i have a proposal that would not only solve (i hope) what
>     >>> Pascal is concerned about, but would also be (IMHO) very useful 
for the RFC
>     >> series:
>     >>>
>     >>> How about we do crearte on datatracker a mechanism to officially
>     >>> register a third-party reference to a particular IETF document. 
Draft or
>     >> RFC.
>     >>>
>     >>> Everybody who writes an external document could create such a third-party
>     >> reference.
>     >>> We'd have to discuss access control if its abused.
>     >>>
>     >>> The one benefit (which i was interested in) would be that we would
>     >>> finally start getting some inight if/where our documents are being
>     >>> used elsewhere in the industry. Especially given how a lot of industry
>     >>> bodies  work with closed documents, it is completely impossible to
>     >>> just scrape the Internet to find uses (as its "kinda" done in the
>     >>> research world). Especially now that we're trying to reach out to more
>     >>> external SDO in IoT, Media operations or other industrial verticals,
>     >> something like this would hopefully be timely.
>     >>>
>     >>> The other benefit would be that whoever creates the reference would
>     >>> (automatically) get status updates about the document. So the foreign
>     >>> SDO document editor or manager could use this to track the IETF 
reference
>     >> and status.
>     >>>
>     >>> Depending on what we put into such "foreign reference" (to be filled
>     >>> out when it's created/updated), we would likely be able to satisfy more
>     >> work-flows.
>     >>>
>     >>> Cheers
>     >>>       Toerless
>     >>>
>     >>> On Fri, Mar 25, 2022 at 10:28:20AM +0000, Pascal Thubert (pthubert) wrote:
>     >>>> Along the same line (though a different problem that we'd need 
to fork as
>     >> a separate thread) is our wording for IETF references.
>     >>>> At the moment we indicate that external specs (think say IEEE) 
must not
>     >> reference drafts. But when the draft stalls before RFC, this makes the
>     >> reference completely unusable. Makes no sense to me, and hardly reflected in
>     >> practice. A better practice would be how we eat our own dogfood, 
which is
>     >> that a draft must not be a normative reference when standard X is published,
>     >> whether by IETF or else.
>     >>>>
>     >>>> Interested in following that up too? If so please fork.
>     >>>>
>     >>>> Note: this can effectively hurt. Within the last year or 2, I faced that
>     >> issue with both IEEE and ETSI. At ETSI it was mostly theoretical 
and we kinda
>     >> forced our way to reference I-drafts arguing that the doc we are 
writing is
>     >> not a standard. OTOH, at IEEE that was harder. We had text in 802.11md about
>     >> the proxy ARP function and the fact that there's also IPv6 to care about.
>     >> Incidentally, the text cited a draft in progress for the proxy ND operation
>     >> (now RFC 8929) as an informational reference (all non-IEEE references are
>     >> informational). At the last minute, the whole change was removed 
from .11md
>     >> on the grounds that the I-D reference was not RFC, and the text was frozen
>     >> for publication. At that time, the I-draft had been waiting for its turn in
>     >> the RFC Editor queue for months. The RFC was pulled from the RFC 
editor queue
>     >> and published within weeks after the freeze. I discovered the .11 removal
>     >> only later, appealed, but the freeze is immutable.
>     >>>>
>     >>>> Keep safe;
>     >>>>
>     >>>> Pascal
>     >>>>
>     >>>>> -----Original Message-----
>     >>>>> From: WGChairs <wgchairs-bounces@ietf.org <mailto:wgchairs-bounces@ietf.org>> On Behalf Of Henk
>     >>>>> Birkholz
>     >>>>> Sent: vendredi 25 mars 2022 10:40
>     >>>>> To: Valery Smyslov <valery@smyslov.net <mailto:valery@smyslov.net>>; 'Toerless Eckert'
>     >>>>> <tte@cs.fau.de <mailto:tte@cs.fau.de>>; 'Tools Team Discussion' <tools-discuss@ietf.org <mailto:tools-discuss@ietf.org>>;
>     >>>>> wgchairs@ietf.org <mailto:wgchairs@ietf.org>
>     >>>>> Subject: Re: Chair/datatracker tracking expired WG documents ?
>     >>>>>
>     >>>>> Coincidentally, I was expressing the expressing the exact same
>     >>>>> sentiment in a side-discussion two days ago. I'd really appreciate
>     >>>>> that feature, both as a chair and a contributor.
>     >>>>>
>     >>>>> On 25.03.22 09:04, Valery Smyslov wrote:
>     >>>>>> Hi,
>     >>>>>>
>     >>>>>>> Is there a way for datatracker on a WG's page to (automatically)
>     >>>>>>> show
>     >>>>> expired WG documents ?
>     >>>>>>>
>     >>>>>>> I have one such draft in my WG and it wouldn't show up on the WG
>     >>>>> page.
>     >>>>>>> Of course, in general one may not want to bother about expired
>     >>>>>>> drafts unless explicitly added, but for WG document IMHO, it would
>     >>>>>>> be great if they would automatically show up in in the WG section
>     >>>>>>> unless their status is maybe accordingly updated or the like
>     >>>>>>
>     >>>>>> I also think this feature would be useful, because now the expired
>     >>>>>> WG document is not shown at all at the WG page and it's sometimes
>     >>>>>> difficult to find it (you need to remember the name).
>     >>>>>>
>     >>>>>> Regards,
>     >>>>>> Valery.
>     >>>>>>
>     >>>>>>> Thanks
>     >>>>>>>        Toerless
>     >>>>>>
>     >>>>>>
>     >>>>
>     >>>
> 
>     _______________________________________________
>     rfc-interest mailing list
>     rfc-interest@rfc-editor.org <mailto:rfc-interest@rfc-editor.org>
>     https://mailman.rfc-editor.org/mailman/listinfo/rfc-interest <https://mailman.rfc-editor.org/mailman/listinfo/rfc-interest>
> 
> 
> _______________________________________________
> rfc-interest mailing list
> rfc-interest@rfc-editor.org
> https://mailman.rfc-editor.org/mailman/listinfo/rfc-interest
> 

_______________________________________________
rfc-interest mailing list
rfc-interest@rfc-editor.org
https://mailman.rfc-editor.org/mailman/listinfo/rfc-interest