Re: [TOOLS-DEVELOPMENT] Draft of inline-errata SoW

Eric Rescorla <ekr@rtfm.com> Fri, 01 February 2019 01:02 UTC

Return-Path: <ekr@rtfm.com>
X-Original-To: tools-development@ietfa.amsl.com
Delivered-To: tools-development@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BBEF1131196 for <tools-development@ietfa.amsl.com>; Thu, 31 Jan 2019 17:02:27 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.04
X-Spam-Level:
X-Spam-Status: No, score=-2.04 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.142, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=rtfm-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xbApsWDICCGK for <tools-development@ietfa.amsl.com>; Thu, 31 Jan 2019 17:02:24 -0800 (PST)
Received: from mail-lf1-x133.google.com (mail-lf1-x133.google.com [IPv6:2a00:1450:4864:20::133]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DB5FE131195 for <tools-development@ietf.org>; Thu, 31 Jan 2019 17:02:23 -0800 (PST)
Received: by mail-lf1-x133.google.com with SMTP id a16so3822697lfg.3 for <tools-development@ietf.org>; Thu, 31 Jan 2019 17:02:23 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rtfm-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=xLTOx45IUI931BlgbSSzGils32kSRgXaRAZYx4sTE1Y=; b=DKV9Rfeohs509xboeY69Uk6mame5qxWI/zbBU/eGfaXcXfIpAyqZtLYcHrlnEj3fUW KZTUmaTlhbo1Bxkdb0Vvc9yBezbyS/jLOOn/nuPZBzk5SN5hL23tBlPzb4zDHV62nw33 TDmCixE2+I2s9f9Y2XEW/cmVSZ0PMocXJNwr+3xDC9CLPn8UYsqeztSR3/Le8mR8C7z8 HpZMEOwURtx1/1OrTPgtZ8EV/Lg8GJcBAbVMd2cgiJR4aDe6Nm9GbvRXj4hXzrq9syJr pXsc99B+gwMl4v8t3s5JbLwEX7MX0+WW63YfMt5vS+75daT3FlgQGL8WrfNB28BgxyWk d79g==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=xLTOx45IUI931BlgbSSzGils32kSRgXaRAZYx4sTE1Y=; b=tQScCgPXQD0lmtXS4JSXhfHOOGxB5ArJpJ1XF2y55/DCqjc64x06w4iQnltF0kyrbs jc5cSsFuLzrGFcR2QRG+hOaRjTomwYJRWT5QZOfJbip/cQdoMJmMFX6fd/tWcNIfjYE6 NLV4Tg8SWk4tvtJjtx304kGQrklfmNUSKR5dz8TWXc4W7Oc70MiQznKm7vE2oRrf6nHc SMULkOZG1rw+3QSH5V78XUT9lQjI24Wu31cb48j5RYYwNtdGVVaW3e+4ZN8dK8bfKSu+ hRCyOnzUbaISVGDiwBoNKR3hoWf5dqaO42KKGPh7EAMQg7vwrHrphbD7rMdHT73qeOuz kCCQ==
X-Gm-Message-State: AJcUukdQWJoCVcd1GNGAsye7xmhPJjdgCVOrGdYi53chEJmDgUJ5HvpS CiaCqhrjjn6uolISzY91NLOizp2S6IwaYc1pZ5p4Qg==
X-Google-Smtp-Source: ALg8bN4aFAk6E6T5KMPvTcLJfaHhayrnm5bFCU8KI9D1EJF8wUM26o2wASknTjuEG6/YFxUN8auz2utuYmiJud+qido=
X-Received: by 2002:a19:3fcf:: with SMTP id m198mr26511993lfa.106.1548982941585; Thu, 31 Jan 2019 17:02:21 -0800 (PST)
MIME-Version: 1.0
References: <8368cd93-8148-3ebd-7504-9fee9dfc5b53@nostrum.com> <DFF29D04-35BA-46FD-862C-F8EB93B23865@amsl.com> <B2D8DAC2-63F3-4613-B032-A2CBBB0BE43A@rfc-editor.org> <CABcZeBMJUYZiQ+pBsoWjoXTPe=LD0TNh-HFhBK+xnamzg03s1w@mail.gmail.com> <DEF205B2-3846-45FE-97D1-D6DD46189646@rfc-editor.org> <CABcZeBPhjXA7VyJOLcgWMnm8Pkb5Rvj=39cx06DxFXUaAGaa9Q@mail.gmail.com> <0C991CF5-BEAD-4EB3-B8CE-1CA26711E334@rfc-editor.org>
In-Reply-To: <0C991CF5-BEAD-4EB3-B8CE-1CA26711E334@rfc-editor.org>
From: Eric Rescorla <ekr@rtfm.com>
Date: Thu, 31 Jan 2019 17:01:42 -0800
Message-ID: <CABcZeBPA9XFqkTphfgfBWjYDKNAn2c1fUU=mwPGxgz7n4V0=iQ@mail.gmail.com>
To: Heather Flanagan <rse@rfc-editor.org>
Cc: Sandy Ginoza <sginoza@amsl.com>, IETF Tools Development <tools-development@ietf.org>
Content-Type: multipart/alternative; boundary="000000000000ff373f0580cab175"
Archived-At: <https://mailarchive.ietf.org/arch/msg/tools-development/cMPGxLpOcEMJ82wtelZorA9znHE>
Subject: Re: [TOOLS-DEVELOPMENT] Draft of inline-errata SoW
X-BeenThere: tools-development@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Tools Development list server <tools-development.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tools-development>, <mailto:tools-development-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tools-development/>
List-Post: <mailto:tools-development@ietf.org>
List-Help: <mailto:tools-development-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-development>, <mailto:tools-development-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 01 Feb 2019 01:02:28 -0000

On Thu, Jan 31, 2019 at 3:18 PM Heather Flanagan <rse@rfc-editor.org> wrote:

>
>
> On Jan 31, 2019, at 12:44 PM, Eric Rescorla <ekr@rtfm.com> wrote:
>
>
>
> On Thu, Jan 31, 2019 at 12:20 PM Heather Flanagan <rse@rfc-editor.org>
> wrote:
>
>> Hi ekr,
>>
>> I understand your point, but must disagree - these documents will not be
>> fully archived,
>>
>
> I don't see how this is relevant. In my hypothetical, the version which is
> "fully archived" is simply wrong (and in fact, self-contradictory), so it's
> not sensible to talk about having normative status on that point.
>
>
> It is relevant because the RFC Series is as much about archiving formally
> approved documents as it is making those documents available.
>

I don't agree that it's as much about that -- though I agree it's partly
about it -- but I suppose we can leave this for another day.


The archived documents may include information which has proven to be
> wrong, but the information is not corrected until we have a new document
> published.
>

This doesn't seem entirely accurate. The information *is* corrected in that
we file errata and have them approved and available, and those errata have
wha What we're talking about now is exactly how we present those errata.


>
> and the verification process is outside the consensus process (which I
>> think is important for IETF documents).
>>
>
> This seems like an interesting point, but is actually mitigated by the
> fact that if the approver makes a mistake, we can change the erratum again.
>
>
>
> Yes, true, but that is isn’t required to flow through any kind of
> consensus process.
>

Well, this is true, but it's also the case that these kinds of changes are
regularly made in AUTH48 without going through any kind of consensus
process, with only the IESG and the authors serving as the arbiters of
whether a change needs consensus. The level of consensus isn't materially
different just because the RFC has been published.


Taking a step back: an RFC -- at least a protocol specification --  is a
> set of instructions for how to implement a protocol. And what people need
> to know is how to actually implement the protocol. And when there is a
> clear error in the specification that doesn't match how the specification
> is being interpreted in practice, then it isn't helpful to act as if the
> error has normative force. The question is what the best interpretation of
> the RFC is at a given time.
>
>
>
> I get that, and am very sympathetic to that point. That’s why I’m in favor
> of creating these annotated RFCs in the first place, as an aid to both
> implementers and future -bis authors. But the annotated RFCs are a moving
> target with an insufficient consensus process for change, making them
> something I’m not willing to include as an official, normative output
> within the RFC Series.
>

It seems to me that the questions of what has normative force is really a
question for the IETF, not the RFC Editor. The IETF (with consensus, of
course) could decide tomorrow to mint a new class of documents that had
normative force and send them through some entirely separate publication
process (Github, Web pages, engraved on the face of the moon) and they
would still have whatever normative force one ascribes to the IETF
consensus process. Of course, that's a separate question from what goes in
the RFC Series.

All in all, I think this suggests that it would be better to have this
material on the IETF site and let IETF make whatever statements it wants to
about the status of the errata.

-Ekr


>
>
>> -Heather
>>
>> On Jan 31, 2019, at 11:29 AM, Eric Rescorla <ekr@rtfm.com> wrote:
>>
>> Hmm... I'm not sure that that's quite the desirable outcome.
>>
>> Let's take the example of a clear (and minor) technical error: in the
>> body of the text, the RFC says that we use code point X and in the IANA
>> considerations it says code point Y and the code point that people use is
>> actually "Y". So, someone files an erratum that changes the body of the
>> text to read Y. In this case, we absolutely do want people to think that
>> the annotated version is the one with normative force.
>>
>> -Ekr
>>
>>
>> On Thu, Jan 31, 2019 at 9:28 AM Heather Flanagan <rse@rfc-editor.org>
>> wrote:
>>
>>> Hi Sandy,
>>>
>>> You know I like the idea of a sandbox space - the RFC Editor needs a
>>> better way to explore ideas in a visible way. That said, there is concern
>>> about any hint of normative-ness to the annotated docs, and hosting them on
>>> the RFC Ed website might suggest some amount of officialness. I think we
>>> can potentially mitigate that by including something in the CSS that THESE
>>> ARE NOT NORMATIVE DOCUMENTS, but other ideas are welcome.
>>>
>>> -HEather
>>>
>>> On Jan 30, 2019, at 6:47 PM, Sandy Ginoza <sginoza@amsl.com> wrote:
>>>
>>> Hi all,
>>>
>>> I figured this comment/question would be more appropriate here rather
>>> than as feedback for the SoW.  I can’t remember if placement was decided
>>> when the IESG discussed this topic at the last IETF, so sorry if this is
>>> re-raising discussion I should already be aware of.
>>>
>>> The text says:
>>>
>>> This tool will initially be used to create pages served somewhere other
>>> than the RFC Editor’s website (www.rfc-editor.org). After gaining
>>> experience and community feedback, the pages might be moved to that
>>> website. Thus, the development of the tools should assume that the way the
>>> results are deployed will change over time.
>>>
>>> The RFC Editor has been talking about creating an experimental space on
>>> our site.  I think it’s worth considering having these annotated documents
>>> live in an experimental space on the RFC Editor site so they’re on the site
>>> from the beginning.  This seems like a perfect use for an experimental
>>> space.  Also, I believe that once these documents live somewhere, that is
>>> where users will look for them; if they become the de facto RFCs, I think
>>> we want them to be on our site.
>>>
>>> Thanks,
>>> Sandy
>>>
>>>
>>> On Jan 29, 2019, at 12:07 PM, Robert Sparks <rjsparks@nostrum.com>
>>> wrote:
>>>
>>> Adam's developed an initial draft for the inline-errata SoW. He started
>>> it as a google-doc and my initial set of feedback changes were easy enough
>>> to make there. Unless someone objects, I suggest we continue the
>>> development of this one using that tool. If you do object, for any reason,
>>> please let me know and I'll send a PDF while we adjust.
>>>
>>>
>>> https://docs.google.com/document/d/1T-6eBrNPC7aIxOTChdIZE7fecbxUJ7kq-F6RhyCNUGI/edit?usp=sharing
>>>
>>> RjS
>>>
>>> _______________________________________________
>>> TOOLS-DEVELOPMENT mailing list
>>> TOOLS-DEVELOPMENT@ietf.org
>>> https://www.ietf.org/mailman/listinfo/tools-development
>>>
>>>
>>> _______________________________________________
>>> TOOLS-DEVELOPMENT mailing list
>>> TOOLS-DEVELOPMENT@ietf.org
>>> https://www.ietf.org/mailman/listinfo/tools-development
>>>
>>>
>>> _______________________________________________
>>> TOOLS-DEVELOPMENT mailing list
>>> TOOLS-DEVELOPMENT@ietf.org
>>> https://www.ietf.org/mailman/listinfo/tools-development
>>>
>>
>>
>