Re: Evolving Documents (nee "Living Documents") side meeting at IETF105.)

John C Klensin <john-ietf@jck.com> Sat, 20 July 2019 16:01 UTC

Return-Path: <john-ietf@jck.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id ED3AA12018C for <ietf@ietfa.amsl.com>; Sat, 20 Jul 2019 09:01:36 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.104
X-Spam-Level:
X-Spam-Status: No, score=-1.104 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RDNS_NONE=0.793, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id lP-HN6iStxqP for <ietf@ietfa.amsl.com>; Sat, 20 Jul 2019 09:01:35 -0700 (PDT)
Received: from bsa3.jck.com (unknown [65.175.133.137]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 591381200E5 for <ietf@ietf.org>; Sat, 20 Jul 2019 09:01:35 -0700 (PDT)
Received: from hp5.int.jck.com ([198.252.137.153] helo=JcK-HP5.jck.com) by bsa3.jck.com with esmtp (Exim 4.82 (FreeBSD)) (envelope-from <john-ietf@jck.com>) id 1hornf-0001MN-BY; Sat, 20 Jul 2019 12:01:31 -0400
Date: Sat, 20 Jul 2019 12:01:26 -0400
From: John C Klensin <john-ietf@jck.com>
To: Warren Kumari <warren@kumari.net>
cc: Christopher Morrow <morrowc.lists@gmail.com>, Keith Moore <moore@network-heretics.com>, ietf <ietf@ietf.org>
Subject: Re: Evolving Documents (nee "Living Documents") side meeting at IETF105.)
Message-ID: <D040E023EFC54C735EB4EED7@JcK-HP5.jck.com>
In-Reply-To: <CAHw9_i+m9H=BjvUrg5gqRfjBTZ4vEeRc6K2FW+2OaArbS+MZEA@mail.gmail.com>
References: <F2D5DCCF-4051-444B-9522-9E11F9F93005@fugue.com> <869599E9-7571-4677-AB9A-961027549C54@network-heretics.com> <144ff436-a7a2-22f7-7b06-4d0b3bcfefac@joelhalpern.com> <20190719041456.GL33367@vurt.meerval.net> <254fc5f6-3576-a62f-b84f-a7c5d29b0055@joelhalpern.com> <a1561aa7-5f41-0e2a-1892-cfb587196ac0@gmail.com> <C3D53639-C2C0-42CE-9708-99294091E012@puck.nether.net> <a17a8648-14c8-1889-4ee3-86996ff6281e@gmail.com> <3B0C189A-D56B-430F-82FF-19DE0DC788DE@puck.nether.net> <BA80E73F53C26B9191294131@JcK-HP5.jck.com> <20190719190534.GG38674@shrubbery.net> <7FF2DA2F2DC64741DA8B5747@JcK-HP5.jck.com> <CAHw9_iL-9D1EFZcXp6twK+WL137F5zArLcUrJw50Q-YL0PBpag@mail.gmail.com> <b0015262-b009-90a8-aaed-c2dd175706cf@network-heretics.com> <CAL9jLaZdQpn=KNHbTZJL=RcV4Jzw=AWUTC2LsY1+fBUcTajBoA@mail.gmail.com> <CAHw9_i+m9H=BjvUrg5gqRfjBTZ4vEeRc6K2FW+2OaArbS+MZEA@mail.gmail.c om>
X-Mailer: Mulberry/4.0.8 (Win32)
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/ewt8XOq9vlXvUmYhVlF-yKroy14>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 20 Jul 2019 16:01:37 -0000


--On Saturday, 20 July, 2019 10:17 -0400 Warren Kumari
<warren@kumari.net> wrote:

> On Sat, Jul 20, 2019 at 9:00 AM Christopher Morrow
> <morrowc.lists@gmail.com> wrote:
>> 
>> On Sat, Jul 20, 2019 at 8:51 AM Keith Moore
>> <moore@network-heretics.com> wrote:
>> > I believe your statement of intent.  But I think it's fair
>> > to realize that there is already tremendous pressure to
>> > deploy implementations before they've been formally
>> > approved, and there's a danger that any kind of
>> > distinguished "mark" will have the (unintended) effect of
>> > promoting deployment of the marked version of a protocol.
>> 
>> regardless of 'published or not' folk will always push for
>> the early implementation of FOO before it has been 'ratified'.
>> it's pretty clear that this happens, and that nothing about
>> this discussion is going to change that.
>> 
> 
> *I* think that we really want early implementations of FOO
> before it has been ratified - without this we don't have the
> "running code" part of "rough consensus and running code.
> I think the trouble comes in when there are *deployments* of
> FOO before it has been ratified....

Exactly.  And, at the risk of singing an old song, that was
exactly what Proposed Standard was supposed to be about.

So, with the understanding that I'm not optimistic about this
for the reasons I gave earlier and a quarter-century of history,
consider an alternate proposal: Return Proposed Standard to its
original intended status.  Try to make it clear that anyone
deploying a new specification at Proposed Standard is a fool and
deliberately misleading customers about stability and the
future.  Make it lots easier and faster to get one through the
system, e.g., by forbidding or ignoring editorial nit-picking
during IETF LC and, as BCP9 clearly allowed, simply documenting
known omissions and areas of uncertainty and moving on.  Let
Proposed Standards be close enough to preliminary engineering
specifications that there are real incentives to advance (and
carefully finish end edit) documents after implementation and
implementability have been proven.   The main review should be
"is this clear and precise enough to implement for test
purposes, with or without judicious application of the
robustness principle" (one thing we should learn from
implementation, interoperability testing, and running code more
generally is a list of things that need to be documented more
precisely but that, again, was part of the original idea).
Increase RFC Production Center staffing and resources for
editorial cleanups to make documents clear, but use different
criteria for deciding whether a document is "good enough" to
publication to Proposed Standards and Internet Standards.
Narrow AUTH48 for Proposed Standards to a "speak now; explain to
the RFC Editor, IESG, and the community why you need more time;
or just hold your piece"... and, if you are the one author who
has not signed off where others have, note that you will be
dropped to a Contributor by editorial action if you don't
respond within that window.    Identify ADs who are holding
things up and where to the community and future nomcoms, even
explicitly considering it grounds for recall if any one AD is
consistently out of line.  

Would it work?  I obviously have my doubts.  Would it have
chances of working at least as good as trying to devise an
entirely new system and convincing people to understand exactly
what it is about?  IMO, probably yes or at least sooner.   Would
it be equally fast as a WG simply attaching a stamp of approval
to one of its documents?  Probably not quite, but keep in mind
that, once a WG decides a document is ready for publication,
nothing in BCP 9 requires shepherd reports, extensive IESG )or
even AD) review and evaluation, more than two weeks of IETF LC
for WG documents, and then an extensive IESG review and debate
afterwards.  If a document takes more than a month between when
the WG decides it is ready for community review before it is the
hands of the RFC Editor, there is either something substantively
wrong with it, the WG didn't do its job (reflecting badly on WG
leadership and the responsible AD), or we are dealing with
impediments that the community and/or the IESG set up,
presumably in the name of closer attempts at perfection.   If we
think that is a problem, let's fix it, rather than looking for
new terminology that just kicks assorted cans down the road or
that avoids timely review outside the developing WG (again, IETF
LC on WG documents is nominally only two weeks -- that is not
where the problem lies).   And, if all of that means we have too
many WGs and two many work efforts going to be consistent with
quality, let's do some serious prioritizing and change that.

best,
   john