Re: Thought experiment [Re: Quality of Directorate reviews]

Keith Moore <moore@network-heretics.com> Thu, 07 November 2019 21:36 UTC

Return-Path: <moore@network-heretics.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id DE9AB12082A for <ietf@ietfa.amsl.com>; Thu, 7 Nov 2019 13:36:29 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.598
X-Spam-Level:
X-Spam-Status: No, score=-2.598 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_LOW=-0.7, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=messagingengine.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id XfmJL0SAPoiq for <ietf@ietfa.amsl.com>; Thu, 7 Nov 2019 13:36:27 -0800 (PST)
Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B4E49120168 for <ietf@ietf.org>; Thu, 7 Nov 2019 13:36:27 -0800 (PST)
Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id 021D520D0B; Thu, 7 Nov 2019 16:36:27 -0500 (EST)
Received: from mailfrontend2 ([10.202.2.163]) by compute6.internal (MEProxy); Thu, 07 Nov 2019 16:36:27 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm1; bh=fwKKfGjVHBILXv/hsfr7Zw2CnEYR+WXfE55izAXmQ u8=; b=x/lQjtxmdpZmeAOEi6JPvJgnvxExGzYBOWxKTUX4tVl6k9HhsTVjCD08Z dgbuazvjya1vqCkW9LYQsP+oKOk/lETx1fNOYP99oRPoJ9V0Ozv3JfHnLWIn7syL O1rHecHLbDrufq6zFgNMC6pwcB9TwkLThrMasWMOjULkn6akrs/RTKfXZXUZ2maV 6PHZAdG3JwvoYb+6Hz+yS7dTFuxEE0HOj3OvhIDfT0KvwuYM6cKY9voTqxEfJLMS /MbqXZptnyAEqv4/890pcfs1nMoeB5rGH7iFgezwKRGnHeAvFhIkZLEYD5XK5LY3 PtxN89BePXlSTGtRdKu1ilCuys5yw==
X-ME-Sender: <xms:Wo7EXRFOZkyYG048pirovvce66NtqFUrnTOTkNxi6xRNAX2iDrYQSA>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedufedrudduledgudehudcutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepuffvfhfhkffffgggjggtgfesth ekredttdefjeenucfhrhhomhepmfgvihhthhcuofhoohhrvgcuoehmohhorhgvsehnvght fihorhhkqdhhvghrvghtihgtshdrtghomheqnecukfhppedutdekrddvvddurddukedtrd duheenucfrrghrrghmpehmrghilhhfrhhomhepmhhoohhrvgesnhgvthifohhrkhdqhhgv rhgvthhitghsrdgtohhmnecuvehluhhsthgvrhfuihiivgeptd
X-ME-Proxy: <xmx:Wo7EXTtbfINhLedbusbN4IfCf7QFircH9DE3tRIXYTgArqbd4-OMEQ> <xmx:Wo7EXadRUNMknWcFfGPQVtovh725E6No5aqyxcCqgBJ1g2CNRpc4LQ> <xmx:Wo7EXRk3Q87hjkUpRRpLDtLtUX_F8TRoT6wLWYTQ2CEW68kq0csYBA> <xmx:Wo7EXbnBeDB7cNB7hAkIb_Yh88y0foE-iJ4pNp67r0w3h5LeEwQNEA>
Received: from [192.168.1.97] (108-221-180-15.lightspeed.knvltn.sbcglobal.net [108.221.180.15]) by mail.messagingengine.com (Postfix) with ESMTPA id 76BE3306005B; Thu, 7 Nov 2019 16:36:26 -0500 (EST)
Subject: Re: Thought experiment [Re: Quality of Directorate reviews]
To: ietf@ietf.org
References: <CAJU8_nUovmFmgNiYx0ez_1f+GPdU9xGViDYWfowEEomrn0pyDw@mail.gmail.com> <alpine.LRH.2.21.1911040841160.27600@bofh.nohats.ca> <CE06CC6D-E37F-4C90-B782-D14B1D715D4B@cable.comcast.com> <38E47448-63B4-4A5D-8A9D-3AB890EBDDDD@akamai.com> <09886edb-4302-b309-9eaa-f016c4487128@gmail.com> <26819.1572990657@localhost> <2668fa45-7667-51a6-7cb6-4b704c7fba5a@isode.com> <2C97D18E-3DA0-4A2D-8179-6D86EB835783@gmail.com> <91686B28-9583-4A8E-AF8A-E66977B1FE13@gmail.com> <012b9437-4440-915c-f1f9-b85e1b0be768@gmail.com> <20191107014849.GC12148@localhost> <57465486-71b1-a87a-fa8c-bad7157f9025@gmail.com> <3caeb4cf-b92b-99fd-77df-7b1aef3e2979@network-heretics.com> <12884.1573157976@localhost>
From: Keith Moore <moore@network-heretics.com>
Message-ID: <8b46db76-574a-bd2c-18af-0546dee0fd3e@network-heretics.com>
Date: Thu, 7 Nov 2019 16:36:25 -0500
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.9.0
MIME-Version: 1.0
In-Reply-To: <12884.1573157976@localhost>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Content-Language: en-US
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/GQT2Bzoffy_ji8eqK9RnPzcRRns>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 07 Nov 2019 21:36:30 -0000

On 11/7/19 3:19 PM, Michael Richardson wrote:

> Keith Moore <moore@network-heretics.com>; wrote:
>      > This is where the biggest disconnect between 2026 and reality is.   If the
>      > reality is that industry is going to deploy implementations at Proposed
>      > Standard or sooner (and as far as I can tell, that's been reality for as long
>      > as there's been an Internet "industry"), it makes sense for IETF to recognize
>      > that and react accordingly.
>
> You are saying this as if it's a bug.
> It's not!  It's by design.
> We deploy at PS in order to find out if there is interoperability.

My first impression is that this is indeed a bug, a tremendous 
disservice to Internet users.   But I remind myself that automatic 
software update is becoming increasingly common.   So at least for 
products that are certain to be run on Internet-connected hosts (as 
opposed to, say, on air-gapped networks), and for which secure update 
can be provided, there might be cases for which premature deployment 
makes sense - especially if there's a strategy designed into the 
protocol for dealing with version skew in the endpoints' 
implementations.   (Assuming public internet connectivity isn't at all 
the general case, but it's an important corner case.)

Also, PS criteria were specifically not designed for deployment; the 
idea was that you need interop testing before deploying.   But if 
interop testing were incorporated earlier in the process (which does 
seem to be more common these days) then the sequencing assumed by 2026 
might be suboptimal.

I could imagine that rather than the initial RFC being at PS, it could 
be (for some cases, probably not all) at something akin to what Draft 
Standard used to be - interop testing already done by the time the 
initial RFC is published, with any changes made as a result of the 
testing incorporated into that RFC.

>      > If we want there to be a prototype "just for testing" status, it should
>      > probably be called something other than Proposed - the name has come to mean
>      > something else in IETF context.   And we should deliberately change one or
>      > more protocol elements to make the standard incompatible with
>
> We do "just for testing" regularly at the internet-draft stage.

yeah, and it doesn't make sense to go through the whole RFC publication 
process just to agree on a specification to test to.

Keith