Re: Thought experiment [Re: Quality of Directorate reviews]

Brian E Carpenter <brian.e.carpenter@gmail.com> Thu, 07 November 2019 02:25 UTC

Return-Path: <brian.e.carpenter@gmail.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E23131200F3 for <ietf@ietfa.amsl.com>; Wed, 6 Nov 2019 18:25:46 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level:
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ozdpB66Ch9_u for <ietf@ietfa.amsl.com>; Wed, 6 Nov 2019 18:25:45 -0800 (PST)
Received: from mail-pl1-x635.google.com (mail-pl1-x635.google.com [IPv6:2607:f8b0:4864:20::635]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1185812008F for <ietf@ietf.org>; Wed, 6 Nov 2019 18:25:45 -0800 (PST)
Received: by mail-pl1-x635.google.com with SMTP id y24so356156plr.12 for <ietf@ietf.org>; Wed, 06 Nov 2019 18:25:45 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=EpBrku2KMVwdcffinPKyrpa+8GMmfAUyhiN6HwL4mwM=; b=NN1dP6JiXLCYAidx8LahQ9cRnM330uHM8peOcqEO3/vngRtn6NkYt+iRh4nOPRfhvA /GTvcx6yow5bFvJ4pGRuQu3J5kCOIIW64eZ/StlpjX+UO5ff624Lq3Dleka01s3oqeiL ezUSg9Lab0M9N3voS1BsVt0UmESb4Jriq+IeZmOCt0bDoUlWyA8Hh0xdGmfbzsUOYob6 gX2cv3ivcuiGi+EZLlZZwz4XgANmMW2y8jfE2vvAfdQv1McpVbce/H1kUpFCUQ3sNHex N8o3ar+4LpB9kW4WoFwUFRydAYui+53oq6hFWpB5ovA8UKFsoRw23YNJelaqCpekIqhG SSkA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=EpBrku2KMVwdcffinPKyrpa+8GMmfAUyhiN6HwL4mwM=; b=PZpu9kHPyNYUVvszF8RASkzK5xs/5IJ6BJaZfepiYzb3Gm8/V9lXVAMVquLlOpXuFq OdSakRPTnnZ/gdiFJULRcGH2iAK8voihLvXQ2dJ8ZvKrUBOk4/4uxZJuZVwHn61HAk3c r1ZqsVkOVUC6oRE8xKxFCBPQvJ1jmM33LP09GeSNGuh0RNYc5WtLCnJE8V2BhX4I2OxP UZwYrbf8H2SLXk4yS9L2qFtO5QKfaPaOS2Npb7hQyqomgaUxPgK8p7ggL4WMp8uyF7Fw ijCZVycVKMd6DG/mTsjB3TwGYzoP+noBae6f/WyiwPwcbgJsh0xO+uPxJPPJ1BeVwBu0 6dTA==
X-Gm-Message-State: APjAAAW7CkEFyyXUDHtY7hVI4p9aymS37mOUSXD3f/5gMGQjcNqRTDUi 3KlJqbFab+TtJCOQpa/+0N8=
X-Google-Smtp-Source: APXvYqxnNVjH8i/vokyOxQ14idqIpHMuUSnkGIohnORcjnC9Fojz8Sd76QOfKI7oQmduDW7ca0tAyg==
X-Received: by 2002:a17:902:6b4c:: with SMTP id g12mr1077301plt.78.1573093544136; Wed, 06 Nov 2019 18:25:44 -0800 (PST)
Received: from [192.168.178.30] (8.166.69.111.dynamic.snap.net.nz. [111.69.166.8]) by smtp.gmail.com with ESMTPSA id m65sm5463416pje.3.2019.11.06.18.25.41 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 06 Nov 2019 18:25:43 -0800 (PST)
Subject: Re: Thought experiment [Re: Quality of Directorate reviews]
To: Nico Williams <nico@cryptonector.com>
Cc: Bob Hinden <bob.hinden@gmail.com>, Ralph Droms <rdroms.ietf@gmail.com>, Alexey Melnikov <alexey.melnikov@isode.com>, IETF <ietf@ietf.org>, Michael Richardson <mcr+ietf@sandelman.ca>
References: <CAJU8_nUovmFmgNiYx0ez_1f+GPdU9xGViDYWfowEEomrn0pyDw@mail.gmail.com> <alpine.LRH.2.21.1911040841160.27600@bofh.nohats.ca> <CE06CC6D-E37F-4C90-B782-D14B1D715D4B@cable.comcast.com> <38E47448-63B4-4A5D-8A9D-3AB890EBDDDD@akamai.com> <09886edb-4302-b309-9eaa-f016c4487128@gmail.com> <26819.1572990657@localhost> <2668fa45-7667-51a6-7cb6-4b704c7fba5a@isode.com> <2C97D18E-3DA0-4A2D-8179-6D86EB835783@gmail.com> <91686B28-9583-4A8E-AF8A-E66977B1FE13@gmail.com> <012b9437-4440-915c-f1f9-b85e1b0be768@gmail.com> <20191107014849.GC12148@localhost>
From: Brian E Carpenter <brian.e.carpenter@gmail.com>
Message-ID: <57465486-71b1-a87a-fa8c-bad7157f9025@gmail.com>
Date: Thu, 7 Nov 2019 15:25:40 +1300
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.9.0
MIME-Version: 1.0
In-Reply-To: <20191107014849.GC12148@localhost>
Content-Type: text/plain; charset=utf-8
Content-Language: en-US
Content-Transfer-Encoding: 7bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/xRN22k7NrK-Vc-geji91QAbtGfY>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 07 Nov 2019 02:25:47 -0000

On 07-Nov-19 14:48, Nico Williams wrote:
> On Thu, Nov 07, 2019 at 11:54:59AM +1300, Brian E Carpenter wrote:
>> Here's a thought experiment.
>>
>> Update the standards process such that the approval of Proposed Standard
>> RFCs, after an IETF last call including some specified cross-area review
>> requirements, is done by the WG consensus process with the consent of the AD .
>>
>> Why would that work? Because it now incents the WG chairs by making them,
>> in effect, where the buck stops. So the WG chairs and AD (typically
>> a committee of three) will feel the obligation to get everything
>> right. And it scales.
> 
> So, no more IESG review?  What would we need the IESG for anymore?  It
> would be gone, I guess?

Not at all. Firstly, I said *Proposed* Standard. The experiment would leave
the IESG in charge for Internet Standard. (Also for documents submitted
outside the WG process, which is rare of course.) And the criterion is
still IETF rough consensus following an IETF last call. Just trying
to eliminate a manifest bottleneck.

Secondly, they'd still be the authority for chartering, appointing
WG chairs, appointing directorates, and other aspects of overseeing
the process. Most of the duties described in RFC 2026 in fact.

> Sure, it will scale better.  But quality will suffer.

And maybe some documents will spend fewer than, say, 2 years in MISSREF.
Speed vs quality is indeed a trade-off. In the era of rapid prototyping
our timescale really looks pretty stupid.

>> [...]. So the WG chairs and AD (typically a committee of three) [...]
> 
> Typically one of the ADs is uninvolved with a WG for which the other is
> responsible, so that would be a committee of two, not three.

Two WG chairs is almost the norm these days. But yes, the essence of
the experiment is to reduce the number of people in the decision
process - and intentionally lower the bar for Proposed Standard closer
to how it's defined in RFC2026:
   A Proposed Standard specification is generally stable, has resolved
   known design choices, is believed to be well-understood, has received
   significant community review, and appears to enjoy enough community
   interest to be considered valuable.  However, further experience
   might result in a change or even retraction of the specification
   before it advances.
When I look at some the DISCUSSes I've seen in recent months, I really
don't think that definition is being applied.

I would also add to my thought experiment a mandatory Implementation
Status section. That's stronger than RFC2026.

 Brian