Re: Quality of Directorate reviews

Michael Richardson <mcr+ietf@sandelman.ca> Wed, 06 November 2019 15:39 UTC

Return-Path: <mcr+ietf@sandelman.ca>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E003F120C6F for <ietf@ietfa.amsl.com>; Wed, 6 Nov 2019 07:39:24 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.2
X-Spam-Level:
X-Spam-Status: No, score=-4.2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 5MAk1MasWLI0 for <ietf@ietfa.amsl.com>; Wed, 6 Nov 2019 07:39:22 -0800 (PST)
Received: from tuna.sandelman.ca (tuna.sandelman.ca [209.87.249.19]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1284A1209DD for <ietf@ietf.org>; Wed, 6 Nov 2019 07:39:16 -0800 (PST)
Received: from sandelman.ca (obiwan.sandelman.ca [IPv6:2607:f0b0:f:2::247]) by tuna.sandelman.ca (Postfix) with ESMTP id C6F1C3897B for <ietf@ietf.org>; Wed, 6 Nov 2019 10:36:19 -0500 (EST)
Received: from localhost (localhost [IPv6:::1]) by sandelman.ca (Postfix) with ESMTP id 1BF1914 for <ietf@ietf.org>; Wed, 6 Nov 2019 10:39:15 -0500 (EST)
From: Michael Richardson <mcr+ietf@sandelman.ca>
To: ietf <ietf@ietf.org>
Subject: Re: Quality of Directorate reviews
In-Reply-To: <9C797CFF-6120-4783-8D2F-098D3F0E0A7F@tzi.org>
References: <157279399807.13506.13363770981495597049.idtracker@ietfa.amsl.com> <0EF64763-BA25-468A-B387-91445A61D318@gmail.com> <CAJU8_nUovmFmgNiYx0ez_1f+GPdU9xGViDYWfowEEomrn0pyDw@mail.gmail.com> <alpine.LRH.2.21.1911040841160.27600@bofh.nohats.ca> <CE06CC6D-E37F-4C90-B782-D14B1D715D4B@cable.comcast.com> <38E47448-63B4-4A5D-8A9D-3AB890EBDDDD@akamai.com> <09886edb-4302-b309-9eaa-f016c4487128@gmail.com> <26819.1572990657@localhost> <2668fa45-7667-51a6-7cb6-4b704c7fba5a@isode.com> <2C97D18E-3DA0-4A2D-8179-6D86EB835783@gmail.com> <9C797CFF-6120-4783-8D2F-098D3F0E0A7F@tzi.org>
X-Mailer: MH-E 8.6; nmh 1.7+dev; GNU Emacs 24.5.1
X-Face: $\n1pF)h^`}$H>Hk{L"x@)JS7<%Az}5RyS@k9X%29-lHB$Ti.V>2bi.~ehC0; <'$9xN5Ub# z!G,p`nR&p7Fz@^UXIn156S8.~^@MJ*mMsD7=QFeq%AL4m<nPbLgmtKK-5dC@#:k
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-="; micalg="pgp-sha256"; protocol="application/pgp-signature"
Date: Wed, 06 Nov 2019 10:39:15 -0500
Message-ID: <22770.1573054755@localhost>
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/6JF0e-eCm6CuYBIWUVWkPXuyNaU>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 06 Nov 2019 15:39:25 -0000

Carsten Bormann <cabo@tzi.org> wrote:
    > But please do keep in mind that after having worked a couple of years
    > on a document, the WG might no longer see things that a fresh look will
    > uncover.  I think getting that fresh look is one of the great features
    > of the multi-step review process we have.  Also, there is the simple
    > fact of serendipity!  (Which is not very structured, and someone
    > schooled in quality processes will hate, but creating quality is not
    > really a controlled process anyway…)

1) We need these things to happen significantly before WGLC, and the WG has
   to not regard these things as hostile; this means that the review has to help.
   The reviewer has to then become involved in the changes that result.
   (This argues for the "stable document" statement, but I'd way prefer that
   we published stable-document as PS, using some lighter weight process,
   even if it winds up in a new series)

2) The AD for that directorate has to be involved such that the relevant AD
   does not just repeat the entire conversation.

3) We need the time from beginning the document process to the end of this to
   occur a bit faster as authors of a document simply get exhausted.  That
   probably argues for shorter documents.  It also argues for more hands to
   be involved, which might mean to me, lifting the 5 author limit.

--
Michael Richardson <mcr+IETF@sandelman.ca>, Sandelman Software Works
 -= IPv6 IoT consulting =-