Re: Quality of Directorate reviews
Keith Moore <moore@network-heretics.com> Wed, 06 November 2019 15:32 UTC
Return-Path: <moore@network-heretics.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 138BC1208E1 for <ietf@ietfa.amsl.com>; Wed, 6 Nov 2019 07:32:16 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.598
X-Spam-Level:
X-Spam-Status: No, score=-2.598 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_NONE=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=messagingengine.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7NLL76lirPfO for <ietf@ietfa.amsl.com>; Wed, 6 Nov 2019 07:32:14 -0800 (PST)
Received: from wout1-smtp.messagingengine.com (wout1-smtp.messagingengine.com [64.147.123.24]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A39D91208C4 for <ietf@ietf.org>; Wed, 6 Nov 2019 07:32:14 -0800 (PST)
Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.west.internal (Postfix) with ESMTP id B14965C7; Wed, 6 Nov 2019 10:32:13 -0500 (EST)
Received: from mailfrontend1 ([10.202.2.162]) by compute6.internal (MEProxy); Wed, 06 Nov 2019 10:32:13 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=WZJ4yD eeDHyPvY9Tb7uCSk3eZ8ectxuONSGz+Kl6RmY=; b=YXAwco90OzSXCZauAl3xsS nqSc2rSEh5d2A9NoK/0g32faRycQZvevDBIEKJbMeHmo58hoyXRlAoqzDHgP6aeQ /28vMzch6KqL4VrrsSea9tETVoy9mpccTvm4yolmZ8lgOo5ZUo3HQSe/aP1jiWVc 6IrokmyjD5UDw/Z88RPdmxFw2WlI1qiYD6wwiCYD3cZfImZHaOrh0iI0L3SpEj8a 9XMH5VI+SmIiD8sRx3K8HadB6xAyckSAGS12Qd2BaeUU03nXJyuPphWbr+g9vMA/ Xa2UWu9qlJgCw3GcWlZoBUg3IpASKZv3zLU7IJkZEu5EH+YOqR9BuY/fCEcyes4Q ==
X-ME-Sender: <xms:fOfCXRZgXEft-o8B448I7sFcaCYIYg8vZWzKf8iBRJwDOXRFhGg5uw>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedufedruddujedgjeekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefuvfhfhffkffgfgggjtgesrgdtre ertdefjeenucfhrhhomhepmfgvihhthhcuofhoohhrvgcuoehmohhorhgvsehnvghtfiho rhhkqdhhvghrvghtihgtshdrtghomheqnecukfhppedutdekrddvvddurddukedtrdduhe enucfrrghrrghmpehmrghilhhfrhhomhepmhhoohhrvgesnhgvthifohhrkhdqhhgvrhgv thhitghsrdgtohhmnecuvehluhhsthgvrhfuihiivgeptd
X-ME-Proxy: <xmx:fOfCXUwt0UmOB_uqoPhh8qrgBihsDhUPym2bG-mJYW38lKKFKaIgVw> <xmx:fOfCXYYijknw-uq2IPacpmOE9iCgd-cNo161UnhCDq8LbjyK55gZPg> <xmx:fOfCXdwrRpO2AvPzikIvvkd2IJsDQoFPDueeHj_UTsezGk_vSHOspA> <xmx:fefCXTAEBbC9a2KMzMPzzW1STgff4t0utNF8atN1OEIuubUMq4K3Hw>
Received: from [192.168.1.97] (108-221-180-15.lightspeed.knvltn.sbcglobal.net [108.221.180.15]) by mail.messagingengine.com (Postfix) with ESMTPA id 82D788005A; Wed, 6 Nov 2019 10:32:12 -0500 (EST)
Subject: Re: Quality of Directorate reviews
To: Ralph Droms <rdroms.ietf@gmail.com>
Cc: ietf@ietf.org
References: <157279399807.13506.13363770981495597049.idtracker@ietfa.amsl.com> <0EF64763-BA25-468A-B387-91445A61D318@gmail.com> <CAJU8_nUovmFmgNiYx0ez_1f+GPdU9xGViDYWfowEEomrn0pyDw@mail.gmail.com> <alpine.LRH.2.21.1911040841160.27600@bofh.nohats.ca> <CE06CC6D-E37F-4C90-B782-D14B1D715D4B@cable.comcast.com> <38E47448-63B4-4A5D-8A9D-3AB890EBDDDD@akamai.com> <09886edb-4302-b309-9eaa-f016c4487128@gmail.com> <26819.1572990657@localhost> <2668fa45-7667-51a6-7cb6-4b704c7fba5a@isode.com> <2C97D18E-3DA0-4A2D-8179-6D86EB835783@gmail.com> <7d7b2541-c5b2-dbfc-e503-36fffc6fabeb@network-heretics.com> <2FBA1517-52B8-478B-95E4-ABDAF8C4A16C@gmail.com>
From: Keith Moore <moore@network-heretics.com>
Message-ID: <f291d0b9-48bb-edfb-6caa-ce4963e29900@network-heretics.com>
Date: Wed, 06 Nov 2019 10:32:10 -0500
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.9.0
MIME-Version: 1.0
In-Reply-To: <2FBA1517-52B8-478B-95E4-ABDAF8C4A16C@gmail.com>
Content-Type: multipart/alternative; boundary="------------5B044B86C1C33DDDB11E9CD5"
Content-Language: en-US
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/IaMlrKf0tE_AtReHYw3hD7RUu4U>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 06 Nov 2019 15:32:16 -0000
On 11/6/19 10:19 AM, Ralph Droms wrote: >> As long as working groups are as siloed as they are, this is unlikely any WG that affects interests that are outside of its narrow scope. And it's very dangerous to assume that WGs are competent to produce high quality work in isolation at least with our current processes. Though I'd certainly be in favor of some kind of explicit extra-WG review earlier in a WG's or document's lifespan. > We don't want to assume WGs are competent to produce high quality work, but we should certainly expect that they are. I'm not even sure what that means. And that seems like a tricky wire to balance on. Let me state the problem in a different way: Most WGs labor for years to produce a few documents, sometimes reaching "rough consensus" mostly by exhaustion, and the level of effort invested is such that it takes tremendous will to completely reject their output even if it's horrible. Fortunately such output is usually not horrible, but it's not unusual for the result to fail to consider negative effects, and/or for the documents to be poorly written. At that point the group is too burned out to consider significant changes. But "expecting" that the work is high quality, to justify weakening the reviews that such drafts are subjected to, seems counterproductive. And I agree that we should not depend on "heroes" either inside or outside the IESG, to provide documents with thorough reviews at a point that it's too late to fix most problems anyway. So to me that means we need to do thorough, IETF-wide reviews earlier. > WGs that regularly don't produce high quality work, perhaps, should not be supported in the IETF? IMO most WGs should have a short (2-3 years) lifetime. So by the time it's clear that they do or don't produce high-quality work, it's time for them to be winding down anyway. Keith
- NomCom 2019 Call for Community Feedback NomCom Chair 2019
- Re: NomCom 2019 Call for Community Feedback Stewart Bryant
- Re: NomCom 2019 Call for Community Feedback Salz, Rich
- Re: NomCom 2019 Call for Community Feedback Kyle Rose
- Re: NomCom 2019 Call for Community Feedback Paul Wouters
- Re: NomCom 2019 Call for Community Feedback Kathleen Moriarty
- Re: NomCom 2019 Call for Community Feedback Livingood, Jason
- Re: NomCom 2019 Call for Community Feedback Salz, Rich
- Re: NomCom 2019 Call for Community Feedback Randy Bush
- Re: NomCom 2019 Call for Community Feedback Yoav Nir
- Re: NomCom 2019 Call for Community Feedback Kathleen Moriarty
- Re: NomCom 2019 Call for Community Feedback Salz, Rich
- Re: NomCom 2019 Call for Community Feedback Stephen Farrell
- Re: NomCom 2019 Call for Community Feedback Brian E Carpenter
- Re: NomCom 2019 Call for Community Feedback Salz, Rich
- Re: NomCom 2019 Call for Community Feedback Stephen Farrell
- Re: NomCom 2019 Call for Community Feedback Brian E Carpenter
- Re: NomCom 2019 Call for Community Feedback Kyle Rose
- Re: NomCom 2019 Call for Community Feedback Keith Moore
- Re: NomCom 2019 Call for Community Feedback Tim Wicinski
- Re: NomCom 2019 Call for Community Feedback Rob Sayre
- Re: NomCom 2019 Call for Community Feedback Benjamin Kaduk
- Re: NomCom 2019 Call for Community Feedback Bob Hinden
- Re: NomCom 2019 Call for Community Feedback Donald Eastlake
- Re: NomCom 2019 Call for Community Feedback Kathleen Moriarty
- Re: NomCom 2019 Call for Community Feedback Eric Vyncke (evyncke)
- Re: NomCom 2019 Call for Community Feedback Salz, Rich
- Re: NomCom 2019 Call for Community Feedback Keith Moore
- Re: NomCom 2019 Call for Community Feedback John Levine
- Re: NomCom 2019 Call for Community Feedback Salz, Rich
- Re: NomCom 2019 Call for Community Feedback Stewart Bryant
- Re: NomCom 2019 Call for Community Feedback Kathleen Moriarty
- Re: NomCom 2019 Call for Community Feedback Michael Richardson
- Re: NomCom 2019 Call for Community Feedback Kyle Rose
- AD workload [was Re: NomCom 2019 Call for Communi… Brian E Carpenter
- Re: AD workload [was Re: NomCom 2019 Call for Com… Mark Nottingham
- Re: AD workload [was Re: NomCom 2019 Call for Com… Rob Sayre
- Re: AD workload [was Re: NomCom 2019 Call for Com… Terry Manderson
- Re: AD workload [was Re: NomCom 2019 Call for Com… Salz, Rich
- Re: AD workload [was Re: NomCom 2019 Call for Com… Keith Moore
- Re: AD workload [was Re: NomCom 2019 Call for Com… Leif Johansson
- Quality of Directorate reviews Alexey Melnikov
- Re: Quality of Directorate reviews Ralph Droms
- RE: Quality of Directorate reviews Rob Wilton (rwilton)
- Re: Quality of Directorate reviews Alexey Melnikov
- Re: Quality of Directorate reviews Stewart Bryant
- Re: AD workload [was Re: NomCom 2019 Call for Com… Salz, Rich
- RE: Quality of Directorate reviews Paul Wouters
- Re: Quality of Directorate reviews Carsten Bormann
- Re: Quality of Directorate reviews Ralph Droms
- Re: Quality of Directorate reviews Keith Moore
- Re: Quality of Directorate reviews Ralph Droms
- Re: AD workload [was Re: NomCom 2019 Call for Com… Michael Richardson
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Keith Moore
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Michael Richardson
- Re: AD workload [was Re: NomCom 2019 Call for Com… Stewart Bryant
- Re: Quality of Directorate reviews Stewart Bryant
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Bob Hinden
- Re: Quality of Directorate reviews Bob Hinden
- Re: Quality of Directorate reviews Salz, Rich
- Re: Quality of Directorate reviews Bob Hinden
- Re: Quality of Directorate reviews Jared Mauch
- Re: Quality of Directorate reviews Salz, Rich
- Re: Quality of Directorate reviews Stewart Bryant
- Re: AD workload [was Re: NomCom 2019 Call for Com… Leif Johansson
- Re: AD workload [was Re: NomCom 2019 Call for Com… Salz, Rich
- Re: AD workload [was Re: NomCom 2019 Call for Com… Salz, Rich
- Re: AD workload [was Re: NomCom 2019 Call for Com… Leif Johansson
- Re: AD workload [was Re: NomCom 2019 Call for Com… Leif Johansson
- Thought experiment [Re: Quality of Directorate re… Brian E Carpenter
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Quality of Directorate reviews Keith Moore
- Re: Quality of Directorate reviews Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Brian E Carpenter
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Brian E Carpenter
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Leif Johansson
- Re: Thought experiment [Re: Quality of Directorat… Bob Hinden
- Re: Thought experiment [Re: Quality of Directorat… Bob Hinden
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… tom petch
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Stewart Bryant
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Salz, Rich
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Brian E Carpenter
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Bob Hinden
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Christian Huitema
- Author and attendance measurements [Was: Re: Thou… Jari Arkko
- Re: Author and attendance measurements [Was: Re: … Keith Moore
- Re: AD workload [was Re: NomCom 2019 Call for Com… Eliot Lear
- Re: AD workload [was Re: NomCom 2019 Call for Com… Ole Troan
- Re: Author and attendance measurements [Was: Re: … John C Klensin
- Re: AD workload [was Re: NomCom 2019 Call for Com… Salz, Rich
- Re: Author and attendance measurements [Was: Re: … Michael Richardson
- Re: Author and attendance measurements [Was: Re: … Andrew G. Malis
- Re: AD workload [was Re: NomCom 2019 Call for Com… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Bob Hinden
- Re: Author and attendance measurements [Was: Re: … Keith Moore
- Re: Author and attendance measurements [Was: Re: … Michael Richardson
- Re: NomCom 2019 Call for Community Feedback John Leslie
- Re: AD workload [was Re: NomCom 2019 Call for Com… Brian E Carpenter
- Re: AD workload [was Re: NomCom 2019 Call for Com… Keith Moore
- Re: AD workload [was Re: NomCom 2019 Call for Com… Michael Richardson
- Re: AD workload [was Re: NomCom 2019 Call for Com… Keith Moore
- Re: Author and attendance measurements [Was: Re: … John C Klensin
- Re: NomCom 2019 Call for Community Feedback John C Klensin
- Re: NomCom 2019 Call for Community Feedback Mary B
- Re: Author and attendance measurements [Was: Re: … Carsten Bormann
- Re: Author and attendance measurements [Was: Re: … Michael Richardson
- Re: Quality of Directorate reviews Phillip Hallam-Baker
- Re: Quality of Directorate reviews Keith Moore
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Julian Reschke
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Benjamin Kaduk
- Re: Quality of Directorate reviews Keith Moore
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Benjamin Kaduk
- Re: Quality of Directorate reviews Abdussalam Baryun
- Re: Quality of Directorate reviews Mark Nottingham