Re: Quality of Directorate reviews
Keith Moore <moore@network-heretics.com> Thu, 07 November 2019 00:01 UTC
Return-Path: <moore@network-heretics.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 74FEA12008F for <ietf@ietfa.amsl.com>; Wed, 6 Nov 2019 16:01:57 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.598
X-Spam-Level:
X-Spam-Status: No, score=-2.598 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_LOW=-0.7, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=messagingengine.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id M-gsablwwy3X for <ietf@ietfa.amsl.com>; Wed, 6 Nov 2019 16:01:55 -0800 (PST)
Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7CC27120025 for <ietf@ietf.org>; Wed, 6 Nov 2019 16:01:55 -0800 (PST)
Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id B2EF3212BF; Wed, 6 Nov 2019 19:01:54 -0500 (EST)
Received: from mailfrontend2 ([10.202.2.163]) by compute6.internal (MEProxy); Wed, 06 Nov 2019 19:01:54 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm1; bh=YV30HBmhBXeV5YTCuUMexDTiIi7G6P5oUo1VYFOcv mM=; b=c9wY3yCWbSOb/z0kqRysg5dfcbneosVG3+LptxrIx8Chc2lGpqKIQ8vJ8 xLMsyAQDI0aj00xvHaacGGdFRZhpxS3FGitOVnS1P/U0C4GP4PKz4OOUe+RO7jAJ /FTw5BmsLssIdAcrK4DB6dGlVOtfZUd6sPau3Fe1a28vtIiu2HTzrAi7Sc1uXW1v +UPIqvrn0sfrRPg47wfSEjzMNehKM9qBzSDopV6jJ9vJiSJhckQK1w2/gq9VEjYB prYpHFF3mZTNvI79MPzI958eGMUmZlFHgMcs/rPXo1g6BKtHdKdz2sgbBRu69qxK ZuJU5VnaIkhXFk6xyvaAzbD7704KQ==
X-ME-Sender: <xms:8V7DXU8YWDZkbQkBWQPwDP0peDVTtVUfqXQAPzzzSHCencKNrel6SQ>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedufedruddukedgudeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefuvfhfhffkffgfgggjtgfgsehtke ertddtfeejnecuhfhrohhmpefmvghithhhucfoohhorhgvuceomhhoohhrvgesnhgvthif ohhrkhdqhhgvrhgvthhitghsrdgtohhmqeenucfkphepuddtkedrvddvuddrudektddrud ehnecurfgrrhgrmhepmhgrihhlfhhrohhmpehmohhorhgvsehnvghtfihorhhkqdhhvghr vghtihgtshdrtghomhenucevlhhushhtvghrufhiiigvpedt
X-ME-Proxy: <xmx:8V7DXe84mTgFKJvIp-2uS6nb_uY7HnFpjy0Sw3Jc5xWGtmrBk-sYeg> <xmx:8V7DXXpWHHCVTEr_9PbsXm0ie0twM7KdT0hFo5qBrtw9qowcdpNd3A> <xmx:8V7DXRXc8lf3yeABsy3rGOKNqjaJkVzqj2nsMQ6Pnuj3OC59NR-_Nw> <xmx:8l7DXZ2aA1fRt3YdsWAc7A5Alzl8cEQ0CLS1zhEPRyhtQt2SoaehpA>
Received: from [192.168.1.97] (108-221-180-15.lightspeed.knvltn.sbcglobal.net [108.221.180.15]) by mail.messagingengine.com (Postfix) with ESMTPA id D256C306005F; Wed, 6 Nov 2019 19:01:52 -0500 (EST)
Subject: Re: Quality of Directorate reviews
To: ietf@ietf.org
References: <157279399807.13506.13363770981495597049.idtracker@ietfa.amsl.com> <0EF64763-BA25-468A-B387-91445A61D318@gmail.com> <CAJU8_nUovmFmgNiYx0ez_1f+GPdU9xGViDYWfowEEomrn0pyDw@mail.gmail.com> <alpine.LRH.2.21.1911040841160.27600@bofh.nohats.ca> <CE06CC6D-E37F-4C90-B782-D14B1D715D4B@cable.comcast.com> <38E47448-63B4-4A5D-8A9D-3AB890EBDDDD@akamai.com> <09886edb-4302-b309-9eaa-f016c4487128@gmail.com> <26819.1572990657@localhost> <2668fa45-7667-51a6-7cb6-4b704c7fba5a@isode.com> <2C97D18E-3DA0-4A2D-8179-6D86EB835783@gmail.com> <7d7b2541-c5b2-dbfc-e503-36fffc6fabeb@network-heretics.com> <2FBA1517-52B8-478B-95E4-ABDAF8C4A16C@gmail.com> <f291d0b9-48bb-edfb-6caa-ce4963e29900@network-heretics.com> <7527.1573059260@localhost>
From: Keith Moore <moore@network-heretics.com>
Message-ID: <7ccf7cf2-3ce1-c838-b838-fce2bc8e7cc0@network-heretics.com>
Date: Wed, 06 Nov 2019 19:01:52 -0500
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.9.0
MIME-Version: 1.0
In-Reply-To: <7527.1573059260@localhost>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Transfer-Encoding: 8bit
Content-Language: en-US
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/DmYTRgZ4GCIRFR3HYNpiewXIpno>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 07 Nov 2019 00:01:58 -0000
On 11/6/19 11:54 AM, Michael Richardson wrote: > Keith Moore<moore@network-heretics.com> wrote: > >> WGs that regularly don't produce high quality work, perhaps, should > >> not be supported in the IETF? > > > IMO most WGs should have a short (2-3 years) lifetime. So by the time it's > > clear that they do or don't produce high-quality work, it's time for them to > > be winding down anyway. > > I would like to amend this. WGs should have a short (1-2) year iteration time. > That is, time from milestone being added to the charter to IESG Publication as PS. > I really think that WGs need to remain in existence longer in order to deal > with errata, to look at interop results, write operational documents, and > promote to IS. I can see pros and cons with this. IMO one of the problems with long-lived WGs is that they can keep creating more work for themselves whether or not it is needed. Sure, they need to update their charters to do so but I've rarely seen those efforts be rebuffed. I also understand that the more WGs there are, the more load there is on the ADs, even if many of those WGs are dormant. So I think it might make more sense to have a specific long-term WG or two per area to focus on maintenance, than to keep the narrowly-focused WGs around indefinitely. Such a "maintenance" WG might also be tasked with periodically reviewing each of the current standards-track documents in that area, looking at the state of deployment and suitability for purpose, and making recommendations for updating, status change, new documents (e.g. usage profiles or applicability statements), or deprecation as appropriate. > The list of AD candidates is effectively limited to the current list of WG chairs. > (I've said this before, multiple times) I don't think this is actually true. It's closer to the set of people who have chaired a WG at some time in the present or past. And I think it would be fair to consider directorate members in some cases. > Since most of the ADs were awesome WG chairs, it's hardly surprising that > they revert to what they were good at, and basically just take on the WG > chair responsability for document quality. While that might happen in some cases, I don't think that's a good explanation for ADs taking on detailed review. ADs know that they're in a unique position to uphold the quality of IETF standards. They see the widely varying quality that WGs produce, and they know how important it is to get some of that stuff right. (Some of it is relatively inconsequential.) And in practice, an AD actually has fairly limited power to make sure that a WG reliably produces good output. The AD can in theory fire poor chairs, but this has the potential to be so disruptive as to make things worse, and there may be a dearth of good chairs to replace them. It's all well and good (and politically wise) to get directorate members to do detailed reviews, but an AD doesn't always have that luxury, and sometimes an AD has to dig fairly deeply into a document in order to make sense of the (sometimes conflicting) reviews and Last Call comments anyway. The buck really does stop with the IESG and IMO they're the ones in the best positions to be making the final decisions - partly because they are likely to have broad views, and partly because about the only thing that gives them any "steering" capability is the fact that they're the ones doing the final signoff. > Afterall: that's the skill that they demonstrated so well that it got them "promoted". I believe that AD and WG chair require somewhat different skill sets. If I were on nomcom I'd be looking for ADs who have demonstrated cat herding expertise and are conversant in multiple technical subject areas. A WG chair can be a specialist; an AD needs to be a generalist. Keith
- NomCom 2019 Call for Community Feedback NomCom Chair 2019
- Re: NomCom 2019 Call for Community Feedback Stewart Bryant
- Re: NomCom 2019 Call for Community Feedback Salz, Rich
- Re: NomCom 2019 Call for Community Feedback Kyle Rose
- Re: NomCom 2019 Call for Community Feedback Paul Wouters
- Re: NomCom 2019 Call for Community Feedback Kathleen Moriarty
- Re: NomCom 2019 Call for Community Feedback Livingood, Jason
- Re: NomCom 2019 Call for Community Feedback Salz, Rich
- Re: NomCom 2019 Call for Community Feedback Randy Bush
- Re: NomCom 2019 Call for Community Feedback Yoav Nir
- Re: NomCom 2019 Call for Community Feedback Kathleen Moriarty
- Re: NomCom 2019 Call for Community Feedback Salz, Rich
- Re: NomCom 2019 Call for Community Feedback Stephen Farrell
- Re: NomCom 2019 Call for Community Feedback Brian E Carpenter
- Re: NomCom 2019 Call for Community Feedback Salz, Rich
- Re: NomCom 2019 Call for Community Feedback Stephen Farrell
- Re: NomCom 2019 Call for Community Feedback Brian E Carpenter
- Re: NomCom 2019 Call for Community Feedback Kyle Rose
- Re: NomCom 2019 Call for Community Feedback Keith Moore
- Re: NomCom 2019 Call for Community Feedback Tim Wicinski
- Re: NomCom 2019 Call for Community Feedback Rob Sayre
- Re: NomCom 2019 Call for Community Feedback Benjamin Kaduk
- Re: NomCom 2019 Call for Community Feedback Bob Hinden
- Re: NomCom 2019 Call for Community Feedback Donald Eastlake
- Re: NomCom 2019 Call for Community Feedback Kathleen Moriarty
- Re: NomCom 2019 Call for Community Feedback Eric Vyncke (evyncke)
- Re: NomCom 2019 Call for Community Feedback Salz, Rich
- Re: NomCom 2019 Call for Community Feedback Keith Moore
- Re: NomCom 2019 Call for Community Feedback John Levine
- Re: NomCom 2019 Call for Community Feedback Salz, Rich
- Re: NomCom 2019 Call for Community Feedback Stewart Bryant
- Re: NomCom 2019 Call for Community Feedback Kathleen Moriarty
- Re: NomCom 2019 Call for Community Feedback Michael Richardson
- Re: NomCom 2019 Call for Community Feedback Kyle Rose
- AD workload [was Re: NomCom 2019 Call for Communi… Brian E Carpenter
- Re: AD workload [was Re: NomCom 2019 Call for Com… Mark Nottingham
- Re: AD workload [was Re: NomCom 2019 Call for Com… Rob Sayre
- Re: AD workload [was Re: NomCom 2019 Call for Com… Terry Manderson
- Re: AD workload [was Re: NomCom 2019 Call for Com… Salz, Rich
- Re: AD workload [was Re: NomCom 2019 Call for Com… Keith Moore
- Re: AD workload [was Re: NomCom 2019 Call for Com… Leif Johansson
- Quality of Directorate reviews Alexey Melnikov
- Re: Quality of Directorate reviews Ralph Droms
- RE: Quality of Directorate reviews Rob Wilton (rwilton)
- Re: Quality of Directorate reviews Alexey Melnikov
- Re: Quality of Directorate reviews Stewart Bryant
- Re: AD workload [was Re: NomCom 2019 Call for Com… Salz, Rich
- RE: Quality of Directorate reviews Paul Wouters
- Re: Quality of Directorate reviews Carsten Bormann
- Re: Quality of Directorate reviews Ralph Droms
- Re: Quality of Directorate reviews Keith Moore
- Re: Quality of Directorate reviews Ralph Droms
- Re: AD workload [was Re: NomCom 2019 Call for Com… Michael Richardson
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Keith Moore
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Michael Richardson
- Re: AD workload [was Re: NomCom 2019 Call for Com… Stewart Bryant
- Re: Quality of Directorate reviews Stewart Bryant
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Bob Hinden
- Re: Quality of Directorate reviews Bob Hinden
- Re: Quality of Directorate reviews Salz, Rich
- Re: Quality of Directorate reviews Bob Hinden
- Re: Quality of Directorate reviews Jared Mauch
- Re: Quality of Directorate reviews Salz, Rich
- Re: Quality of Directorate reviews Stewart Bryant
- Re: AD workload [was Re: NomCom 2019 Call for Com… Leif Johansson
- Re: AD workload [was Re: NomCom 2019 Call for Com… Salz, Rich
- Re: AD workload [was Re: NomCom 2019 Call for Com… Salz, Rich
- Re: AD workload [was Re: NomCom 2019 Call for Com… Leif Johansson
- Re: AD workload [was Re: NomCom 2019 Call for Com… Leif Johansson
- Thought experiment [Re: Quality of Directorate re… Brian E Carpenter
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Quality of Directorate reviews Keith Moore
- Re: Quality of Directorate reviews Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Brian E Carpenter
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Brian E Carpenter
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Leif Johansson
- Re: Thought experiment [Re: Quality of Directorat… Bob Hinden
- Re: Thought experiment [Re: Quality of Directorat… Bob Hinden
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… tom petch
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Stewart Bryant
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Salz, Rich
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Brian E Carpenter
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Thought experiment [Re: Quality of Directorat… Bob Hinden
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Nico Williams
- Re: Thought experiment [Re: Quality of Directorat… Christian Huitema
- Author and attendance measurements [Was: Re: Thou… Jari Arkko
- Re: Author and attendance measurements [Was: Re: … Keith Moore
- Re: AD workload [was Re: NomCom 2019 Call for Com… Eliot Lear
- Re: AD workload [was Re: NomCom 2019 Call for Com… Ole Troan
- Re: Author and attendance measurements [Was: Re: … John C Klensin
- Re: AD workload [was Re: NomCom 2019 Call for Com… Salz, Rich
- Re: Author and attendance measurements [Was: Re: … Michael Richardson
- Re: Author and attendance measurements [Was: Re: … Andrew G. Malis
- Re: AD workload [was Re: NomCom 2019 Call for Com… Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Bob Hinden
- Re: Author and attendance measurements [Was: Re: … Keith Moore
- Re: Author and attendance measurements [Was: Re: … Michael Richardson
- Re: NomCom 2019 Call for Community Feedback John Leslie
- Re: AD workload [was Re: NomCom 2019 Call for Com… Brian E Carpenter
- Re: AD workload [was Re: NomCom 2019 Call for Com… Keith Moore
- Re: AD workload [was Re: NomCom 2019 Call for Com… Michael Richardson
- Re: AD workload [was Re: NomCom 2019 Call for Com… Keith Moore
- Re: Author and attendance measurements [Was: Re: … John C Klensin
- Re: NomCom 2019 Call for Community Feedback John C Klensin
- Re: NomCom 2019 Call for Community Feedback Mary B
- Re: Author and attendance measurements [Was: Re: … Carsten Bormann
- Re: Author and attendance measurements [Was: Re: … Michael Richardson
- Re: Quality of Directorate reviews Phillip Hallam-Baker
- Re: Quality of Directorate reviews Keith Moore
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Keith Moore
- Re: Thought experiment [Re: Quality of Directorat… Julian Reschke
- Re: Thought experiment [Re: Quality of Directorat… Michael Richardson
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Benjamin Kaduk
- Re: Quality of Directorate reviews Keith Moore
- Re: Quality of Directorate reviews Michael Richardson
- Re: Quality of Directorate reviews Benjamin Kaduk
- Re: Quality of Directorate reviews Abdussalam Baryun
- Re: Quality of Directorate reviews Mark Nottingham