Re: Quality of Directorate reviews

Michael Richardson <mcr+ietf@sandelman.ca> Wed, 06 November 2019 15:33 UTC

Return-Path: <mcr+ietf@sandelman.ca>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 58A911208DF for <ietf@ietfa.amsl.com>; Wed, 6 Nov 2019 07:33:53 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.2
X-Spam-Level:
X-Spam-Status: No, score=-4.2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id W0qmgyy8-uwM for <ietf@ietfa.amsl.com>; Wed, 6 Nov 2019 07:33:51 -0800 (PST)
Received: from tuna.sandelman.ca (tuna.sandelman.ca [IPv6:2607:f0b0:f:3:216:3eff:fe7c:d1f3]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id AB7B3120128 for <ietf@ietf.org>; Wed, 6 Nov 2019 07:33:51 -0800 (PST)
Received: from sandelman.ca (obiwan.sandelman.ca [IPv6:2607:f0b0:f:2::247]) by tuna.sandelman.ca (Postfix) with ESMTP id 217673818F; Wed, 6 Nov 2019 10:30:55 -0500 (EST)
Received: from localhost (localhost [IPv6:::1]) by sandelman.ca (Postfix) with ESMTP id 6AEE714; Wed, 6 Nov 2019 10:33:50 -0500 (EST)
From: Michael Richardson <mcr+ietf@sandelman.ca>
To: Paul Wouters <paul@nohats.ca>
cc: "Rob Wilton \(rwilton\)" <rwilton@cisco.com>, ietf <ietf@ietf.org>
Subject: Re: Quality of Directorate reviews
In-Reply-To: <alpine.LRH.2.21.1911060937020.10926@bofh.nohats.ca>
References: <157279399807.13506.13363770981495597049.idtracker@ietfa.amsl.com> <0EF64763-BA25-468A-B387-91445A61D318@gmail.com> <CAJU8_nUovmFmgNiYx0ez_1f+GPdU9xGViDYWfowEEomrn0pyDw@mail.gmail.com> <alpine.LRH.2.21.1911040841160.27600@bofh.nohats.ca> <CE06CC6D-E37F-4C90-B782-D14B1D715D4B@cable.comcast.com> <38E47448-63B4-4A5D-8A9D-3AB890EBDDDD@akamai.com> <09886edb-4302-b309-9eaa-f016c4487128@gmail.com> <26819.1572990657@localhost> <2668fa45-7667-51a6-7cb6-4b704c7fba5a@isode.com> <2C97D18E-3DA0-4A2D-8179-6D86EB835783@gmail.com> <MN2PR11MB43669E4CEF13CDA51A764F9AB5790@MN2PR11MB4366.namprd11.prod.outlook.com> <alpine.LRH.2.21.1911060937020.10926@bofh.nohats.ca>
X-Mailer: MH-E 8.6; nmh 1.7+dev; GNU Emacs 24.5.1
X-Face: $\n1pF)h^`}$H>Hk{L"x@)JS7<%Az}5RyS@k9X%29-lHB$Ti.V>2bi.~ehC0; <'$9xN5Ub# z!G,p`nR&p7Fz@^UXIn156S8.~^@MJ*mMsD7=QFeq%AL4m<nPbLgmtKK-5dC@#:k
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature"
Date: Wed, 06 Nov 2019 10:33:50 -0500
Message-ID: <21563.1573054430@localhost>
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/v8PSmHJoNjaQ0yn8UxjQxC3Iwec>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 06 Nov 2019 15:33:53 -0000

Paul Wouters <paul@nohats.ca> wrote:
    >> Perhaps RFCs could list (within the document) who reviewed/approved
    >> them, and in which role/capacity the review had been performed.

    >> This could serve two purposes:
    >> - some minimal reward for those individuals taking the time to review the document,
    >> - encouragement for the reviewers to ensure that an adequate review has been performed based on the role/capacity in which they are acting.

    > I think I like this idea, but also, speaking for myself I would refuse
    > to review a few more documents of things that are too far out of my
    > area of expertise (which might be a good or bad thing, depending on
    > whether anyone else steps up)

I think that this is certainly wise, but I also think that having reviews
From people who are completely cold is often good.  It depends; I've been
asked to review some extension to a TE-RSVP (for instance, probably got that
TLA wrong) document that basically just added two new attributes, and I can't
even comprehend the thing being extended, as it's an extension of something
else I don't know. I agree with you: there is little I can add other than
saying, "paragraph four seems awkward".
But that in itself has value, but it's not a useful review to the AD.

But there are other things you and I could come to cold, like (to use my
example above), that might be:
"An Architecture for doing Traffic Engineering with RSVP" where we might
actually be able to say, "Yes, I understood the problem, and I agree that the
solution seems to be in scale with the problem, and the security posture
seems appropriate"

--
Michael Richardson <mcr+IETF@sandelman.ca>ca>, Sandelman Software Works
 -= IPv6 IoT consulting =-