IETF Logo Mail Archive

RE: Quality of Directorate reviews

"Rob Wilton (rwilton)" <rwilton@cisco.com> Wed, 06 November 2019 11:42 UTC

Return-Path: <rwilton@cisco.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 649AA12086B for <ietf@ietfa.amsl.com>; Wed, 6 Nov 2019 03:42:26 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.501
X-Spam-Level:
X-Spam-Status: No, score=-14.501 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=b9Oh0epW; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=bJYUxSXJ
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id yprPqDGuNc5s for <ietf@ietfa.amsl.com>; Wed, 6 Nov 2019 03:42:24 -0800 (PST)
Received: from rcdn-iport-9.cisco.com (rcdn-iport-9.cisco.com [173.37.86.80]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 43B75120861 for <ietf@ietf.org>; Wed, 6 Nov 2019 03:42:24 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=2255; q=dns/txt; s=iport; t=1573040544; x=1574250144; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=jK5CPFV4u/ejvUK3ffzXmZ4kTLs92ehuIBjSiGqcNDU=; b=b9Oh0epWAsHfYS3xuAB6T7RzHRdWoF/x+wSjsxT897bLI8CoWuvb9e+q ZdL+im7ZfqlPC8Lhflzj6ynfafNNfam8lD4mqs75xrUTUTqVu+sHvvJIL 6Qwi5ZJQ94Fkhn0jrLFFUf2Cl5TNIPAawXAOSlk6J5Rg3YO8KQfBFBvA+ E=;
IronPort-PHdr: 9a23:5bx/RR8zTWJksf9uRHGN82YQeigqvan1NQcJ650hzqhDabmn44+8ZB7E/fs4iljPUM2b8P9Ch+fM+4HYEW0bqdfk0jgZdYBUERoMiMEYhQslVdSaCEnnK/jCZC0hF8MEX1hgrDm2
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0ApAABDsMJd/5BdJa1mGgEBAQEBAQEBAQMBAQEBEQEBAQICAQEBAYFtAgEBAQELAYFKUAWBRCAECyoKh2UDin6CXolWjiiCUgNUCQEBAQwBAS0CAQGEQAKEDiQ3Bg4CAwsBAQQBAQECAQUEbYU3DIVRAQEBAQMSKAYBATcBCwQCAQgOAwQBAQEeECERHQgCBAENBQgahUcDLgECphgCgTiIYIIngn4BAQWFBQ0LghcJgTYBjBMYgUA/gRFGgkw+ghuCLINAgiyVaJdbQQqCJJErhCyZbI5DikGPIwIEAgQFAg4BAQWBaCOBWHAVO4JsUBEUgwYMF4NQilN0AYEnj1MBgQ4BAQ
X-IronPort-AV: E=Sophos;i="5.68,274,1569283200"; d="scan'208";a="572099133"
Received: from rcdn-core-8.cisco.com ([173.37.93.144]) by rcdn-iport-9.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 06 Nov 2019 11:42:22 +0000
Received: from XCH-RCD-003.cisco.com (xch-rcd-003.cisco.com [173.37.102.13]) by rcdn-core-8.cisco.com (8.15.2/8.15.2) with ESMTPS id xA6BgMt7022133 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Wed, 6 Nov 2019 11:42:22 GMT
Received: from xhs-aln-002.cisco.com (173.37.135.119) by XCH-RCD-003.cisco.com (173.37.102.13) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Wed, 6 Nov 2019 05:42:22 -0600
Received: from xhs-rtp-003.cisco.com (64.101.210.230) by xhs-aln-002.cisco.com (173.37.135.119) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Wed, 6 Nov 2019 05:42:21 -0600
Received: from NAM04-BN3-obe.outbound.protection.outlook.com (64.101.32.56) by xhs-rtp-003.cisco.com (64.101.210.230) with Microsoft SMTP Server (TLS) id 15.0.1473.3 via Frontend Transport; Wed, 6 Nov 2019 06:42:21 -0500
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=aWK3lj5Nny1eCKuztKKcSBeiUm13KRRy0esEcMsbeztX0Pr6tdpgIdz12I0endu5ZTxPHr4vysk8pH9ntZfxTSpNnmuN97oBtnQBKtf4gCz/ffSnn99B6jPP7PBp5omE7/wvhrIF4b2hiysC8qhNwTevvJCRVzRHZFhFTgERrvclHMBTDAL/U4crjGzXMTEUOdHCtuuH4Lq27ujtrASP3EQx7UCK32r6FfjmVFnJ3+BWx25hHObXBKWEpEcXd9FSrM/yeGpFJ9i/wZIGOG4+FnFGiUSUvNGqGTvi9YZJqVlV7acklPptKIz/dtFynDZHJBX4T/t2ZTRiKA9ydaXmKw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=B49uITP7lNV1LMAb2MKc2fMWyiL+lwZSP5ZVZeE5wg0=; b=P3jvYst8yKEGuV+dO5ROpUK4WXdYFjF/3ij7GEkRwDyVkD3XwXKAwXN7SwMqBcsVPhBafg8cIWZ++Z9kVTAn6I6ddp9YcDrzrWmjgIt32YB+iM+T2wte1M+7W541ydqahACtkTaUk+9w/86jWhmP8ey6gRC6/O8PdOrmfeGyRaqMpvlSUpieRNEqTsRNN6kCg0wWtMIR9soVLX29USIGIHa/yKAkgEZ36g6uAvay0S/5BGea2Lrrh2Nfifr97vKXQp4SVBBwsy2RNyHMeoZjOnfHNeCRJd154CYeXOSTo69g2f4c8FUmu8YyQy2WiKCCzIqSGr8YDa3/Pt95REI3iQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cisco.com; dmarc=pass action=none header.from=cisco.com; dkim=pass header.d=cisco.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector2-cisco-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=B49uITP7lNV1LMAb2MKc2fMWyiL+lwZSP5ZVZeE5wg0=; b=bJYUxSXJN7T6zIPl0TkepKKZzQp7wNJegDoWvQISuZSxUldWmPImzx/Bm98xZFfLyoUhjzCsK5oTIgYjCCLafQVrPgFooqxJdB699U6nTarvslbJR9nK/6xJj5sx0UFgAkMdPo496ckPVP3Iu/Qix7dOdxQDkwv/7SfvHmdQM6s=
Received: from MN2PR11MB4366.namprd11.prod.outlook.com (52.135.38.209) by MN2PR11MB3952.namprd11.prod.outlook.com (10.255.181.21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2430.20; Wed, 6 Nov 2019 11:42:19 +0000
Received: from MN2PR11MB4366.namprd11.prod.outlook.com ([fe80::49b6:bc5c:bd3e:203c]) by MN2PR11MB4366.namprd11.prod.outlook.com ([fe80::49b6:bc5c:bd3e:203c%5]) with mapi id 15.20.2430.020; Wed, 6 Nov 2019 11:42:19 +0000
From: "Rob Wilton (rwilton)" <rwilton@cisco.com>
To: Ralph Droms <rdroms.ietf@gmail.com>, Alexey Melnikov <alexey.melnikov@isode.com>
CC: Michael Richardson <mcr+ietf@sandelman.ca>, ietf <ietf@ietf.org>
Subject: RE: Quality of Directorate reviews
Thread-Topic: Quality of Directorate reviews
Thread-Index: AQHVlI3pvKbdAx2zQ0m3a6BfpwOeGqd9+maAgAAHgeA=
Date: Wed, 06 Nov 2019 11:42:19 +0000
Message-ID: <MN2PR11MB43669E4CEF13CDA51A764F9AB5790@MN2PR11MB4366.namprd11.prod.outlook.com>
References: <157279399807.13506.13363770981495597049.idtracker@ietfa.amsl.com> <0EF64763-BA25-468A-B387-91445A61D318@gmail.com> <CAJU8_nUovmFmgNiYx0ez_1f+GPdU9xGViDYWfowEEomrn0pyDw@mail.gmail.com> <alpine.LRH.2.21.1911040841160.27600@bofh.nohats.ca> <CE06CC6D-E37F-4C90-B782-D14B1D715D4B@cable.comcast.com> <38E47448-63B4-4A5D-8A9D-3AB890EBDDDD@akamai.com> <09886edb-4302-b309-9eaa-f016c4487128@gmail.com> <26819.1572990657@localhost> <2668fa45-7667-51a6-7cb6-4b704c7fba5a@isode.com> <2C97D18E-3DA0-4A2D-8179-6D86EB835783@gmail.com>
In-Reply-To: <2C97D18E-3DA0-4A2D-8179-6D86EB835783@gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=rwilton@cisco.com;
x-originating-ip: [173.38.220.45]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 330947a7-c330-4131-9e72-08d762ae61a0
x-ms-traffictypediagnostic: MN2PR11MB3952:
x-microsoft-antispam-prvs: <MN2PR11MB39527AD678FD735C42C28CE4B5790@MN2PR11MB3952.namprd11.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:8882;
x-forefront-prvs: 02135EB356
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(396003)(136003)(346002)(39860400002)(376002)(366004)(189003)(199004)(51444003)(13464003)(99286004)(26005)(3480700005)(256004)(102836004)(33656002)(14444005)(5660300002)(66476007)(7696005)(76176011)(66066001)(53546011)(9686003)(229853002)(66946007)(66556008)(6506007)(66446008)(64756008)(76116006)(55016002)(4326008)(2906002)(6116002)(3846002)(6246003)(14454004)(478600001)(6436002)(54906003)(52536014)(110136005)(316002)(74316002)(7736002)(8676002)(476003)(486006)(25786009)(81166006)(8936002)(305945005)(71190400001)(11346002)(86362001)(446003)(81156014)(71200400001)(186003); DIR:OUT; SFP:1101; SCL:1; SRVR:MN2PR11MB3952; H:MN2PR11MB4366.namprd11.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 5vb3foQ9ib7X9wsW/b/C/RrJXdweUi+pGxk6gZu7dJYLxMmCyr78FM3Sal5ahWkijV6H82Mpo6Sr3SRjDbaBAXsxLhHe2hfMk8tcUjXCxY7imK9KZpCSkl+QNhlHbAHQgOJUfAidPijN60JjYHFku0d363VI7e0QrPk2pU42ZXzp3iHekK6EQr1j3QNM0X0JU+mTZgphfigXldtthP+hk7gA/44APiJ88ZmWtPE9OQZvfbCBI17cKqrlMvmBD0vgeBsLBA9w1o6+Kx2T/rJ0pTMLnRKBDG7pg4efwJ1OpCDssg+9YHnvQFA9xRTAqkcBEMEkVUoOn0XZSNGUlOzMqmPiOqyHdGIBfMFK+lh1UOn4YHMHNN4BZoNc3hpfbCfN8Zgy67kBjeW5y0oTk3nRUptwmc8SzzcCJQ2w0riFnGF4W9dt3XJr0aeuqnVGBPVN
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 330947a7-c330-4131-9e72-08d762ae61a0
X-MS-Exchange-CrossTenant-originalarrivaltime: 06 Nov 2019 11:42:19.4804 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: I+kFrJLEBvZBvyXj1AU5Ens3pzBbjPNaRTRFw5e5Q6b1b/vO0PiH0lHV3zuphVCcUR7f87kbmLsqbYx8V/JClA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR11MB3952
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.37.102.13, xch-rcd-003.cisco.com
X-Outbound-Node: rcdn-core-8.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/uZ2twv4v2ntdwLafchj7Lq9BdOE>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 06 Nov 2019 11:42:27 -0000

Perhaps RFCs could list (within the document) who reviewed/approved them, and in which role/capacity the review had been performed.

This could serve two purposes:
 - some minimal reward for those individuals taking the time to review the document,
 - encouragement for the reviewers to ensure that an adequate review has been performed based on the role/capacity in which they are acting. 

Rob


> -----Original Message-----
> From: ietf <ietf-bounces@ietf.org> On Behalf Of Ralph Droms
> Sent: 06 November 2019 11:03
> To: Alexey Melnikov <alexey.melnikov@isode.com>
> Cc: Michael Richardson <mcr+ietf@sandelman.ca>; ietf <ietf@ietf.org>
> Subject: Re: Quality of Directorate reviews
> 
> 
> 
> > On Nov 6, 2019, at 5:34 AM, Alexey Melnikov <alexey.melnikov@isode.com>
> wrote:
> >
> > Hi Michael,
> >
> > On 05/11/2019 21:50, Michael Richardson wrote:
> >>
> >> Brian E Carpenter <brian.e.carpenter@gmail.com> wrote:
> >>> If we want the IESG job to be more reasonably sized, we have to take
> >>> work away from the ADs. As far as I can see, that means taking away
> >>> their duty of acting as final reviewers. I don't want to name names
> >>> because I don't think the ADs are to be blamed individually, but
> >>> some of them spend *enormous* effort on detailed reviews.
> >>
> >> +1
> >>
> >> I think that there is a lack of trust by ADs of the various
> directorates.
> >
> > Other ADs have commented on this, but I think I need to repeat what
> > they said and expand on it.
> >
> > Results are vary varied. Some are quite good (e.g. Gen-Art) and others
> > really depend on reviewer. ADs responsible for Directorates are faces
> > with the choice of firing half of their Directorates (which has some
> > rather unfortunate consequences) and/or raise the bar on who should be
> > allowed to join. We already struggle to recruit people at all levels
> > of our organization.
> >
> > Best Regards,
> > Alexey
> 
> We shouldn't be depending on last-minute quality checks to maintain the
> quality of our output.  Working groups should be producing documents that
> are ready to publish, and develop trust that their documents are high
> quality.
> 
> - Ralph
> 
> >

v2.23.0 | Report a Bug | By Email