Re: Late review management (Re: [Icar] independence of reviews; variability)

Margaret Wasserman <margaret@thingmagic.com> Wed, 10 March 2004 21:47 UTC

Received: from optimus.ietf.org (optimus.ietf.org [132.151.1.19]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id QAA08688 for <icar-archive@odin.ietf.org>; Wed, 10 Mar 2004 16:47:26 -0500 (EST)
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B1BXW-00029U-Gp for icar-archive@odin.ietf.org; Wed, 10 Mar 2004 16:46:58 -0500
Received: (from exim@localhost) by www1.ietf.org (8.12.8/8.12.8/Submit) id i2ALkwoZ008271 for icar-archive@odin.ietf.org; Wed, 10 Mar 2004 16:46:58 -0500
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B1BXW-00029K-CQ for icar-web-archive@optimus.ietf.org; Wed, 10 Mar 2004 16:46:58 -0500
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id QAA08655 for <icar-web-archive@ietf.org>; Wed, 10 Mar 2004 16:46:55 -0500 (EST)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 1B1BXU-0001yW-00 for icar-web-archive@ietf.org; Wed, 10 Mar 2004 16:46:56 -0500
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1B1BWX-0001pT-00 for icar-web-archive@ietf.org; Wed, 10 Mar 2004 16:45:58 -0500
Received: from optimus.ietf.org ([132.151.1.19]) by ietf-mx with esmtp (Exim 4.12) id 1B1BVe-0001h0-00 for icar-web-archive@ietf.org; Wed, 10 Mar 2004 16:45:02 -0500
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B1BVf-000204-Cr; Wed, 10 Mar 2004 16:45:03 -0500
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B1BVb-0001yR-TD for icar@optimus.ietf.org; Wed, 10 Mar 2004 16:44:59 -0500
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id QAA08579 for <icar@ietf.org>; Wed, 10 Mar 2004 16:44:57 -0500 (EST)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 1B1BVZ-0001gB-00 for icar@ietf.org; Wed, 10 Mar 2004 16:44:58 -0500
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1B1BUb-0001Wv-00 for icar@ietf.org; Wed, 10 Mar 2004 16:43:58 -0500
Received: from smtp.exodus.net ([66.35.230.236]) by ietf-mx with esmtp (Exim 4.12) id 1B1BTi-0001F5-00 for icar@ietf.org; Wed, 10 Mar 2004 16:43:02 -0500
Received: from ms101.mail1.com (ms101.mail1.com [209.1.5.174]) by smtp.exodus.net (8.12.8/8.12.8) with ESMTP id i2ANKRw3005851 for <icar@ietf.org>; Wed, 10 Mar 2004 15:20:27 -0800
Received: from [192.168.2.2] (unverified [207.31.248.169]) by accounting.espmail.com (Rockliffe SMTPRA 5.2.5) with ESMTP id <B0018676377@ms101.mail1.com>; Wed, 10 Mar 2004 13:42:32 -0800
Mime-Version: 1.0
X-Sender: margaret@thingmagic.com@ms101.mail1.com
Message-Id: <p0602044ebc75384bb9a3@[192.168.2.2]>
In-Reply-To: <161118984.20040310131612@brandenburg.com>
References: <1221060422.20040308164330@brandenburg.com> <035201c40588$c86cc840$0400a8c0@DFNJGL21> <227129254.1078828209@localhost> <161118984.20040310131612@brandenburg.com>
Date: Wed, 10 Mar 2004 16:42:28 -0500
To: Dave Crocker <dhc@dcrocker.net>, Harald Tveit Alvestrand <harald@alvestrand.no>
From: Margaret Wasserman <margaret@thingmagic.com>
Subject: Re: Late review management (Re: [Icar] independence of reviews; variability)
Cc: Spencer Dawkins <spencer@mcsr-labs.org>, icar@ietf.org
Content-Type: text/plain; charset="us-ascii" ; format="flowed"
Sender: icar-admin@ietf.org
Errors-To: icar-admin@ietf.org
X-BeenThere: icar@ietf.org
X-Mailman-Version: 2.0.12
Precedence: bulk
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=unsubscribe>
List-Id: Improved Cross-Area Review <icar.ietf.org>
List-Post: <mailto:icar@ietf.org>
List-Help: <mailto:icar-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=subscribe>
X-Spam-Checker-Version: SpamAssassin 2.60 (1.212-2003-09-23-exp) on ietf-mx.ietf.org
X-Spam-Status: No, hits=0.0 required=5.0 tests=AWL autolearn=no version=2.60


>Once again, diversity of perspectives is our friend... that is, if we
>believe in community rough consensus, rather than hierarchical assertion
>of authority.

This touches on a thought I've had off-and-on for the past couple of years...

The current IETF structures, policies and processes are based on some 
fundamental assumptions two of which are (1) that making decisions by 
rough consensus, reached through an open process will achieve good 
results, and (2) we can select leaders (ADs, WG chairs, etc.) and 
trust them to fairly solicit, judge and act upon rough community 
consensus.  Sometimes, though, we seem to question those assumption, 
and we end up adding structures, policies or processes that are 
intended to protect us from the results of our own consensus-driven 
decisions.  I think that is (and has been) a mistake.

While there is no decision making process (hierarchical, democratic, 
I just get to decide...) that achieves good results all of the time, 
the consensus-driven process has worked well for the IETF over the 
years.  By failing to trust it, we don't actually move to another 
effective decision making process, we just break the one that we have.

I think that this same line of thinking applies to review...  We 
should put into place the mechanisms, tools, training, etc. to 
improve the community's capacity to provide quality review.  Perhaps 
we should provide mechanisms that help WGs' find and recruit 
reviewers.  We could even develop some guidelines about what type and 
quantity of review makes sense at each level.  But, ultimately, I 
think that we should trust that our WGs (and our WG chairs, document 
editors, etc.) actually _want_ to  produce good quality, 
well-reviewed work.  We can improve their ability to do that by 
giving them better tools, but we won't achieve anything by trying to 
enforce quality through "better" rules.

If we decide, as a community, that we can no longer trust the 
consensus process and/or the motivations of our ADs, WG chairs or 
document editors, we have a _much_ bigger problem than can be solved 
by changing our review processes.

Margaret

_______________________________________________
Icar mailing list
Icar@ietf.org
https://www1.ietf.org/mailman/listinfo/icar