Re: Late review management (Re: [Icar] independence of reviews; variability)
David Meyer <dmm@1-4-5.net> Wed, 10 March 2004 23:04 UTC
Received: from optimus.ietf.org (optimus.ietf.org [132.151.1.19])
by ietf.org (8.9.1a/8.9.1a) with ESMTP id SAA11981
for <icar-archive@odin.ietf.org>; Wed, 10 Mar 2004 18:04:28 -0500 (EST)
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org)
by optimus.ietf.org with esmtp (Exim 4.20) id 1B1Ck5-0004Rb-8d
for icar-archive@odin.ietf.org; Wed, 10 Mar 2004 18:04:01 -0500
Received: (from exim@localhost)
by www1.ietf.org (8.12.8/8.12.8/Submit) id i2AN414G017080
for icar-archive@odin.ietf.org; Wed, 10 Mar 2004 18:04:01 -0500
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org)
by optimus.ietf.org with esmtp (Exim 4.20) id 1B1Ck5-0004RJ-2m
for icar-web-archive@optimus.ietf.org; Wed, 10 Mar 2004 18:04:01 -0500
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1])
by ietf.org (8.9.1a/8.9.1a) with ESMTP id SAA11933
for <icar-web-archive@ietf.org>; Wed, 10 Mar 2004 18:03:57 -0500 (EST)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12)
id 1B1Ck2-0006El-00
for icar-web-archive@ietf.org; Wed, 10 Mar 2004 18:03:58 -0500
Received: from exim by ietf-mx with spam-scanned (Exim 4.12)
id 1B1Cj6-00065y-00
for icar-web-archive@ietf.org; Wed, 10 Mar 2004 18:03:01 -0500
Received: from optimus.ietf.org ([132.151.1.19])
by ietf-mx with esmtp (Exim 4.12) id 1B1Ci8-0005wx-00
for icar-web-archive@ietf.org; Wed, 10 Mar 2004 18:02:00 -0500
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org)
by optimus.ietf.org with esmtp (Exim 4.20)
id 1B1CiA-0002oJ-4o; Wed, 10 Mar 2004 18:02:02 -0500
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org)
by optimus.ietf.org with esmtp (Exim 4.20) id 1B1ChB-00027e-GP
for icar@optimus.ietf.org; Wed, 10 Mar 2004 18:01:01 -0500
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1])
by ietf.org (8.9.1a/8.9.1a) with ESMTP id SAA11848
for <icar@ietf.org>; Wed, 10 Mar 2004 18:00:57 -0500 (EST)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12)
id 1B1Ch8-0005nW-00
for icar@ietf.org; Wed, 10 Mar 2004 18:00:58 -0500
Received: from exim by ietf-mx with spam-scanned (Exim 4.12)
id 1B1CgD-0005f5-00
for icar@ietf.org; Wed, 10 Mar 2004 18:00:02 -0500
Received: from m106.maoz.com ([205.167.76.9]) by ietf-mx with esmtp (Exim 4.12)
id 1B1CfP-0005NM-00
for icar@ietf.org; Wed, 10 Mar 2004 17:59:11 -0500
Received: from m106.maoz.com (localhost.localdomain [127.0.0.1])
by m106.maoz.com (8.12.11/8.12.11) with ESMTP id i2AMwdR2018170;
Wed, 10 Mar 2004 14:58:39 -0800
Received: (from dmm@localhost)
by m106.maoz.com (8.12.11/8.12.10/Submit) id i2AMwd5t018169;
Wed, 10 Mar 2004 14:58:39 -0800
X-Authentication-Warning: m106.maoz.com: dmm set sender to dmm@1-4-5.net using
-f
Date: Wed, 10 Mar 2004 14:58:39 -0800
From: David Meyer <dmm@1-4-5.net>
To: Margaret Wasserman <margaret@thingmagic.com>
Cc: Dave Crocker <dhc@dcrocker.net>,
Harald Tveit Alvestrand <harald@alvestrand.no>,
Spencer Dawkins <spencer@mcsr-labs.org>, icar@ietf.org
Subject: Re: Late review management (Re: [Icar] independence of reviews;
variability)
Message-ID: <20040310225839.GA17999@1-4-5.net>
References: <1221060422.20040308164330@brandenburg.com>
<035201c40588$c86cc840$0400a8c0@DFNJGL21> <227129254.1078828209@localhost>
<161118984.20040310131612@brandenburg.com>
<p0602044ebc75384bb9a3@[192.168.2.2]>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <p0602044ebc75384bb9a3@[192.168.2.2]>
User-Agent: Mutt/1.4.1i
X-public-key: http://www.1-4-5.net/~dmm/public-key.asc
X-philosophy: "I just had to let it go" -- John Lennon
Sender: icar-admin@ietf.org
Errors-To: icar-admin@ietf.org
X-BeenThere: icar@ietf.org
X-Mailman-Version: 2.0.12
Precedence: bulk
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/icar>,
<mailto:icar-request@ietf.org?subject=unsubscribe>
List-Id: Improved Cross-Area Review <icar.ietf.org>
List-Post: <mailto:icar@ietf.org>
List-Help: <mailto:icar-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/icar>,
<mailto:icar-request@ietf.org?subject=subscribe>
X-Spam-Checker-Version: SpamAssassin 2.60 (1.212-2003-09-23-exp) on
ietf-mx.ietf.org
X-Spam-Status: No, hits=0.0 required=5.0 tests=AWL autolearn=no version=2.60
Margaret, >> >Once again, diversity of perspectives is our friend... that is, if we >> >believe in community rough consensus, rather than hierarchical assertion >> >of authority. >> >> This touches on a thought I've had off-and-on for the past couple of >> years... >> >> The current IETF structures, policies and processes are based on some >> fundamental assumptions two of which are (1) that making decisions by >> rough consensus, reached through an open process will achieve good >> results, and (2) we can select leaders (ADs, WG chairs, etc.) and >> trust them to fairly solicit, judge and act upon rough community >> consensus. Sometimes, though, we seem to question those assumption, >> and we end up adding structures, policies or processes that are >> intended to protect us from the results of our own consensus-driven >> decisions. I think that is (and has been) a mistake. I couldn't really parse the last sentence in this paragraph, i.e., what do you think is the mistake, questioning the assumptions or adding structures, policies, or processes? That being said, honestly questioning one's assumptions with an eye toward improvement is never wrong. However, the latter (adding structure, etc) clearly can. So maybe its not really so much about the questioning (that much is healthy for our or any organization); maybe it is more about what we do in few those cases (if any) that we might find in which our common assumptions don't hold. In the case of the IETF, it is pretty clear that there are at most a few cases in which our consensus based approach is less efficient than we might like; it clearly works well in the vast majority of cases (nuff said on that one; the record speaks for itself). >> While there is no decision making process (hierarchical, democratic, >> I just get to decide...) that achieves good results all of the time, >> the consensus-driven process has worked well for the IETF over the >> years. By failing to trust it, we don't actually move to another >> effective decision making process, we just break the one that we have. Maybe there is be something more (less?) granular here, like trusting the "Rough consensus and running code" isn't a binary thing? That is, it works extremely well for us most of the time, however, we do need to be vigilant and watch out for those few instances in which it doesn't. So maybe it is less about trust, and possibly more about trying to make sure those processes that have been so successful for us continue to serve us well. That goal would seem (minimally) to require continual reevaluation as we, our technology, and our industry evolve. At least that is how I see this issue. >> I think that this same line of thinking applies to review... We >> should put into place the mechanisms, tools, training, etc. to >> improve the community's capacity to provide quality review. Perhaps >> we should provide mechanisms that help WGs' find and recruit >> reviewers. We could even develop some guidelines about what type and >> quantity of review makes sense at each level. But, ultimately, I >> think that we should trust that our WGs (and our WG chairs, document >> editors, etc.) actually _want_ to produce good quality, >> well-reviewed work. We can improve their ability to do that by >> giving them better tools, but we won't achieve anything by trying to >> enforce quality through "better" rules. Completely agree. >> If we decide, as a community, that we can no longer trust the >> consensus process and/or the motivations of our ADs, WG chairs or >> document editors, we have a _much_ bigger problem than can be solved >> by changing our review processes. Again, completely agree. Dave _______________________________________________ Icar mailing list Icar@ietf.org https://www1.ietf.org/mailman/listinfo/icar
- [Icar] independence of reviews; variability Dave Crocker
- Re: [Icar] independence of reviews; variability Dave Crocker
- Re: [Icar] independence of reviews; variability Spencer Dawkins
- Re: [Icar] independence of reviews; variability Mark Allman
- Re: [Icar] independence of reviews; variability Dave Crocker
- Late review management (Re: [Icar] independence o… Harald Tveit Alvestrand
- Re: [Icar] independence of reviews; variability Margaret Wasserman
- Re: [Icar] independence of reviews; variability Dave Crocker
- Re: Late review management (Re: [Icar] independen… Dave Crocker
- Re: Late review management (Re: [Icar] independen… Margaret Wasserman
- Re: Late review management (Re: [Icar] independen… David Meyer
- Re: Late review management (Re: [Icar] independen… David Meyer
- Re: Late review management (Re: [Icar] independen… Harald Tveit Alvestrand
- Re: Late review management (Re: [Icar] independen… Margaret Wasserman
- Re: Late review management (Re: [Icar] independen… David Meyer
- Re: Late review management (Re: [Icar] independen… Eric Rosen
- Re: Late review management (Re: [Icar] independen… Scott W Brim
- Re: Late review management (Re: [Icar] independen… Harald Tveit Alvestrand
- Re: Late review management (Re: [Icar] independen… avri
- Re: Late review management (Re: [Icar] independen… Dave Crocker
- Re: Late review management (Re: [Icar] independen… Eric Rosen
- Re: Late review management (Re: [Icar] independen… Dave Crocker
- Re: Late review management (Re: [Icar] independen… Harald Tveit Alvestrand
- Re: [Icar] independence of reviews; variability Mark Allman