Re: Late review management (Re: [Icar] independence of reviews; variability)

David Meyer <dmm@1-4-5.net> Thu, 11 March 2004 00:36 UTC

Received: from optimus.ietf.org (optimus.ietf.org [132.151.1.19]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id TAA16812 for <icar-archive@odin.ietf.org>; Wed, 10 Mar 2004 19:36:29 -0500 (EST)
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B1EB6-0000h9-AH for icar-archive@odin.ietf.org; Wed, 10 Mar 2004 19:36:00 -0500
Received: (from exim@localhost) by www1.ietf.org (8.12.8/8.12.8/Submit) id i2B0a0fR002665 for icar-archive@odin.ietf.org; Wed, 10 Mar 2004 19:36:00 -0500
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B1EB6-0000gu-5L for icar-web-archive@optimus.ietf.org; Wed, 10 Mar 2004 19:36:00 -0500
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id TAA16808 for <icar-web-archive@ietf.org>; Wed, 10 Mar 2004 19:35:59 -0500 (EST)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 1B1EB4-0004b9-00 for icar-web-archive@ietf.org; Wed, 10 Mar 2004 19:35:58 -0500
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1B1EA6-0004TD-00 for icar-web-archive@ietf.org; Wed, 10 Mar 2004 19:34:59 -0500
Received: from optimus.ietf.org ([132.151.1.19]) by ietf-mx with esmtp (Exim 4.12) id 1B1E99-0004Km-00 for icar-web-archive@ietf.org; Wed, 10 Mar 2004 19:33:59 -0500
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B1E9A-0000ec-IY; Wed, 10 Mar 2004 19:34:00 -0500
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B1E8O-0000Zy-Gn for icar@optimus.ietf.org; Wed, 10 Mar 2004 19:33:12 -0500
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id TAA16725 for <icar@ietf.org>; Wed, 10 Mar 2004 19:33:11 -0500 (EST)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 1B1E8M-0004Bz-00 for icar@ietf.org; Wed, 10 Mar 2004 19:33:10 -0500
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1B1E7d-00041i-00 for icar@ietf.org; Wed, 10 Mar 2004 19:32:25 -0500
Received: from m106.maoz.com ([205.167.76.9]) by ietf-mx with esmtp (Exim 4.12) id 1B1E6g-0003i6-00 for icar@ietf.org; Wed, 10 Mar 2004 19:31:26 -0500
Received: from m106.maoz.com (localhost.localdomain [127.0.0.1]) by m106.maoz.com (8.12.11/8.12.11) with ESMTP id i2B0UsIA020720; Wed, 10 Mar 2004 16:30:54 -0800
Received: (from dmm@localhost) by m106.maoz.com (8.12.11/8.12.10/Submit) id i2B0UsEl020719; Wed, 10 Mar 2004 16:30:54 -0800
X-Authentication-Warning: m106.maoz.com: dmm set sender to dmm@1-4-5.net using -f
Date: Wed, 10 Mar 2004 16:30:54 -0800
From: David Meyer <dmm@1-4-5.net>
To: Margaret Wasserman <margaret@thingmagic.com>
Cc: Dave Crocker <dhc@dcrocker.net>, Harald Tveit Alvestrand <harald@alvestrand.no>, Spencer Dawkins <spencer@mcsr-labs.org>, icar@ietf.org
Subject: Re: Late review management (Re: [Icar] independence of reviews; variability)
Message-ID: <20040311003054.GA20694@1-4-5.net>
References: <1221060422.20040308164330@brandenburg.com> <035201c40588$c86cc840$0400a8c0@DFNJGL21> <227129254.1078828209@localhost> <161118984.20040310131612@brandenburg.com> <p0602044ebc75384bb9a3@[192.168.2.2]> <20040310225839.GA17999@1-4-5.net> <p06020451bc75580f2b76@[192.168.2.2]>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <p06020451bc75580f2b76@[192.168.2.2]>
User-Agent: Mutt/1.4.1i
X-public-key: http://www.1-4-5.net/~dmm/public-key.asc
X-philosophy: "I just had to let it go" -- John Lennon
Sender: icar-admin@ietf.org
Errors-To: icar-admin@ietf.org
X-BeenThere: icar@ietf.org
X-Mailman-Version: 2.0.12
Precedence: bulk
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=unsubscribe>
List-Id: Improved Cross-Area Review <icar.ietf.org>
List-Post: <mailto:icar@ietf.org>
List-Help: <mailto:icar-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=subscribe>
X-Spam-Checker-Version: SpamAssassin 2.60 (1.212-2003-09-23-exp) on ietf-mx.ietf.org
X-Spam-Status: No, hits=0.0 required=5.0 tests=AWL autolearn=no version=2.60

On Wed, Mar 10, 2004 at 07:26:23PM -0500, Margaret Wasserman wrote:
>> At 2:58 PM -0800 3/10/04, David Meyer wrote:
>> > >>  Sometimes, though, we seem to question those assumption,
>> > >> and we end up adding structures, policies or processes that are
>> >>> intended to protect us from the results of our own consensus-driven
>> >>> decisions.  I think that is (and has been) a mistake.
>> >
>> >	I couldn't really parse the last sentence in this
>> >	paragraph, i.e., what do you think is the mistake,
>> >	questioning the assumptions or adding structures,
>> >	policies, or processes?
>> 
>> I meant that I believe it is (and has been) a mistake to add new 
>> structures, policies and procedures at the end of the process that 
>> are intended to protect us from the less-than-perfect results of the 
>> WG consensus process, because I don't believe that is the most 
>> effective way to produce good work.
>> 
>> It's not that I think we should let small, insular WGs run amok and 
>> then blindly publish everything that they produce.  However, I think 
>> that we would do better to offer community guidance and input during 
>> the development of new work (through review, for instance) than to 
>> try to block that work at the end.
>> 
>> There is really nothing new in what I'm saying...  Most modern 
>> engineering organizations have reached the point where they know that 
>> more bugs can be found and corrected, with less schedule impact, 
>> through early review (such as design and code review) than by quality 
>> checks at the end of the process (such as traditional 
>> post-development QA processes).
>> 
>> IMO, we do need some type of evaluation at the end (as a final check 
>> to detect and correct failures earlier in the process), but the 
>> current situation where a large percentage of the work of the IETF is 
>> blocked and modified after the WG believes it is finished, is 
>> pathological.  IMO, we can't fix this problem at the end (by just 
>> publishing the work, for example) we need to fix it at the beginning 
>> (in the WGs). An important way to try to fix this problem is to get 
>> more community input/review, including review and guidance from IETF 
>> leaderhship, earlier in the process.

	I think we're in pretty close agreement.

	Dave

_______________________________________________
Icar mailing list
Icar@ietf.org
https://www1.ietf.org/mailman/listinfo/icar