Re: Late review management (Re: [Icar] independence of reviews; variability)

Margaret Wasserman <margaret@thingmagic.com> Thu, 11 March 2004 00:32 UTC

Received: from optimus.ietf.org (optimus.ietf.org [132.151.1.19]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id TAA16639 for <icar-archive@odin.ietf.org>; Wed, 10 Mar 2004 19:32:39 -0500 (EST)
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B1E7M-0000UD-02 for icar-archive@odin.ietf.org; Wed, 10 Mar 2004 19:32:10 -0500
Received: (from exim@localhost) by www1.ietf.org (8.12.8/8.12.8/Submit) id i2B0W79H001868 for icar-archive@odin.ietf.org; Wed, 10 Mar 2004 19:32:07 -0500
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B1E7L-0000U3-Pd for icar-web-archive@optimus.ietf.org; Wed, 10 Mar 2004 19:32:07 -0500
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id TAA16560 for <icar-web-archive@ietf.org>; Wed, 10 Mar 2004 19:32:06 -0500 (EST)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 1B1E7K-0003z2-00 for icar-web-archive@ietf.org; Wed, 10 Mar 2004 19:32:06 -0500
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1B1E6I-0003mN-00 for icar-web-archive@ietf.org; Wed, 10 Mar 2004 19:31:03 -0500
Received: from optimus.ietf.org ([132.151.1.19]) by ietf-mx with esmtp (Exim 4.12) id 1B1E5L-0003c5-00 for icar-web-archive@ietf.org; Wed, 10 Mar 2004 19:30:03 -0500
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B1E5K-0000QV-C9; Wed, 10 Mar 2004 19:30:02 -0500
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B1E4S-0000PK-5X for icar@optimus.ietf.org; Wed, 10 Mar 2004 19:29:08 -0500
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id TAA16440 for <icar@ietf.org>; Wed, 10 Mar 2004 19:29:07 -0500 (EST)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 1B1E4Q-0003Tg-00 for icar@ietf.org; Wed, 10 Mar 2004 19:29:06 -0500
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1B1E3b-0003LT-00 for icar@ietf.org; Wed, 10 Mar 2004 19:28:15 -0500
Received: from smtp.exodus.net ([66.35.230.237] helo=smtp02-w.exodus.net) by ietf-mx with esmtp (Exim 4.12) id 1B1E36-0003Bk-00 for icar@ietf.org; Wed, 10 Mar 2004 19:27:44 -0500
Received: from ms101.mail1.com (ms101.mail1.com [209.1.5.174]) by smtp02-w.exodus.net (8.12.8/8.12.8) with ESMTP id i2ALZbEv017500 for <icar@ietf.org>; Wed, 10 Mar 2004 15:35:37 -0600
Received: from [192.168.2.2] (unverified [207.31.248.169]) by accounting.espmail.com (Rockliffe SMTPRA 5.2.5) with ESMTP id <B0018678336@ms101.mail1.com>; Wed, 10 Mar 2004 16:27:13 -0800
Mime-Version: 1.0
X-Sender: margaret@thingmagic.com@ms101.mail1.com
Message-Id: <p06020451bc75580f2b76@[192.168.2.2]>
In-Reply-To: <20040310225839.GA17999@1-4-5.net>
References: <1221060422.20040308164330@brandenburg.com> <035201c40588$c86cc840$0400a8c0@DFNJGL21> <227129254.1078828209@localhost> <161118984.20040310131612@brandenburg.com> <p0602044ebc75384bb9a3@[192.168.2.2]> <20040310225839.GA17999@1-4-5.net>
Date: Wed, 10 Mar 2004 19:26:23 -0500
To: David Meyer <dmm@1-4-5.net>
From: Margaret Wasserman <margaret@thingmagic.com>
Subject: Re: Late review management (Re: [Icar] independence of reviews; variability)
Cc: Dave Crocker <dhc@dcrocker.net>, Harald Tveit Alvestrand <harald@alvestrand.no>, Spencer Dawkins <spencer@mcsr-labs.org>, icar@ietf.org
Content-Type: text/plain; charset="us-ascii" ; format="flowed"
Sender: icar-admin@ietf.org
Errors-To: icar-admin@ietf.org
X-BeenThere: icar@ietf.org
X-Mailman-Version: 2.0.12
Precedence: bulk
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=unsubscribe>
List-Id: Improved Cross-Area Review <icar.ietf.org>
List-Post: <mailto:icar@ietf.org>
List-Help: <mailto:icar-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=subscribe>
X-Spam-Checker-Version: SpamAssassin 2.60 (1.212-2003-09-23-exp) on ietf-mx.ietf.org
X-Spam-Status: No, hits=0.0 required=5.0 tests=AWL autolearn=no version=2.60

At 2:58 PM -0800 3/10/04, David Meyer wrote:
>  >>  Sometimes, though, we seem to question those assumption,
>  >> and we end up adding structures, policies or processes that are
>>>  intended to protect us from the results of our own consensus-driven
>>>  decisions.  I think that is (and has been) a mistake.
>
>	I couldn't really parse the last sentence in this
>	paragraph, i.e., what do you think is the mistake,
>	questioning the assumptions or adding structures,
>	policies, or processes?

I meant that I believe it is (and has been) a mistake to add new 
structures, policies and procedures at the end of the process that 
are intended to protect us from the less-than-perfect results of the 
WG consensus process, because I don't believe that is the most 
effective way to produce good work.

It's not that I think we should let small, insular WGs run amok and 
then blindly publish everything that they produce.  However, I think 
that we would do better to offer community guidance and input during 
the development of new work (through review, for instance) than to 
try to block that work at the end.

There is really nothing new in what I'm saying...  Most modern 
engineering organizations have reached the point where they know that 
more bugs can be found and corrected, with less schedule impact, 
through early review (such as design and code review) than by quality 
checks at the end of the process (such as traditional 
post-development QA processes).

IMO, we do need some type of evaluation at the end (as a final check 
to detect and correct failures earlier in the process), but the 
current situation where a large percentage of the work of the IETF is 
blocked and modified after the WG believes it is finished, is 
pathological.  IMO, we can't fix this problem at the end (by just 
publishing the work, for example) we need to fix it at the beginning 
(in the WGs). An important way to try to fix this problem is to get 
more community input/review, including review and guidance from IETF 
leaderhship, earlier in the process.

Margaret


_______________________________________________
Icar mailing list
Icar@ietf.org
https://www1.ietf.org/mailman/listinfo/icar