Re: [Icar] an early review experiment

Alex Rousskov <rousskov@measurement-factory.com> Wed, 19 May 2004 21:32 UTC

Received: from optimus.ietf.org (iesg.org [132.151.1.19]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id RAA19180 for <icar-archive@odin.ietf.org>; Wed, 19 May 2004 17:32:09 -0400 (EDT)
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1BQYQF-0002fR-SN for icar-archive@odin.ietf.org; Wed, 19 May 2004 17:16:19 -0400
Received: (from exim@localhost) by www1.ietf.org (8.12.8/8.12.8/Submit) id i4JLGJPD010249 for icar-archive@odin.ietf.org; Wed, 19 May 2004 17:16:19 -0400
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1BQXVK-0006QT-9m for icar-web-archive@optimus.ietf.org; Wed, 19 May 2004 16:17:30 -0400
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id QAA11238 for <icar-web-archive@ietf.org>; Wed, 19 May 2004 16:17:27 -0400 (EDT)
Received: from ietf-mx.ietf.org ([132.151.6.1] helo=ietf-mx) by ietf-mx with esmtp (Exim 4.32) id 1BQXVI-0006HV-HQ for icar-web-archive@ietf.org; Wed, 19 May 2004 16:17:28 -0400
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1BQXTs-00060f-00 for icar-web-archive@ietf.org; Wed, 19 May 2004 16:16:01 -0400
Received: from optimus.ietf.org ([132.151.1.19]) by ietf-mx with esmtp (Exim 4.12) id 1BQXSm-0005jF-00 for icar-web-archive@ietf.org; Wed, 19 May 2004 16:14:53 -0400
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1BQXCT-0007hw-Ea; Wed, 19 May 2004 15:58:01 -0400
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1BQWqA-0000ay-DF for icar@optimus.ietf.org; Wed, 19 May 2004 15:34:58 -0400
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id PAA06074 for <icar@ietf.org>; Wed, 19 May 2004 15:34:56 -0400 (EDT)
Received: from ietf-mx.ietf.org ([132.151.6.1] helo=ietf-mx) by ietf-mx with esmtp (Exim 4.32) id 1BQWq8-0007FT-S8 for icar@ietf.org; Wed, 19 May 2004 15:34:56 -0400
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1BQWp9-00079s-00 for icar@ietf.org; Wed, 19 May 2004 15:33:56 -0400
Received: from measurement-factory.com ([206.168.0.5]) by ietf-mx with esmtp (Exim 4.12) id 1BQWoP-00075B-00 for icar@ietf.org; Wed, 19 May 2004 15:33:09 -0400
Received: from measurement-factory.com (localhost [127.0.0.1]) by measurement-factory.com (8.12.9/8.12.9) with ESMTP id i4JJX5p6094086; Wed, 19 May 2004 13:33:05 -0600 (MDT) (envelope-from rousskov@measurement-factory.com)
Received: (from rousskov@localhost) by measurement-factory.com (8.12.9/8.12.9/Submit) id i4JJX5UL094085; Wed, 19 May 2004 13:33:05 -0600 (MDT) (envelope-from rousskov)
Date: Wed, 19 May 2004 13:33:05 -0600 (MDT)
From: Alex Rousskov <rousskov@measurement-factory.com>
To: Mark Allman <mallman@icir.org>
cc: icar@ietf.org
Subject: Re: [Icar] an early review experiment
In-Reply-To: <20040519144950.EB9D977AA5C@guns.icir.org>
Message-ID: <Pine.BSF.4.58.0405191316190.77504@measurement-factory.com>
References: <20040519144950.EB9D977AA5C@guns.icir.org>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: icar-admin@ietf.org
Errors-To: icar-admin@ietf.org
X-BeenThere: icar@ietf.org
X-Mailman-Version: 2.0.12
Precedence: bulk
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=unsubscribe>
List-Id: Improved Cross-Area Review <icar.ietf.org>
List-Post: <mailto:icar@ietf.org>
List-Help: <mailto:icar-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=subscribe>
X-Spam-Checker-Version: SpamAssassin 2.60 (1.212-2003-09-23-exp) on ietf-mx.ietf.org
X-Spam-Status: No, hits=0.0 required=5.0 tests=AWL autolearn=no version=2.60

On Wed, 19 May 2004, Mark Allman wrote:

> If I were to sketch the "weighyness" space of early, cross area
> reviews, it'd be something like this:
>
>   + one end of the spectrum would be that ICAR-type comments must be
>     addressed before the document moves forward
>
>   + the other end of the space seems to me to be that the ICAR-type
>     reviews are just like any other review that comes in from a
>     community member (i.e., no special status)
>
>   + there may be middle ground
>
> It'd be nice to hear thoughts on where folks are in this space.

IMO, WG MUST publicly address all reviewer concerns, but can do so any
way it wants. WG MAY reject to act on any comment, for any reason, but
MUST publicly document that the comment is rejected and SHOULD
document rejection rationale.  IESG SHOULD NOT review documents with
unaddressed concerns.

For these rules to be meaningful/effective, there has to be a
mechanism/tool to register specific concerns and WG responses to them
(e.g., ID Tracker DISCUSS items on steroids). Just exchanging freeform
e-mails is not good enough.

It seems to me that same rules should apply to any review, regardless
of its source. There may be periods when WG does not accept reviews
for specific documents though (because they are not ready for any kind
of review or because the WG has finished working on them and wants
IESG to take over).

One simple way to manage review timings is to have both First Call and
Last Call for each draft (at least). These calls will make it clear
when reviews are welcome (and when reviewer comments are virtually
guaranteed to be addressed).

I do not know whether the above fits any of the three bullets you
proposed. It seems lile the second bullet because all reviews have the
same status (but I would call that status "special" compared to the
current "no special status" situation), but it also matches the intent
of the first bullet as far as final IESG action is concerned.

HTH,

Alex.


_______________________________________________
Icar mailing list
Icar@ietf.org
https://www1.ietf.org/mailman/listinfo/icar