Re: [Icar] an early review experiment

"Joel M. Halpern" <joel@stevecrocker.com> Wed, 19 May 2004 21:59 UTC

Received: from optimus.ietf.org (iesg.org [132.151.1.19]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id RAA22610 for <icar-archive@odin.ietf.org>; Wed, 19 May 2004 17:59:42 -0400 (EDT)
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1BQZ2M-00021w-NL for icar-archive@odin.ietf.org; Wed, 19 May 2004 17:55:42 -0400
Received: (from exim@localhost) by www1.ietf.org (8.12.8/8.12.8/Submit) id i4JLtgFd007799 for icar-archive@odin.ietf.org; Wed, 19 May 2004 17:55:42 -0400
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1BQYnb-00059j-3J for icar-web-archive@optimus.ietf.org; Wed, 19 May 2004 17:40:27 -0400
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id RAA20563 for <icar-web-archive@ietf.org>; Wed, 19 May 2004 17:40:23 -0400 (EDT)
Received: from ietf-mx.ietf.org ([132.151.6.1] helo=ietf-mx) by ietf-mx with esmtp (Exim 4.32) id 1BQYnY-0004uZ-MF for icar-web-archive@ietf.org; Wed, 19 May 2004 17:40:24 -0400
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1BQYlK-0004Oa-00 for icar-web-archive@ietf.org; Wed, 19 May 2004 17:38:07 -0400
Received: from optimus.ietf.org ([132.151.1.19]) by ietf-mx with esmtp (Exim 4.12) id 1BQYge-0003e2-00 for icar-web-archive@ietf.org; Wed, 19 May 2004 17:33:16 -0400
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1BQYaa-0006UW-Sy; Wed, 19 May 2004 17:27:00 -0400
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1BQXce-0008Ml-0W for icar@optimus.ietf.org; Wed, 19 May 2004 16:25:04 -0400
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id QAA11868 for <icar@ietf.org>; Wed, 19 May 2004 16:24:55 -0400 (EDT)
Received: from ietf-mx.ietf.org ([132.151.6.1] helo=ietf-mx) by ietf-mx with esmtp (Exim 4.32) id 1BQXcW-0007Lc-AL for icar@ietf.org; Wed, 19 May 2004 16:24:56 -0400
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1BQXbW-0007EX-00 for icar@ietf.org; Wed, 19 May 2004 16:23:55 -0400
Received: from ns.execdsl.net ([208.184.15.238] helo=EXECDSL.COM) by ietf-mx with esmtp (Exim 4.12) id 1BQXaX-000743-00 for icar@ietf.org; Wed, 19 May 2004 16:22:54 -0400
Received: from [64.254.114.114] (HELO JLaptop.stevecrocker.com) by EXECDSL.COM (CommuniGate Pro SMTP 3.3) with ESMTP id 6969256; Wed, 19 May 2004 16:22:20 -0400
Message-Id: <5.1.0.14.0.20040519161941.0241a008@localhost>
X-Sender: joel@stevecrocker.com@localhost
X-Mailer: QUALCOMM Windows Eudora Version 5.1
Date: Wed, 19 May 2004 16:22:02 -0400
To: icar@ietf.org
From: "Joel M. Halpern" <joel@stevecrocker.com>
Subject: Re: [Icar] an early review experiment
Cc: Alex Rousskov <rousskov@measurement-factory.com>
In-Reply-To: <Pine.BSF.4.58.0405191316190.77504@measurement-factory.com>
References: <20040519144950.EB9D977AA5C@guns.icir.org> <20040519144950.EB9D977AA5C@guns.icir.org>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"; format=flowed
Sender: icar-admin@ietf.org
Errors-To: icar-admin@ietf.org
X-BeenThere: icar@ietf.org
X-Mailman-Version: 2.0.12
Precedence: bulk
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=unsubscribe>
List-Id: Improved Cross-Area Review <icar.ietf.org>
List-Post: <mailto:icar@ietf.org>
List-Help: <mailto:icar-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=subscribe>
X-Spam-Checker-Version: SpamAssassin 2.60 (1.212-2003-09-23-exp) on ietf-mx.ietf.org
X-Spam-Status: No, hits=0.0 required=5.0 tests=AWL autolearn=no version=2.60

Most of these comments, while fair concerns, seem to be primarily addressed 
to the general question of how working groups manage comments.  General 
working group process is probably outside of the scope of this working group.
Yours,
Joel M. Halpern

PS: To be specific, I do not think that the ICAR working group can direct 
that working groups should (much less must) have problem trackers, and 
should (or must) address all comments received, regardless of source.  Even 
though those may be good ideas.

At 01:33 PM 5/19/2004 -0600, Alex Rousskov wrote:
>On Wed, 19 May 2004, Mark Allman wrote:
>
> > If I were to sketch the "weighyness" space of early, cross area
> > reviews, it'd be something like this:
> >
> >   + one end of the spectrum would be that ICAR-type comments must be
> >     addressed before the document moves forward
> >
> >   + the other end of the space seems to me to be that the ICAR-type
> >     reviews are just like any other review that comes in from a
> >     community member (i.e., no special status)
> >
> >   + there may be middle ground
> >
> > It'd be nice to hear thoughts on where folks are in this space.
>
>IMO, WG MUST publicly address all reviewer concerns, but can do so any
>way it wants. WG MAY reject to act on any comment, for any reason, but
>MUST publicly document that the comment is rejected and SHOULD
>document rejection rationale.  IESG SHOULD NOT review documents with
>unaddressed concerns.
>
>For these rules to be meaningful/effective, there has to be a
>mechanism/tool to register specific concerns and WG responses to them
>(e.g., ID Tracker DISCUSS items on steroids). Just exchanging freeform
>e-mails is not good enough.
>
>It seems to me that same rules should apply to any review, regardless
>of its source. There may be periods when WG does not accept reviews
>for specific documents though (because they are not ready for any kind
>of review or because the WG has finished working on them and wants
>IESG to take over).
>
>One simple way to manage review timings is to have both First Call and
>Last Call for each draft (at least). These calls will make it clear
>when reviews are welcome (and when reviewer comments are virtually
>guaranteed to be addressed).
>
>I do not know whether the above fits any of the three bullets you
>proposed. It seems lile the second bullet because all reviews have the
>same status (but I would call that status "special" compared to the
>current "no special status" situation), but it also matches the intent
>of the first bullet as far as final IESG action is concerned.
>
>HTH,
>
>Alex.
>
>
>_______________________________________________
>Icar mailing list
>Icar@ietf.org
>https://www1.ietf.org/mailman/listinfo/icar


_______________________________________________
Icar mailing list
Icar@ietf.org
https://www1.ietf.org/mailman/listinfo/icar