[Icar] Re: I-D ACTION:draft-zinin-icar-arts-00.txt

Brian E Carpenter <brc@zurich.ibm.com> Fri, 26 March 2004 10:08 UTC

Received: from optimus.ietf.org (optimus.ietf.org [132.151.1.19]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id FAA10675 for <icar-archive@odin.ietf.org>; Fri, 26 Mar 2004 05:08:24 -0500 (EST)
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B6oFo-0000yf-Gm for icar-archive@odin.ietf.org; Fri, 26 Mar 2004 05:07:56 -0500
Received: (from exim@localhost) by www1.ietf.org (8.12.8/8.12.8/Submit) id i2QA7ug4003748 for icar-archive@odin.ietf.org; Fri, 26 Mar 2004 05:07:56 -0500
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B6oFn-0000yN-Un for icar-web-archive@optimus.ietf.org; Fri, 26 Mar 2004 05:07:56 -0500
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id FAA10650 for <icar-web-archive@ietf.org>; Fri, 26 Mar 2004 05:07:52 -0500 (EST)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 1B6oFk-00068q-00 for icar-web-archive@ietf.org; Fri, 26 Mar 2004 05:07:52 -0500
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1B6oEo-00063K-00 for icar-web-archive@ietf.org; Fri, 26 Mar 2004 05:06:55 -0500
Received: from optimus.ietf.org ([132.151.1.19]) by ietf-mx with esmtp (Exim 4.12) id 1B6oDv-0005yZ-00 for icar-web-archive@ietf.org; Fri, 26 Mar 2004 05:05:59 -0500
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B6oDx-0000gU-NO; Fri, 26 Mar 2004 05:06:01 -0500
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1B6oDq-0000fl-VY for icar@optimus.ietf.org; Fri, 26 Mar 2004 05:05:55 -0500
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id FAA10566 for <icar@ietf.org>; Fri, 26 Mar 2004 05:05:51 -0500 (EST)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 1B6oDn-0005xR-00 for icar@ietf.org; Fri, 26 Mar 2004 05:05:51 -0500
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1B6oCp-0005sj-00 for icar@ietf.org; Fri, 26 Mar 2004 05:04:52 -0500
Received: from imhotep.hursley.ibm.com ([195.212.14.170] helo=mail-gw2.hursley.ibm.com) by ietf-mx with esmtp (Exim 4.12) id 1B6oCA-0005lQ-00 for icar@ietf.org; Fri, 26 Mar 2004 05:04:11 -0500
Received: from localhost.localdomain ([127.0.0.1] helo=mail-gw2.hursley.ibm.com) by mail-gw2.hursley.ibm.com with esmtp (Exim 4.12) id 1B6oBh-00062L-00; Fri, 26 Mar 2004 10:03:41 +0000
Received: from [9.20.136.27] (helo=sp15en17.hursley.ibm.com) by mail-gw2.hursley.ibm.com with esmtp (Exim 4.12) id 1B6oBh-00061y-00; Fri, 26 Mar 2004 10:03:41 +0000
Received: from zurich.ibm.com (sig-9-145-246-252.de.ibm.com [9.145.246.252]) by sp15en17.hursley.ibm.com (AIX5.1/8.11.6p2/8.11.0) with ESMTP id i2QA3eF63254; Fri, 26 Mar 2004 10:03:41 GMT
Message-ID: <4063F7B9.5424BB6E@zurich.ibm.com>
Date: Fri, 26 Mar 2004 10:28:25 +0100
From: Brian E Carpenter <brc@zurich.ibm.com>
Organization: IBM
X-Mailer: Mozilla 4.79 [en] (Windows NT 5.0; U)
X-Accept-Language: en,fr,de
MIME-Version: 1.0
To: icar@ietf.org, zinin@psg.com
References: <200403152055.PAA24125@ietf.org>
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Content-Transfer-Encoding: 7bit
Subject: [Icar] Re: I-D ACTION:draft-zinin-icar-arts-00.txt
Sender: icar-admin@ietf.org
Errors-To: icar-admin@ietf.org
X-BeenThere: icar@ietf.org
X-Mailman-Version: 2.0.12
Precedence: bulk
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=unsubscribe>
List-Id: Improved Cross-Area Review <icar.ietf.org>
List-Post: <mailto:icar@ietf.org>
List-Help: <mailto:icar-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=subscribe>
X-Spam-Checker-Version: SpamAssassin 2.60 (1.212-2003-09-23-exp) on ietf-mx.ietf.org
X-Spam-Status: No, hits=0.0 required=5.0 tests=AWL autolearn=no version=2.60
Content-Transfer-Encoding: 7bit
Content-Transfer-Encoding: 7bit

I realise this is an oldish version but I do have a few comments...

>  2.1 Overview
> 
>    Briefly, the cross-functional review process may be described as fol-
>    lows.
> 
>    Each area has an area review team (ART) which ADs delegate the
>    interim document review function to. When necessary (early in the
>    process, or during the WG Last call, or both), the WG chairs request
>    the review for a document by sending an e-mail to all required ARTs
>    (at a minimum the ART of the area the WG belongs to). 

I don't see why it has to be the WG chairs, in the case of early review.
As soon as a document is in serious discussion, I think the authors should
be able to request a review. We should be strongly encouraging early review.

If it is a review required as part of a last call process, it's fine that
the WG chairs request it - but that is already too late for the first
cross-area review.

The other advantage of allowing authors to request review is that it
provides a path for early review of independent submissions. That is
a hole in the draft.

>  2.3 Area Review Teams
...
>    Selection of the ART members is done personally by the ADs. Possible
>    variations, however, may include open call for nominations, followed
>    up by ADs interviewing the candidates and personally approving them.

This does not follow from assumption 2 in section 2.2. On the contrary, if
the objective is to maintain trust in the ADs --or more accurately, to extend
that trust to the ART-- there must be some degree of community process in
creating the team. I think an open call should be obligatory, and an open
call for confidential comments. After that, it's OK for the AD to decide.

>    When a document needs to be reviewed by ART, the AD assigns two ART
>    members as "token holders". All ART members are encouraged to review
>    the document, however, the token holders are held responsible for
>    providing comments within a 2-week time frame and following up on
>    them with the document authors and/or the hosting WG. 

2 weeks is really very tough if we are talking about deep review of
serious specs. I wouldn't like to be asked to review NFSv4 in 2 weeks.

> 2.5 Role of Cross-Area Review within the Standards Process
...
>           Note that ADs are given a tool they can use to off-load docu-
>           ment review to the extent they believe is necessary, but they
>           are not required to do so. It is then left to the ADs to make
>           sure they are using this tool appropriately and sufficiently.

I can't quarrel with these words, but somehow they don't get the point
that *early* cross area review, before the document gets anywhere near
an AD, should significantly increase document quality and reduce the
need for detailed review at the end of the process.

> 
>  2.6 Initiation of Review Process
> 
>    The cross-functional review process can be initiated either by an AD
>    or by a WG chair after consultation with the ADs.

As noted above, I believe that authors should be *encouraged* to initiate
early review themselves. Don't put the load at the end of the process - put
it as early as possible.

>    The review process may be initiated at an early stage of a document
>    (e.g. when the WG is starting to consider an approach) to ensure
>    architectural validity and correctness of the general direction

This should be "should" IMHO.

>    The same process may be used by the ADs and the RFC-Editor to request
>    cross-functional review for individual submissions they are shepherd-
>    ing or checking for conflicts.

This should be a separate section with its own headline, and should be 
a "should" IMHO. I would be very concerned to see a duplication of review
teams for independent submissions.

   Brian



_______________________________________________
Icar mailing list
Icar@ietf.org
https://www1.ietf.org/mailman/listinfo/icar