Re: [Icar] Progress?

Dave Crocker <dhc@dcrocker.net> Mon, 19 April 2004 17:34 UTC

Received: from optimus.ietf.org (optimus.ietf.org [132.151.1.19]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id NAA25987 for <icar-archive@odin.ietf.org>; Mon, 19 Apr 2004 13:34:12 -0400 (EDT)
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1BFcWG-0005B6-7I for icar-archive@odin.ietf.org; Mon, 19 Apr 2004 13:25:20 -0400
Received: (from exim@localhost) by www1.ietf.org (8.12.8/8.12.8/Submit) id i3JHPKbu019897 for icar-archive@odin.ietf.org; Mon, 19 Apr 2004 13:25:20 -0400
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1BFcTZ-0004cn-NT for icar-web-archive@optimus.ietf.org; Mon, 19 Apr 2004 13:22:33 -0400
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id NAA24858 for <icar-web-archive@ietf.org>; Mon, 19 Apr 2004 13:22:29 -0400 (EDT)
Received: from ietf-mx.ietf.org ([132.151.6.1] helo=ietf-mx) by ietf-mx with esmtp (Exim 4.32) id 1BFcTX-0007E4-PE for icar-web-archive@ietf.org; Mon, 19 Apr 2004 13:22:31 -0400
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1BFcSC-0006rT-00 for icar-web-archive@ietf.org; Mon, 19 Apr 2004 13:21:09 -0400
Received: from optimus.ietf.org ([132.151.1.19]) by ietf-mx with esmtp (Exim 4.12) id 1BFcRH-0006bW-00 for icar-web-archive@ietf.org; Mon, 19 Apr 2004 13:20:11 -0400
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1BFcJP-0002j2-0j; Mon, 19 Apr 2004 13:12:03 -0400
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 1BFcGa-0001ys-Li for icar@optimus.ietf.org; Mon, 19 Apr 2004 13:09:08 -0400
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id NAA24141 for <icar@ietf.org>; Mon, 19 Apr 2004 13:09:04 -0400 (EDT)
Received: from ietf-mx.ietf.org ([132.151.6.1] helo=ietf-mx) by ietf-mx with esmtp (Exim 4.32) id 1BFcGY-0003zH-PD for icar@ietf.org; Mon, 19 Apr 2004 13:09:06 -0400
Received: from exim by ietf-mx with spam-scanned (Exim 4.12) id 1BFcFc-0003m5-00 for icar@ietf.org; Mon, 19 Apr 2004 13:08:09 -0400
Received: from joy.songbird.com ([208.184.79.7]) by ietf-mx with esmtp (Exim 4.12) id 1BFcEe-0003LP-00 for icar@ietf.org; Mon, 19 Apr 2004 13:07:08 -0400
Received: from bbfujip (jay.songbird.com [208.184.79.253]) by joy.songbird.com (8.11.6/8.11.6) with ESMTP id i3JH6Vd31810; Mon, 19 Apr 2004 10:06:31 -0700
Date: Mon, 19 Apr 2004 10:06:42 -0700
From: Dave Crocker <dhc@dcrocker.net>
Reply-To: dcrocker@brandenburg.com
Organization: Brandenburg InternetWorking
X-Priority: 3 (Normal)
Message-ID: <45741475.20040419100642@brandenburg.com>
To: Mark Allman <mallman@icir.org>
CC: Brian E Carpenter <brc@zurich.ibm.com>, icar@ietf.org
Subject: Re: [Icar] Progress?
In-Reply-To: <20040419163838.39B5C77A6D5@guns.icir.org>
References: <717382561.20040416091907@brandenburg.com> <20040419163838.39B5C77A6D5@guns.icir.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Content-Transfer-Encoding: 7bit
Sender: icar-admin@ietf.org
Errors-To: icar-admin@ietf.org
X-BeenThere: icar@ietf.org
X-Mailman-Version: 2.0.12
Precedence: bulk
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=unsubscribe>
List-Id: Improved Cross-Area Review <icar.ietf.org>
List-Post: <mailto:icar@ietf.org>
List-Help: <mailto:icar-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/icar>, <mailto:icar-request@ietf.org?subject=subscribe>
X-Spam-Checker-Version: SpamAssassin 2.60 (1.212-2003-09-23-exp) on ietf-mx.ietf.org
X-Spam-Status: No, hits=0.7 required=5.0 tests=AWL,PRIORITY_NO_NAME autolearn=no version=2.60
Content-Transfer-Encoding: 7bit
Content-Transfer-Encoding: 7bit

Mark,


MA> I.e., if we don't invoke the review function as an explicit step in the
MA> process will anyone do it?

We already have some working groups doing it. How do we get more? I
think that this is a matter of culture and educating folks about
benefits and, to some extent, expectations. Let's assume that
participants want good things. This is a reasonable assumption almost
all the time. This means that a benefits-oriented approach should
work, without the need of coercion.

Simple examples of how to 'sell' the idea of early, (external)
(cross-area) reviews:  Working Group chair training touts
it. ADs suggest it -- repeatedly.  Experienced participations suggest
it -- repeatedly.

I think there is also benefit in having a centralized index for
accessing reviews, so that the community can see what it happening in
that front.  It also serves to mark the possible snowball effect that
you cite.


MA>   But, in the absence of experience
MA> that concretely shows that some sort of early review function is, in
MA> fact, useful and worthwhile what is the incentive for a WG to invoke the
MA> review function?

If reviewing proposals were an odd or new idea then we might have to
worry about selling the basic concept.  But this is all pretty
standard stuff in the academic and engineering community.  Getting
fresh sets of expert eyes to look things over is not a controversial
concept and the benefits are well-established.


MA> The other thing I wonder about is new-ish folk in the IETF.  People
MA> bring ideas in that are not really baked, but they don't realize it (new
MA> UDP-based app with no congestion control, no thoughts given to security,
MA> etc.).  What is the incentive for these people to turn around and ask a
MA> bunch of people they don't know to pick apart their work when they are
MA> Obviously Correct?

The question is what is the incentive for a *group* to call for
reviews.  Individuals do not matter much, but the group does.  So the
review process serves to raise important questions about a spec -- or
provide confirmation of its constructs -- before there has been
long-term investment in the effort.  That's pretty strong incentive.


MA> SIRS didn't get much activity in the grand scheme of things.

I've commented on the tendency to dismiss the SIRS experience before.
Quick summary:

SIRS was started during summer and by mid-Fall there were rumors it
had failed. The negative effect this is likely to have had on
continued use of SIRS should not be underestimated.

Particularly given typical IETF timeframes, that anyone would declare
a strategic IETF experiment to have failed after such a short time
suggests deeper problems with either patience levels or agendas.

SIRS did virtually no "marketing" either proactively such as prodding
working groups to use its services, or passively, such as collecting
review data (statistics and source copies of reviews) in a single
place.

On the other hand, it got good signup by folks offering to do reviews
and it did get some review requests.

d/
--
 Dave Crocker <mailto:dcrocker@brandenburg.com>
 Brandenburg InternetWorking <http://www.brandenburg.com>
 Sunnyvale, CA  USA <tel:+1.408.246.8253>, <fax:+1.866.358.5301>


_______________________________________________
Icar mailing list
Icar@ietf.org
https://www1.ietf.org/mailman/listinfo/icar