Re: [apps-review] Early Cursory Reviews

SM <sm+ietf@elandsys.com> Sun, 20 March 2011 21:21 UTC

Return-Path: <sm@elandsys.com>
X-Original-To: apps-review@core3.amsl.com
Delivered-To: apps-review@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 69C203A6BE3 for <apps-review@core3.amsl.com>; Sun, 20 Mar 2011 14:21:51 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.565
X-Spam-Level:
X-Spam-Status: No, score=-102.565 tagged_above=-999 required=5 tests=[AWL=0.034, BAYES_00=-2.599, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7kTNLgYDzga4 for <apps-review@core3.amsl.com>; Sun, 20 Mar 2011 14:21:48 -0700 (PDT)
Received: from mail.elandsys.com (mail.elandsys.com [208.69.177.125]) by core3.amsl.com (Postfix) with ESMTP id 9C2073A6BE2 for <apps-review@ietf.org>; Sun, 20 Mar 2011 14:21:48 -0700 (PDT)
Received: from SUBMAN.elandsys.com ([41.136.233.187]) (authenticated bits=0) by mail.elandsys.com (8.13.8/8.13.8) with ESMTP id p2KLN8r5007945; Sun, 20 Mar 2011 14:23:17 -0700
DKIM-Signature: v=1; a=rsa-sha1; c=simple/simple; d=elandsys.com; s=mail; t=1300656199; bh=dhLFKmd0+sabuGmhQeJZDHRbbJs=; h=Message-Id:Date:To:From:Subject:Cc:In-Reply-To:References: Mime-Version:Content-Type; b=CmzPOKxNkWW2AVDHVJAkb+CZZT2wI474rHym4+DxwB2EsfKAqTQqpBgMhzyJvy9t4 WVJBSjt10rDUZPLu7OzuxHh3k7mEDZtmhnC+xIzAbmBnYprqY4wiYcEJqlF3uTYewb FMj4yqTaC0U6ShRZ9cwjkuOeHiKcYC/5HlVUzSWI=
Message-Id: <6.2.5.6.2.20110320131107.0c1623e8@elandnews.com>
X-Mailer: QUALCOMM Windows Eudora Version 6.2.5.6
Date: Sun, 20 Mar 2011 14:22:31 -0700
To: Pete Resnick <presnick@qualcomm.com>
From: SM <sm+ietf@elandsys.com>
In-Reply-To: <4D861916.30504@qualcomm.com>
References: <6.2.5.6.2.20110318165117.0d43e6e0@elandnews.com> <4D850453.1090509@qualcomm.com> <4D853F38.4080203@dcrocker.net> <f5b8vwanlrr.fsf@calexico.inf.ed.ac.uk> <4D861916.30504@qualcomm.com>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"; format="flowed"
Cc: apps-review@ietf.org
Subject: Re: [apps-review] Early Cursory Reviews
X-BeenThere: apps-review@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: Apps Area Review List <apps-review.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/apps-review>, <mailto:apps-review-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/apps-review>
List-Post: <mailto:apps-review@ietf.org>
List-Help: <mailto:apps-review-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/apps-review>, <mailto:apps-review-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 20 Mar 2011 21:21:51 -0000

Hi Pete,
At 08:11 20-03-2011, Pete Resnick wrote:
>Even if you were assigned one per month, what would be the amount of 
>time you would want from "pickup out of the queue" until "completion 
>of review"? What I worry about is the same thing SM is trying to 
>address with the initial proposed changes: I don't want to wait for 
>a month to find out that someone is *not* going to be able to 
>complete a review and then we have to restart the month timer in the 
>queue, especially for what I'm hoping is an early cursory review. Is 
>one week enough time to complete a review of this sort, even if you 
>are only asked to do one per month?

The general agreement was one week for reviews going for IESG 
evaluation and two weeks for other reviews.  Here's when some reviews 
were assigned and when they were submitted:

draft-cheshire-dnsext-dns-sd            2010-12-02   2010-12-03
draft-ietf-sipcore-event-rate-control   2010-12-02   2010-12-15
draft-bryan-metalinkhttp                2011-01-22   2011-02-28
draft-ietf-hokey-ldn-discovery-06       2011-02-01   2011-02-04
draft-holsten-about-uri-scheme-06       2011-02-01   2011-02-07
draft-ietf-netconf-4741bis-07           2011-02-01   2011-02-07

Some reviewers take a week or less.  As some documents are be quite 
lengthy, the review takes more time.  There are also other factors to 
take into account, such as how familiar the reviewer is with the 
subject matter, to determine how long a review may take.

Although I mentioned it several times, team members do not generally 
ask to be put on leave.  I didn't do that last November and it caused 
some delays in posting the assignments.  It is easier for me to plan 
the work if I know about the availability of reviewers.

I suggest that we do a few cursory reviews so that the team gets a 
better idea of how it works and how much work it entails.

Best regards,
-sm