Re: Updating BCP 10 -- NomCom ELEGIBILITY

Dave Cridland <dave@cridland.net> Sun, 15 February 2015 19:38 UTC

Return-Path: <dave@cridland.net>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D84201A00E0 for <ietf@ietfa.amsl.com>; Sun, 15 Feb 2015 11:38:14 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.378
X-Spam-Level:
X-Spam-Status: No, score=-1.378 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FM_FORGED_GMAIL=0.622, HTML_MESSAGE=0.001, SPF_PASS=-0.001] autolearn=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id hVHIRJnAtCUo for <ietf@ietfa.amsl.com>; Sun, 15 Feb 2015 11:38:12 -0800 (PST)
Received: from mail-ob0-x22a.google.com (mail-ob0-x22a.google.com [IPv6:2607:f8b0:4003:c01::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 6727F1A0010 for <ietf@ietf.org>; Sun, 15 Feb 2015 11:38:12 -0800 (PST)
Received: by mail-ob0-f170.google.com with SMTP id va2so35950581obc.1 for <ietf@ietf.org>; Sun, 15 Feb 2015 11:38:11 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cridland.net; s=google; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=g+n4jFVafaC1bt7E9CBiemhpvU/Kr07j0lXJZiHzdPM=; b=DmIUNQFoFvtF54r9vv89IW0I5vOIpoUxnhpE7fvbhhNXhEqCKYFpIGMMGN6lnSBDp9 GTnHlXBTyPZHc2d0YBXkRnzAOnvBt026zaaxo4iQQo8DI1V5bq1RGGh7FdP0uVNc7Dp0 U/aOj8U7xy7Yceg1LTtmHS66NSN7mnfmVx0Zw=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=g+n4jFVafaC1bt7E9CBiemhpvU/Kr07j0lXJZiHzdPM=; b=gK1hsn+BnXqakfUBsCfkGf5rhQxe0GWh+/6F9hYO6YwoaAnS6G7yQjmpy/+hGpwIhw bXajZIcVb+VD8Kfp50QTglh/XWZjqM34NetuHFWARTqUam/CHZjr64l9NeDO2uksEpPE +EJZ+695iZ0h3LqCtsw3Qw7inYK1QBn/Gf8IWe759zM4tTocVA4YdRSjYQitYblVx4oJ D3zbvKfKXXH3gfLGQyChIVRq1YRAFGBXZyio8DPJ/A23yTfpk2Wn+0GgA+rfTuKsFSJK JkkWoxWxiGZly8ursg3tuF8FeVaKnmMKj0riF+qMoaFfQ0BnUW05gWbbGJO0Q+6QGDvm C5Vg==
X-Gm-Message-State: ALoCoQmILcx/m1uy5EkAowV5qGZXn1aRitpYyMqRsN+NavwHcIxQcwSsPhWkVBNNjNv8hSzHOj3b
MIME-Version: 1.0
X-Received: by 10.182.144.170 with SMTP id sn10mr13245756obb.52.1424029091608; Sun, 15 Feb 2015 11:38:11 -0800 (PST)
Received: by 10.60.77.71 with HTTP; Sun, 15 Feb 2015 11:38:11 -0800 (PST)
In-Reply-To: <20738.1424014484@sandelman.ca>
References: <CAL0qLwZk=k-CWLte_ChK9f1kzLwMOTRyi7AwFa8fLjBsextBcA@mail.gmail.com> <9772.1420830216@sandelman.ca> <CAL0qLwZatYW2e4Wk6GXB2U26fsCn8BV2qt-07kHBugiq34zrcQ@mail.gmail.com> <6025.1423672358@sandelman.ca> <CAL0qLwYtE618sA99hgXP-5wk+BYdcXLbiZqd_36OreYQ1LB7hQ@mail.gmail.com> <732CCD31-0F13-472F-9825-C5F5D650C41B@vigilsec.com> <2457EE06-4960-40B5-AF10-2EDFBF18B2B6@nominum.com> <7C601AA4-55C4-43FE-B2FE-1D22BD73F166@vigilsec.com> <CAKHUCzyJ62hVyJVVLuL5-nXx_i5VO2cW3LA6R1sdZbDHxoY_Tw@mail.gmail.com> <43ADF7ED-6A42-4097-8FFA-5DA0FC21D07A@vigilsec.com> <CAKHUCzyfB+GhNqmDhrzki4tVn0faMLyt_cqgeHFcQL2b5pkkAQ@mail.gmail.com> <CAL0qLwYLuknVuY-n6R18_WxW=67+MaE8MZvWyhrGEhofEXLRwg@mail.gmail.com> <CAKHUCzwoqKAN27kFgWSgVX80xWu3niN9qxaGakSKs+D+1h4ssA@mail.gmail.com> <20738.1424014484@sandelman.ca>
Date: Sun, 15 Feb 2015 19:38:11 +0000
Message-ID: <CAKHUCzyv=ANE_TCt1=p6Ksym71ogNZopJY5Th0Zi8zuX-C-M3g@mail.gmail.com>
Subject: Re: Updating BCP 10 -- NomCom ELEGIBILITY
From: Dave Cridland <dave@cridland.net>
To: Michael Richardson <mcr+ietf@sandelman.ca>
Content-Type: multipart/alternative; boundary="089e0153694e27d08b050f259c34"
Archived-At: <http://mailarchive.ietf.org/arch/msg/ietf/PVN4E6k1h01Z_0FV8KhbsKnT1-0>
Cc: "ietf@ietf.org Discussion" <ietf@ietf.org>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 15 Feb 2015 19:38:15 -0000

On 15 Feb 2015 15:34, "Michael Richardson" <mcr+ietf@sandelman.ca> wrote:
>
>
> Dave Cridland <dave@cridland.net> wrote:
>     > 1) AUTH48 is interesting as a metric; it's clearly an indicator of a
>     > document actually getting published, and one that doesn't get
delayed
>     > outside the author's control unlike publication. Moreover, anyone
going
>     > through AUTH48 has had to deal with an IESG telechat on their
document;
>     > that's extremely useful experience in leadership selection. Possibly
>     > "last call" and "telechat" are also good enough - and interesting
in as
>     > much as a document that "fails" last call is arguably as important a
>     > contribution as one that goes on to publication.
>
> So, instead of AUTH48, you'd pick an earlier state like IESG Review.
>     (see https://datatracker.ietf.org/doc/help/state/draft-iesg/, but
>     actually I think write-up and the diagram are old and missing some
states...)
>
> That (perhaps correctly) skips things that go through the Independent
> Submission Stream.
>
> I agree that including the authors into the state above solves the
problem of
> a document which is so good that it needs no review and no tickets.
>

That all sounds good. And yes, I think an independent stream submission is
reasonable to skip. I did consider suggesting that only IETF consensus
documents should count, but that is probably too narrow.

>     > 2) I think the document uploader concept is good, but limiting the
>     > documents to only those which get scheduled time in a WG session
isn't
>     > so good; some WGs don't meet often, or even at all, and a document
>     > that's so well crafted that it doesn't need discussion in a face to
>     > face meeting is a really good document in my opinion. Clearly we
don't
>     > want arbitrary documents either. Any WG document would seem a "good"
>     > contribution, and I suspect any document with a shepherd assigned
>     > should be safe, too, since that effectively implies an expectation
to
>     > publish.
>
> The problem with shephard assigned is that it could be very late in the
> process, and a document which *does* get a lot of discussion and revision,
> represents a lot of contribution of effort.   It is not unreasonable to me
> that a single document occupies the entire IETF "life" of 3-4 persons.
>

Yes, true. As I said, I think measuring contribution is a very hard metric
to find, and there's an implicit suggestion lurking here that we're after
long-term, quality contributions - I'm not sure I disagree with that
incidentally.

But in general terms, any document that has any of those characteristics -
it's WG document, one that's getting WG "time" by some measurement, or one
that has a shepherd assigned - seems likely to be good for a document
uploader metric.

It might be interesting to have the tools adapted so the uploader can note
which of the authors have actively contributed this time around, too, to
avoid the situation where two co-authors have to share uploading.
Similarly, it might be useful for WG chairs to be able to tag a document as
having been discussed within their WG.

>     > 3) This works for WGs that use a ticketing system and have
>     > meetings. Not sure what percentage that actually is.
>
> A number of WG chairs don't like the current ticketing system, but
increasing
> I think that WGs are going to use some ticket system.
>

And, thinking about it further, we probably want to promote the use of a
ticket system anyway. In addition, I'm more comfortable with measurable
metrics.

Again, it might be useful for the ticket system to be able to record
whether the ticket resulted in useful discussion, and note who was
involved. Again, this is at the whim of somebody, but I really don't think
excluding whims is entirely a positive thing.

Dave.