Re: [Mtgvenue] Exploration of a "posting" metric - draft-elkins-mtgvenue-participation-metrics

Dave Crocker <dhc@dcrocker.net> Wed, 20 July 2016 09:48 UTC

Return-Path: <dhc@dcrocker.net>
X-Original-To: mtgvenue@ietfa.amsl.com
Delivered-To: mtgvenue@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3F33712D110 for <mtgvenue@ietfa.amsl.com>; Wed, 20 Jul 2016 02:48:53 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.107
X-Spam-Level:
X-Spam-Status: No, score=-1.107 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RDNS_NONE=0.793] autolearn=no autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id BcYjf0Ra5McM for <mtgvenue@ietfa.amsl.com>; Wed, 20 Jul 2016 02:48:52 -0700 (PDT)
Received: from simon.songbird.com (unknown [72.52.113.5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id D2A3012D0A5 for <mtgvenue@ietf.org>; Wed, 20 Jul 2016 02:48:51 -0700 (PDT)
Received: from [31.133.176.198] (dhcp-b0c6.meeting.ietf.org [31.133.176.198]) (authenticated bits=0) by simon.songbird.com (8.14.4/8.14.4/Debian-4.1ubuntu1) with ESMTP id u6K9nPG5005168 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NOT); Wed, 20 Jul 2016 02:49:27 -0700
To: "Fred Baker (fred)" <fred@cisco.com>, "nalini.elkins@insidethestack.com" <nalini.elkins@insidethestack.com>
References: <F4EACEAA-0255-4985-AB4B-0247085C1D68@cisco.com>
From: Dave Crocker <dhc@dcrocker.net>
Organization: Brandenburg InternetWorking
Message-ID: <6ca7e342-87b7-fa19-1ca4-ae8fa9908c12@dcrocker.net>
Date: Wed, 20 Jul 2016 11:48:30 +0200
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.2.0
MIME-Version: 1.0
In-Reply-To: <F4EACEAA-0255-4985-AB4B-0247085C1D68@cisco.com>
Content-Type: text/plain; charset="windows-1252"; format="flowed"
Content-Transfer-Encoding: 7bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/mtgvenue/JQcXFVtn5a5E_fhlXktBRlrb-pg>
Cc: "mtgvenue@ietf.org" <mtgvenue@ietf.org>
Subject: Re: [Mtgvenue] Exploration of a "posting" metric - draft-elkins-mtgvenue-participation-metrics
X-BeenThere: mtgvenue@ietf.org
X-Mailman-Version: 2.1.17
Precedence: list
Reply-To: dcrocker@bbiw.net
List-Id: "List for email discussion of the IAOC meeting venue selection process." <mtgvenue.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/mtgvenue>, <mailto:mtgvenue-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/mtgvenue/>
List-Post: <mailto:mtgvenue@ietf.org>
List-Help: <mailto:mtgvenue-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/mtgvenue>, <mailto:mtgvenue-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 20 Jul 2016 09:48:53 -0000

On 7/20/2016 11:37 AM, Fred Baker (fred) wrote:
> In your draft and in your talk, you mention the possibility of measuring a person's participation or contribution in terms of email postings. You also mention a number of other possible models, such as whether their name winds up be "acknowledged" or listed as a "contributor" in a draft or RFC.
>
> I took a crack at extracting information about email postings from the mail archive.
...
> The point of that was to identify low-hanging fruit.


The problem is that quite a lot of that fruit is underdeveloped, or rotten.

The S/N ration for postings is sufficiently poor as to render measuring 
posting possibly only slightly better than the 'just showing up' metric 
of registering for a meeting.  Simply put, just counting whether a 
person posts to the lists tells us nothing about whether they've 
actually "contributed" to the substance of the work.

"Contribution" needs to be measured meaningfully, as well as 
objectively, even if the measurement is coarse and doesn't count everyone.

This is why I've suggested reaching no deeper than the Acknowledgements 
and Contributors sections of I-D's and RFCs (as well as author lists, of 
course.)  If a name shows up there, the person made it through a basic 
filter for having been seen to actually contribute.


d/
-- 

   Dave Crocker
   Brandenburg InternetWorking
   bbiw.net