Re: [Mtgvenue] Exploration of a "posting" metric - draft-elkins-mtgvenue-participation-metrics

"Fred Baker (fred)" <fred@cisco.com> Thu, 21 July 2016 06:58 UTC

Return-Path: <fred@cisco.com>
X-Original-To: mtgvenue@ietfa.amsl.com
Delivered-To: mtgvenue@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5E08112B02B for <mtgvenue@ietfa.amsl.com>; Wed, 20 Jul 2016 23:58:06 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -112.835
X-Spam-Level:
X-Spam-Status: No, score=-112.835 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-1.287, SPF_PASS=-0.001, URIBL_ABUSE_SURBL=1.25, URIBL_SBL=1.623, URIBL_SBL_A=0.1, USER_IN_DEF_DKIM_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YXPKFD_Oa1Tz for <mtgvenue@ietfa.amsl.com>; Wed, 20 Jul 2016 23:58:04 -0700 (PDT)
Received: from alln-iport-4.cisco.com (alln-iport-4.cisco.com [173.37.142.91]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 64D2212D10D for <mtgvenue@ietf.org>; Wed, 20 Jul 2016 23:58:04 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=4134; q=dns/txt; s=iport; t=1469084284; x=1470293884; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=0mZ2Tbo3sT4dkG1mL8eE/AAFsf5KMfSlm5fDBYsWK5I=; b=EQAsOvXt+FmAkXLmek2hBWXZHO/ReZ1H2e9moi7WK8hn/7gLnfYK5SZK HWX5MNjmvLFsWBiz+Cw4a3iqpKEZusU84hzHBgMOXIpm6iYG8gnteFiuL w0bxLCZZQIe2onWZOukku9IYzx6Q8ARZSR+Kdekun75KsfyZYSoOvRuX7 g=;
X-Files: signature.asc : 833
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0AjAgAUcpBX/4kNJK1TCoM/VnwGuFyBeyKFeAKBLzgUAQEBAQEBAWUnhFwBAQQBeQULAgEIDgouMiUCBA4FDg2IDQgOvSgBAQEBAQEBAQEBAQEBAQEBAQEBAQEOCQWIIgiCTYQSBgsBToJ6gi8FmSYBgzeBcIlDjzqQIAEeNoILHBeBNW4BhiI2fwEBAQ
X-IronPort-AV: E=Sophos;i="5.28,398,1464652800"; d="asc'?scan'208";a="299616691"
Received: from alln-core-4.cisco.com ([173.36.13.137]) by alln-iport-4.cisco.com with ESMTP/TLS/DHE-RSA-AES256-SHA; 21 Jul 2016 06:58:03 +0000
Received: from XCH-ALN-011.cisco.com (xch-aln-011.cisco.com [173.36.7.21]) by alln-core-4.cisco.com (8.14.5/8.14.5) with ESMTP id u6L6w3lq000452 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=FAIL); Thu, 21 Jul 2016 06:58:03 GMT
Received: from xch-rcd-013.cisco.com (173.37.102.23) by XCH-ALN-011.cisco.com (173.36.7.21) with Microsoft SMTP Server (TLS) id 15.0.1210.3; Thu, 21 Jul 2016 01:58:02 -0500
Received: from xch-rcd-013.cisco.com ([173.37.102.23]) by XCH-RCD-013.cisco.com ([173.37.102.23]) with mapi id 15.00.1210.000; Thu, 21 Jul 2016 01:58:02 -0500
From: "Fred Baker (fred)" <fred@cisco.com>
To: Dave Crocker <dcrocker@bbiw.net>
Thread-Topic: [Mtgvenue] Exploration of a "posting" metric - draft-elkins-mtgvenue-participation-metrics
Thread-Index: AQHR4mpImFr6AcQWuk6kajOw1E1H1A==
Date: Thu, 21 Jul 2016 06:58:02 +0000
Message-ID: <F55F4AE7-345B-4509-9EFA-FD70C7168766@cisco.com>
References: <F4EACEAA-0255-4985-AB4B-0247085C1D68@cisco.com> <6ca7e342-87b7-fa19-1ca4-ae8fa9908c12@dcrocker.net> <B6A66A5E-5DBA-43D5-8140-F4248A8E023F@cisco.com> <7c78abb8-d930-db2b-715d-70bb290ebea0@bbiw.net>
In-Reply-To: <7c78abb8-d930-db2b-715d-70bb290ebea0@bbiw.net>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-mailer: Apple Mail (2.3124)
x-ms-exchange-messagesentrepresentingtype: 1
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [10.61.239.122]
Content-Type: multipart/signed; boundary="Apple-Mail=_CFAE8B00-1005-4855-B7B3-2D1602D0256F"; protocol="application/pgp-signature"; micalg="pgp-sha1"
MIME-Version: 1.0
Archived-At: <https://mailarchive.ietf.org/arch/msg/mtgvenue/frfp-wm829j5uzOnPavlWRA49oI>
Cc: "mtgvenue@ietf.org" <mtgvenue@ietf.org>, Nalini Elkins <nalini.elkins@insidethestack.com>
Subject: Re: [Mtgvenue] Exploration of a "posting" metric - draft-elkins-mtgvenue-participation-metrics
X-BeenThere: mtgvenue@ietf.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: "List for email discussion of the IAOC meeting venue selection process." <mtgvenue.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/mtgvenue>, <mailto:mtgvenue-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/mtgvenue/>
List-Post: <mailto:mtgvenue@ietf.org>
List-Help: <mailto:mtgvenue-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/mtgvenue>, <mailto:mtgvenue-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 21 Jul 2016 06:58:06 -0000

> On Jul 20, 2016, at 8:11 PM, Dave Crocker <dcrocker@bbiw.net> wrote:
> 
> On 7/20/2016 8:08 PM, Fred Baker (fred) wrote:
>> If you have some good heuristics, I'd be interested. I don't think "hire an intern" is a long term solution.
> 
> Well, it gets easier when the input is an xml source, but for classic ascii source, other than obvious header-searching algorithms, no I haven't a clue.

One thing I found myself thinking about last night was the Note Well. Legally, https://www.ietf.org/about/note-well.html says that a variety of fairly unmeasurable events, such as speaking at a mike, are contributions. I understand the desire to find the substantive contributors, which include those acknowledged in, contributing to, or writing drafts; in my working group I have a number of people whose contributions I value quite a bit that AFAIK never attend a meeting, but comment on the email list. From my perspective, there are some forms of contribution that are more readily measured and some that are less so. It seems to me that the way to approach it is to figure out what can be measured and decide to what degree we think it's relevant or gives us the information we need.

Yes some of that is being rewarded for showing up, for some definition of "showing up". Our numbers are all over the map; we have 1346 in physical attendance, and 264 in remote attendance this week, Ray said last night IIRC. We have a total of 2135 posted internet drafts as of this morning, with 2746 distinct email addresses in their respective "author" sections, which is almost twice as many. 2812 people (including ++attorneylegalhelp++@codg.download, whoever that is) posted email to some list@ietf.org in 2016, which might have been pages and pages or as simple as "+1", which is important when I'm measuring consensus. I have no idea how many people are acknowledged or made it into "contributor" sections, because last night I slept rather than reading 2135 internet drafts. I did think about a tool, and there may be some analytic heuristics out there. If Google is to be believed, someone once posted a corpus of tens of thousands of names...

I think we need a measurable, repeatable, way to identify contributors or participants, and to say where they are located, if we are going to try to position meetings near our contributors. Our definitions in the past have been based on internet draft authorship and physical attendance. Happy to extend that, but I need a way to do it that I can implement in a tool, that anyone can use to repeat the experiment. And absent that, I'm not sure how much pontification on what it means to be a participant or a contributor provides value.