Author and attendance measurements [Was: Re: Thought experiment [Re: Quality of Directorate reviews]]

Jari Arkko <jari.arkko@piuha.net> Fri, 08 November 2019 07:11 UTC

Return-Path: <jari.arkko@piuha.net>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 892E112009E for <ietf@ietfa.amsl.com>; Thu, 7 Nov 2019 23:11:38 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.897
X-Spam-Level:
X-Spam-Status: No, score=-1.897 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id mLFa_t9dRvgm for <ietf@ietfa.amsl.com>; Thu, 7 Nov 2019 23:11:35 -0800 (PST)
Received: from p130.piuha.net (p130.piuha.net [193.234.218.130]) by ietfa.amsl.com (Postfix) with ESMTP id 190FC12000F for <ietf@ietf.org>; Thu, 7 Nov 2019 23:11:35 -0800 (PST)
Received: from localhost (localhost [127.0.0.1]) by p130.piuha.net (Postfix) with ESMTP id 25C9A6601C4; Fri, 8 Nov 2019 09:11:33 +0200 (EET)
Received: from p130.piuha.net ([127.0.0.1]) by localhost (p130.piuha.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id AJ-lpobWt5Jw; Fri, 8 Nov 2019 09:11:29 +0200 (EET)
Received: from [127.0.0.1] (p130.piuha.net [IPv6:2001:14b8:1829::130]) by p130.piuha.net (Postfix) with ESMTPS id 085B0660130; Fri, 8 Nov 2019 09:11:28 +0200 (EET)
From: Jari Arkko <jari.arkko@piuha.net>
Message-Id: <26D1F92D-67A9-4F96-9FFF-76D525C4BE6E@piuha.net>
Content-Type: multipart/alternative; boundary="Apple-Mail=_19694D5A-ED86-4712-8A07-AF79F22B3F57"
Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\))
Subject: Author and attendance measurements [Was: Re: Thought experiment [Re: Quality of Directorate reviews]]
Date: Fri, 08 Nov 2019 09:11:28 +0200
In-Reply-To: <11796.1573157656@localhost>
Cc: ietf@ietf.org
To: Michael Richardson <mcr+ietf@sandelman.ca>
References: <157279399807.13506.13363770981495597049.idtracker@ietfa.amsl.com> <0EF64763-BA25-468A-B387-91445A61D318@gmail.com> <CAJU8_nUovmFmgNiYx0ez_1f+GPdU9xGViDYWfowEEomrn0pyDw@mail.gmail.com> <alpine.LRH.2.21.1911040841160.27600@bofh.nohats.ca> <CE06CC6D-E37F-4C90-B782-D14B1D715D4B@cable.comcast.com> <38E47448-63B4-4A5D-8A9D-3AB890EBDDDD@akamai.com> <09886edb-4302-b309-9eaa-f016c4487128@gmail.com> <26819.1572990657@localhost> <2668fa45-7667-51a6-7cb6-4b704c7fba5a@isode.com> <2C97D18E-3DA0-4A2D-8179-6D86EB835783@gmail.com> <91686B28-9583-4A8E-AF8A-E66977B1FE13@gmail.com> <012b9437-4440-915c-f1f9-b85e1b0be768@gmail.com> <8b387d57-f056-7de3-9851-a431b17b67b4@network-heretics.com> <c97440e1-c6bb-8219-2970-357d9c45beb2@gmail.com> <fa406d85-babb-9821-047f-ad7efbdd23f5@network-heretics.com> <11796.1573157656@localhost>
X-Mailer: Apple Mail (2.3273)
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/vXJYgc13QPvMWgAKTd26lMHWiYo>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 08 Nov 2019 07:11:38 -0000

> My impression from the regular plenary reports on attendance my impression is
> that the number of people involved in the IETF is declining, yet the number
> of RFCs being processed is going up.

I think the reports tell you that persons in meetings is going down. I’m not sure we have data to say number of people involved is declining. Could be offset by people who are remote in the meetings or people who only use mailing lists but still participate effectively.

The number of RFCs is not going up, it went up (peaking at 2006 and 2011) and has been in somewhat of a decline since then. See https://arkko.com/tools/rfcstats/pubdistr.html <https://arkko.com/tools/rfcstats/pubdistr.html> and https://www.rfc-editor.org/report-summary/ <https://www.rfc-editor.org/report-summary/> (Note that on my stats the last year numbers are always a bit off, because the years aren’t complete. So don’t look at 2019 too much.)

> And the number of conflicts seems to be going up because so many more people
> are involved in quite a range of WGs.   How does this compare to ten years
> ago?  I'm not even sure I know what number I want to ask for here.
> 
> Jari, can you tell if we have more unique authors from your stats system?
> Are we individually producing more documents?  Are we collaborating across
> communities more often, which is why we have more conflicts?
> 
> It seems like it must be that more of the people involved are writing
> documents.  Did we have more people who were exclusively "tourists" before?


I don’t have an easy way to answer all your questions. I did pull the following stats from my server though. These are the unique authors (or explicitly named contributors) in RFCs published per year. So, the number of distinct people who published at least one RFC. (Note: again, don’t look at 2019, and I don’t have a good way of assessing how accurate the author identification is over all RFCs. Reader beware.)

2001	396
2002	408
2003	454
2004	448
2005	561
2006	713
2007	582
2008	509
2009	490
2010	630
2011	703
2012	599
2013	537
2014	562
2015	698
2016	711
2017	630
2018	541
2019	370

The highest levels of unique authors occurred in 2006, 2011, and 2016. The two of the first years co-incide with high RFC production levels, but 2016 did not. Eyeballing this, I’d say the number of unique authors seems to vary but I don’t see a recent drop-off. Pretty healthy numbers I’d say, even, if 600-700 people manage to publish RFCs and the meetings draw 900-1100 people.

I have anecdotal impression that conflicts are up because there’s a set of people who are key contributors across multiple areas and WGs. I could dig up some further stats on that, but not right now.

Jari