Re: [TOOLS-DEVELOPMENT] Automating statistics and reporting SoW (-02)

Ray Pelletier <rpelletier@isoc.org> Wed, 09 July 2014 17:02 UTC

Return-Path: <rpelletier@isoc.org>
X-Original-To: tools-development@ietfa.amsl.com
Delivered-To: tools-development@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 66D031A0104 for <tools-development@ietfa.amsl.com>; Wed, 9 Jul 2014 10:02:44 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -101.401
X-Spam-Level:
X-Spam-Status: No, score=-101.401 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, J_CHICKENPOX_31=0.6, J_CHICKENPOX_41=0.6, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PLGVjBAXvIAU for <tools-development@ietfa.amsl.com>; Wed, 9 Jul 2014 10:02:41 -0700 (PDT)
Received: from na01-bl2-obe.outbound.protection.outlook.com (mail-bl2lp0206.outbound.protection.outlook.com [207.46.163.206]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id D42AB1A0062 for <tools-development@ietf.org>; Wed, 9 Jul 2014 10:02:40 -0700 (PDT)
Received: from [192.168.0.27] (69.131.53.120) by BN1PR06MB232.namprd06.prod.outlook.com (10.242.215.142) with Microsoft SMTP Server (TLS) id 15.0.980.8; Wed, 9 Jul 2014 17:02:30 +0000
Content-Type: multipart/alternative; boundary="Apple-Mail=_65F172C5-95A8-4249-8E6D-CF00F716DDA7"
MIME-Version: 1.0 (Mac OS X Mail 7.3 \(1878.2\))
From: Ray Pelletier <rpelletier@isoc.org>
In-Reply-To: <284F42A1-A9AE-45EF-B922-F346E5CA5178@amsl.com>
Date: Wed, 09 Jul 2014 13:02:21 -0400
Message-ID: <BAF5DBAF-14A6-4699-9C63-D815D8925FFA@isoc.org>
References: <53BAFCF9.1060606@nostrum.com> <AD736E1D-19F2-4B9C-9EB7-BFAF4296AEF9@isoc.org> <284F42A1-A9AE-45EF-B922-F346E5CA5178@amsl.com>
To: Sandy Ginoza <sginoza@amsl.com>
X-Mailer: Apple Mail (2.1878.2)
X-Originating-IP: [69.131.53.120]
X-ClientProxiedBy: BLUPR01CA017.prod.exchangelabs.com (10.141.30.47) To BN1PR06MB232.namprd06.prod.outlook.com (10.242.215.142)
X-Microsoft-Antispam: BCL:0;PCL:0;RULEID:
X-Forefront-PRVS: 0267E514F9
X-Forefront-Antispam-Report: SFV:NSPM; SFS:(6049001)(164054003)(199002)(189002)(51704005)(24454002)(377424004)(377454003)(69556001)(77096002)(92726001)(92566001)(74502001)(66066001)(89996001)(42186005)(33656002)(80022001)(105586002)(95666004)(62966002)(86362001)(93916002)(50226001)(85306003)(82746002)(104166001)(20776003)(87286001)(19580405001)(87976001)(15202345003)(84326002)(83072002)(106356001)(83716003)(83322001)(88136002)(36756003)(85852003)(16799955002)(81542001)(21056001)(102836001)(19580395003)(512954002)(79102001)(110136001)(31966008)(76176999)(81342001)(15975445006)(74662001)(15188155005)(16236675004)(64706001)(71186001)(4396001)(46102001)(99396002)(77156001)(76482001)(107046002)(57306001)(101416001)(50986999)(77982001)(104396001)(579004); DIR:OUT; SFP:; SCL:1; SRVR:BN1PR06MB232; H:[192.168.0.27]; FPR:; MLV:sfv; PTR:InfoNoRecords; MX:3; LANG:en;
X-OriginatorOrg: isoc.org
Archived-At: http://mailarchive.ietf.org/arch/msg/tools-development/Q_LEHgxr7fJkcKI3c5fUctTarlg
Cc: IETF Tools Development <tools-development@ietf.org>
Subject: Re: [TOOLS-DEVELOPMENT] Automating statistics and reporting SoW (-02)
X-BeenThere: tools-development@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Tools Development list server <tools-development.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tools-development>, <mailto:tools-development-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tools-development/>
List-Post: <mailto:tools-development@ietf.org>
List-Help: <mailto:tools-development-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-development>, <mailto:tools-development-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 09 Jul 2014 17:02:44 -0000

On Jul 9, 2014, at 12:46 PM, Sandy Ginoza <sginoza@amsl.com> wrote:

> Ray,
> 
> The queue summary that you're referring to
> (http://www.rfc-editor.org/CurrQstats.txt)

Glad that report is automated.  Not the same as the weekly email however with its list
of all the docs and they state they are in, then the summary at the bottom.
And the link in that report http://www.rfc-editor.org/current_queue.php is not the same as the
one above.  see below.

> is the first link under Queue
> Statistics on http://www.rfc-editor.org/reports. It's already automated,
> so I'm not sure there's a work item there.
> 
> As for the past 4 weeks of data, it's intentional to no longer
> provide weekly graphs; after discussion at a stream managers' meeting regarding potential changes to our reporting, there was preference for providing a sliding 12-month report.

And I agree with that.  Perhaps then the link to that annual report could be
included in the Weekly Current Queue Email (see below)

Thanks
Ray

>  In addition, the weekly graphs
> were tough to read and didn't seem to provide a good basis for
> determining trends because the short time period.  We believe the
> monthly counts are more helpful - please see the "# of Docs in Primary
> Processing States" graph on http://www.rfc-editor.org/reports/ to see
> the amount of docs in each state grow/shrink over time.  For example, we
> can see the sudden increase in queue size in Feb and the steady decrease
> each month thereafter.
> 
> Thanks,
> Sandy
> 
> 
> On Jul 8, 2014, at 7:52 AM, Ray Pelletier wrote:
> 
>> Robert
>> 
>> I receive a Current Queue Summary every week which lists all the Documents
>> and their current state and at the end provides an aggregated summary.
>> That report is not mentioned in this SOW.
>> 
>> I am mainly interested in the aggregated summary and would like to see that on top, not
>> the bottom, plus I would like to see the last 4 weeks of data to see what the trend is.
>> 
>> Can we add that report to this work?
>> 
>> Ray
>> On Jul 7, 2014, at 4:03 PM, Robert Sparks <rjsparks@nostrum.com> wrote:
>> 
>>> All -
>>> 
>>> I've been working with Heather, Alice, and Sandy on the attached SoW to improve
>>> the way the RFC Editor generates several of the periodic reporting artifacts.
>>> 
>>> This should be ready to go unless this team spots something that needs to change.
>>> 
>>> RjS
>>> <AutomatedReporting-02.docx><AutomatedReporting-02.pdf>_______________________________________________
>>> TOOLS-DEVELOPMENT mailing list
>>> TOOLS-DEVELOPMENT@ietf.org
>>> https://www.ietf.org/mailman/listinfo/tools-development

> From: <rfc-editor@rfc-editor.org>
> Subject: RFC Editor - Current Queue Summary
> Date: July 8, 2014 at 2:20:03 AM GMT-4
> To: <iesg@ietf.org>, <iab@iab.org>, <iana@iana.org>, <iad@ietf.org>, <rfc-editor@rfc-editor.org>
> 
> RFC Editor Queue Report
> 
> Note: To view this report at any time, see http://www.rfc-editor.org/current_queue.php
> Below is a snapshot.
> 
>   Current       Weeks in    Weeks          Draft name                                       Cluster    Pages     Submitted
>   state         state       in q
> 
>    EDIT*R           3.9      22.6  draft-ietf-cdni-requirements-17                          C216        24        2014-01-30
>    EDIT             7.9       7.7  draft-ietf-soc-overload-control-15                                   37        2014-05-14
>    EDIT             5.1       5.6  draft-ietf-mpls-psc-updates-06                           C224        11        2014-05-29
>    EDIT             4.7       5.0  draft-ietf-netmod-system-mgmt-16                                     41        2014-06-02
>    EDIT             5.0       5.0  draft-ietf-sidr-policy-qualifiers-02                                 4         2014-06-02
>    EDIT             5.0       5.0  draft-eastlake-iana-cfm-considerations-02                            7         2014-06-02
>    EDIT*A           4.1       4.4  draft-ietf-bfd-tc-mib-08                                             12        2014-06-06
>    EDIT             4.6       4.4  draft-ietf-dmm-requirements-17                                       24        2014-06-06
>    EDIT*R           3.1       4.4  draft-ietf-bfd-mib-22                                                38        2014-06-06
>    EDIT             1.6       4.0  draft-kivinen-ipsecme-ikev2-rfc5996bis-04                            139       2014-06-09
>    EDIT             3.7       3.7  draft-ietf-cdni-framework-14                             C216        56        2014-06-11
>    EDIT             2.7       3.4  draft-ietf-6man-multicast-scopes-07                                  7         2014-06-13
>    EDIT             2.6       3.4  draft-ietf-idr-bgp-enhanced-route-refresh-10                         7         2014-06-13
>    EDIT             3.1       3.1  draft-zulr-mpls-tp-linear-protection-switching-12                    32        2014-06-15
>    EDIT             2.7       3.0  draft-mahalingam-dutt-dcops-vxlan-09                                 23        2014-06-16
>    EDIT             3.0       3.0  draft-ietf-dnsop-delegation-trust-maintainance-14                    21        2014-06-16
>    EDIT             2.7       2.9  draft-gieben-pandoc2rfc-03                                           10        2014-06-17
>    EDIT*R           2.6       2.6  draft-ietf-dhc-dhcpv4-over-dhcpv6-09                                 16        2014-06-19
>    EDIT             1.6       2.6  draft-kaplan-insipid-session-id-04                                   16        2014-06-19
>    EDIT             2.6       2.6  draft-ietf-straw-b2bua-loop-detection-04                             6         2014-06-19
>    EDIT             1.6       2.0  draft-ietf-mpls-ldp-hello-crypto-auth-10                             15        2014-06-23
>    EDIT             2.1       2.0  draft-ietf-pce-pcep-inter-domain-p2mp-procedures-08                  22        2014-06-23
>    EDIT             2.1       2.0  draft-ietf-mmusic-udptl-dtls-10                                      24        2014-06-23
>    EDIT             2.1       2.0  draft-ietf-pwe3-p2mp-pw-requirements-10                              17        2014-06-23
>    EDIT             1.0       1.0  draft-ietf-appsawg-sieve-duplicate-09                                14        2014-06-30
>    EDIT*A           1.0       1.0  draft-ietf-l2vpn-vpls-ldp-mac-opt-13                                 26        2014-06-30
>    EDIT             1.0       1.0  draft-salgueiro-dispatch-websocket-sipclf-02                         8         2014-06-30
>    EDIT             0.7       1.0  draft-ietf-tram-stun-dtls-05                                         18        2014-06-30
>    EDIT             1.0       1.0  draft-adolf-dvb-urn-upd-01                                           3         2014-06-30
>    EDIT             0.1       1.0  draft-wilde-xml-patch-10                                             17        2014-06-30
>    EDIT             1.0       0.9  draft-ietf-mmusic-latching-08                                        16        2014-07-01
>    RFC-EDITOR       3.1       7.0  draft-ietf-ipsecme-esp-ah-reqts-10                                   11        2014-05-19
>    RFC-EDITOR       0.4       6.9  draft-drage-sipping-rfc3455bis-14                                    46        2014-05-20
>    AUTH48*R         3.0      42.9  draft-ietf-alto-server-discovery-10                      C206        19        2013-09-10
>    AUTH48          14.1      22.0  draft-hartmann-default-port-for-irc-via-tls-ssl-09                   6         2014-02-03
>    AUTH48           7.1      18.9  draft-ietf-l2vpn-vpls-mib-15                                         48        2014-02-25
>    AUTH48           3.0      17.6  draft-ietf-alto-protocol-27                              C206        90        2014-03-06
>    AUTH48           5.1      14.0  draft-ietf-radext-ieee802ext-12                                      27        2014-03-31
>    AUTH48           0.7      13.6  draft-ietf-ippm-testplan-rfc2680-05                                  29        2014-04-03
>    AUTH48           2.7      12.0  draft-ietf-tcpm-1323bis-21                                           49        2014-04-14
>    AUTH48           2.0      11.9  draft-ietf-xrblock-rtcp-xr-loss-conceal-12                           31        2014-04-15
>    AUTH48           2.1      11.7  draft-ietf-pcp-dhcp-13                                               10        2014-04-16
>    AUTH48           1.9      11.0  draft-ietf-tls-applayerprotoneg-05                                   9         2014-04-21
>    AUTH48           1.9      10.7  draft-ietf-mpls-ldp-multi-topology-12                                19        2014-04-23
>    AUTH48           1.7      10.0  draft-ovsienko-babel-hmac-authentication-09                          55        2014-04-28
>    AUTH48           0.1       9.7  draft-iab-styleguide-02                                              25        2014-04-30
>    AUTH48           0.9       9.6  draft-housley-pkix-oids-03                                           30        2014-05-01
>    AUTH48           1.1       9.1  draft-andrews-dnsext-expire-04                                       5         2014-05-04
>    AUTH48           3.9       8.9  draft-ietf-dhc-dhcpv6-unknown-msg-08                                 6         2014-05-06
>    AUTH48           2.6       8.4  draft-moriarty-pkcs12v1-1-05                                         30        2014-05-09
>    AUTH48           0.7       8.0  draft-ietf-payload-rtp-aptx-05                                       22        2014-05-12
>    AUTH48           1.1       7.0  draft-ietf-l2vpn-vpls-inter-domain-redundancy-07                     12        2014-05-19
>    AUTH48           0.9       6.9  draft-ietf-idr-aigp-18                                               15        2014-05-20
>    AUTH48           0.1       5.6  draft-ietf-mpls-extended-admin-group-07                              7         2014-05-29
>    AUTH48           0.7       5.6  draft-ietf-ippm-2330-update-05                                       17        2014-05-29
>    AUTH48           0.1       5.0  draft-iab-itat-report-04                                             15        2014-06-02
>    AUTH48           0.1       4.7  draft-ietf-appsawg-uri-get-off-my-lawn-05                            8         2014-06-04
>    AUTH48-DONE      0.9      13.9  draft-iab-rfc4441rev-08                                              33        2014-04-01
>    AUTH             1.1       7.7  draft-ietf-stir-problem-statement-05                                 25        2014-05-14
>    AUTH             0.9       6.9  draft-vanelburg-dispatch-private-network-ind-07                      22        2014-05-20
>    AUTH             1.1       5.9  draft-ietf-eman-framework-19                                         57        2014-05-27
>    REF*R            0.1      17.9  draft-ietf-mpls-forwarding-09                            C224        59        2014-03-04
>    MISSREF*R(1G)   94.0      94.0  draft-ietf-idr-as0-06                                    C171        7         2012-09-17
>    MISSREF*R(1G)   92.9      92.9  draft-ietf-abfab-usecases-05                             C172        14        2012-09-25
>    MISSREF*R(1G)   80.6      80.4  draft-ietf-nfsv4-federated-fs-admin-15                   C182        38        2012-12-21
>    MISSREF*R(1G)   78.9      80.4  draft-ietf-nfsv4-federated-fs-protocol-15                C182        63        2012-12-21
>    MISSREF*R(1G)   73.1      76.7  draft-ietf-bliss-shared-appearances-15                   C184        71        2013-01-16
>    MISSREF*R(1G)   75.6      75.6  draft-ietf-simple-chat-18                                C187        42        2013-01-24
>    MISSREF*R(1G)   51.6      51.7  draft-ietf-appsawg-acct-uri-06                           C202        9         2013-07-10
>    MISSREF*R(1G)   48.1      48.0  draft-ietf-nvo3-overlay-problem-statement-04             C204        24        2013-08-05
>    MISSREF*R(1G)   23.7      23.6  draft-ietf-payload-rtp-howto-13                          C214        61        2014-01-23
>    MISSREF*R(1G)   18.0      20.9  draft-ietf-mmusic-rfc2326bis-40                          C214        309       2014-02-11
>    MISSREF*R(1G)    9.7      10.0  draft-ietf-mpls-ldp-applicability-label-adv-03                       8         2014-04-28
>    MISSREF*R(1G)    8.0       8.0  draft-dunbar-armd-arp-nd-scaling-practices-08                        14        2014-05-12
>    MISSREF*R(1G)    3.0       3.7  draft-ietf-cuss-sip-uui-17                                           19        2014-06-11
>    MISSREF*R(1G)    2.0       3.4  draft-ietf-trill-esadi-09                                            41        2014-06-13
>    MISSREF*R(2G)    1.0       2.7  draft-goix-appsawg-enum-acct-uri-07                      C202        8         2014-06-18
> 
> 
> #### RFC Editor Queue Summary:  2014-07-08 ####
> 
>    State             total #       total #      Median Wks    Average Wks
>                      docs          pages        in state      in state
>    EDIT                   31            711            2.6            2.8
>    RFC-EDITOR              2             57            1.8            1.8
>    AUTH48                 24            584            1.8            2.4
>    AUTH48-DONE             1             33            0.0            0.9
>    AUTH                    3            104            1.1            1.0
>    IANA                    0              0            0.0            0.0
>    IESG                    0              0            0.0            0.0
>    REF                     1             59            0.0            0.1
>    MISSREF(1G)            14            720           49.9           47.1
>    MISSREF(2G)             1              8            0.0            1.0
>    MISSREF(3G)             0              0            0.0            0.0
>    ISR                     0              0            0.0            0.0
>    ISR-AUTH                0              0            0.0            0.0
>    TO                      0              0            0.0            0.0
> 
> 
> Totals:    77 docs    2276 pages
> 
> 
> ####   Cluster Definitions   ####
> 
> http://www.rfc-editor.org/all_clusters.php



>> 
>> _______________________________________________
>> TOOLS-DEVELOPMENT mailing list
>> TOOLS-DEVELOPMENT@ietf.org
>> https://www.ietf.org/mailman/listinfo/tools-development
>> 
>