Re: [Tools-implementation] https accesses to drafts and RFCs on tools.ietf.org

Henrik Levkowetz <henrik@levkowetz.com> Thu, 03 September 2020 13:35 UTC

Return-Path: <henrik@levkowetz.com>
X-Original-To: tools-implementation@ietfa.amsl.com
Delivered-To: tools-implementation@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 43FD23A0BFC for <tools-implementation@ietfa.amsl.com>; Thu, 3 Sep 2020 06:35:37 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.847
X-Spam-Level:
X-Spam-Status: No, score=-2.847 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, NICE_REPLY_A=-0.948, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id wZgvFdRnIRN9 for <tools-implementation@ietfa.amsl.com>; Thu, 3 Sep 2020 06:35:31 -0700 (PDT)
Received: from zinfandel.tools.ietf.org (zinfandel.tools.ietf.org [64.170.98.42]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DC44C3A0BF2 for <tools-implementation@ietf.org>; Thu, 3 Sep 2020 06:35:31 -0700 (PDT)
Received: from h-202-242.a357.priv.bahnhof.se ([158.174.202.242]:51306 helo=tannat.localdomain) by zinfandel.tools.ietf.org with esmtpsa (TLS1.2:DHE_RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from <henrik@levkowetz.com>) id 1kDpOg-0002hU-1o for tools-implementation@ietf.org; Thu, 03 Sep 2020 06:35:30 -0700
To: tools-implementation@ietf.org
References: <67be10c9-1958-4357-bb59-7fd2f845bd23@levkowetz.com>
From: Henrik Levkowetz <henrik@levkowetz.com>
Message-ID: <de5b86a2-aeb6-0675-4ffb-af093ae7ea07@levkowetz.com>
Date: Thu, 03 Sep 2020 15:35:18 +0200
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0) Gecko/20100101 Thunderbird/45.8.0
MIME-Version: 1.0
In-Reply-To: <67be10c9-1958-4357-bb59-7fd2f845bd23@levkowetz.com>
Content-Type: multipart/signed; micalg="pgp-sha256"; protocol="application/pgp-signature"; boundary="MWHC9qVxL7IAG2afu6g10R9ACM4XKQemu"
X-SA-Exim-Connect-IP: 158.174.202.242
X-SA-Exim-Rcpt-To: tools-implementation@ietf.org
X-SA-Exim-Mail-From: henrik@levkowetz.com
X-SA-Exim-Version: 4.2.1 (built Mon, 26 Dec 2011 16:24:06 +0000)
X-SA-Exim-Scanned: Yes (on zinfandel.tools.ietf.org)
X-Clacks-Overhead: GNU Terry Pratchett
Archived-At: <https://mailarchive.ietf.org/arch/msg/tools-implementation/gvEKdvrSL_U87IWRmCJ-JmF-sew>
Subject: Re: [Tools-implementation] https accesses to drafts and RFCs on tools.ietf.org
X-BeenThere: tools-implementation@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Tools Implementation <tools-implementation.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tools-implementation>, <mailto:tools-implementation-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tools-implementation/>
List-Post: <mailto:tools-implementation@ietf.org>
List-Help: <mailto:tools-implementation-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-implementation>, <mailto:tools-implementation-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 03 Sep 2020 13:35:37 -0000

Hi Roman

Here are the FTP figures from the IETF production server, based on the
available log data.  The bargraphs are scaled to the same scale as the
equivalent tools figures.  Since the production server doesn't serve
htmlized drafts and RFCs over FTP, there are no figures for those
categories:


Unprocessed Drafts:
    506 2020-08-02   3% 
    180 2020-08-03   1% 
    196 2020-08-04   1% 
    128 2020-08-05   0% 
    127 2020-08-06   0% 
    211 2020-08-07   1% 
    189 2020-08-08   1% 
    199 2020-08-09   1% 
    215 2020-08-10   1% 
    193 2020-08-11   1% 
   1851 2020-08-12  12% 
   1280 2020-08-13   8% 

    174 2020-08-23   1% 
    156 2020-08-24   1% 
    193 2020-08-25   1% 
    111 2020-08-26   0% 
   1986 2020-08-27  13% 
    210 2020-08-28   1% 
   5355 2020-08-29  36% *
    523 2020-08-30   3% 
    180 2020-08-31   1% 
    204 2020-09-01   1% 
    257 2020-09-02   1% 
    118 2020-09-03   0% 

  614.2 Average/Day  4% 
  14742 Total      
    111 Minimum/Day
   5355 Maximum/Day


Unprocessed RFCs:
      9 2020-08-02   0% 
     29 2020-08-03   0% 
     30 2020-08-04   0% 
     23 2020-08-05   0% 
   3376 2020-08-06  24% *********
    637 2020-08-07   4% *
     30 2020-08-08   0% 
     14 2020-08-09   0% 
     24 2020-08-10   0% 
     20 2020-08-11   0% 
     18 2020-08-12   0% 
     36 2020-08-13   0% 

      1 2020-08-22   0% 
     17 2020-08-23   0% 
     19 2020-08-24   0% 
     27 2020-08-25   0% 
     24 2020-08-26   0% 
     35 2020-08-27   0% 
   3549 2020-08-28  26% **********
   3483 2020-08-29  25% **********
   1802 2020-08-30  13% *****
     38 2020-08-31   0% 
    330 2020-09-01   2% 
     59 2020-09-02   0% 
     20 2020-09-03   0% 

  546.0 Average/Day  4% =
  13650 Total      
      1 Minimum/Day
   3549 Maximum/Day


The figures above show only retrievals of the .txt version, which matches
the tools.ietf.org figures; but there were also retrievals of derived .pdf,
.html, .json (meta-information) and text versions without extension, which
in particular gave a spike of 49855 retrievals on Aug. 28th.  That spike
was essentially due to one actor.  Grouping the Aug. 28 data above by client:

      1 1.241.44.96                        0% 
      1 162.216.25.12                      0% 
      7 172.83.168.131                     0% 
      6 192.30.89.142                      0% 
      4 2001:4898:80e8:a:9a8:247b:f8dc:e   0% 
      7 2a00:801:fd:800:250:56ff:fea5:ca   0% 
      5 alpha.harfa.net                    0% 
      8 anubis.u-strasbg.fr                0% 
   3464 chekov.greenie.muc.de             97% ********************************
      5 ftp.nluug.nl                       0% 
      7 ftp2.ncnu.edu.tw                   0% 
      8 pike-www.lysator.liu.se            0% 
      7 proxy3.nic.ad.jp                   0% 
      5 quimby.gnus.org                    0% 
      7 seymour23.snmp.com                 0% 
      7 vlsi03.si.noda.tus.ac.jp           0% 

or looking at the full RFC retrievals of that date, not just the .txt files:

      1 1.241.44.96                        0% 
      1 162.216.25.12                      0% 
     29 172.83.168.131                     0% 
     31 192.30.89.142                      0% 
      4 2001:4898:80e8:a:9a8:247b:f8dc:e   0% 
     33 2a00:801:fd:800:250:56ff:fea5:ca   0% 
     26 alpha.harfa.net                    0% 
     36 anubis.u-strasbg.fr                0% 
     31 chandelierly.boon.volia.net        0% 
  49482 chekov.greenie.muc.de             99% ********************************
     27 ftp.nluug.nl                       0% 
     34 ftp2.ncnu.edu.tw                   0% 
     34 pike-www.lysator.liu.se            0% 
     36 proxy3.nic.ad.jp                   0% 
      5 quimby.gnus.org                    0% 
     12 seymour23.snmp.com                 0% 
     33 vlsi03.si.noda.tus.ac.jp           0% 




Best regards,

	Henrik

On 2020-08-25 19:46, Henrik Levkowetz wrote:
> Hi Roman,
> 
> I don't know how to best partition and select the data about https accesses
> to drafts and RFCs on tools.ietf.org, but here's a first approach.
> 
> I've split the data into accesses to htmlized documents and unprocessed
> documents, and in turn split those into draft-* and rfc* accesses.
> 
> All figures are for the last 73 days (since June 14th):
> 
> Htmlized drafts:
> 	  97322 Average/Day
> 	7104548 Total      
> 	  29097 Minimum/Day
> 	 135658 Maximum/Day
> 
> Htmlized RFCs:
> 	  306076 Average/Day
> 	22343564 Total     
> 	  126506 Minimum/Day
> 	  535266 Maximum/Day
> 
> Unprocessed Drafts:
> 	  47976 Average/Day
> 	3502257 Total      
> 	  14070 Minimum/Day
> 	 169578 Maximum/Day
> 
> Unprocessed RFCs:
> 	   8748 Average/Day
> 	 638645 Total      
> 	   5289 Minimum/Day
> 	  18640 Maximum/Day
> 
> In case it would be of any use (I don't think so, the figures above
> should contain the essence, but ...) I've also copied in the per-day
> counts with histogram below.
> 
> Let me know if you need the data massaged differently.
> 
> 
> Best regards,
> 
> 	Henrik
> 
> 
> 
> --------------------------------------------------------------------------------
> 
> 
> 
> apache-html-draft.hits
>   81266 2020-06-14   1% ********************************
>  106428 2020-06-15   1% ******************************************
>  110841 2020-06-16   1% ********************************************
>  111007 2020-06-17   1% ********************************************
>   78600 2020-06-18   1% *******************************
>   72794 2020-06-19   1% ****************************
>   53766 2020-06-20   0% *********************
>   62376 2020-06-21   0% ************************
>   88540 2020-06-22   1% ***********************************
>   85501 2020-06-23   1% **********************************
>   81878 2020-06-24   1% ********************************
>   92900 2020-06-25   1% ************************************
>   87744 2020-06-26   1% **********************************
>   62831 2020-06-27   0% *************************
>   67390 2020-06-28   0% **************************
>  104369 2020-06-29   1% *****************************************
>  100735 2020-06-30   1% ****************************************
>  107741 2020-07-01   1% ******************************************
>  135658 2020-07-02   1% ******************************************************
>   89205 2020-07-03   1% ***********************************
>   74852 2020-07-04   1% *****************************
>   64488 2020-07-05   0% *************************
>   90414 2020-07-06   1% ***********************************
>  113455 2020-07-07   1% *********************************************
>   95969 2020-07-08   1% **************************************
>  104358 2020-07-09   1% *****************************************
>   95166 2020-07-10   1% *************************************
>  103439 2020-07-11   1% *****************************************
>  104289 2020-07-12   1% *****************************************
>  123107 2020-07-13   1% *************************************************
>  105469 2020-07-14   1% *****************************************
>  124455 2020-07-15   1% *************************************************
>  111573 2020-07-16   1% ********************************************
>  114783 2020-07-17   1% *********************************************
>   84040 2020-07-18   1% *********************************
>   91487 2020-07-19   1% ************************************
>   98138 2020-07-20   1% ***************************************
>   86829 2020-07-21   1% **********************************
>   89191 2020-07-22   1% ***********************************
>   92841 2020-07-23   1% ************************************
>   95828 2020-07-24   1% **************************************
>   78270 2020-07-25   1% *******************************
>   79919 2020-07-26   1% *******************************
>   89278 2020-07-27   1% ***********************************
>  105444 2020-07-28   1% *****************************************
>  115671 2020-07-29   1% **********************************************
>  107497 2020-07-30   1% ******************************************
>   91011 2020-07-31   1% ************************************
>  112594 2020-08-01   1% ********************************************
>  117895 2020-08-02   1% **********************************************
>  115567 2020-08-03   1% **********************************************
>  111839 2020-08-04   1% ********************************************
>  133018 2020-08-05   1% ****************************************************
>  129636 2020-08-06   1% ***************************************************
>   92681 2020-08-07   1% ************************************
>  103041 2020-08-08   1% *****************************************
>  108460 2020-08-09   1% *******************************************
>  101429 2020-08-10   1% ****************************************
>  100971 2020-08-11   1% ****************************************
>  112109 2020-08-12   1% ********************************************
>  108633 2020-08-13   1% *******************************************
>  113473 2020-08-14   1% *********************************************
>  105689 2020-08-15   1% ******************************************
>  105464 2020-08-16   1% *****************************************
>  117522 2020-08-17   1% **********************************************
>  106793 2020-08-18   1% ******************************************
>  115426 2020-08-19   1% *********************************************
>  124808 2020-08-20   1% *************************************************
>   97833 2020-08-21   1% **************************************
>   80983 2020-08-22   1% ********************************
>   71943 2020-08-23   1% ****************************
>   74813 2020-08-24   1% *****************************
>   29097 2020-08-25   0% ***********
> 
> 97322.6 Average      1% ======================================
> 7104548 Total      
>   29097 Minimum    
>  135658 Maximum    
> 
> 
> apache-html-rfcs.hits
>  146316 2020-06-14   0% **************
>  291820 2020-06-15   1% *****************************
>  295920 2020-06-16   1% *****************************
>  338479 2020-06-17   1% **********************************
>  273364 2020-06-18   1% ***************************
>  222879 2020-06-19   0% **********************
>  141763 2020-06-20   0% **************
>  188444 2020-06-21   0% *******************
>  288590 2020-06-22   1% *****************************
>  270873 2020-06-23   1% ***************************
>  305401 2020-06-24   1% ******************************
>  333383 2020-06-25   1% *********************************
>  274105 2020-06-26   1% ***************************
>  241347 2020-06-27   1% ************************
>  188843 2020-06-28   0% *******************
>  348267 2020-06-29   1% ***********************************
>  325185 2020-06-30   1% ********************************
>  373970 2020-07-01   1% *************************************
>  352141 2020-07-02   1% ***********************************
>  321019 2020-07-03   1% ********************************
>  223567 2020-07-04   1% **********************
>  232055 2020-07-05   1% ***********************
>  368149 2020-07-06   1% *************************************
>  353699 2020-07-07   1% ***********************************
>  321830 2020-07-08   1% ********************************
>  394128 2020-07-09   1% ***************************************
>  361806 2020-07-10   1% ************************************
>  280085 2020-07-11   1% ****************************
>  286048 2020-07-12   1% ****************************
>  345781 2020-07-13   1% **********************************
>  288702 2020-07-14   1% *****************************
>  309233 2020-07-15   1% *******************************
>  535266 2020-07-16   2% ******************************************************
>  352427 2020-07-17   1% ***********************************
>  242841 2020-07-18   1% ************************
>  387772 2020-07-19   1% ***************************************
>  517604 2020-07-20   2% ****************************************************
>  488514 2020-07-21   2% *************************************************
>  388045 2020-07-22   1% ***************************************
>  311588 2020-07-23   1% *******************************
>  317076 2020-07-24   1% *******************************
>  211095 2020-07-25   0% *********************
>  283776 2020-07-26   1% ****************************
>  334426 2020-07-27   1% *********************************
>  328170 2020-07-28   1% *********************************
>  340508 2020-07-29   1% **********************************
>  315105 2020-07-30   1% *******************************
>  229031 2020-07-31   1% ***********************
>  159211 2020-08-01   0% ****************
>  220397 2020-08-02   0% **********************
>  316824 2020-08-03   1% *******************************
>  313566 2020-08-04   1% *******************************
>  310807 2020-08-05   1% *******************************
>  331097 2020-08-06   1% *********************************
>  279409 2020-08-07   1% ****************************
>  165472 2020-08-08   0% ****************
>  172664 2020-08-09   0% *****************
>  287621 2020-08-10   1% *****************************
>  295719 2020-08-11   1% *****************************
>  294523 2020-08-12   1% *****************************
>  307640 2020-08-13   1% *******************************
>  416059 2020-08-14   1% *****************************************
>  280695 2020-08-15   1% ****************************
>  263146 2020-08-16   1% **************************
>  333133 2020-08-17   1% *********************************
>  442889 2020-08-18   1% ********************************************
>  478904 2020-08-19   2% ************************************************
>  435493 2020-08-20   1% *******************************************
>  344104 2020-08-21   1% **********************************
>  280130 2020-08-22   1% ****************************
>  289216 2020-08-23   1% *****************************
>  327903 2020-08-24   1% *********************************
>  126506 2020-08-25   0% ************
> 
> 306076.2 Average     1% ==============================
> 22343564 Total     
>  126506 Minimum    
>  535266 Maximum    
> 
> 
> apache-id-draft.hits
>   49253 2020-06-14   1% ***************
>   55167 2020-06-15   1% *****************
>   50603 2020-06-16   1% ****************
>   46365 2020-06-17   1% **************
>   35022 2020-06-18   0% ***********
>   36849 2020-06-19   1% ***********
>   26434 2020-06-20   0% ********
>   50503 2020-06-21   1% ****************
>   39440 2020-06-22   1% ************
>   36768 2020-06-23   1% ***********
>   35647 2020-06-24   1% ***********
>   40646 2020-06-25   1% ************
>   38485 2020-06-26   1% ************
>   29214 2020-06-27   0% *********
>   39570 2020-06-28   1% ************
>   41089 2020-06-29   1% *************
>   33619 2020-06-30   0% **********
>   38919 2020-07-01   1% ************
>   65630 2020-07-02   1% ********************
>   54483 2020-07-03   1% *****************
>   39213 2020-07-04   1% ************
>   57434 2020-07-05   1% ******************
>   49707 2020-07-06   1% ***************
>   52609 2020-07-07   1% ****************
>   57386 2020-07-08   1% ******************
>   49086 2020-07-09   1% ***************
>   62601 2020-07-10   1% *******************
>  158713 2020-07-11   4% **************************************************
>  105169 2020-07-12   3% *********************************
>  169578 2020-07-13   4% ******************************************************
>   47409 2020-07-14   1% ***************
>   46682 2020-07-15   1% **************
>   49097 2020-07-16   1% ***************
>   47495 2020-07-17   1% ***************
>   32693 2020-07-18   0% **********
>   47718 2020-07-19   1% ***************
>   42470 2020-07-20   1% *************
>   36461 2020-07-21   1% ***********
>   37586 2020-07-22   1% ***********
>   34639 2020-07-23   0% ***********
>   31298 2020-07-24   0% *********
>   28626 2020-07-25   0% *********
>   47178 2020-07-26   1% ***************
>   37545 2020-07-27   1% ***********
>   36335 2020-07-28   1% ***********
>   43743 2020-07-29   1% *************
>   38596 2020-07-30   1% ************
>   35525 2020-07-31   1% ***********
>   36294 2020-08-01   1% ***********
>   68482 2020-08-02   1% *********************
>   53792 2020-08-03   1% *****************
>   52330 2020-08-04   1% ****************
>   50216 2020-08-05   1% ***************
>   53453 2020-08-06   1% *****************
>   43428 2020-08-07   1% *************
>   47594 2020-08-08   1% ***************
>   65591 2020-08-09   1% ********************
>   49202 2020-08-10   1% ***************
>   44368 2020-08-11   1% **************
>   43565 2020-08-12   1% *************
>   43954 2020-08-13   1% *************
>   42661 2020-08-14   1% *************
>   42860 2020-08-15   1% *************
>   63403 2020-08-16   1% ********************
>   49925 2020-08-17   1% ***************
>   41924 2020-08-18   1% *************
>   45676 2020-08-19   1% **************
>   42967 2020-08-20   1% *************
>   35859 2020-08-21   1% ***********
>   29273 2020-08-22   0% *********
>   41134 2020-08-23   1% *************
>   33938 2020-08-24   0% **********
>   14070 2020-08-25   0% ****
> 
> 47976.1 Average      1% ===============
> 3502257 Total      
>   14070 Minimum    
>  169578 Maximum    
> 
> 
> apache-rfc-rfc.hits
>    5689 2020-06-14   0% ****************
>    7496 2020-06-15   1% *********************
>    6072 2020-06-16   0% *****************
>    7809 2020-06-17   1% **********************
>    8344 2020-06-18   1% ************************
>    5607 2020-06-19   0% ****************
>    6158 2020-06-20   0% *****************
>    8768 2020-06-21   1% *************************
>    6436 2020-06-22   1% ******************
>   10604 2020-06-23   1% ******************************
>    6253 2020-06-24   0% ******************
>    9404 2020-06-25   1% ***************************
>    7029 2020-06-26   1% ********************
>    6340 2020-06-27   0% ******************
>    6685 2020-06-28   1% *******************
>   18446 2020-06-29   2% *****************************************************
>    6903 2020-06-30   1% *******************
>    7748 2020-07-01   1% **********************
>    9239 2020-07-02   1% **************************
>   10152 2020-07-03   1% *****************************
>    6783 2020-07-04   1% *******************
>    6220 2020-07-05   0% ******************
>    9874 2020-07-06   1% ****************************
>   15519 2020-07-07   2% ********************************************
>    8622 2020-07-08   1% ************************
>    9060 2020-07-09   1% **************************
>    9293 2020-07-10   1% **************************
>    9300 2020-07-11   1% **************************
>    7486 2020-07-12   1% *********************
>    9554 2020-07-13   1% ***************************
>    9725 2020-07-14   1% ****************************
>    7622 2020-07-15   1% **********************
>    7774 2020-07-16   1% **********************
>    7787 2020-07-17   1% **********************
>    6762 2020-07-18   1% *******************
>    7617 2020-07-19   1% **********************
>    8770 2020-07-20   1% *************************
>   11967 2020-07-21   1% **********************************
>    7177 2020-07-22   1% ********************
>    6735 2020-07-23   1% *******************
>   11814 2020-07-24   1% **********************************
>    5953 2020-07-25   0% *****************
>    9505 2020-07-26   1% ***************************
>    8357 2020-07-27   1% ************************
>   13692 2020-07-28   2% ***************************************
>    9109 2020-07-29   1% **************************
>    6942 2020-07-30   1% ********************
>   15018 2020-07-31   2% *******************************************
>    7288 2020-08-01   1% *********************
>   10365 2020-08-02   1% ******************************
>   11136 2020-08-03   1% ********************************
>   10579 2020-08-04   1% ******************************
>   11461 2020-08-05   1% *********************************
>   15231 2020-08-06   2% ********************************************
>    9138 2020-08-07   1% **************************
>   10778 2020-08-08   1% *******************************
>    6635 2020-08-09   1% *******************
>    7065 2020-08-10   1% ********************
>    7351 2020-08-11   1% *********************
>   18640 2020-08-12   2% ******************************************************
>    8030 2020-08-13   1% ***********************
>    7939 2020-08-14   1% **********************
>    7211 2020-08-15   1% ********************
>    6818 2020-08-16   1% *******************
>    7713 2020-08-17   1% **********************
>    8318 2020-08-18   1% ************************
>    9671 2020-08-19   1% ****************************
>    8971 2020-08-20   1% *************************
>    6335 2020-08-21   0% ******************
>    5289 2020-08-22   0% ***************
>    7672 2020-08-23   1% **********************
>    8450 2020-08-24   1% ************************
>    5342 2020-08-25   0% ***************
> 
>  8748.6 Average      1% =========================
>  638645 Total      
>    5289 Minimum    
>   18640 Maximum    
>