IETF Logo Mail Archive

[Tools-discuss] Discontinuing large text dumps

Robert Sparks <rjsparks@nostrum.com> Thu, 08 June 2023 17:27 UTC

Return-Path: <rjsparks@nostrum.com>
X-Original-To: tools-discuss@ietfa.amsl.com
Delivered-To: tools-discuss@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 60E4CC14CF17 for <tools-discuss@ietfa.amsl.com>; Thu, 8 Jun 2023 10:27:22 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.075
X-Spam-Level:
X-Spam-Status: No, score=-7.075 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, T_SPF_HELO_PERMERROR=0.01, T_SPF_PERMERROR=0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nostrum.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id u9cANRyQYkHg for <tools-discuss@ietfa.amsl.com>; Thu, 8 Jun 2023 10:27:18 -0700 (PDT)
Received: from nostrum.com (raven-v6.nostrum.com [IPv6:2001:470:d:1130::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B00CCC14F748 for <tools-discuss@ietf.org>; Thu, 8 Jun 2023 10:27:18 -0700 (PDT)
Received: from [192.168.1.102] ([47.186.48.51]) (authenticated bits=0) by nostrum.com (8.17.1/8.17.1) with ESMTPSA id 358HRHjS098890 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for <tools-discuss@ietf.org>; Thu, 8 Jun 2023 12:27:17 -0500 (CDT) (envelope-from rjsparks@nostrum.com)
DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=nostrum.com; s=default; t=1686245237; bh=HSntj62w/1C4DCS3sTFw1dJlajsccOh9M+EC6bdvKxE=; h=Date:To:From:Subject; b=HXxiJhygBZzdTYYcIvD1eesO124CDl1RBmye6oUsfRXM8PYp8thwb2HzXk4fN6nTa 3kl7SSX8AmThRGyPDKhwlRbIwHPUcqBeG/m0CpfD2AXBvWggB5mEecNAfkzrL7mQZm qZVYJIghDN72GcYSGxuhBWvJL9p4OfvHKywmK/0k=
X-Authentication-Warning: raven.nostrum.com: Host [47.186.48.51] claimed to be [192.168.1.102]
Content-Type: multipart/alternative; boundary="------------g0K0lIONVsYdjQ0wqiOsxfnA"
Message-ID: <c6cf8db7-dd8d-6fb7-3bb0-e1fce8e3f958@nostrum.com>
Date: Thu, 08 Jun 2023 12:27:11 -0500
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0) Gecko/20100101 Thunderbird/102.11.2
Content-Language: en-US
To: tools-discuss <tools-discuss@ietf.org>
From: Robert Sparks <rjsparks@nostrum.com>
Archived-At: <https://mailarchive.ietf.org/arch/msg/tools-discuss/-DxunM0GBgLgndv_a2MXxfN6OaU>
Subject: [Tools-discuss] Discontinuing large text dumps
X-BeenThere: tools-discuss@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IETF Tools Discussion <tools-discuss.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tools-discuss>, <mailto:tools-discuss-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tools-discuss/>
List-Post: <mailto:tools-discuss@ietf.org>
List-Help: <mailto:tools-discuss-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-discuss>, <mailto:tools-discuss-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 08 Jun 2023 17:27:22 -0000

We have several pages that have existed for some time that are _very_ 
expensive to serve, and are not frequently accessed.

We are planning to stop serving these pages this way - if anyone is 
really consuming them, let me know and I'll describe other ways to get 
the information more efficiently.

These are:

  * /wg/1wg-charters.txt
  * /wg/1wg-charters-by-acronym.txt
  * /wg/1wg-summary.txt
  * /wg/1wg-summary-by-acronym.txt

at the datatracker and

  * 1id-index.txt
  * 1id-abstracts.txt

at www.ietf.org.

This has been discussed repeatedly with leadership during tools team 
meetings (see 
https://notes.ietf.org/tools-team-20230314#Stop-serving-text-dumps---Robert) 
for the most recent.

(at least one of these pages is currently broken in the 11.0.0 release, 
and we are working on it).

RjS

v2.23.0 | Report a Bug | By Email