Re: [Tools-implementation] Organization of the mail archives

Ryan Cross <rcross@amsl.com> Tue, 15 September 2020 18:17 UTC

Return-Path: <rcross@amsl.com>
X-Original-To: tools-implementation@ietfa.amsl.com
Delivered-To: tools-implementation@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6F9593A1672 for <tools-implementation@ietfa.amsl.com>; Tue, 15 Sep 2020 11:17:09 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.898
X-Spam-Level:
X-Spam-Status: No, score=-1.898 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 5YEd2GmKH00o for <tools-implementation@ietfa.amsl.com>; Tue, 15 Sep 2020 11:17:07 -0700 (PDT)
Received: from mail.amsl.com (c8a.amsl.com [4.31.198.40]) (using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 00FBA3A1671 for <tools-implementation@ietf.org>; Tue, 15 Sep 2020 11:17:06 -0700 (PDT)
Received: from localhost (localhost [127.0.0.1]) by c8a.amsl.com (Postfix) with ESMTP id 98F933C3087; Tue, 15 Sep 2020 11:17:05 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
Received: from c8a.amsl.com ([127.0.0.1]) by localhost (c8a.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3Ay_XgGkJkE3; Tue, 15 Sep 2020 11:17:05 -0700 (PDT)
Received: from [IPv6:2601:602:9c00:ae0:b0aa:25e3:6d97:3477] (unknown [IPv6:2601:602:9c00:ae0:b0aa:25e3:6d97:3477]) by c8a.amsl.com (Postfix) with ESMTPSA id 2B1253C3086; Tue, 15 Sep 2020 11:17:05 -0700 (PDT)
From: Ryan Cross <rcross@amsl.com>
Message-Id: <1F5A3AFF-2844-4F92-A81F-F70EC5FAA715@amsl.com>
Content-Type: multipart/alternative; boundary="Apple-Mail=_2C1F256E-C03B-4CAA-9F12-AB9B4A24F694"
Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.1\))
Date: Tue, 15 Sep 2020 11:17:05 -0700
In-Reply-To: <7e213352-f0ba-6a84-0d26-1d2cb669f5f5@nostrum.com>
Cc: "tools-implementation@ietf.org" <tools-implementation@ietf.org>
To: Robert Sparks <rjsparks@nostrum.com>
References: <8ec50ff6-471b-f698-5e61-b6034509e930@nostrum.com> <7e213352-f0ba-6a84-0d26-1d2cb669f5f5@nostrum.com>
X-Mailer: Apple Mail (2.3608.120.23.2.1)
Archived-At: <https://mailarchive.ietf.org/arch/msg/tools-implementation/C3wCpiSCZ3S4KWrqdTP9zqCUKiY>
Subject: Re: [Tools-implementation] Organization of the mail archives
X-BeenThere: tools-implementation@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Tools Implementation <tools-implementation.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tools-implementation>, <mailto:tools-implementation-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tools-implementation/>
List-Post: <mailto:tools-implementation@ietf.org>
List-Help: <mailto:tools-implementation-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-implementation>, <mailto:tools-implementation-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 15 Sep 2020 18:17:09 -0000

Inline

> On Sep 15, 2020, at 9:58 AM, Robert Sparks <rjsparks@nostrum.com> wrote:
> 
> Continuing this in the context of today's conversation.
> 
> After the cleanup described below, we are/will-be left with:
> 
> 
> /a/mailarch/data/archive as the _authoritative_ store. 
> 
> /a/mailarch/data/mbox_archive/public as an automatically generated set of mbox files generated from the authoritative store. 
> 
> Should we plan to move the first to be under /doc and the second to be under /derived?
> 
> 
Do you mean

/a/mailarch/data/doc/[list name]

/a/mailarch/data/derived/[list name]

Or something else?
> RjS
> 
> 
> 
> -------- Forwarded Message --------
> Subject:	Organization of the mail archives
> Date:	Tue, 1 Sep 2020 12:30:56 -0500
> From:	Robert Sparks <rjsparks@nostrum.com> <mailto:rjsparks@nostrum.com>
> To:	Ryan Cross <rcross@amsl.com> <mailto:rcross@amsl.com>, tools-implementation@ietf.org <mailto:tools-implementation@ietf.org> <tools-implementation@ietf.org> <mailto:tools-implementation@ietf.org>
> 
> After consulting with Ryan, I propose this disposition for the following email archive related directories:
> 
> 
>>> Legacy Mailarchive /a/ietf A few very old mail archive scripts
> This can simply be removed. The scripts are no longer used.
>>> Email Mailarchive /a/isode ISODE IMAP server data store
>>> Email Mailarchive /a/mailarch Mail Archive operations
> 
> These should stay where they are.
> 
> /a/mailarch/data/archive is the _authoritative_ store.
> 
> /a/mailarch/data/mbox_archive/public is an automatically generated set of mbox files generated from the authoritative store. That should be used to replace several things below.
> 
>>> Email Mailman /a/mailman Mailman operations
> That has to remain (though we should consider what to do with it when we bring in Mailman3
>>> Email Mailman /a/mailman/archives Mailman Legacy Archives
> This has to remain - it is where mailman's internal archiving takes place - any lists using pipermail are kept here, so Legacy isn't really accurate above
>>> 
>>> Email Postfix /a/postfix Postfix operations
> This remains
>>> FTP FTP/Website combined /a/www/ietf-ftp/concluded-wg-ietf-mail-archive ftp, rsync none NOT exposed by http
>>> 
> These have all been imported, and are served through the mailarchive. These should be stashed. I personally don't think we should serve them in any way since they are available through the mailarchive. If they are served, they should clearly be in something I'd like to start calling the "museum".
>> 
>>> FTP FTP/Website combined /a/www/ietf-ftp/ietf-mail-archive Contains text versions of mail archive ftp, rsync night-runner All web access is to the /a/www/ietf-mail-archive tree, which this is a copy of
> This should go away as soon as ftp stops depending on it (and we had another conversation about removing it already).
>>> Email Mailarchive /a/www/ietf-mail-archive Legacy mail archive
>>> Email Mailarchive /a/www/ietf-mail-archive/text
>>> Email Mailarchive /a/www/ietf-mail-archive/text-secure
>>> Email Mailarchive /a/www/ietf-mail-archive/web
>>> Email Mailarchive /a/www/ietf-mail-archive/web-old
>>> Email Mailarchive /a/www/ietf-mail-archive/web-secure
>>> 
>>> Again, has all of that been imported, and can all of this simply be removed (or stashed offline)?
> All of this should be stashed. Everything here, with the possible exception of things in web-old have been imported into mailarchive. Ryan is looking at making sure those get imported. Once that's done, all of these should either be taken offline or put in the museum.
> 
> Are there any other puddles of email-archive related things that aren't in those directories?
>