Re: [Tools-implementation] Organization of the mail archives

Robert Sparks <rjsparks@nostrum.com> Tue, 01 September 2020 19:04 UTC

Return-Path: <rjsparks@nostrum.com>
X-Original-To: tools-implementation@ietfa.amsl.com
Delivered-To: tools-implementation@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A4CE23A0F48 for <tools-implementation@ietfa.amsl.com>; Tue, 1 Sep 2020 12:04:01 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.027
X-Spam-Level:
X-Spam-Status: No, score=-3.027 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, NICE_REPLY_A=-0.948, T_SPF_HELO_PERMERROR=0.01, T_SPF_PERMERROR=0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nostrum.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id HMgYCgWhc0vO for <tools-implementation@ietfa.amsl.com>; Tue, 1 Sep 2020 12:04:00 -0700 (PDT)
Received: from nostrum.com (raven-v6.nostrum.com [IPv6:2001:470:d:1130::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2D3303A0F3E for <tools-implementation@ietf.org>; Tue, 1 Sep 2020 12:04:00 -0700 (PDT)
Received: from unescapeable.local ([47.186.30.41]) (authenticated bits=0) by nostrum.com (8.16.1/8.15.2) with ESMTPSA id 081J3wGV009918 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for <tools-implementation@ietf.org>; Tue, 1 Sep 2020 14:03:59 -0500 (CDT) (envelope-from rjsparks@nostrum.com)
DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=nostrum.com; s=default; t=1598987039; bh=r+RQ5ZTuggGlkuMZei6iDRt9nck59jFdiSCHvTcKmmQ=; h=Subject:To:References:From:Date:In-Reply-To; b=AvhjBqnqUwBy1HorXbLxRhe1+gC14Syp/pqRtnIGW127CSPj4zPvsT8d3cFepO2im CwdUnIkuI6I9qO1JCC70MIMK5tAQMtOBSWCAa7H3I5zd5KcxzC6GLsH0pxPDfXYC84 qIJ6MPgUWLYIpZecy0TL53U6V/tALjfyiyHkaEpE=
X-Authentication-Warning: raven.nostrum.com: Host [47.186.30.41] claimed to be unescapeable.local
To: tools-implementation@ietf.org
References: <751dc801-bd0a-ed46-e21e-c4ff5cecc8f2@nostrum.com> <590C0EF3-79A5-411F-B745-D8BAA085BEE6@amsl.com> <8ec50ff6-471b-f698-5e61-b6034509e930@nostrum.com> <CABL0ig4DCfU=o8C8MgpUMMXSvQtCcwXT64dF4cEq=pRS12MG4Q@mail.gmail.com>
From: Robert Sparks <rjsparks@nostrum.com>
Message-ID: <f24484e6-16b0-b86b-7d3a-8fcd8e9c8377@nostrum.com>
Date: Tue, 01 Sep 2020 14:03:57 -0500
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0) Gecko/20100101 Thunderbird/68.12.0
MIME-Version: 1.0
In-Reply-To: <CABL0ig4DCfU=o8C8MgpUMMXSvQtCcwXT64dF4cEq=pRS12MG4Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Transfer-Encoding: 7bit
Content-Language: en-US
Archived-At: <https://mailarchive.ietf.org/arch/msg/tools-implementation/QOgjSQEzn1eyJz0t-g9kg_3jx8c>
Subject: Re: [Tools-implementation] Organization of the mail archives
X-BeenThere: tools-implementation@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Tools Implementation <tools-implementation.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tools-implementation>, <mailto:tools-implementation-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tools-implementation/>
List-Post: <mailto:tools-implementation@ietf.org>
List-Help: <mailto:tools-implementation-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-implementation>, <mailto:tools-implementation-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 01 Sep 2020 19:04:02 -0000

On 9/1/20 12:51 PM, Glen wrote:
> Separate subthread:
>
> On Tue, Sep 1, 2020 at 10:31 AM Robert Sparks <rjsparks@nostrum.com> wrote:
>>>>                       Email    Mailman    /a/mailman/archives Mailman Legacy Archives
>> This has to remain - it is where mailman's internal archiving takes
>> place - any lists using pipermail are kept here, so Legacy isn't really
>> accurate above
> Point of clarification:
> *All lists use pipermail in that Ryan has said that Mailman2's
> internal archiver cannot be shut off or replaced.
> But
> *No lists use pipermail in that /pipermail is not served from anywhere
> in the Apache config, and all references to /pipermail are redirected
> to the Mailarchive.
>
> So we cannot move or remove, but can safely ignore, everything inside
> /a/mailman it seems.

Thank you!

But I'm still a bit concerned about one thing. I had it in my head that 
there were still some active, or only recently (~5yrs) dormant lists 
that only existed outside what mailarchive was ingesting. If that's not 
true, I'll be relieved. Ryan (or anyone else) - do you remember any such 
thing and can you point to it?


>
>>>>                       FTP    FTP/Website combined /a/www/ietf-ftp/concluded-wg-ietf-mail-archive        ftp, rsync    none    NOT exposed by http
> Forgive me, I might be misreading "NOT exposed by http," but:
> https://www.ietf.org/ietf-ftp/concluded-wg-ietf-mail-archive/
Old notes - clearly no longer correct. At the time, they said 
"http://www.ietf.org/ietf-ftp goes to ietf-ftp/ietf".
>
>> These have all been imported, and are served through the mailarchive.
>> These should be stashed. I personally don't think we should serve them
>> in any way since they are available through the mailarchive.
> +1 I agree they should be removed from FTP, RSYNC, and HTTP, and not served.
>
>>>>                       FTP    FTP/Website combined /a/www/ietf-ftp/ietf-mail-archive    Contains text versions of mail archive    ftp, rsync    night-runner    All web access is to the /a/www/ietf-mail-archive tree, which this is a copy of
>> This should go away as soon as ftp stops depending on it (and we had
>> another conversation about removing it already).
>>>>                       Email    Mailarchive /a/www/ietf-mail-archive    Legacy mail archive
>>>>                       Email    Mailarchive /a/www/ietf-mail-archive/text
>>>>                       Email    Mailarchive /a/www/ietf-mail-archive/text-secure
>>>>                       Email    Mailarchive /a/www/ietf-mail-archive/web
>>>>                       Email    Mailarchive /a/www/ietf-mail-archive/web-old
>>>>                       Email    Mailarchive /a/www/ietf-mail-archive/web-secure
>>>> Again, has all of that been imported, and can all of this simply be removed (or stashed offline)?
>> All of this should be stashed. Everything here, with the possible
>> exception of things in web-old have been imported into mailarchive. Ryan
>> is looking at making sure those get imported. Once that's done, all of
>> these should either be taken offline or put in the museum.
> +1.
>
> I assume I should do the "taking offline".  How will I know when to
> proceed with that?  Robert, I assume you will oversee that?
Yes. Right now we are still trying to understand, and that understanding 
will build a plan. I talk about what I think _should_ happen above as a 
proposal to that plan, not as directives to take action now.
>
> Glen
>