Re: IETF Mail List Failure

Randy Bush <randy@psg.com> Fri, 18 May 2018 07:50 UTC

Return-Path: <randy@psg.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 768011274D2; Fri, 18 May 2018 00:50:17 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.901
X-Spam-Level:
X-Spam-Status: No, score=-6.901 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id p68SmmgRrs4U; Fri, 18 May 2018 00:50:15 -0700 (PDT)
Received: from ran.psg.com (ran.psg.com [IPv6:2001:418:8006::18]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5808E127275; Fri, 18 May 2018 00:50:15 -0700 (PDT)
Received: from localhost ([127.0.0.1] helo=ryuu.rg.net) by ran.psg.com with esmtp (Exim 4.86_2) (envelope-from <randy@psg.com>) id 1fJa9V-0006hX-Of; Fri, 18 May 2018 07:50:14 +0000
Date: Fri, 18 May 2018 09:50:13 +0200
Message-ID: <m2603lieru.wl-randy@psg.com>
From: Randy Bush <randy@psg.com>
To: IETF Executive Director <exec-director@ietf.org>
Cc: IETF Rinse Repeat <ietf@ietf.org>
Subject: Re: IETF Mail List Failure
In-Reply-To: <152661185460.1578.3189815605270968957.idtracker@ietfa.amsl.com>
References: <152661185460.1578.3189815605270968957.idtracker@ietfa.amsl.com>
User-Agent: Wanderlust/2.15.9 (Almost Unreal) Emacs/25.3 Mule/6.0 (HANACHIRUSATO)
MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue")
Content-Type: text/plain; charset="US-ASCII"
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/0RnTeX41txSnG0Nyhb5ath_REAQ>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 18 May 2018 07:50:18 -0000

> On 17 May, from 17:48 UTC (13:48 EDT) to 23:48 UTC (18:49 EDT),
> outbound email from the IETF email lists failed to send. Mail sent to
> the lists went into the archives, but was not received by list
> subscribers.
> 
> A problem in the DMARC-rewriting system caused outbound mail delivery
> to fail silently, without alarm or error message. The rewriting system
> has been taken offline, which restored outbound email service.  The
> lists are back up.
> 
> Unfortunately, because the mail was discarded rather than queued, if
> you sent mail to any IETF list today during the outage window, we ask
> you to please resend your message.
> 
> We apologize for this issue and are working with the Tools Team to
> correct the system before it is put back online again.

thanks, alexa.  these things happen, and i won't even demand a refund :)
sympathies for the pain.

< micro-management = off >

i really appreciate technical details.  there are still a few operators
left in the ietf community, and we try to learn from our oopsies.  a
deeper post mortem would even be welcome as many of us are also trying
to deal with dmarc hell.  you run a medium scale mail operation and any
lessons you share are appreciated.

randy