Service Restored - Partial Service Outage April 11
Glen <glen@amsl.com> Mon, 11 April 2022 16:04 UTC
Return-Path: <glen@amsl.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1])
by ietfa.amsl.com (Postfix) with ESMTP id EF79C3A0820
for <ietf@ietfa.amsl.com>; Mon, 11 Apr 2022 09:04:32 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -101.919
X-Spam-Level:
X-Spam-Status: No, score=-101.919 tagged_above=-999 required=5
tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_BLOCKED=0.001,
SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01,
USER_IN_WELCOMELIST=-0.01, USER_IN_WHITELIST=-100]
autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44])
by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024)
with ESMTP id GTbYptrz4CIX for <ietf@ietfa.amsl.com>;
Mon, 11 Apr 2022 09:04:30 -0700 (PDT)
Received: from c8a.amsl.com (c8a.amsl.com [4.31.198.40])
(using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits))
(No client certificate requested)
by ietfa.amsl.com (Postfix) with ESMTPS id 916293A07F6
for <ietf@ietf.org>; Mon, 11 Apr 2022 09:04:30 -0700 (PDT)
Received: by c8a.amsl.com (Postfix, from userid 1000)
id 7D372425A344; Mon, 11 Apr 2022 09:04:30 -0700 (PDT)
Date: Mon, 11 Apr 2022 09:04:30 -0700
From: Glen <glen@amsl.com>
To: ietf@ietf.org
Subject: Service Restored - Partial Service Outage April 11
Message-ID: <20220411160430.GB26686@amsl.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
User-Agent: Mutt/1.10.1 (2018-07-13)
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/62pe4tZSUT6LD6RFKV0vwt3_16c>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>,
<mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>,
<mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 11 Apr 2022 16:04:33 -0000
All - A number of IETF services were impacted by an unexpected outage. The impacted services included the Author-tools site, Notes, the new Wikis, staff email, ticketing and Zulip. The cause of the outage was a malfunctioning backup job on the cloud platform which caused a physical host to exhaust logical disk space. This in turn caused the cloud virtual machines to experience degraded service. The problem has been identified and corrected, and all services are now back online. I apologize for the inconvenience. Glen -- Glen Barney IT Director AMS (IETF Secretariat)