Re: [ietf-smtp] [ dispatch] Forced SMTP redirects

Ned Freed <ned.freed@mrochek.com> Fri, 19 March 2021 23:06 UTC

Return-Path: <ned.freed@mrochek.com>
X-Original-To: ietf-smtp@ietfa.amsl.com
Delivered-To: ietf-smtp@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0DFF33A133F for <ietf-smtp@ietfa.amsl.com>; Fri, 19 Mar 2021 16:06:28 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.1
X-Spam-Level:
X-Spam-Status: No, score=-2.1 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=mrochek.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id hU6SfIEV5xGx for <ietf-smtp@ietfa.amsl.com>; Fri, 19 Mar 2021 16:06:26 -0700 (PDT)
Received: from mauve.mrochek.com (mauve.mrochek.com [98.153.82.211]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3870E3A133E for <ietf-smtp@ietf.org>; Fri, 19 Mar 2021 16:06:26 -0700 (PDT)
Received: from dkim-sign.mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01RWUWDX795C00FF4J@mauve.mrochek.com> for ietf-smtp@ietf.org; Fri, 19 Mar 2021 16:01:22 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mrochek.com; s=201712; t=1616194881; bh=+Kn51lbHCpR2BGcWN0McxN4WGk1QFvEdQF/hjbABatA=; h=Cc:Date:From:Subject:In-reply-to:References:To:From; b=rPW9kYp+aMEuO5VbozgGGQal2MIJfMoXpu8EvYIKJboXTdBzaSM4Qr2GZLTqlI/WZ /N9KI6I1aXQrQnl2K+465Z3a2MGmHpD/DJjiJVXTJJjxeNQKXUc3o7V9WZ386lsdlC tEZ8/0gTLZ+Fy1Dgt/nMqSTg9XN/GD5KDdrKl2gQ=
MIME-version: 1.0
Content-transfer-encoding: 8bit
Content-type: TEXT/PLAIN; charset="utf-8"
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01RWUVBXIOKG0085YQ@mauve.mrochek.com>; Fri, 19 Mar 2021 16:01:19 -0700 (PDT)
Cc: ietf-smtp@ietf.org
Message-id: <01RWUWDVLMAM0085YQ@mauve.mrochek.com>
Date: Fri, 19 Mar 2021 15:47:38 -0700
From: Ned Freed <ned.freed@mrochek.com>
In-reply-to: "Your message dated Fri, 19 Mar 2021 08:45:06 +0000" <7C18EE31-89D3-41EB-9EFE-C2E1EBC0D473@wordtothewise.com>
References: <CAKFo7wkawgk-Yj676kE5MqK8XuebuArMexH-eOdq_Uo7ijdimQ@mail.gmail.com> <20200710015947.0BE2D1C78A2F@ary.qy> <CAKFo7w=MJBt0FdnCcOZCXZWdkd6Jinv4TqwdpefdoaCncbZH3Q@mail.gmail.com> <6AEA7D44C8037B32BC1F3810@PSB> <81d0132b-3ebf-2b0b-756b-503bb5afdb37@dcrocker.net> <8E2D8138-EE61-486A-B957-A922F0C6F4B3@dukhovni.org> <20210318003233.DC44C70A8F5D@ary.qy> <e90d22da-e124-4542-8ef6-83798f5725de@gulbrandsen.priv.no> <F5461844610EDF6715D08D1B@PSB> <503e5ae8-71a1-8c9e-33b3-5c475d0ad76f@pscs.co.uk> <C7297FCD-DA5A-43D1-972C-537171D4330F@wordtothewise.com> <B258F7AA-3FC4-47C7-8DB1-98BA423D597E@dukhovni.org> <7C18EE31-89D3-41EB-9EFE-C2E1EBC0D473@wordtothewise.com>
To: Laura Atkins <laura@wordtothewise.com>
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf-smtp/Orz9w6l-7MZkxJ-KxaQ8zBaYeJ8>
Subject: Re: [ietf-smtp] [ dispatch] Forced SMTP redirects
X-BeenThere: ietf-smtp@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussion of issues related to Simple Mail Transfer Protocol \(SMTP\) \[RFC 821, RFC 2821, RFC 5321\]" <ietf-smtp.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf-smtp>, <mailto:ietf-smtp-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf-smtp/>
List-Post: <mailto:ietf-smtp@ietf.org>
List-Help: <mailto:ietf-smtp-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf-smtp>, <mailto:ietf-smtp-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Mar 2021 23:06:28 -0000


> > On 19 Mar 2021, at 07:39, Viktor Dukhovni <ietf-dane@dukhovni.org> wrote:
> >
> >> On Mar 18, 2021, at 10:55 AM, Laura Atkins <laura@wordtothewise.com> wrote:
> >>
> >> MTAs that send high volumes of email do pay attention to the other digits and the extended codes. In fact, many of them do full text parsing to try and determine how they should handle future mail to that address. https://smtpfieldmanual.com is one example.

> > Is this "paying attention" really happening *during* delivery, to
> > guide further progress of the SMTP transaction, or, as seems more
> > likely, rather an after-the-fact forensic analysis to keep lists
> > in good hygiene.

> I believe both. For instance, there it at least one, and I believe multiple,
> MTA(s) that actively monitor the codes during delivery and change the speed /
> connections based on the current set of response codes.

Commonly called "backoff". (A term I dislike because it's the term we chose
years earlier for specifying retry intervals, and now our documentation has
become confusing as hell ;-)

> For instance, the VMG servers will start temp failing mail with a 452 [TSS04]
> and that is a signal that there is a reputation related limit on that particular
> mail stream. The MTA then adjusts, or even stops, sending for a programatically
> determined period of time. These are real time controls and they are already
> implemented, but in a non-standard way.

But it seems that you are now effectively agreeing with Viktor - altering your
behavior for subsequent transaction is a very very different thing than altering
it during a transaction. We absolutely implement the former but not the latter -
I can't think of a case where this sort of analysis causes a change in client
behavior.

> > Detailed SMTP server replies are certainly useful forensically,
> > what's under discussion in this thread, is to what extent the SMTP
> > protocol engine in the sending client really needs to be concerned
> > with such details.

> There are MTA vendors that advertise things like “	Automatic backoff rules
> in case of delivery problems”. In many cases delivery problems are indicated
by>  non-standard SMTP responses by the receiver indicating there is an issue with
th> at set of deliveries.

> > Occasionally, an MTA with an uncertain reputation may choose to
> > conditionally soften a 5XX reply to a 4XX reply, if it has another
> > means to reach the destination (from a different IP address, ...).
> > Perhaps that's the every-day reality for some sending systems, and
> > in that case I can see these closely scrutinising the server reply.
> > In most other cases, there's little reason to look beyond the first
> > digit.


> This is not my experience dealing with the bulk end of the industry at all.
> They are heavily scrutinising and monitoring sends on a real time basis and that
> includes looking at all the full text of the SMTP response, not just the first
> digit.

Again, I think you are basically in agreement here. Unless I'm misinderstanding
something, Viktor is saying that such scrutiny does take place and is fine, but
when it happens it doesn't alter client behavior during the transaction. Nothing
you're said indicates this is happening, and given how badly it interacts with
pipelining I'm skeptical that high-end delivery systems would implement it.

				Ned