Re: [ietf-smtp] [ dispatch] Forced SMTP redirects

Laura Atkins <laura@wordtothewise.com> Sat, 20 March 2021 11:20 UTC

Return-Path: <laura@wordtothewise.com>
X-Original-To: ietf-smtp@ietfa.amsl.com
Delivered-To: ietf-smtp@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B1E313A2020 for <ietf-smtp@ietfa.amsl.com>; Sat, 20 Mar 2021 04:20:19 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.098
X-Spam-Level:
X-Spam-Status: No, score=-2.098 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=wordtothewise.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id TfOkMM6EQnKb for <ietf-smtp@ietfa.amsl.com>; Sat, 20 Mar 2021 04:20:17 -0700 (PDT)
Received: from mail.wordtothewise.com (mail.wordtothewise.com [104.225.223.158]) by ietfa.amsl.com (Postfix) with ESMTP id 49AED3A201F for <ietf-smtp@ietf.org>; Sat, 20 Mar 2021 04:20:17 -0700 (PDT)
Received: from [192.168.0.227] (unknown [37.228.231.27]) by mail.wordtothewise.com (Postfix) with ESMTPSA id CFEB19F149 for <ietf-smtp@ietf.org>; Sat, 20 Mar 2021 04:20:15 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=wordtothewise.com; s=aardvark; t=1616239216; bh=rbUG537AzpmyaE96veMWwCNUc2InIHv1XtRrWeejavg=; h=From:Subject:Date:References:To:In-Reply-To:From; b=bzIFFulRt2om6KetOn3LirnDrZczdrw8kuL5kr8VTGmy8bAagF6/+wI9PNoGWgVVc HvfdQRnKCAjiTu5Ri/J8waNy513S5CW5jO2De96S7TzSayFTmTUa3j25y3FOwXzKLb lvjEOGkgQJ2maBGwg00v4LXedllR8AnMSzKlM7xA=
From: Laura Atkins <laura@wordtothewise.com>
Content-Type: multipart/alternative; boundary="Apple-Mail=_C48FCBAC-BF74-4145-BE53-AB365008DED1"
Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\))
Date: Sat, 20 Mar 2021 11:20:13 +0000
References: <CAKFo7wkawgk-Yj676kE5MqK8XuebuArMexH-eOdq_Uo7ijdimQ@mail.gmail.com> <20200710015947.0BE2D1C78A2F@ary.qy> <CAKFo7w=MJBt0FdnCcOZCXZWdkd6Jinv4TqwdpefdoaCncbZH3Q@mail.gmail.com> <6AEA7D44C8037B32BC1F3810@PSB> <81d0132b-3ebf-2b0b-756b-503bb5afdb37@dcrocker.net> <8E2D8138-EE61-486A-B957-A922F0C6F4B3@dukhovni.org> <20210318003233.DC44C70A8F5D@ary.qy> <e90d22da-e124-4542-8ef6-83798f5725de@gulbrandsen.priv.no> <F5461844610EDF6715D08D1B@PSB> <503e5ae8-71a1-8c9e-33b3-5c475d0ad76f@pscs.co.uk> <C7297FCD-DA5A-43D1-972C-537171D4330F@wordtothewise.com> <B258F7AA-3FC4-47C7-8DB1-98BA423D597E@dukhovni.org> <7C18EE31-89D3-41EB-9EFE-C2E1EBC0D473@wordtothewise.com> <01RWUWDVLMAM0085YQ@mauve.mrochek.com>
To: ietf-smtp@ietf.org
In-Reply-To: <01RWUWDVLMAM0085YQ@mauve.mrochek.com>
Message-Id: <051DE9D3-1A4C-4809-BE07-F76777837549@wordtothewise.com>
X-Mailer: Apple Mail (2.3608.120.23.2.4)
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf-smtp/oCmx1crbUi3aSE-95wpClOaIARo>
Subject: Re: [ietf-smtp] [ dispatch] Forced SMTP redirects
X-BeenThere: ietf-smtp@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussion of issues related to Simple Mail Transfer Protocol \(SMTP\) \[RFC 821, RFC 2821, RFC 5321\]" <ietf-smtp.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf-smtp>, <mailto:ietf-smtp-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf-smtp/>
List-Post: <mailto:ietf-smtp@ietf.org>
List-Help: <mailto:ietf-smtp-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf-smtp>, <mailto:ietf-smtp-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 20 Mar 2021 11:20:20 -0000


> On 19 Mar 2021, at 22:47, Ned Freed <ned.freed@mrochek.com> wrote:
> 
> 
> 
>>> On 19 Mar 2021, at 07:39, Viktor Dukhovni <ietf-dane@dukhovni.org> wrote:
>>> 
>>>> On Mar 18, 2021, at 10:55 AM, Laura Atkins <laura@wordtothewise.com> wrote:
>>>> 
>>>> MTAs that send high volumes of email do pay attention to the other digits and the extended codes. In fact, many of them do full text parsing to try and determine how they should handle future mail to that address. https://smtpfieldmanual.com is one example.
> 
>>> Is this "paying attention" really happening *during* delivery, to
>>> guide further progress of the SMTP transaction, or, as seems more
>>> likely, rather an after-the-fact forensic analysis to keep lists
>>> in good hygiene.
> 
>> I believe both. For instance, there it at least one, and I believe multiple,
>> MTA(s) that actively monitor the codes during delivery and change the speed /
>> connections based on the current set of response codes.
> 
> Commonly called "backoff". (A term I dislike because it's the term we chose
> years earlier for specifying retry intervals, and now our documentation has
> become confusing as hell ;-)

Language is definitely an issue. SMTP-speak, deliverability-speak and email-marketing-speak all use the same words in different ways and setting the language parameters for any discussion is important. 

>> For instance, the VMG servers will start temp failing mail with a 452 [TSS04]
>> and that is a signal that there is a reputation related limit on that particular
>> mail stream. The MTA then adjusts, or even stops, sending for a programatically
>> determined period of time. These are real time controls and they are already
>> implemented, but in a non-standard way.
> 
> But it seems that you are now effectively agreeing with Viktor - altering your
> behavior for subsequent transaction is a very very different thing than altering
> it during a transaction. We absolutely implement the former but not the latter -
> I can't think of a case where this sort of analysis causes a change in client
> behavior.

You get a 452 for this transaction and you stop the transaction and then modify future transactions. The MTA developers can confirm that’s what they’re doing, but my understanding is this is what’s happening under the covers. 

>>> Detailed SMTP server replies are certainly useful forensically,
>>> what's under discussion in this thread, is to what extent the SMTP
>>> protocol engine in the sending client really needs to be concerned
>>> with such details.
> 
>> There are MTA vendors that advertise things like “	Automatic backoff rules
>> in case of delivery problems”. In many cases delivery problems are indicated
> by>  non-standard SMTP responses by the receiver indicating there is an issue with
> th> at set of deliveries.
> 
>>> Occasionally, an MTA with an uncertain reputation may choose to
>>> conditionally soften a 5XX reply to a 4XX reply, if it has another
>>> means to reach the destination (from a different IP address, ...).
>>> Perhaps that's the every-day reality for some sending systems, and
>>> in that case I can see these closely scrutinising the server reply.
>>> In most other cases, there's little reason to look beyond the first
>>> digit.
> 
> 
>> This is not my experience dealing with the bulk end of the industry at all.
>> They are heavily scrutinising and monitoring sends on a real time basis and that
>> includes looking at all the full text of the SMTP response, not just the first
>> digit.
> 
> Again, I think you are basically in agreement here. Unless I'm misinderstanding
> something, Viktor is saying that such scrutiny does take place and is fine, but
> when it happens it doesn't alter client behavior during the transaction. Nothing
> you're said indicates this is happening, and given how badly it interacts with
> pipelining I'm skeptical that high-end delivery systems would implement it.

That’s my mental model of how it works, but I don’t know for sure. I’m hoping the folks writing the MTAs will comment here. 

laura 

-- 
Having an Email Crisis?  We can help! 800 823-9674 

Laura Atkins
Word to the Wise
laura@wordtothewise.com
(650) 437-0741		

Email Delivery Blog: https://wordtothewise.com/blog