Re: [ietf-smtp] [Emailcore] Proposed ESMTP keyword RCPTLIMIT

Laura Atkins <laura@wordtothewise.com> Tue, 20 April 2021 14:33 UTC

Return-Path: <laura@wordtothewise.com>
X-Original-To: ietf-smtp@ietfa.amsl.com
Delivered-To: ietf-smtp@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1F8E53A2621 for <ietf-smtp@ietfa.amsl.com>; Tue, 20 Apr 2021 07:33:31 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 1.237
X-Spam-Level: *
X-Spam-Status: No, score=1.237 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_SBL_CSS=3.335, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=wordtothewise.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Pr_3NL3Zy-LY for <ietf-smtp@ietfa.amsl.com>; Tue, 20 Apr 2021 07:33:26 -0700 (PDT)
Received: from mail.wordtothewise.com (mail.wordtothewise.com [104.225.223.158]) by ietfa.amsl.com (Postfix) with ESMTP id 3A26A3A2619 for <ietf-smtp@ietf.org>; Tue, 20 Apr 2021 07:33:26 -0700 (PDT)
Received: from [192.168.0.227] (unknown [37.228.231.27]) by mail.wordtothewise.com (Postfix) with ESMTPSA id D10629F149 for <ietf-smtp@ietf.org>; Tue, 20 Apr 2021 07:33:24 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=wordtothewise.com; s=aardvark; t=1618929205; bh=vqblU6GXKaio2prj2waFvQ5sp7IS6NBMg60g8KeKPck=; h=From:Subject:Date:References:To:In-Reply-To:From; b=BQSYkHY0fnyuifwdhICHMqQh/AypiOUUMcFcGf+KUZXeMVUoX7ARkNPALsbwxq5hl ywRt8zz4pgjkb91DlyOmdCDvafJ+7y69lm2yrS0j4PHd4+iSOiZGRERKy1x0gFuYvi 6GrCi6rczs6iV1iUmUF3UXfPNNS2xdchOQOM1L80=
From: Laura Atkins <laura@wordtothewise.com>
Content-Type: multipart/alternative; boundary="Apple-Mail=_0FC06279-AECA-400F-B8FD-1BA9B0267265"
Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\))
Date: Tue, 20 Apr 2021 15:33:22 +0100
References: <cone.1615844513.220592.51342.1004@monster.email-scan.com> <20210315234648.563C0708B340@ary.qy> <CAO=DXp-+fJwsNegzu3zgwDLtCcSF104AUF=i+_GMgSYVBAKjWg@mail.gmail.com> <01RY24IJ225Q0085YQ@mauve.mrochek.com> <CAO=DXp-VSxeTsWZFAms7WX-jonkSiyGgKV5T_17VGhq6bcsMdg@mail.gmail.com> <cone.1618877363.380527.55051.1004@monster.email-scan.com> <F8AC11B4-1C30-4DE6-AE70-F91994EE7539@wordtothewise.com> <Dx8j6QnjLufgFAwC@highwayman.com>
To: ietf-smtp@ietf.org
In-Reply-To: <Dx8j6QnjLufgFAwC@highwayman.com>
Message-Id: <758F53AD-8A99-47D8-BE39-E5C7A0030FCF@wordtothewise.com>
X-Mailer: Apple Mail (2.3608.120.23.2.4)
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf-smtp/Uy5hdyz4fv6vLZyFtOOVyHBr5SM>
Subject: Re: [ietf-smtp] [Emailcore] Proposed ESMTP keyword RCPTLIMIT
X-BeenThere: ietf-smtp@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussion of issues related to Simple Mail Transfer Protocol \(SMTP\) \[RFC 821, RFC 2821, RFC 5321\]" <ietf-smtp.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf-smtp>, <mailto:ietf-smtp-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf-smtp/>
List-Post: <mailto:ietf-smtp@ietf.org>
List-Help: <mailto:ietf-smtp-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf-smtp>, <mailto:ietf-smtp-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 20 Apr 2021 14:33:31 -0000


> On 20 Apr 2021, at 15:19, Richard Clayton <richard@highwayman.com> wrote:
> 
> In message <F8AC11B4-1C30-4DE6-AE70-F91994EE7539@wordtothewise.com>,
> Laura Atkins <laura@wordtothewise.com> writes
> 
>>> I see nothing to gain from forcing a sending server to artificially limit 
>> itself; how after every N sent messages it has to close its socket, and 
>> reconnect again. What is that supposed to accomplish? I don't get it.
>> 
>> It’s a limit that was implemented more than a decade ago by some of the highest 
>> volume receivers around. I don’t think we have to understand why they did it - 
>> if even the folks who made the decision are still around. [1] We can just say: 
>> this is commonly occurring behavior and it makes sense for SMTP to document it 
>> and have a way to explain it. 
> 
> As you will know, the highest volume receivers have complex machine
> learning systems which can -- after a number of messages -- come to the
> conclusion that sending a SYN-ACK at the start was somewhat of a
> mistake... use of resources is more efficient if you make such senders
> (which dominate) start at the beginning again and you just refuse to let
> them connect "ever again".

Absolutely this is true. 

But many of these systems also have rules that apply universally and have nothing to do with any reputation or performance issues. I was keeping track of them and making them publicly available many years ago. The commercial MTAs mostly handle this in an automated fashion and these limits aren’t published the same way they were in the past (on postmaster pages). 

To give an example of limits I was sharing: 

Provider 1: 		25 connections per IP address	100 recipients per message		
Provider 2: 		5 connections per IP address		100 messages per connection
Provider 3: 		1 connection per IP				1 email per connection
Provider 4:									500 emails per connection; 100 recipients per message
Provider 5: 									20 emails per connection; reputation based rate limiting

Providers 3 and 5 still have those limits in place. The others I’m not as sure about. 

This data is publicly available, I’m just hiding the providers because I really don’t think the details of who is doing what is relevant to the discussion. It’s enough to know that major providers are doing this and have been doing this for at least a decade.

Providing a programatic way to advertise the maximum limits seems to me to be a good addition to the information transmitted. Less reliance on individual people manually maintaining lists of information is never a bad thing.  

[… snip ...]

>> What we should be doing is figuring out how to make these limits more clear to 
>> senders. 
> 
> as I observed before -- don't expect much more than a generic statement
> (which comes down to "sending N good emails is the most you can expect
> to be able to manage") from such systems. Anything which revealed the
> current view ("actually, you've pretty much exhausted our patience")
> just is not going to happen (IMO)

That’s the statement I am looking for here. We accept no more than this, even for the servers with the absolute best reputation. With the understanding that those limits may be lower (sometimes significantly lower) for senders with poorer reputation. 

laura 

-- 
Having an Email Crisis?  We can help! 800 823-9674 

Laura Atkins
Word to the Wise
laura@wordtothewise.com
(650) 437-0741		

Email Delivery Blog: https://wordtothewise.com/blog