Re: [ietf-smtp] Should we update an RFC if people refuse to implement parts of it ?

John Levine <johnl@taugh.com> Sat, 05 June 2021 16:56 UTC

Return-Path: <johnl@iecc.com>
X-Original-To: ietf-smtp@ietfa.amsl.com
Delivered-To: ietf-smtp@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8897F3A28E7 for <ietf-smtp@ietfa.amsl.com>; Sat, 5 Jun 2021 09:56:05 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.851
X-Spam-Level:
X-Spam-Status: No, score=-1.851 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.249, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=iecc.com header.b=ER6qKaov; dkim=pass (2048-bit key) header.d=taugh.com header.b=VNBzO/HY
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jklW-yLvPaAa for <ietf-smtp@ietfa.amsl.com>; Sat, 5 Jun 2021 09:56:00 -0700 (PDT)
Received: from gal.iecc.com (gal.iecc.com [IPv6:2001:470:1f07:1126:0:43:6f73:7461]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DE03D3A28E5 for <ietf-smtp@ietf.org>; Sat, 5 Jun 2021 09:55:59 -0700 (PDT)
Received: (qmail 26703 invoked from network); 5 Jun 2021 16:55:57 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=iecc.com; h=date:message-id:from:to:cc:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:cleverness; s=6844.60bbac9d.k2106; bh=NwjiWb7ampaZU0Hq+dUn/gWGRUukkAWkt2yo+xD2oBw=; b=ER6qKaov6ZuNH/gAsJsSN4+vgtX7ArsezkJmwkgllyEACHK9YSa+GJ8a6rRaQJag2w49aJ1hkCY/BxJ6NO5Oj3yuVtYO7v3GkITX/vM/BEd2mMqigCXy300IxLmMTys1hCsnbeeIQ3hd0u6RNLQuwpnSlzmgEzxJmXb4kav0EmvJCspYZA4EOEe4HmOxf5v7n22X38R72wacD7EfQliWeYx8KqQZE0w5C3pA/r9FwVfbYKbt+4Kf9E5dLgR60MuVl3E52IscK7QRo/qRxkv/PTkSKZ3W+tQTx9Fr/aOOAyb+BNcBQg8jtsGuqGHR0zqUqTl5PHuhdwCoKjVi6y1ovg==
DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=taugh.com; h=date:message-id:from:to:cc:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:cleverness; s=6844.60bbac9d.k2106; bh=NwjiWb7ampaZU0Hq+dUn/gWGRUukkAWkt2yo+xD2oBw=; b=VNBzO/HYhvGKJdrCWCBFtaF9CVopbdpfLzMUj/BwmBQvJw/GYMGBSPwuHMxyd0dj0sTh+gpakcCtI5aNU7679+lQMcr0RYObbMaKZez/r4lJnDYYTy34KOhnNXS9q0A3Y8D5QLHgD/vYTPtMPE55FHJhlujt8jgieuQcQfZ1MwtWvyeYATH3/544PnSJlPt0HaaqVFSZlXAO2zmJ0r5AEJB9TWJl7g5lUWc2KgVkIKF/pL6r9SjCKMgkQ0jFRzsWoy1vUxKNBDEinT7NJZtvLVzt/wTQQYEOqKfYPYICMEAVTv0J6MbOeHJAPnRUBtN+uABnRuBdfXIwtJ8HA/r32w==
Received: from ary.qy ([IPv6:2001:470:1f07:1126::78:696d:6170]) by imap.iecc.com ([IPv6:2001:470:1f07:1126::78:696d:6170]) with ESMTPS (TLS1.2 ECDHE-RSA AES-256-GCM AEAD) via TCP6; 05 Jun 2021 16:55:57 -0000
Received: by ary.qy (Postfix, from userid 501) id 8BCB9C495E5; Sat, 5 Jun 2021 12:55:55 -0400 (EDT)
Date: Sat, 05 Jun 2021 12:55:55 -0400
Message-Id: <20210605165556.8BCB9C495E5@ary.qy>
From: John Levine <johnl@taugh.com>
To: ietf-smtp@ietf.org
Cc: john-ietf@jck.com
In-Reply-To: <C744AD1CDF9E8214916463BB@PSB>
Organization: Taughannock Networks
X-Headerized: yes
Cleverness: minimal
Mime-Version: 1.0
Content-type: text/plain; charset="utf-8"
Content-transfer-encoding: 8bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf-smtp/PBQbJqAjdV9o6zzQSajb1swirEU>
Subject: Re: [ietf-smtp] Should we update an RFC if people refuse to implement parts of it ?
X-BeenThere: ietf-smtp@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussion of issues related to Simple Mail Transfer Protocol \(SMTP\) \[RFC 821, RFC 2821, RFC 5321\]" <ietf-smtp.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf-smtp>, <mailto:ietf-smtp-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf-smtp/>
List-Post: <mailto:ietf-smtp@ietf.org>
List-Help: <mailto:ietf-smtp-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf-smtp>, <mailto:ietf-smtp-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 05 Jun 2021 16:56:06 -0000

It appears that John C Klensin  <john-ietf@jck.com> said:
>No.  I am asking a much more pragmatic question or pair of
>questions: (i) whether making a change in this area (see below)
>is worth, at this particular point, opening up RFC 6531 and/or
>6532 (and reviewing whether other documents in the SMTPUTF8
>collection to see if they need similar adjustments) would be
>worth the trouble and (ii) whether there is the energy to do
>that and to do it well.

At this point, tne answer is clearly no.  I was asking as part of
the EAI testing I'm doing for the UASG, to figure out how hard I
should try to persuade people to fix their code to pass that particular
test.  (Not very, since they all say no anyway.)

FWIW, Gmail and Hotmail/Live/Office365 which I believe are the 
largest EAI-enabled mail systems in the world, also have A labels.
Of course, when I looked at a test message I sent to my Hotmail
account, I found this gem, so A-labels are hardly their biggest issue.
Check out those "with" and "via" clauses:

Authentication-Results:
 =?gb2312?B?c3BmPW5vbmUgKHNlbmRlciBJUCBpcyAxMDguMTYxLjEzMy4xMzYpIHNtdHAu?=
 =?gb2312?B?bWFpbGZyb209eG4tLTVucTIxanl1OWQxdGEueG4tLTVucXg0MWF1NG5xb2hz?=
 =?gb2312?B?cDNheGNnLnhuLS1maXFzOHM7IGhvdG1haWwuY29tOyBka2ltPW5vbmUgKG1l?=
 =?gb2312?B?c3NhZ2Ugbm90IHNpZ25lZCkgaGVhZGVyLmQ9bm9uZTtob3RtYWlsLmNvbTsg?=
 =?gb2312?B?ZG1hcmM9ZmFpbCBhY3Rpb249bm9uZSBoZWFkZXIuZnJvbT23osvN08q8/i4=?=
 =?gb2312?B?tefX09PKvP6y4srULtbQufo7Y29tcGF1dGg9cGFzcyByZWFzb249MTA1?=
Received-SPF: None (protection.outlook.com:
 xn--5nq21jyu9d1ta.xn--5nqx41au4nqohsp3axcg.xn--fiqs8s does not designate
 permitted sender hosts)
Received: from xn--5nq21jyu9d1ta.xn--5nqx41au4nqohsp3axcg.xn--fiqs8s
 (108.161.133.136) by AM5EUR03FT048.mail.protection.outlook.com
 (10.152.17.177) with Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4195.21 via Frontend
 Transport; Sat, 5 Jun 2021 16:23:47 +0000

I have found pretty good support for exhanging mail with EAI addresses.  Those
two hosted mail systems do so and most open source MTAs have adequate EAI support,
Postfic, Exim, Courier, and now even sendmail (in beta, but it works.)

What I have not found is a lot of support for hosting their own EAI
addresses. You can do it in the open source stuff, but nobody does.
It's fairly painful to do so for a variety of reasons. On most systems
foo@<A-label> and foo@<U-label> are not mapped together so you have to
make two addresses for everyone, and MUA support is spotty at best.
Ned has described some of the reasons that even though Oracle's MTA
has code to support local EAI addresses, nobody uses it.

I have found almost no support at all for EAI in POP and IMAP. The
only open source is Courier IMAP, and the commercial ones with EAI
extensions I've tried are really buggy, to the point of repeatedly
requiring that I patch the python IMAP library to keep it from
crashing during the tests. IMAP already has overcomplex but usable
support for multiple character sets in folder names and search terms,
and I have found that more often than not non-EAI IMAP servers such as
Dovecot work adequately with EAI mail sort of by accident because they
don't try to enforce 7-bit ASCII in their 8-bit data.

So anyway, I expect that EAI and ASCII mail will coexist for a long time even
though there is no downgrade path to smooth the way.  The A-labels are just
a symptom of that.

R's,
John