Re: [ietf-smtp] [Proposal] confusing parts of the mail system, was 250-MARKDOWN

John Bucy <jbucy@google.com> Thu, 10 January 2019 19:05 UTC

Return-Path: <jbucy@google.com>
X-Original-To: ietf-smtp@ietfa.amsl.com
Delivered-To: ietf-smtp@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8980D130F3F for <ietf-smtp@ietfa.amsl.com>; Thu, 10 Jan 2019 11:05:22 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -17.641
X-Spam-Level:
X-Spam-Status: No, score=-17.641 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.142, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, ENV_AND_HDR_SPF_MATCH=-0.5, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5, USER_IN_DEF_SPF_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qA7xWIhiyV5h for <ietf-smtp@ietfa.amsl.com>; Thu, 10 Jan 2019 11:05:20 -0800 (PST)
Received: from mail-ed1-x52d.google.com (mail-ed1-x52d.google.com [IPv6:2a00:1450:4864:20::52d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4F864130F2D for <ietf-smtp@ietf.org>; Thu, 10 Jan 2019 11:05:20 -0800 (PST)
Received: by mail-ed1-x52d.google.com with SMTP id o10so11062023edt.13 for <ietf-smtp@ietf.org>; Thu, 10 Jan 2019 11:05:20 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=qnojFxmBpJZ8EX9Uk88bbNTCCpYTnF7XMBcmzqhltVw=; b=Oi42qRaHW4iw2m8yDMap+I9jtK14csWJN9Sqsycws57Lz0ZRePfhtiCcU7bMSFdmfx g1NX/D1yrHuYvt7unLBSKkTtmW214KvP5I8PEP3v22ZSWHOXUe46A0JayNNhrWB00OK/ GpQjaBFgCyzbc7jZqFOiu6lOvPgjzNIuI8Htdl2TGcczDiH1qNQYE/rGrCRK88faplXT E8UlUb+XAj/0XhfneGnsPBvoFfOl7e2dz+hHXJ2xaEHeJoEKq5G9+PKA9WCeZajKVm2Q /azgtUK10X/P1XR9NKHpTXOMIVJdZyY44p+z6z6+uEM3Ix8d8fKR7Oa4SLIBF7piz/v0 uagw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=qnojFxmBpJZ8EX9Uk88bbNTCCpYTnF7XMBcmzqhltVw=; b=QrEOdBfECxAkacBjs7Pi9JFeH3YQryP/3tvMFtEHQxd4jn0/ksMFoK/7oH9LtqxZ66 LhYILgKeCWqFf8ZqpH2m35hQCNgTDnhhzW3WiVG0NTL9z/aaxZTf/nmbGXFLxtZq61E0 HZ9ZAGxAWx2COOU651ttO2tesyfJK1vqk6boM0ISKk5U06eCUU14uAZk5izD5hNNvYqZ eSxVOQZKYqQi6nuAkVjFdDTxoRMxL0nJ6Llk2MPFrMBjwckc16hhOH92WjJDoSYrFOPY M3K4cksxpVMoHZQ4+KsVHJi8h+isfQEF1TCg1+JEghtquXaKlpDvAoHkZ+9paVrKbblV AR9A==
X-Gm-Message-State: AJcUukcMnYio2klPFmJYUzczstAT2BYkhqZwDL11lWcKK9ecCsAu2vPH ezVRvyrwtP+eGu4mSi6tjOPufycuORrbkXY2uMB21jyr0ak=
X-Google-Smtp-Source: ALg8bN5x4zKVPah5s5uoNzvHkDNgx027iLP80NWgCfRwAUBBaDrwz0CPvrOWl0Rd5wa2npWcwkHooM5Qpli8vB2MHHo=
X-Received: by 2002:a50:9977:: with SMTP id l52mr10129299edb.277.1547147118554; Thu, 10 Jan 2019 11:05:18 -0800 (PST)
MIME-Version: 1.0
References: <CAOEezJTxTN9x_JFXgLidj9k8NVgFTRyqyQc4Aak8UEQuvjiM0w@mail.gmail.com> <20190109143529.33122200C76CAD@ary.local> <460d4589-5517-3762-5764-7474523dd09b@digilicious.com> <01R1U95VCAHI00004L@mauve.mrochek.com> <74e22977-8ee8-c762-4882-b56e5911430e@digilicious.com>
In-Reply-To: <74e22977-8ee8-c762-4882-b56e5911430e@digilicious.com>
From: John Bucy <jbucy@google.com>
Date: Thu, 10 Jan 2019 11:05:07 -0800
Message-ID: <CALui8C2qzp_jBo=YHA+XXBGF6+jigDeEaX24L2bohQBdaXKHwg@mail.gmail.com>
To: Gene Hightower <gene@digilicious.com>
Cc: Ned Freed <ned.freed@mrochek.com>, John Levine <johnl@taugh.com>, ietf-smtp <ietf-smtp@ietf.org>, giri@dombox.org
Content-Type: multipart/alternative; boundary="0000000000006b3df8057f1f42ef"
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf-smtp/oR_B1avRYUF_gt_BIRQLKFPZTqU>
Subject: Re: [ietf-smtp] [Proposal] confusing parts of the mail system, was 250-MARKDOWN
X-BeenThere: ietf-smtp@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussion of issues related to Simple Mail Transfer Protocol \(SMTP\) \[RFC 821, RFC 2821, RFC 5321\]" <ietf-smtp.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf-smtp>, <mailto:ietf-smtp-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf-smtp/>
List-Post: <mailto:ietf-smtp@ietf.org>
List-Help: <mailto:ietf-smtp-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf-smtp>, <mailto:ietf-smtp-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 10 Jan 2019 19:05:22 -0000

On Thu, Jan 10, 2019 at 9:43 AM Gene Hightower <gene@digilicious.com> wrote:

> On 10/01/2019 08.03, Ned Freed wrote:
>
> >> On 09/01/2019 06.35, John Levine wrote:
> >
> >>> My mail server doesn't support or understand any media types at all.
> >>> MIME and media types are all handled in the MUA.
> >
> >> I agree, except for BINARYMIME: the one MIME type advertised in the
> >> greeting stage of ESMTP.
> >
> > Binary is a content transfer encoding, not a media type.
>
> Yes, correction: transfer encoding, not media type.
>
> Let me try to restate my point using a few more words.
>
> The area where MTA (the “mail server” from above) software needs to
> announce support for a protocol feature to enable features at the
> level of the message body is CHUNKING and BINARYMIME, RFC 3030.
>
> If many of the leading figures in the email world can engage in a
> lively discussion about a proposed MARKDOWN extension to SMTP, I
> thought I'd try to raise some interest in BINARYMIME.
>
> On 10/01/2019 08.03, Ned Freed wrote:
>
> > But the availability of the technology doesn't mean people will use
> > it. The asessment of most seems to be that the benefits don't
> > outweigh the costs.
>
> First step is CHUNKING; small benefit, modest cost.  Involves MTAs.
>
> Next step is BINARYMIME; much larger benefit, much larger cost.
> Involves storage formats (no mbox) and IMAP software and MUAs; the
> whole email ecosystem.
>
> We know CHUNKING is doable, Microsoft and Google both do it.
> (I also do it.)
>
> Question is, is BINARYMIME doable?  Or a lost cause?
>

As I see it, the problem is a message getting stuck "in the middle" where
the next hop doesn't support the extension e.g. user has a .forward file.
The most obvious options to me are:
1. downgrade the message from binary to base64. dmarc made this infeasible
at least for senders that use it but I'm hopeful that arc can fix that. Not
sure about s/mime.
2. An MTA could not accept an extension for a particular recipient if it
isn't sure that there is no next hop or the next hop supports it (i.e. fail
RCPT) so that this can be pushed all the way back to submission. I think we
identified the correct extended status for this for (at least) binarymime
and smtputf8 in a previous thread.

With respect to deploying extensions, sites with millions of mailboxes
- want to gradually deploy any new feature rather than knifeswitch to
everyone at once
- may have a long tail of mailboxes that take a long time to upgrade (e.g.
gateways to a legacy system) and it would be nice for the 99% to get the
benefit sooner



cheers
john