Re: [imap5] Feature set? - was Re: Designing a new replacement protocol for IMAP

Adrien de Croy <adrien@qbik.com> Thu, 16 February 2012 09:21 UTC

Return-Path: <adrien@qbik.com>
X-Original-To: imap5@ietfa.amsl.com
Delivered-To: imap5@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B22B521F86DA for <imap5@ietfa.amsl.com>; Thu, 16 Feb 2012 01:21:30 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.21
X-Spam-Level:
X-Spam-Status: No, score=-2.21 tagged_above=-999 required=5 tests=[AWL=-4.611, BAYES_00=-2.599, GB_SUMOF=5]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id AXar7WposKyo for <imap5@ietfa.amsl.com>; Thu, 16 Feb 2012 01:21:26 -0800 (PST)
Received: from smtp.qbik.com (smtp.qbik.com [210.55.214.35]) by ietfa.amsl.com (Postfix) with ESMTP id A112521F86AD for <imap5@ietf.org>; Thu, 16 Feb 2012 01:21:24 -0800 (PST)
Received: From [192.168.1.10] (unverified [219.89.217.118]) by SMTP Server [210.55.214.35] (WinGate SMTP Receiver v7.1.0 (Build 3381)) with SMTP id <0018866148@smtp.qbik.com>; Thu, 16 Feb 2012 22:21:23 +1300
Message-ID: <4F3CCA6C.3020004@qbik.com>
Date: Thu, 16 Feb 2012 22:20:44 +1300
From: Adrien de Croy <adrien@qbik.com>
User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:11.0) Gecko/20120202 Thunderbird/11.0
MIME-Version: 1.0
To: Dave Cridland <dave@cridland.net>
References: <B764BD8C8B6047E659EABBE2@caldav.corp.apple.com> <4F397212.1030107@qbik.com> <20120213210805.GB13029@launde.brong.net> <alpine.LSU.2.00.1202151405550.30682@hermes-2.csi.cam.ac.uk> <1329315552.1444.140661036879893@webmail.messagingengine.com> <4F3BBFA4.8010107@isode.com> <1329316981.8310.140661036883625@webmail.messagingengine.com> <4F3BC7DA.5070803@gulbrandsen.priv.no> <20120215181047.GB13906@launde.brong.net> <alpine.OSX.2.00.1202151020140.38441@hsinghsing.panda.com> <20120215213122.GB16253@launde.brong.net> <4F3C2C1B.6030408@qbik.com> <3077.1329344733.342803@puncture> <4F3CA887.9050509@gulbrandsen.priv.no> <3077.1329382177.374908@puncture>
In-Reply-To: <3077.1329382177.374908@puncture>
Content-Type: text/plain; charset="ISO-8859-1"; format="flowed"
Content-Transfer-Encoding: 7bit
Cc: "Discussion on drastically slimming-down IMAP." <imap5@ietf.org>, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>
Subject: Re: [imap5] Feature set? - was Re: Designing a new replacement protocol for IMAP
X-BeenThere: imap5@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion on drastically slimming-down IMAP." <imap5.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/imap5>, <mailto:imap5-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/imap5>
List-Post: <mailto:imap5@ietf.org>
List-Help: <mailto:imap5-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/imap5>, <mailto:imap5-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 16 Feb 2012 09:21:30 -0000

Hi Dave

I agree with the things you've said about generic protocols, and trying 
to fix all the worlds problems - e.g. scoping something too big to be 
doable.

This all started when Brom sent an email around about a replacement 
protocol for IMAP.

One of the main problems with the current suite of protocols used for 
mail, is that even if one could implement them all, providing a better 
user experience than Exchange or Gmail would not be the result.

Add to that the fact that specifying a new mail protocol is a heap of 
work, the obvious question was why limit ourselves to only providing a 
replacement.

Forever is a long time.

That's why I proposed a layered approach.

If you look at a mail client even like Thunderbird, which I'm using to 
write this mail.

There are settings for:

SMTP: specification of server, choice of authentication method, choice 
of security (SSL vs STARTTLS vs none), username and password.
IMAP: specification of server, choice of authentication method, choice 
of security (SSL vs STARTTLS vs none), username and password.
LDAP: specification of server(s), choice of authentication method, 
choice of security (SSL vs STARTTLS vs none), username and password.

If I want a calendar I need to add in something like Lightning (current 
version not compatible with TB11), or something else.  Presumably it 
uses CalDAV, which goes over WebDAV which goes over HTTP, so I've got 
credentials to deal with for that, and possibly some intermediary proxy 
with credentials as well.

This all adds up to a complete clusterxxxx - it's an appalling user 
experience, and supporting it is costly as well.

Any one of these settings if wrong is a support call.  That's why I 
proposed condensing all the choice of server, port, auth and security to 
1 protocol, and layer the facilities on top.  Even if all we did was 
layer the existing protocols on top of this, we'd be a lot further ahead.

Last time I checked it was 2012.  Email is supposed to be (or have been) 
the "killer" internet application - the most important one.

To provide such a poor user experience is shameful.  Especially after 30 
odd years.

And of course I understand it's the result of an evolutionary process 
over time.  So of course it's messy and ugly.

But unless we do something about it, it will be that way forever, or 
until someone in future deals with it.  Or it gets replaced out from 
under us by web-based services which are able to independently provide 
an acceptable user experience.

Seems to me that in the context of discussion of a new mail protocol, 
could be a good time to consider these things.

Hence the kitchen sink :)

Cheers

Adrien


On 16/02/2012 9:49 p.m., Dave Cridland wrote:
> On Thu Feb 16 06:56:07 2012, Arnt Gulbrandsen wrote:
>> On 02/15/2012 11:25 PM, Dave Cridland wrote:
>> > This mailing list is "Discussion on drastically slimming-down 
>> IMAP", and
>> > you've listed the properties of ACAP, SIEVE, IMAP, CalDAV, CardDAV 
>> *and*
>> > Submission, and then thrown in a kitchen sink too.
>>
>> As I see it, he's listed features which are in the Exchange protocol and
>> in the unnamed protocol spoken by gmail's javascript heap and its
>> mothership.
>>
>> That makes them worthy of discussion.
>
> I'm mostly revelling in the irony.
>
>> I know IETF dogma is that protocols shouldn't overlap. But it's a weak
>> kind of dogma: IMAP overlaps with POP, POP overlaps with Submission,
>> various IMAP extensions with ACAP and what's that about IMSP? I could 
>> go on.
>
> There's two huge problems with the approach.
>
> Firstly, using a generic data model, or a generic protocol, 
> automatically produces compromise. I've learnt to mistrust genericity 
> in protocols - it all seems like such a lovely idea, and then 
> everything turns into the bastard offspring of SQL. And the thing with 
> SQL is that you can do useful things like indices and whotsits, which 
> let you specialize the data store, but nobody ever gets that far. The 
> only cases where this has worked is to partially specialize the 
> datastore - LDAP/X.500 does this, as did ACAP - but only one of those 
> has succeeded by any metric.
>
> I'd note that, similarly, METADATA and ANNOTATE should have done well, 
> if it weren't for the fact they expanded beyond a simple dumping 
> ground for "everything else", and people tried to use them as the One 
> True Datastore.
>
> Secondly, the broader the scope, the bigger the task - I don't see any 
> likelyhood of getting such a protocol sorted out before the end of the 
> decade, or beyond. The phrase "boil the ocean" springs to mind. 
> Remember, Exchange and the like are not successful because they do 
> calendaring and mail, they're successful because they seamlessly blend 
> calendaring and mail - the result is more than the sum of its parts, 
> but making that blend will not be easy.
>
> Aside from anything else - you want configuration storage services in 
> $NEWPROTO? Well, I surely want these to have all the facilities that 
> ACAP gives me. Calendaring? I'm sure that Cyrus will want it to have 
> parity with, or exceed, CalDAV. Mail? There's any number of folk here 
> who'll want their own special sauce in. And they'd be right, from 
> their perspective, and the net result would be unimplementable.
>
> Dave.

-- 
Adrien de Croy - WinGate Proxy Server - http://www.wingate.com