Re: [imapext] draft-ietf-appsawg-multimailbox-search

Bron Gondwana <brong@fastmail.fm> Thu, 06 March 2014 10:57 UTC

Return-Path: <brong@fastmail.fm>
X-Original-To: imapext@ietfa.amsl.com
Delivered-To: imapext@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9DCC41A01C9 for <imapext@ietfa.amsl.com>; Thu, 6 Mar 2014 02:57:59 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.801
X-Spam-Level:
X-Spam-Status: No, score=-0.801 tagged_above=-999 required=5 tests=[BAYES_20=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id IEvA2CIce0Xp for <imapext@ietfa.amsl.com>; Thu, 6 Mar 2014 02:57:57 -0800 (PST)
Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) by ietfa.amsl.com (Postfix) with ESMTP id 53BF11A01C8 for <imapext@ietf.org>; Thu, 6 Mar 2014 02:57:57 -0800 (PST)
Received: from compute5.internal (compute5.nyi.mail.srv.osa [10.202.2.45]) by gateway1.nyi.mail.srv.osa (Postfix) with ESMTP id 7383520D79 for <imapext@ietf.org>; Thu, 6 Mar 2014 05:57:53 -0500 (EST)
Received: from web5 ([10.202.2.215]) by compute5.internal (MEProxy); Thu, 06 Mar 2014 05:57:53 -0500
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=fastmail.fm; h= message-id:from:to:mime-version:content-transfer-encoding :content-type:in-reply-to:references:subject:date; s=mesmtp; bh= MuuDWgsDPlJG07V3tv7Sw+2pzMw=; b=Vjw9mlcA39v7icZZrE80XBa+qs4Igq3p 6vD/nGQTHFE0RcDh+5I3QfJQKv83USeX/9azaNViYASX6QFUZJN3BQ5BHy1lIbzu NSzcCjjiKBLEehpAYZUM6z/2F2OvQU52EaeFjVCzk2ujsYI0krJ3MQoo93xpbyEn dky6SzwI8YE=
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=message-id:from:to:mime-version :content-transfer-encoding:content-type:in-reply-to:references :subject:date; s=smtpout; bh=MuuDWgsDPlJG07V3tv7Sw+2pzMw=; b=b48 BRDwKkiATSJ2VAa3YC6cVj9Qrd/KO6PDMmtPZMgncQYyQZfQQyXaiTiBdGxNXP0R Vr90DXFvxycrzzZsaos4PyxAsAikhkBEYAET296gtyPgUnG9wQeis4Yd/opfmpW5 RZGwmnHQRQQvLn6qjFEDhml7zwdvRqLO4eU8qfp0=
Received: by web5.nyi.mail.srv.osa (Postfix, from userid 99) id 4EE15B0593F; Thu, 6 Mar 2014 05:57:53 -0500 (EST)
Message-Id: <1394103473.14059.91258445.054B3082@webmail.messagingengine.com>
X-Sasl-Enc: /2Uw4UVqHZ+FH5TB6pTsw9m3hjfWmF/poe8YAnYhqLxo 1394103473
From: Bron Gondwana <brong@fastmail.fm>
To: imapext@ietf.org
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Type: text/plain
X-Mailer: MessagingEngine.com Webmail Interface - ajax-4527a23f
In-Reply-To: <CAC4RtVCgLuvpAqEs6Nzz+358dvg4q2YkBNmeq39SYFmnYOLoKw@mail.gmail.com>
References: <CAC4RtVCgLuvpAqEs6Nzz+358dvg4q2YkBNmeq39SYFmnYOLoKw@mail.gmail.com>
Date: Thu, 06 Mar 2014 21:57:53 +1100
Archived-At: http://mailarchive.ietf.org/arch/msg/imapext/hmOOxmOYUdihIdtDD9HXfTNXLJY
Subject: Re: [imapext] draft-ietf-appsawg-multimailbox-search
X-BeenThere: imapext@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Discussion of IMAP extensions <imapext.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/imapext>, <mailto:imapext-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/imapext/>
List-Post: <mailto:imapext@ietf.org>
List-Help: <mailto:imapext-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/imapext>, <mailto:imapext-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 06 Mar 2014 10:57:59 -0000

On Thu, Mar 6, 2014, at 09:42 PM, Barry Leiba wrote:
> IMAP denizens...
> 
> Chris Newman has asked that we consider moving the Multimailbox Search
> extension to Standards Track (it was published as RFC 6237 as
> Experimental).  Appsawg is handling that:
> 
> http://datatracker.ietf.org/doc/draft-ietf-appsawg-multimailbox-search/
> 
> I'd like to ask the IMAP crowd to do two things:
> 
> 1. Review the document and post comments to apps-discuss@ietf.org
> 
> 2. Tell us, in your review or separately here, if you (a) have
> implemented it and/or (b) have interest in implementing it (and
> specify client, server, or both).

We didn't implement it because it wasn't possible to track the results
over time - instead we have a command xconvmultisearch (yes, I know,
ugly name) which:

a) only works within single users, because:
b) we keep a single highestmodseq value across all mailboxes within a single
   user, so we can
c) lock the entire user from modifications while we run the search, and
   hence ensure a consistent read, and
d) return the highestmodseq of that read, so that further requests can
   ask for updates since the previous modseq - and they'll get a list of
   anything added, removed or just touched.

This also handles the folding of related (roughly thread=references, with
some trickyness) messages into a single "exemplar".

So we're strayed quite a long way from IMAP to get what we need.

Anyway - my main problem with it is that users don't just want search - they
want sort.  Running the search across multiple mailboxes means you still need
to fetch all the data for all the matches before you can get a meaningful sort
by any parameter other than mailbox name as the first sort index.  And that
can be a lot of download to the client if you searched a common term.]

I'm not signed up for apps-discuss.  Guess I'd better go do that.

Cheers,

Bron.


-- 
  Bron Gondwana
  brong@fastmail.fm