[Extra] Discussing SNIPPET

"Bron Gondwana" <brong@fastmailteam.com> Mon, 17 September 2018 11:52 UTC

Return-Path: <brong@fastmailteam.com>
X-Original-To: extra@ietfa.amsl.com
Delivered-To: extra@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9C4F1130E1B for <extra@ietfa.amsl.com>; Mon, 17 Sep 2018 04:52:46 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.982
X-Spam-Level:
X-Spam-Status: No, score=-1.982 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, MIME_HEADER_CTYPE_ONLY=0.717, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=fastmailteam.com header.b=B1A9wC0x; dkim=pass (2048-bit key) header.d=messagingengine.com header.b=ZZWeQ9BJ
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ePH6AUXlTtJ6 for <extra@ietfa.amsl.com>; Mon, 17 Sep 2018 04:52:45 -0700 (PDT)
Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 0D4FF1271FF for <extra@ietf.org>; Mon, 17 Sep 2018 04:52:45 -0700 (PDT)
Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id AED66212A0; Mon, 17 Sep 2018 07:52:43 -0400 (EDT)
Received: from imap22 ([10.202.2.72]) by compute6.internal (MEProxy); Mon, 17 Sep 2018 07:52:43 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= fastmailteam.com; h=cc:content-type:date:from:message-id:subject :to:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=LWA5EbiD7NkNTn UR0BV+ZWT4zkafg3SkLZO53UUMK7g=; b=B1A9wC0xQBEzDDR2Fgt4MpHZb9qaGD FXXV5gwyfbGC2HkkSSOv0ipXUs2Tumy1IclQitNk5TVC2jnx+TOd6cxHXdfITaaG Zh7T4tUPiMdfaqnhqBpHIJu9XkG35XFgLGd8RvOiARDpW1+eY8brYdU8jBTivQTG cDuCFGzwnP4bO2P7Y63LkwuNOh6Hv6YEtIacRLLrgmIoB37kJ4pUD8F8X/uo5Pu+ 3+po/r1rmor/8QdklwliQmYvpozq1PEVCQo2Yi8JVP34oKg7cPpWdnSIo4O4QAp8 6ALygLKfNfs8VgBhv91t7eigwT89f/65XtHPtSmCf9FxwHV+c4OhnCog==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:message-id :subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=LWA5Eb iD7NkNTnUR0BV+ZWT4zkafg3SkLZO53UUMK7g=; b=ZZWeQ9BJHdfJWIzrE4xcOd JU3UH4wwPz0eYcxlGFrNAi1GyhSrySiE6N0S77PuilDYQL8J1Lo33Co+4DcnCS89 MOLLgIM37TEQ1hpwKCPSTlaO3KrpeSZeCstijQXF1TonfmOfFRbfeoHB0meY/QJl A9iBX4eeTbrCpPokq117BEisWdvOKdSUX9ZhnRPqrJ6Yzsjq+mrIv8EIHSRAtcah 7nfx0jLFMiVcv35rRK25RTefwh7XJga1uyJ/cjUIOXP697mcY0BAUyhUPAPwWkd1 D7R1AWFDJOsCqnoQcur8b+1c2jXU4WlItBRhMue5vmmqs/6MofORjEWh+DopSnyg ==
X-ME-Proxy: <xmx:i5WfWyUF0a4GS-iJmdsn9AFt3X9FRL42VVZ9ke1uG0zjE4DbTZwkpg> <xmx:i5WfW-xkA0KNJUC05ZtnL8EzBAXIc0Xg4pcAeO3TTeyUOp2NqrlQ4g> <xmx:i5WfW4NJiAFAEsUWzhsKTXSqhGpBd654f-zGEJsHpLcwUEuhqsGD5A> <xmx:i5WfW358nWHJ38c6wfloiwKW1eM-ypHnKoU7WEzn4q9ekLlHkPicEw> <xmx:i5WfWxMhp7M4ZWKxO4RCuMzAQl6mA9Dyl0Y1Kzw4SWkx1nTdrpUDkg> <xmx:i5WfW_qzf5Bxi34vmL5kxpQTsb8N2--lNMdG-S6sU5fJg7DAEBxQ6g>
X-ME-Sender: <xms:i5WfW0DbWaceU5RziUNxgou3iHi_0c-gEnEWihMYGPCpf9T5d6L5Ww>
Received: by mailuser.nyi.internal (Postfix, from userid 501) id F0A3BE311; Mon, 17 Sep 2018 07:52:42 -0400 (EDT)
Message-Id: <0a9f6019-776c-49ff-a800-af494374ce59@sloti22d1t06>
User-Agent: Cyrus-JMAP/3.1.5-497-g962c979-fmnext-20180917v5
x-jmap-identity-id: 56629417
Date: Mon, 17 Sep 2018 07:52:42 -0400
From: Bron Gondwana <brong@fastmailteam.com>
To: extra@ietf.org
Cc: Michael Slusarz <michael.slusarz@open-xchange.com>
Content-Type: multipart/alternative; boundary="a6caac384d3742ca90aadbc1f7bbd2c9"
Archived-At: <https://mailarchive.ietf.org/arch/msg/extra/ZB2AWR5F8I1NP0r1lnAI6ty2uAI>
Subject: [Extra] Discussing SNIPPET
X-BeenThere: extra@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Email mailstore and eXtensions To Revise or Amend <extra.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/extra>, <mailto:extra-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/extra/>
List-Post: <mailto:extra@ietf.org>
List-Help: <mailto:extra-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/extra>, <mailto:extra-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 17 Sep 2018 11:52:47 -0000

Hi All, 
 
I've just posted REPLACE off for publication after the expiry of the WGLC period and confirming the IPR status. 
 
In terms of the remaining documents, we have a couple of Sieve docs which Jiankang is busy Shepherding through their last calls, we have 64bit which we allowed to lapse (for now) and we have imap4rev2 which is a giant piece of work. 
 Finally, we have the recently adopted draft-ietf-extra-imap-fetch-snippet-00.
 
To summarise the discussion: 
 
1) there's nobody who thinks this is a bad idea 
2) there's general agreement that specifying an exact algorithm is bad 
3) while LAZY may or may not be that valuable, nobody minds it that much. Easy approach is to always generate regardless of the modifier. 
 
So much for the things everyone agreed on (please correct me if I missed anything!) Here's the issues under debate: 
 
a) Naming. The great difficulties, naming and cache invalidation! (and yep, we've got the second one too). Should it be called SNIPPET, or something else like PREVIEW? I'm asking largely because JMAP used "SearchSnippet" to refer to a fragment of matching text with terms hilighted. And JMAP used "preview" for the short piece of text (up to 256 characters) that represents the email content. 
 
b) Cache Invalidation. Ho hum. Is this an immutable property? If so, what happens if the server implementation changes? I'm quite happy to call it "softly immutable" myself - it might not be exactly the same bytes, but you can use the old version without major problems. 
 
c) Length:  
   The server SHOULD limit the length of the snippet text to 100
   characters.  The server MUST NOT output snippet text longer than 200
   characters.
 
I would prefer to bring this up to more like 200 for should and 256 for MUST NOT. 100 is a pretty short preview on big screens. I'd also be willing to have a way for the client to hint for shorter previews to save network bandwidth, but have servers generally store 256 chars. The syntax makes it quite easy to add a MAXLEN=80 or whatever to the fetch command. 
 
And yes, this would be trivial to implement in our server with its existing previews, and I would totally do it during last call :) 
 Bron. 
 
 
-- 
 Bron Gondwana, CEO, FastMail Pty Ltd 
 brong@fastmailteam.com