Re: [Extra] AD review of draft-ietf-extra-imap-status-size-01

Bron Gondwana <brong@fastmailteam.com> Fri, 11 May 2018 02:01 UTC

Return-Path: <brong@fastmailteam.com>
X-Original-To: extra@ietfa.amsl.com
Delivered-To: extra@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D489B12D82F for <extra@ietfa.amsl.com>; Thu, 10 May 2018 19:01:07 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.7
X-Spam-Level:
X-Spam-Status: No, score=-2.7 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=fastmailteam.com header.b=KK2ZRzgN; dkim=pass (2048-bit key) header.d=messagingengine.com header.b=NXjgB2M1
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id j7bSJvrJX715 for <extra@ietfa.amsl.com>; Thu, 10 May 2018 19:01:05 -0700 (PDT)
Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2322012D7F1 for <extra@ietf.org>; Thu, 10 May 2018 19:01:05 -0700 (PDT)
Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id B8CC1224CE for <extra@ietf.org>; Thu, 10 May 2018 22:01:03 -0400 (EDT)
Received: from web5 ([10.202.2.215]) by compute6.internal (MEProxy); Thu, 10 May 2018 22:01:03 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= fastmailteam.com; h=content-transfer-encoding:content-type:date :from:in-reply-to:message-id:mime-version:references:subject:to :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=DwvGAsrBomQzi+hCx X9j1OEwQAuxUWNwJn/ii7UEbLY=; b=KK2ZRzgNiO4npvXFsEIdCUWekWqv2yWx1 Jn2Ipm7ASzDX8j2UBFjOTfxkUWWBFfQ7I6mmEOFTm9cRO4V521GN2/QOZQkYE4US A1N/cfWioYz2goMDzk55y3ZuT7Sa5vgZEmxOJidvbXJoh3MSR68y5AsVaDQjCRDT f01/cWV0m+7l+qAzfVjfOfTXvw2JXSv/6g5p6P3M/yzJ4XO2p4cuyKLMYxSuxToT g2lympb6hvOxMdCfjFdOvKwkoagFABYO+98uZYJNb1jNPs3eas8l2hGI6vKPvhZ2 AyYlI4hwUUWJ4BrZgHeFiJkJNYLZB6VFxsPYn8D9xHGiTC09phtQQ==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=DwvGAs rBomQzi+hCxX9j1OEwQAuxUWNwJn/ii7UEbLY=; b=NXjgB2M102/QfVJE78AwdZ ZfMyJ2lavYg90O7KGarSGhvu0niFd3udVs4IhkzAKyu6BqBn5liOo20txhovU5W6 +8awFSpp7U0mQF8HOql4e4AIBEFn6dVKglKkSY3C9WjbAFGjqwbkXTb3sIxE+RHI HIBcCNAaK/45Qxg9QqLxXnmp/MhiO9JFU036atD8/Ta3i0gGilqbgwWujNrDLnZY ezGI0hrycsHiM37hKjy9jw5TZ0z8Ill+Q2wJXRVEisUCj8FDaKQIASK5PKoJ+Od5 tQrgph9D1lCgwPZvIZP1/JoycNQkHIdJoWI9TW9wqfCmm6QDkqE+yPeUEXgJ/5fg ==
X-ME-Sender: <xms:X_n0Wqu359euSxaznYBbLcOw_sONvP8qsWG61DTFd2AmHFN5nlYvrg>
Received: by mailuser.nyi.internal (Postfix, from userid 99) id 821F59E085; Thu, 10 May 2018 22:01:03 -0400 (EDT)
Message-Id: <1526004063.3372904.1368184696.34A255D8@webmail.messagingengine.com>
From: Bron Gondwana <brong@fastmailteam.com>
To: extra@ietf.org
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Type: multipart/alternative; boundary="_----------=_152600406333729040"
X-Mailer: MessagingEngine.com Webmail Interface - ajax-29fe4c42
References: <5AE207FD.8020203@isode.com> <71D1116A-0D02-424B-9B22-58110DD8202D@oracle.com> <D6002572-B87C-47FA-98A1-D963F25F5B0E@oracle.com> <9e94523e-d12d-e61c-d63b-e54dea7fd33e@dovecot.fi> <84D7D0C7-B12B-4DF2-B059-010CCE8F8271@oracle.com>
Date: Fri, 11 May 2018 12:01:03 +1000
In-Reply-To: <84D7D0C7-B12B-4DF2-B059-010CCE8F8271@oracle.com>
Archived-At: <https://mailarchive.ietf.org/arch/msg/extra/WUZRshQExGvZJxFEsHx-LnjhpVQ>
Subject: Re: [Extra] AD review of draft-ietf-extra-imap-status-size-01
X-BeenThere: extra@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Email mailstore and eXtensions To Revise or Amend <extra.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/extra>, <mailto:extra-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/extra/>
List-Post: <mailto:extra@ietf.org>
List-Help: <mailto:extra-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/extra>, <mailto:extra-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 11 May 2018 02:01:08 -0000

My opinion is - just define this response as a 63 bit number.

Crappy thing here with RFC4466 is:

   tagged-ext-simple   = sequence-set / number

And "number" is defined in RFC3501:

number          = 1*DIGIT ; Unsigned 32-bit integer ; (0 <= n <
4,294,967,296)

Which means that the response SHOULD be:

"SIZE" SP "(" number63 ")"  rather than "SIZE" SP number63 to be
tagged-ext.
Bron.


On Fri, 11 May 2018, at 08:40, Chris Newman wrote:
> On 10 May 2018, at 10:30, Stephan Bosch wrote:
>> Op 05/05/2018 om 01:46 schreef Chris Newman:
>>> On 4 May 2018, at 16:42, Chris Newman wrote:
>>> 
>>>> I just noticed we implemented this in 2005 (under the "X-SUN-IMAP">>>> capability). Looking at the implementation, there's a significant
>>>> bug in the specification. Mailbox sizes can easily exceed 4GB; so
>>>> the ABNF for status-att-list needs to be replaced as follows:
>>>> 
>>>>    status-att-list = status-att SP number63 *(SP status-att SP
>>>> number63)
>>>>         ;; number63 is only permitted with extension status
>>>> attributes
>>>>         ;; that explicitly allow it; such as SIZE
>>> 
>>> Oh, just noticed RFC 4466 redefines that, so you instead need a
>>> normative reference to RFC 4466 and then do:
>>> 
>>>    status-att-val /= "SIZE" SP number63
>> 
>> A 4Gb mailbox is still quite huge these days, but you're right. The
>> QUOTA capability has the same problem: how did you address that?
> 
> Quota Storage partially dodges the problem by using 1K rather than 1
> byte units. However, the fact it doesn't allow 63-bit storage
> numbers is> a specification bug (due to proof-by-example: the IMAP data
> model allows> a mailbox with 4G messages each of 4G size). Implementations should
> ignore specification bugs like that (ours does). However, the 32-bit
> limit on UIDs, message size, and message sequence numbers is
> part of the> fundamental IMAP data model. Changes to those values require an
> incompatible change to the IMAP data model that can break previously
> standards-compliant implementations. The IETF generally doesn't make
> that sort of change without a negotiated extension and implementations> that ignore fundamental data models in the standards without
> negotiation> are usually bad Internet citizens.
> 
>> That would have been solved by the 64BIT capability, but that
>> one's on>> hold now
> 
> There's no reason we can't have this spec use a 63-bit number at the
> time we write it. Clients won't get this data unless they ask
> for it and> servers won't send it unless they've advertised it. This requires no
> change to the IMAP data model so no separate negotiation is needed to> use 63-bit numbers here. It's just an extra line of ABNF and with no
> impact on data model and very little impact on implementations. A
> normative dependency on a draft that changes the IMAP data model is a> change to SIZE that I would oppose. But use of a 32-bit integer
> is a bug> in the SIZE draft (again via proof-by-example).
> 
> - Chris
> 
>> Bron, Alexey, opinions?
>> 
>> Regards,
>> 
>> Stephan
>> 
>>> 
>>>         - Chris
>>> 
>>>>    number63  = 1*DIGIT
>>>>                           ;; Positive
>>>> unsigned 63-bit integer
>>>>                           ;; (0 <= n <=
>>>> 9,223,372,036,854,775,807).
>>>> 
>>>>         - Chris
>>>> 
>>>> On 26 Apr 2018, at 10:10, Alexey Melnikov wrote:
>>>> 
>>>>> Hi,
>>>>> 
>>>>> I've been following discussions on this document and it is ready
>>>>> for
>>>>> IETF Last Call, which I just initiated.
>>>>> 
>>>>> One nit: I believe the following reference is now Normative,
>>>>> due to>>>>> added SHOULD level requirement:
>>>>> 
>>>>>  [QUOTA]
>>>>> 
>>>>> Please update the document to reflect this next time the document>>>>> is
>>>>> revised.
>>>>> 
>>>>> Best Regards,
>>>>> Alexey, as AD.
>>>>> 
>>>>> _________________________________________________
>>>>> Extra mailing list
>>>>> Extra@ietf.org
>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ietf.org_mailman_listinfo_extra&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=K_BObr5Kfkr3rxt1oBPF9KFiEU3xl9LcD2OOJG3TXfI&m=B73C8TOrpzVRz_O5v_4esOIRwnbdcZoZaulZWKyZwBY&s=Av_oW8rLHO6EMocPg9SJXED-Ta7xK6PRHohZ6tFZmmM&e=>>>> 
>>>> _________________________________________________
>>>> Extra mailing list
>>>> Extra@ietf.org
>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ietf.org_mailman_listinfo_extra&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=K_BObr5Kfkr3rxt1oBPF9KFiEU3xl9LcD2OOJG3TXfI&m=ErU-4WHaHwqAH1nltCBHaf7zbhatpz2gGlB_BH0n3uI&s=HPU9C98qqq9ZOoEpMPOpUKits0ILuqWjGwmCx6_ZCvo&e=>>> 
>>> _________________________________________________
>>> Extra mailing list
>>> Extra@ietf.org
>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ietf.org_mailman_listinfo_extra&d=DwIDaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=K_BObr5Kfkr3rxt1oBPF9KFiEU3xl9LcD2OOJG3TXfI&m=5HJofT5ocTAB71bioSeN2ztVNEW92Tx14L2kdo_8_PQ&s=VsTTjiVSxN0fQkrv_AoqVm9VLp5Rw5qTjsqJJEODbT4&e=> 
> _________________________________________________
> Extra mailing list
> Extra@ietf.org
> https://www.ietf.org/mailman/listinfo/extra

--
  Bron Gondwana, CEO, FastMail Pty Ltd
  brong@fastmailteam.com