Re: [dispatch] Zstandard compression

Sean Leonard <dev+ietf@seantek.com> Mon, 13 November 2017 06:01 UTC

Return-Path: <dev+ietf@seantek.com>
X-Original-To: dispatch@ietfa.amsl.com
Delivered-To: dispatch@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6A3871287A5 for <dispatch@ietfa.amsl.com>; Sun, 12 Nov 2017 22:01:13 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.898
X-Spam-Level:
X-Spam-Status: No, score=-1.898 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id sYFmRE6rsy5i for <dispatch@ietfa.amsl.com>; Sun, 12 Nov 2017 22:01:11 -0800 (PST)
Received: from smtp-out-1.mxes.net (smtp-out-1.mxes.net [67.222.241.250]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 54015127977 for <dispatch@ietf.org>; Sun, 12 Nov 2017 22:01:11 -0800 (PST)
Received: from dhcp-894b.meeting.ietf.org (dhcp-894b.meeting.ietf.org [31.133.137.75]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.mxes.net (Postfix) with ESMTPSA id 8E9D227530; Mon, 13 Nov 2017 01:01:09 -0500 (EST)
From: Sean Leonard <dev+ietf@seantek.com>
Message-Id: <2A0764E1-1ADA-4510-A717-23095A4362F0@seantek.com>
Content-Type: multipart/alternative; boundary="Apple-Mail=_024AACA5-14A0-47B3-ACC2-26DD688673E3"
Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\))
Date: Mon, 13 Nov 2017 14:01:06 +0800
In-Reply-To: <CAL0qLwbhPCJDBwNw0Q88kW5c2e_8msr+UwtV_4DnMXVOBZoGXA@mail.gmail.com>
Cc: DISPATCH list <dispatch@ietf.org>
To: "Murray S. Kucherawy" <superuser@gmail.com>
References: <CAL0qLwatePp87tC6YGRj4=K0xivMfSr2QSDkn6VVkojvs4DW7A@mail.gmail.com> <E6EAC624-21A3-425A-B355-9D4EFA4F7CBB@seantek.com> <CAL0qLwbhPCJDBwNw0Q88kW5c2e_8msr+UwtV_4DnMXVOBZoGXA@mail.gmail.com>
X-Mailer: Apple Mail (2.3273)
Archived-At: <https://mailarchive.ietf.org/arch/msg/dispatch/ZZnzug0n0DPztdrfXvKcKPUE1u4>
Subject: Re: [dispatch] Zstandard compression
X-BeenThere: dispatch@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: DISPATCH Working Group Mail List <dispatch.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/dispatch>, <mailto:dispatch-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/dispatch/>
List-Post: <mailto:dispatch@ietf.org>
List-Help: <mailto:dispatch-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/dispatch>, <mailto:dispatch-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 13 Nov 2017 06:01:13 -0000

> On Nov 13, 2017, at 11:22 AM, Murray S. Kucherawy <superuser@gmail.com> wrote:
> 
> On Mon, Nov 13, 2017 at 10:22 AM, Sean Leonard <dev+ietf@seantek.com <mailto:dev+ietf@seantek.com>> wrote:
> Those documents do not specify MIME types, and I do not think this document draft-kucherawy-dispatch-zstd should do so either. The media type registration is weak: there is no way to signal inside the format what is inside other than an arbitrary stream of bytes. It is not a file archive format, or another kind of container format that identifies parts.
> 
> Why does that imply that a media type is not appropriate?  A module receiving this content for processing needs to know what format it's in, and I believe that's what these are for.

Working on this. It strikes me as either…odd…or just not really that useful for the purpose. It is a format, but it’s just a format for a stream of arbitrary bytes. There is no way to label it internally beyond the implicit “application/octet-stream” type.

Content-Encoding is therefore very appropriate, but that is for HTTP, not (as of yet) for mail or other messaging formats.

May I ask, what is the reason why you need a media type?

Let me think about it…maybe it would be good to ask the media-types ML.


> 
> I request that we get an OID registration for this for use with Compressed Data Content Type for CMS, RFC 3274. That way it could be used with S/MIME or other formats that use CMS or S/MIME (seeing as how CMS / S/MIME are general container formats).
> 
> Wilco.
> 
> Surveying other container formats and doing the appropriate registrations with them in this draft would be appropriate, if one can articulate a use case in those respective formats.
> 
> Can you suggest an example?

Not offhand, just thought of those two (Content-Encoding, and RFC 3274 CompressedData media type).

Well there’s TLS v1.2 compression methods. Just joking! :-)

Sean

> 
> -MSK