Re: [dispatch] Zstandard compression

Sean Leonard <dev+ietf@seantek.com> Mon, 13 November 2017 02:22 UTC

Return-Path: <dev+ietf@seantek.com>
X-Original-To: dispatch@ietfa.amsl.com
Delivered-To: dispatch@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 49D10127136 for <dispatch@ietfa.amsl.com>; Sun, 12 Nov 2017 18:22:55 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level:
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id W6po4dzdUiTN for <dispatch@ietfa.amsl.com>; Sun, 12 Nov 2017 18:22:53 -0800 (PST)
Received: from smtp-out-1.mxes.net (smtp-out-1.mxes.net [67.222.241.250]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id AB01F127077 for <dispatch@ietf.org>; Sun, 12 Nov 2017 18:22:53 -0800 (PST)
Received: from dhcp-894b.meeting.ietf.org (dhcp-894b.meeting.ietf.org [31.133.137.75]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.mxes.net (Postfix) with ESMTPSA id 108612754E; Sun, 12 Nov 2017 21:22:51 -0500 (EST)
Content-Type: text/plain; charset="us-ascii"
Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\))
From: Sean Leonard <dev+ietf@seantek.com>
In-Reply-To: <CAL0qLwatePp87tC6YGRj4=K0xivMfSr2QSDkn6VVkojvs4DW7A@mail.gmail.com>
Date: Mon, 13 Nov 2017 10:22:48 +0800
Cc: DISPATCH list <dispatch@ietf.org>
Content-Transfer-Encoding: quoted-printable
Message-Id: <E6EAC624-21A3-425A-B355-9D4EFA4F7CBB@seantek.com>
References: <CAL0qLwatePp87tC6YGRj4=K0xivMfSr2QSDkn6VVkojvs4DW7A@mail.gmail.com>
To: "Murray S. Kucherawy" <superuser@gmail.com>
X-Mailer: Apple Mail (2.3273)
Archived-At: <https://mailarchive.ietf.org/arch/msg/dispatch/mkyCba6pgVFKGCZSV0z8s0WO4yk>
Subject: Re: [dispatch] Zstandard compression
X-BeenThere: dispatch@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: DISPATCH Working Group Mail List <dispatch.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/dispatch>, <mailto:dispatch-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/dispatch/>
List-Post: <mailto:dispatch@ietf.org>
List-Help: <mailto:dispatch-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/dispatch>, <mailto:dispatch-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 13 Nov 2017 02:22:55 -0000

Checked out the draft.

To simplify it, it looks like it is most analogous to the RFC 1950 / RFC 1951 documents that describe the algorithm(s) for ZLIB / DEFLATE, for compression of arbitrary data streams.

Those documents do not specify MIME types, and I do not think this document draft-kucherawy-dispatch-zstd should do so either. The media type registration is weak: there is no way to signal inside the format what is inside other than an arbitrary stream of bytes. It is not a file archive format, or another kind of container format that identifies parts.

3.2. Content Encoding is fine.

I request that we get an OID registration for this for use with Compressed Data Content Type for CMS, RFC 3274. That way it could be used with S/MIME or other formats that use CMS or S/MIME (seeing as how CMS / S/MIME are general container formats).

Surveying other container formats and doing the appropriate registrations with them in this draft would be appropriate, if one can articulate a use case in those respective formats.

Sean

> On Nov 2, 2017, at 5:35 AM, Murray S. Kucherawy <superuser@gmail.com> wrote:
> 
> <chair hat clearly off>
> 
> In September, I submitted draft-kucherawy-dispatch-zstd, which introduces a new compression  mechanism and seeks to register media types and content encodings for it.  The most obvious application for it is HTTP payloads, but it has other possible applications.
> 
> I don't know of IETF venues other than this one and maybe the ART list where this kind of thing might be discussed, or how we might dispatch it.  Offlist conversation with Mark Nottingham suggested maybe HTTPBIS might like to at least discuss this, but I haven't looked to see if it fits within their current charter.
> 
> Suggestions for discussion venues or processing options are welcome.
> 
> -MSK
> _______________________________________________
> dispatch mailing list
> dispatch@ietf.org
> https://www.ietf.org/mailman/listinfo/dispatch