IETF Logo Mail Archive

Re: [dispatch] Zstandard compression

"Murray S. Kucherawy" <superuser@gmail.com> Thu, 14 December 2017 14:22 UTC

Return-Path: <superuser@gmail.com>
X-Original-To: dispatch@ietfa.amsl.com
Delivered-To: dispatch@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id ABD341293E3 for <dispatch@ietfa.amsl.com>; Thu, 14 Dec 2017 06:22:54 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.998
X-Spam-Level:
X-Spam-Status: No, score=-1.998 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PvfS4THxgZi3 for <dispatch@ietfa.amsl.com>; Thu, 14 Dec 2017 06:22:53 -0800 (PST)
Received: from mail-qt0-x22b.google.com (mail-qt0-x22b.google.com [IPv6:2607:f8b0:400d:c0d::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C5C291200CF for <dispatch@ietf.org>; Thu, 14 Dec 2017 06:22:52 -0800 (PST)
Received: by mail-qt0-x22b.google.com with SMTP id k19so8096363qtj.6 for <dispatch@ietf.org>; Thu, 14 Dec 2017 06:22:52 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=goVgl54cNkpkM0bj+VpB9sEdwLuuRVbbG4SkNCq7ngw=; b=I1ktX/jXHgbWtlWj4m521RioqQMvzXkZSweYmNgL/d1JjfXvKJNAIbkUJA5FDCVy10 LrhQxPICURvllQh56QktC9ND6SbjjEc9QIxU4M8cyZtl4EuN3wYDKblUj4xq52MLve5U RmJTipNcv7gAcjW++bwfKpwmyp/EnH1JWbdSP7bxiQDMSS2pX/8kdox+OVzftik5kOZH PzZzuxyQ3dtBu2BfNLkMSHXrGF1HT9wrhQ+Lx4vP5mK3/hjFaoO0iqQ2cUZP1dOiqG+C LDqEgCOomYeb+H6h7fzuFCrztl3xHR2uhEg6SAXV5lyEg6BmgYeG61vQwLQA8sIgeWW2 C7Lg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=goVgl54cNkpkM0bj+VpB9sEdwLuuRVbbG4SkNCq7ngw=; b=bn68+3IFrVckdqlwzgOX0dt4wPSmOF+n34HNiqZ8tRx+LcWsmDiAYwlzqaiIlJT4hb osuICemfKTAkVK1Uj7aYD1h5lc5eR2LBSTkJTN3oVRqC+o/C3V0sYGoDIsAeVKJP1682 dnUINu1s9L8egUkqSEtIJHCrrnqlAZDryAaY75eNeCLACZ++SC5iSw76DG2vc5p2zNbs AVmf/uOzzunM8Lyb5gDNM2EiIb9IIsCCX6niH/POx3QS059/2MtIVgOmMkAJRilHUtyc E17kqA2+Cwj2OwPS/RTGRgu/nGf0IXB5hI6JXxzrdMteCqBn7LBfaAe6uxNs9rky7qmd Luew==
X-Gm-Message-State: AKGB3mJ3d09aeX5jyO3WTkficMcMLAm2RiwHmf2ODDB9StA524+tIuOx TmAGBaOH0wwDRTUpgVVuTPcsyY6qZaAHRl5w8Y0j0Q==
X-Google-Smtp-Source: ACJfBot+o8QRd1UIXwS6IxrENeFEmFWooaxGMWDtKMN02Faa2ppSQs3Ko7jjfXOomiIFrEIq637GyEMgcVhTJWTH5Lc=
X-Received: by 10.200.3.158 with SMTP id t30mr16310389qtg.149.1513261371920; Thu, 14 Dec 2017 06:22:51 -0800 (PST)
MIME-Version: 1.0
Received: by 10.237.33.1 with HTTP; Thu, 14 Dec 2017 06:22:51 -0800 (PST)
In-Reply-To: <e88d3d87-a9e6-d37c-c138-68124c8aa449@alvestrand.no>
References: <CAL0qLwatePp87tC6YGRj4=K0xivMfSr2QSDkn6VVkojvs4DW7A@mail.gmail.com> <E6EAC624-21A3-425A-B355-9D4EFA4F7CBB@seantek.com> <CAL0qLwbhPCJDBwNw0Q88kW5c2e_8msr+UwtV_4DnMXVOBZoGXA@mail.gmail.com> <2A0764E1-1ADA-4510-A717-23095A4362F0@seantek.com> <CAL0qLwYMA-HShoDvFtTcqK6dav=5Bfocf1TTJUsgB+3deVTzJA@mail.gmail.com> <dad5e711-3a91-69d1-d3ed-ee38e9237699@it.aoyama.ac.jp> <e88d3d87-a9e6-d37c-c138-68124c8aa449@alvestrand.no>
From: "Murray S. Kucherawy" <superuser@gmail.com>
Date: Thu, 14 Dec 2017 06:22:51 -0800
Message-ID: <CAL0qLwYJXsE-kG1ev+na+ssYJM_QJCirJMt0_tsJK+fzCrHMVQ@mail.gmail.com>
To: Harald Alvestrand <harald@alvestrand.no>
Cc: DISPATCH list <dispatch@ietf.org>
Content-Type: multipart/alternative; boundary="f4030435d08c86997205604d9ec5"
Archived-At: <https://mailarchive.ietf.org/arch/msg/dispatch/xPh2LyQTWbBSBGgC7mlPRO7FD0s>
Subject: Re: [dispatch] Zstandard compression
X-BeenThere: dispatch@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: DISPATCH Working Group Mail List <dispatch.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/dispatch>, <mailto:dispatch-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/dispatch/>
List-Post: <mailto:dispatch@ietf.org>
List-Help: <mailto:dispatch-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/dispatch>, <mailto:dispatch-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 14 Dec 2017 14:22:55 -0000

On Tue, Nov 14, 2017 at 4:25 PM, Harald Alvestrand <harald@alvestrand.no>
wrote:

> > Yes. But I think what Sean is saying is that above and beyond that,
> > you'd (in many if not most use cases) also want to know what the
> > decoded octet stream is about. Otherwise, this information has to be
> > transmitted on a side channel.
>
> One (horribly ugly) way of doing this is to have something like a
> "contains" parameter:
>
> mime-type: application/zstandard; contains="text/plain; charset=utf-8"
>
> That's one form of side channel for passing the data around. Not sure if
> anyone would use it.
> But it's such an ugly way of doing things that it should definitely be
> suggested on the media-types list, not here.
>

Interesting.  I haven't seen this technique used before.  Do other
compression methods have such a mechanism described and registered?

-MSK

v2.23.0 | Report a Bug | By Email