Re: [dispatch] Zstandard compression

Martin Thomson <martin.thomson@gmail.com> Wed, 01 November 2017 23:32 UTC

Return-Path: <martin.thomson@gmail.com>
X-Original-To: dispatch@ietfa.amsl.com
Delivered-To: dispatch@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id AF0E313FD04 for <dispatch@ietfa.amsl.com>; Wed, 1 Nov 2017 16:32:45 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level:
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id SBYGJFdzX5ED for <dispatch@ietfa.amsl.com>; Wed, 1 Nov 2017 16:32:44 -0700 (PDT)
Received: from mail-ot0-x232.google.com (mail-ot0-x232.google.com [IPv6:2607:f8b0:4003:c0f::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E6F6413F786 for <dispatch@ietf.org>; Wed, 1 Nov 2017 16:32:43 -0700 (PDT)
Received: by mail-ot0-x232.google.com with SMTP id n74so197572ota.8 for <dispatch@ietf.org>; Wed, 01 Nov 2017 16:32:43 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=n8zh6NTYyKmMgQj/cWcjDjXRMrbDB7jzAX6cplOOD0k=; b=KLDUa5niD8VBwUchWVtnhzZURSXCQHVwRJU85A60lxbbDnwCx/wAubyqzBUH8N+eM2 AONDXWL1pb6Z9t2M/QOedwEoWvhpi6NBn/oVcPC3o8o0Q/mNwOQO2pFZasbPjknCbKMJ gAhT/rvFb2UsEQlEXL9su2e275tmHrRqFXlgXaOZ8bBzYmbMzEHbyDcCiuJrLOB70J1H I8BxZRP45BU6ezLlQ4zF0URFweX8tH9Gjsy73ZpRzWGd0gVx08O4cp+7D8T4VvNIXf78 w4nWaF0OCYY6GS8hqH6TVm48JVz/0lZd7OCAiSus4bPEIG7LPdY7BJ0Dd7B95uYvSjlw xoXA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=n8zh6NTYyKmMgQj/cWcjDjXRMrbDB7jzAX6cplOOD0k=; b=kSD4Q7/4XfMEo9Zl7IUNQXeiCQxvO/9kREg1tzoZS60U42KowpIzP5oWCaw9bniwSk i+9KlEsxDMCOomYB4KFZ3xS0fVoRj5amiuyp1ccQDZ7NpdBMT3qsAB2sxZhuiAYzAvyg gLRwCr9iTo1Plp2JbymOgUEWVAKVJq7y8aHZ+jB/tHRD5sdyDRgtJPOEzVMtbyLwxl57 OyizCC878C1UCv6JNRdVzoYcyldymu5OIQaLK0X3SqwmZaFQuq1YMieG/8VFOu6XHTjY pC+k+G4BwnvKDDOORV7xOVzAmpjWC6JB1qOLJEOJ3r2N9qdsklVdldUktRrdx/fG0Lmu B6fw==
X-Gm-Message-State: AJaThX6a8GwzB5l3t8K1IemYP1K7DFRrgV1SFgL7FrsP9c2DCWpKamWA XDE+PKr33O6vmlamueNsUDAkjRiqu9uGoIHFz8Y=
X-Google-Smtp-Source: ABhQp+QdYONns24kh83Vsl+lZcudaObj+wQZzXXS7QJoU6N1aVuwaNIqURsnstRWzlgKgeR1u7fe2uNz9B8NXHx73p0=
X-Received: by 10.157.53.17 with SMTP id o17mr1020510otc.35.1509579163151; Wed, 01 Nov 2017 16:32:43 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.157.72.178 with HTTP; Wed, 1 Nov 2017 16:32:42 -0700 (PDT)
In-Reply-To: <22EAF7AB-E6AB-44C5-A424-EF0AF2313EC6@mnot.net>
References: <CAL0qLwatePp87tC6YGRj4=K0xivMfSr2QSDkn6VVkojvs4DW7A@mail.gmail.com> <22EAF7AB-E6AB-44C5-A424-EF0AF2313EC6@mnot.net>
From: Martin Thomson <martin.thomson@gmail.com>
Date: Thu, 02 Nov 2017 10:32:42 +1100
Message-ID: <CABkgnnURFCsrodz21EhuPZox5jwQq=dC28erMibYQtH+_E1rbA@mail.gmail.com>
To: Mark Nottingham <mnot@mnot.net>
Cc: "Murray S. Kucherawy" <superuser@gmail.com>, DISPATCH list <dispatch@ietf.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: <https://mailarchive.ietf.org/arch/msg/dispatch/Fe2vAauAHKPgvV1B6vKqD65btsA>
Subject: Re: [dispatch] Zstandard compression
X-BeenThere: dispatch@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: DISPATCH Working Group Mail List <dispatch.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/dispatch>, <mailto:dispatch-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/dispatch/>
List-Post: <mailto:dispatch@ietf.org>
List-Help: <mailto:dispatch-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/dispatch>, <mailto:dispatch-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 01 Nov 2017 23:32:46 -0000

I think that the right approach here is to approach this similarly
cryptographic algorithms.  It seems like the basic compression
structure is independently useful.  Document the format in one place,
then have short documents that describe content codings and other
things independently.  Then HTTP can take the content-coding work on
at their discretion (or it can progress independently).

I realize that RFC 7932 (brotli) didn't do this, so it would be OK to
just follow that pattern.  It also didn't define a media type. Did you
have a use case in mind for that?

On Thu, Nov 2, 2017 at 9:40 AM, Mark Nottingham <mnot@mnot.net> wrote:
> To be clear - HTTPbis needs a heads up and might want to have discuss the registration of the content-coding (Section 3.2). The whole spec probably belongs elsewhere.
>
> Cheers,
>
>
>> On 2 Nov 2017, at 8:35 am, Murray S. Kucherawy <superuser@gmail.com> wrote:
>>
>> <chair hat clearly off>
>>
>> In September, I submitted draft-kucherawy-dispatch-zstd, which introduces a new compression  mechanism and seeks to register media types and content encodings for it.  The most obvious application for it is HTTP payloads, but it has other possible applications.
>>
>> I don't know of IETF venues other than this one and maybe the ART list where this kind of thing might be discussed, or how we might dispatch it.  Offlist conversation with Mark Nottingham suggested maybe HTTPBIS might like to at least discuss this, but I haven't looked to see if it fits within their current charter.
>>
>> Suggestions for discussion venues or processing options are welcome.
>>
>> -MSK
>> _______________________________________________
>> dispatch mailing list
>> dispatch@ietf.org
>> https://www.ietf.org/mailman/listinfo/dispatch
>
> --
> Mark Nottingham   https://www.mnot.net/
>
> _______________________________________________
> dispatch mailing list
> dispatch@ietf.org
> https://www.ietf.org/mailman/listinfo/dispatch