Re: [dispatch] Zstandard compression

Martin J. Dürst <duerst@it.aoyama.ac.jp> Mon, 13 November 2017 09:25 UTC

Return-Path: <duerst@it.aoyama.ac.jp>
X-Original-To: dispatch@ietfa.amsl.com
Delivered-To: dispatch@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D7F0C129505 for <dispatch@ietfa.amsl.com>; Mon, 13 Nov 2017 01:25:51 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level:
X-Spam-Status: No, score=-1.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=itaoyama.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9_1-Z9jkOOhc for <dispatch@ietfa.amsl.com>; Mon, 13 Nov 2017 01:25:50 -0800 (PST)
Received: from JPN01-TY1-obe.outbound.protection.outlook.com (mail-ty1jpn01on0138.outbound.protection.outlook.com [104.47.93.138]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B6AF61294F7 for <dispatch@ietf.org>; Mon, 13 Nov 2017 01:25:49 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=itaoyama.onmicrosoft.com; s=selector1-it-aoyama-ac-jp; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=ViOaxE1im5nKpQJTbRvTGEnePg0omMMfLVpskqRSuCc=; b=YwNjs5/rWZ1NWqiCFOVBiPY5k/r2odtnh92O2RaQCuPdpReHKd4Zboav1wnU07Tt3Bi2IoxGPEIYnSEJMMfXubBLuzDKktuNTxSTaVvIXtNHnKnqw08cyJ2lYXNFkdWPOkvDoqQXJycx7aQtu4wztnYuJkw6PQ3/UKPWlI/30PM=
Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=duerst@it.aoyama.ac.jp;
Received: from [100.70.12.254] (133.2.59.38) by OS1PR01MB0245.jpnprd01.prod.outlook.com (2a01:111:e400:ac0c::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.218.12; Mon, 13 Nov 2017 09:25:47 +0000
To: "Murray S. Kucherawy" <superuser@gmail.com>, Sean Leonard <dev+ietf@seantek.com>
Cc: DISPATCH list <dispatch@ietf.org>
References: <CAL0qLwatePp87tC6YGRj4=K0xivMfSr2QSDkn6VVkojvs4DW7A@mail.gmail.com> <E6EAC624-21A3-425A-B355-9D4EFA4F7CBB@seantek.com> <CAL0qLwbhPCJDBwNw0Q88kW5c2e_8msr+UwtV_4DnMXVOBZoGXA@mail.gmail.com> <2A0764E1-1ADA-4510-A717-23095A4362F0@seantek.com> <CAL0qLwYMA-HShoDvFtTcqK6dav=5Bfocf1TTJUsgB+3deVTzJA@mail.gmail.com>
From: "Martin J. Dürst" <duerst@it.aoyama.ac.jp>
Organization: Aoyama Gakuin University
Message-ID: <dad5e711-3a91-69d1-d3ed-ee38e9237699@it.aoyama.ac.jp>
Date: Mon, 13 Nov 2017 18:25:46 +0900
User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.4.0
MIME-Version: 1.0
In-Reply-To: <CAL0qLwYMA-HShoDvFtTcqK6dav=5Bfocf1TTJUsgB+3deVTzJA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Language: en-US
Content-Transfer-Encoding: 8bit
X-Originating-IP: [133.2.59.38]
X-ClientProxiedBy: KAWPR01CA0052.jpnprd01.prod.outlook.com (2603:1096:402:b::12) To OS1PR01MB0245.jpnprd01.prod.outlook.com (2a01:111:e400:ac0c::19)
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-Correlation-Id: fc8d5ebd-194a-4578-2621-08d52a7885f9
X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001)(4534020)(4602075)(4627115)(201703031133081)(201702281549075)(2017052603199); SRVR:OS1PR01MB0245;
X-Microsoft-Exchange-Diagnostics: 1; OS1PR01MB0245; 3:AVtjaLVcDRnyPRJ4fwLFv1/jAq6+OJidgoc0bO/YoYaDG6mssSY/iYaRRkYiUFdG0IqLe2BoYCF0U5RQbg+FcB350cVCK+FWxCGuVRoII5zBgsBL+jF39VLLsmXtwnVBXxskGpB5LIBg+X398N3YjQSbcaCga9CElaRcjb02fxY1WMbbGVieF1JWwfl5OU8IgkA+oN9TaUF2D9sMEASyPR2t/q77fcTFYSxUvBCCgDPz79i/gJQPxS5cBoTZubxB; 25:gGNFt92dL3QfX3frv5SClvJMsOLwViL7cqz7o1W+kiUNgl4fL5r6z5FWFX+cK8aJYE51ZV+T4Dde41xKi3ht2AQjUmbHVy2LyCqbGkkqIZQzEQan6w/d3Z7RDR0KyxoBQQpJBaInf6FQOAHtjNtsTz3UB1hVi66Hn/Zpbz6ercqGOxE0YPYGauh94AcQQcxxsHKlF0x8JOpEFNbZaAvdxHSe0BFMIY37osVNOs8QOlZGG1HQVsrhDH0rFPOON0HE0ONYe1Lr3SQ1a0kIcENhIiPIsURU5aVUIoHQiWuU1/ODHC0wSa4PZxfUoS7lrCnjlLtEv6DcQ5UBmnvXhs6X9oTWHrB3zh3FmQrStPeVah4=; 31:6/2BpxU149k0yBnAaBjop0rFS1fO2Y1XLJ3s9Ii3obYyxfud4p4QWNNudjQor2lUZlNeV153aXWU2nndFu2fZ+qaDGShQ/FybD2ul10MClQ8GnLxixpEhc+1fyb25ueb+ER2uvKQ/11AKikrm5oOqPyGW+eqvsY2lvqBAkhtDQYfrCd33cdSHrYfIb2OnyrLNDD5S537tllSy+2QZ8B5LZ1EG/HKjLlEhq5ksSemu8E=
X-MS-TrafficTypeDiagnostic: OS1PR01MB0245:
X-Microsoft-Antispam-PRVS: <OS1PR01MB024590CC5556ADD725EABB5BCA2B0@OS1PR01MB0245.jpnprd01.prod.outlook.com>
X-Exchange-Antispam-Report-Test: UriScan:;
X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(2401047)(5005006)(8121501046)(93006095)(93001095)(3002001)(3231022)(100000703101)(100105400095)(10201501046)(6041248)(20161123558100)(20161123560025)(20161123562025)(20161123564025)(201703131423075)(201702281529075)(201703061421075)(20161123555025)(6072148)(201708071742011)(100000704101)(100105200095)(100000705101)(100105500095); SRVR:OS1PR01MB0245; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:OS1PR01MB0245;
X-Microsoft-Exchange-Diagnostics: 1; OS1PR01MB0245; 4:C/B4jb3PEzrr6gziHYc08GqJF60pu4Kc/tr4udLf01+TrSrTWAzmdas+GZikvY//q7EiK6zRH6L+WDiRqb/tYtBz5BNULt1A+mJTrkZ0Boe64NU3Z3HKSqWgRJIPC99dQCLyJ69avmUe6Duz0jLyx1T+15n8jd/uMq+Z3MtPRzXt0wYE57AQebXGMX4JcSzK3bbRpGQHMSCDEOLAc1GxkeY0bF2+UWxK/4G9HDRR5QqU8UWrF4kp8MEhFBpL581lGt16qE2kYIcCKtOOaFlKQQ==
X-Forefront-PRVS: 0490BBA1F0
X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10019020)(6049001)(6009001)(346002)(376002)(199003)(24454002)(189002)(68736007)(76176999)(54356999)(110136005)(65826007)(5660300001)(53546010)(2950100002)(42882006)(101416001)(16576012)(786003)(58126008)(83506002)(16526018)(7736002)(74482002)(305945005)(8676002)(50466002)(81166006)(50986999)(64126003)(49976008)(6116002)(25786009)(106356001)(3846002)(508600001)(105586002)(81156014)(2870700001)(2906002)(93886005)(33646002)(31686004)(189998001)(8936002)(86362001)(65956001)(6246003)(66066001)(47776003)(65806001)(31696002)(53936002)(67846002)(6486002)(23676003)(229853002)(97736004)(4326008)(39060400002)(78286006); DIR:OUT; SFP:1102; SCL:1; SRVR:OS1PR01MB0245; H:[100.70.12.254]; FPR:; SPF:None; PTR:InfoNoRecords; A:0; MX:1; LANG:en;
Received-SPF: None (protection.outlook.com: it.aoyama.ac.jp does not designate permitted sender hosts)
X-Microsoft-Exchange-Diagnostics: 1;OS1PR01MB0245;23:omVB6ARYwldeU0ZfH6blkdG3je/YxMQZlOj+DkPFK+eLyNjEI3TXItAa5fDqk8qQ0fzw+BdsD2v10pwyEHjL3+F7BxVfJOkYlkmBl9utu7H7bsKtThpZqGJOZClm2D+bxZoYAj8IilkYs133WDmGItDH2l8AKxJ0w/IpH7Drgbwu8s2tp93TR1HuihWwaPRcpl8AXg6JPUDZAc+L900z5u1JTkBnbzL0mlY5xTzt946+hmmRKEZ2EMWiy9o8wBVpcOm8UT0e8PGEXoUh7+tW4LOhvJteqIDRvZL/1Mvk4n0fK8IsBp/RkF3oHPI8XdAC5UzSXRPH4EgyCHNP7PxSIexnB2uH0UatjL70nPTLmXWvE6ZIbBcUVnlv2au7zjxZZ+UYVYWtJjIDEmU8b4bOb/ewdiYp8nOMM9rKdz/6kp1IOitfjSh4sJO6do5h8sPkQn/KVdoJoskENSTZtQctSjgydkvTXFbOe+dLE3RaqFST6WStTVJXLxanq0w3a1pze3TT4d7/Dhh6g0lwGwCxtQga7tJhsIAIxgr/crads6VWqeOoCgcRPy+wwbBP/NZe9x/hIDE/ipx1bO7Gwz5km188v8iFCT2euQrwEdWgDh66G+upnH29rEkg9rzFHI+5unNTEEk0uipVx0oui4X4816R5XLEqxl25YkzMuwTh8iEKe08LdEo/LRgZ88L6WWfh7Mdal32rHUMybSC5y86vaTB4BMRNuLXdd/bRbzQozlpjJMw32goepY5Xt3MtZ5pcQ1Y/XqE6UlTbWnTKD7JOTzSQoYlu/nrMMoZaL0f1i5kJ7wsSTT3Sp04aVVNodl8Asnwjdz6njlecaAa7cib0iroQZV5JT5qiGdLUG30VbVyfb8AiN7b1HappjWCePXO3i6g6FDOs2s0bJUBkPlyFMTas9xlLfrFV45TpVa3HIpQXRbjNv88Qck4V0fD7OkdVE5g+W0FO8PY/uXRSGJrOhy6Zsri4+QtHSnK5psdCpGjsiEZrNhUnskrl4GQnfJRTPi+lOk8fbouQwHJ4O7MFDq/vEeptQ9skhbIoVF1AueFho1A12yvZuzM40NTA4qYni6Hva4+ZsuAx1KtslRC8spGO1QjVX1D0eJ8CBNf5Hu7nBi4/1tvIqHn43sq9lEToLj2QhM6ZhMFtdN1lGZXy9pMdgkbXLreTzl68qZzU8ixYNP0J3ksxE2mXkskJKj02kTbQivZI7rTieWf5CTC6NDbetTcKUDLW0okORn/wk8YobZtt+yQHocDVGt6rPXQM8B8t5fe5gMX8WDf6gmPnQIvhuu9nFoo+ygI87SBUwJGa4Ih3vLc+50KRgTviHvwwOn078hAUn8wlElg3HO3u3sAeQdypf/ru7+u6cbV/LZ5CKHQbMlhoRW/cf9Cb4SicLjRKltvu0GSsBG6a+DXcQ==
X-Microsoft-Exchange-Diagnostics: 1; OS1PR01MB0245; 6:v1J+5oGWcuBgrjasQG1bk9g1U/gpJa9lo1WedQMHivABHb5vd9nFSTnW+Pc/ILE971vnhOk7ApWpS5lajWqqZ1Ujx2HpS75w63RePdjT89nP3f6IQh19+SohErUBaCU/AhT4oOzZWSYiGp7IWJ7DJbh9c3UJChLMGtVm+Nltx4Kbs6MD6iT6/Gxhq6gs4Grh2mXmfvGjgTbvCez78PPevWoDBG65IPQ9neVKPO2mx7+MIQ1H39qIQBVSbmH1ych1+xwPTflc2hcjwHnnjW14gKQ10LKHDDm0R9tVJVQSgJfi3XvVrqCaUCnT8mn/tAuzf/i6AStGV9d1pbSXnB5MA+MNjmCAHGOPqhA3Le06nGU=; 5:Api7wzp+3rXyjmlZwo7pqHtHuZaojwi/O4PgNo81BtnSKExK6igBxPoH6VnHAFMolnOB+yYWmsFEobJpowSO+OVlbe6RT5aaLwjcr7YAWffg2K9WZwTzan6bqg72GumELWHcsQXghAwQfW9iKFWahJD4eKREmKbaoGBGZ2mIfs8=; 24:htqALqh3nn1jcb/fmM0f3ODOoxfWAu9vurASWaXavj7RAKyH3BGk7l53ILVwnYFMopMbVSoTbdUlfKuDZpQ2xhLWUPiUGHaeN5O9E7J72zE=; 7:+77tDJzOOd9+IDFXARuCZDWnFTOHnSH7e6JFPkkxdIl9b1Tsap9uSPuW2jW57mm+8n3muBTskIz8GP4L/bxrzC8I7VpbvW+89O7USlEBW4XWUnDcUNhMu7xLasMC05hLdpwBJXp0Te/6Lnq/ES/dcyP2tJ98O39s8Un4lIWbT6w4ac6lbIffx+DDa5e4XLR0MtfYbhLhMfKvVmHyKeTRqnZhqTljStQypqEHjUuLCHYYS+nctiRk9fvCFJQIfKOp
SpamDiagnosticOutput: 1:99
SpamDiagnosticMetadata: NSPM
X-OriginatorOrg: it.aoyama.ac.jp
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 Nov 2017 09:25:47.1808 (UTC)
X-MS-Exchange-CrossTenant-Network-Message-Id: fc8d5ebd-194a-4578-2621-08d52a7885f9
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: e02030e7-4d45-463e-a968-0290e738c18e
X-MS-Exchange-Transport-CrossTenantHeadersStamped: OS1PR01MB0245
Archived-At: <https://mailarchive.ietf.org/arch/msg/dispatch/QYOMWmGWcAKVS85CITrDQ4Wi0UM>
Subject: Re: [dispatch] Zstandard compression
X-BeenThere: dispatch@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: DISPATCH Working Group Mail List <dispatch.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/dispatch>, <mailto:dispatch-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/dispatch/>
List-Post: <mailto:dispatch@ietf.org>
List-Help: <mailto:dispatch-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/dispatch>, <mailto:dispatch-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 13 Nov 2017 09:25:52 -0000

On 2017/11/13 15:18, Murray S. Kucherawy wrote:
> On Mon, Nov 13, 2017 at 2:01 PM, Sean Leonard <dev+ietf@seantek.com> wrote:

>> Working on this. It strikes me as either…odd…or just not really that
>> useful for the purpose. It is a format, but it’s just a format for a stream
>> of arbitrary bytes. There is no way to label it internally beyond the
>> implicit “application/octet-stream” type.
>>
> 
> Don't you need a hint as to how to decode an octet stream that's encoded in
> some way?

Yes. But I think what Sean is saying is that above and beyond that, 
you'd (in many if not most use cases) also want to know what the decoded 
octet stream is about. Otherwise, this information has to be transmitted 
on a side channel.

Regards,    Martin.