[Cbor] Re: Early allocation for packed CBOR (Re: Reminder: CBOR WG Virtual Meeting on 2024-12-11)

Michael Jones <michael_b_jones@hotmail.com> Wed, 11 December 2024 05:57 UTC

Return-Path: <michael_b_jones@hotmail.com>
X-Original-To: cbor@ietfa.amsl.com
Delivered-To: cbor@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 67BEAC19ECBA for <cbor@ietfa.amsl.com>; Tue, 10 Dec 2024 21:57:09 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.232
X-Spam-Level:
X-Spam-Status: No, score=-1.232 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FORGED_HOTMAIL_RCVD2=0.874, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=hotmail.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Cck9tzMbtITZ for <cbor@ietfa.amsl.com>; Tue, 10 Dec 2024 21:57:09 -0800 (PST)
Received: from SN4PR2101CU001.outbound.protection.outlook.com (mail-southcentralusazolkn19012011.outbound.protection.outlook.com [52.103.14.11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-384) server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id EFF14C16940D for <cbor@ietf.org>; Tue, 10 Dec 2024 21:57:08 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=SfeUU0xEefx2UGd6pm+Ytqafxafn+nV4xkY56xyhBzHnE6SJqCr24riiMqTlv0p5lBYlC70fsQslNn8FNvoUfBvyXnsaN6VLYmC+VQPnyqZfQuahOpwpjpgDAxvKBvf9YzdtMBouLdYbV+KaF1Y/PJd3wUZm8S+eUuTTKrvxOBqCiJ3kDNlaLi40jiKuTglcvkv6ZRPsyItWsaUjg0dUHMz4rsujxfpk9rFW3i13Owd6ZSbq4l8/c383WcrYi18klqnbM+dmwdqv4QOvXrSHAtkr4Q0j3SAZnIhGn9TS1bS0I/qx80ckcAqUkdoRZhQIeoEBFpO6is//6r42Hib08g==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=eBTgycTtC5CHdeZtELkW/yIJhgGjucO3S5yiITJ1mlg=; b=YoWs5LRBziArkCkHN6py/MzGsB0Ry6I9uuo0jeGm/H8qkEpKG+tAWpt28DJoYXDY47gaBDmylcUTA4EWhWT0/KVrAMPXEyDHzabmsCPxu6liU196Qm5kZT4IFbj7Pu3J+u2riVcBj3GX/BZt8gJZyjub9fny1ZMkht7D+h8TNycWIMOWqfluSozRLgOqZ4NkOPIo7uw4+9Opc+a3n47I6N1IeATgZox+RyGElsqvagymjelQKVz9O69HTS9XP5EELbvJJFGNaXQ/JkxldRFnNQfP2/FVgDElo3jwWh1uS0hkUjN955ZYdXdVXIl36ZnVMhRwtZ05RV0QYfCo3tyuwA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=eBTgycTtC5CHdeZtELkW/yIJhgGjucO3S5yiITJ1mlg=; b=oYgeTLzZiJhfGpQz9PE/l3C2PTZ3AfvPxSXF7luWEkbcdlKGpDHTdk/Jo81N3feGhkYKFvgs/z1jKFOI8Ww27ULI4mW0H0/Q4Am4faq2IqDB7RrJR/aF+Y1UBRQ7BgvF8mq0mLbv5N4h6q3vKvP/b5Pt0QjkrqHU/9LLkXMmUDf/MS4qogqUo9Xmboh+iMgQD9WyFOFj2FrFLvQABQIrDGQg6HZN5CxjT3aDzYsz0fX7uGJxH3Rnk13ciZrMekURtz/KAflF7Z2A7DLHSHsH29FdsXecpDPaUDxTfQ/JEaQaDasl1lBtzFi4rxbsI+I4uSyiOFGJKg04I4bdfdxgcQ==
Received: from PH7PR02MB9292.namprd02.prod.outlook.com (2603:10b6:510:275::9) by PH0PR02MB8613.namprd02.prod.outlook.com (2603:10b6:510:101::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8251.14; Wed, 11 Dec 2024 05:57:06 +0000
Received: from PH7PR02MB9292.namprd02.prod.outlook.com ([fe80::e455:8c0f:5367:f8b2]) by PH7PR02MB9292.namprd02.prod.outlook.com ([fe80::e455:8c0f:5367:f8b2%6]) with mapi id 15.20.8230.010; Wed, 11 Dec 2024 05:57:06 +0000
From: Michael Jones <michael_b_jones@hotmail.com>
To: Carsten Bormann <cabo@tzi.org>, Joe Hildebrand <hildjj@cursive.net>
Thread-Topic: [Cbor] Re: Early allocation for packed CBOR (Re: Reminder: CBOR WG Virtual Meeting on 2024-12-11)
Thread-Index: AQHbS2jViXf2rGz05E+JLQuuCEl5QbLgRGWAgAAE3ICAAD4mgIAAA5Cg
Date: Wed, 11 Dec 2024 05:57:06 +0000
Message-ID: <PH7PR02MB92920676E8817271E547F82FB73E2@PH7PR02MB9292.namprd02.prod.outlook.com>
References: <CALaySJKDFscUBGw4CPspXJvUTkXywVHc_FrmhO3ybBWTrwjGXw@mail.gmail.com> <CALaySJJ8-M9x8irtmF2pfDE3GRXU1am9n2a3XeDcmPT+kww+KA@mail.gmail.com> <CALaySJKTQT_9CC-wVVd+fY1NYJ73M8CP22hn=rWrFeTJSJDEsA@mail.gmail.com> <CALaySJKG3oagg6ffLTx8LgvLvnjHHA2DMGgY74E0q=rReAc4PA@mail.gmail.com> <CALaySJLtUR1=G_WH4H+zoJ5LCrHjBgEf1oW104zDtFQighY+gg@mail.gmail.com> <CALaySJLnKxU9m3BNPq4XayrSrorRBG2vuBz1AF-CsEBoSZe7Xg@mail.gmail.com> <CALaySJKaz7C=GN5E=saiDY4KxL+9xCfM0ocZuMStEQ96FnQ4KA@mail.gmail.com> <CALaySJJEXkey9vLAp8VqDXmPsWpxiWN9jjtVnGio1nMQ4K+mDQ@mail.gmail.com> <CALaySJJfc+tET4Vm5UQjHPK5mf61O0iR-1i6=X32CYtWxZLWTQ@mail.gmail.com> <CALaySJKdrk7aPzhT=kbE1B8pq1EBw74nmx_peSJMAoHsG5jyVQ@mail.gmail.com> <CALaySJ+fWX4zEnE5v-Q9R6eCv=kSJjnc-fsXL5PGPgac1GJAcA@mail.gmail.com> <B807C9D3-39A4-4024-BC1D-85DD84EA1735@tzi.org> <DFE56705-CCDD-4172-B577-C873E3DB4898@tzi.org> <5FEA5C07-4A39-4B58-B2AE-F261D111FCE6@cursive.net> <D0618F67-4868-4745-A526-F73DF1A98E1B@tzi.org> <98C6BEDA-C4B2-4657-ABE2-19FE637CE782@cursive.net> <2A875D49-DD88-42D9-969D-0841A6B41F95@tzi.org>
In-Reply-To: <2A875D49-DD88-42D9-969D-0841A6B41F95@tzi.org>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: PH7PR02MB9292:EE_|PH0PR02MB8613:EE_
x-ms-office365-filtering-correlation-id: b74c98db-25a8-4b7d-c9f7-08dd19a8a4ba
x-microsoft-antispam: BCL:0;ARA:14566002|7092599003|15080799006|461199028|8062599003|19110799003|8060799006|3412199025|440099028|102099032|56899033;
x-microsoft-antispam-message-info: uk2Yoe+Mkdfz2w7MSlWn5OH/xWMiEaNcoNYnt15RNtuLFitA6S2iaMUXKB1vPRbnd8l5lg/BCubtAPdbFUoGFu4nZuKW78jMXq+4GMrdGVP4QzgkX2mqu4fLbJlRSYuE3oHXj0Sv6g4ON6R865hoFCgX5r3KnBB/IzOQTdRHgLNG3YuABSOy8uSBcga1P2rQ5+wjCSRsYuu2k0atWfyENvC+1eYf7EytHV7w2L2Y8mlUy0iY/o3OqNgb10EbXkjI/z8nvDDk6fCLmxte6FThz4BMx50SfbyWMJX7RqyxYLSoWzclgZSleCXpjWnFkY7K9QmGi0OIsejrIdfFlMrj2f9+nW8Vzvv4gx6WmBA0gKAON3S4PmWax/ayo/+0BR1ZyBBDJyyR2nXYPt4dGnd9y5EMin/plwpB9NqZQgtBqRfBbxUA0dCLoVoKWq8y4TJqbXNb/KH1fu86JGNw7np5+DI9AB2yLbbgDFB/3dXRtI92E5ggTfl/WLhsM+HKvEal/Hl6NMojfIUmdIZvCzu2Toul95zdrCM/MIIDhsRHGDyd+tplR3lozFdGRg21cfA5Sk0lSnNBcczs/V/VK5Hu6FzyMcdnq1yJ2Tg7j1Br35wAwUrkXA5zZ5ptm7T0xB5+PkSIDvf8b8mi1ct3hA3HEbhR+Dg3gt84dQ8fFL5LGsACOVmKcmh1Equobd57jKrpx4aQ5ImOqkAtm92U8REKqBFZQUNkYKl5MO9UuAP6dkASbiGZEeSM1hoB6xYxjosq+mCNl/4twg7gyOP+pnV1rG3JMsnrmbpMsQsO2wjgCay3r7PHwzykxUTv2vdpd639FI6AdRD4waII8JCVf5tzsOTVqCMSoeDF7SRJpu5ZEREaa0IX2bahhM7WoJGBoG92FA6Ui/vNj/ieS/oHdxUI6uDhjwOmylHVGhD8zpGVpLAfune6BeXWpeXwDmX0plyQ0gLTgaX3qrvWewPFLlTV8mUKSP1fpNCW5EtsxRAN8HqfkDfAUPxVted7LSCfHvWjzFcUVR5fpSut3M1U26FceWY2fCbtG4wER5qmaUrChDM=
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: ZEfI5IgbY/z8yaF+TyQd17f8WhOEl5TVUSjETPnGX3l0b4rIdjMGz1GoUsBA+kmQZNCgKS2aPZ8RNIDkYTb/ufL/KdvTwkF7ZKhiCILYMhH0VW2X4aFSbZGGMJBoJa6nXiRUlN1iMRd9WuEqAzEPPmz6/bKyqMcrzYTHsfKECCyWt8ZgY+xbXRXPSmswH3QoICtjBKDfCtz2aV/BBY1espOPwTl9kT7LNEXWeEQiPPZQTHuSAZEnLrqOPOItnWE26sa48+ZYDvdM2xY8Thz3S46so0iqGrERnQ9rgU/FCK6l359jwHqKFFCHohtoytoy9qjm7xarlZpo77OSYtcTvQAa1Q6Z86Njl5hqyMQwwvPyDXzbzcUMSqGwjUPIx+tGk65lf04Zb81XiIgx2aYHu3wwbEqsiqS/zahHySrKOKuzf2yi4/GpQINs0jy6Ruc8cQMPh06JKJQZay7dqbvywPJ8WZjzNdxcPcvQZ2vQeM9BD3FsAwUITUFvlUulYKwi6/GWF9F9EUa22xuw5bzmxDGi057XfOlRDffXRqEPNz43ljhwdW8n/GvXAxLsOZx4WHNFxNxUD/U8wU2tBirJhlZYfvVhACn3U74yS/L2/tP0CtipLpPUTSH1LWADEg9RHaTSaPUgORzJxF44QJ/pciskEd1BfHudGKOUYrOpLJCkR6mQgENTCkacPd+nRI57XIKoqaEkI+/ag3TY+pQcBNIslUdlilRNgrCChdKD5/C2gx4knMfXsIUYWSpqOc7+E+kDInRkJgfUommFAb7oH9ez4zdkxj9120dIhI9GeDdfYBBRFQWkqs1pYqRmh0jJoRPPR9+FVL0tAJcoG9DVvyFYgdEpwXNTVKK8AMr+AVpdqNqfdNktZa1Ple7a6lWXgFUYmyuF4nqZJ1IMx5XufPzV4wEdvj3ro0/bbuKpuZBk0CBX79gP0zh8jde4vlAWJWAo2ppvZEBQ1FlelUW6d9MRMpkKXg1VKjj+mt3wa79uVLrKNqwgI1c3K0cc9hp4kSfSVbcR6i05ordseo98dPk2sifPYY3jnnGP8NggceCmfajDqwD0iYkjEJ5LirVBYWqLig7NORjWwi8X1hZc4enPZc4a7O+0vCZdlTZI8HO9FfuZPQYelgPcl1XYU2d1rDsBw7zgWsIIQ0AVQ1Wvh7QDR9YSakuwT5KSvQbNO/9gmf50omzRmSwPD0HsMb3pTyDu1NWF6wJwVMGPzvcOp5G+Xd1pqRqgtXTZJ8Vvujz9T7/PCnmEpUcvFjObW5pAkwWZV7YF+DfilxGzIaPkyrvLM8CC9ibvKVguwTEaptTFfUTO94tDqlORgxx+IfmD
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: sct-15-20-4755-11-msonline-outlook-3d941.templateTenant
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: PH7PR02MB9292.namprd02.prod.outlook.com
X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000
X-MS-Exchange-CrossTenant-Network-Message-Id: b74c98db-25a8-4b7d-c9f7-08dd19a8a4ba
X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000
X-MS-Exchange-CrossTenant-originalarrivaltime: 11 Dec 2024 05:57:06.4924 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR02MB8613
Message-ID-Hash: I7Y2AFTK6CNPEBTCFSCFU4ZBXBML2STW
X-Message-ID-Hash: I7Y2AFTK6CNPEBTCFSCFU4ZBXBML2STW
X-MailFrom: michael_b_jones@hotmail.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cbor.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: CBOR <cbor@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [Cbor] Re: Early allocation for packed CBOR (Re: Reminder: CBOR WG Virtual Meeting on 2024-12-11)
List-Id: "Concise Binary Object Representation (CBOR)" <cbor.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/cbor/eX0-lcO6WPdAv2PVJQmjcZIr7-U>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cbor>
List-Help: <mailto:cbor-request@ietf.org?subject=help>
List-Owner: <mailto:cbor-owner@ietf.org>
List-Post: <mailto:cbor@ietf.org>
List-Subscribe: <mailto:cbor-join@ietf.org>
List-Unsubscribe: <mailto:cbor-leave@ietf.org>

> What would be the right size then? 250 million?  220 million?

A typical draft allocating tags allocates a number that you can count on one hand.  Each such tag has a human-readable description of its purpose in the registry so people know what to use them for.

I'd suggest that a reasonable maximum number of tags for a draft to allocate for its purposes is on the order of ten.

If that's not possible for this draft to achieve that, then I suspect that the draft is somehow abusing the tag mechanism to achieve something other than the normal purpose of tags.

				-- Mike

-----Original Message-----
From: Carsten Bormann <cabo@tzi.org> 
Sent: Tuesday, December 10, 2024 9:40 PM
To: Joe Hildebrand <hildjj@cursive.net>
Cc: CBOR <cbor@ietf.org>
Subject: [Cbor] Re: Early allocation for packed CBOR (Re: Reminder: CBOR WG Virtual Meeting on 2024-12-11)

On 11. Dec 2024, at 02:57, Joe Hildebrand <hildjj@cursive.net> wrote:
> 
> I do not agree that 335 million tags, including most of the remaining 1+1 tags is worth the functionality here.

The functionality would indeed stay the same with fewer tags allocated.
What would be the right size then? 250 million?  220 million?

We are allocating a large number (1/13 of the space) of 1+4 tags (which are cheap) to ensure this mechanism doesn’t run into arbitrary limitations.  This is well worth it, so I don’t see how the absolute number of tags is important here.

The 1+1 space is much more critical, indeed.
But I don’t know why you are saying we are using up “most of the remaining 1+1 tags”.
As I wrote, there are 159 1+1 tags remaining, and the proposed allocation is one fourth of that (sorry for my slightly off math in the previous message), commensurate with the foundational importance of this mechanism.

I think we don’t have the same perception on how important the CBOR-packed mechanism is for data items that both need to limit their encoding space and stay efficiently implementable on constrained nodes (which rules out data compression like brotli or zstd).

To give just one example how CBOR-packed can be changing the landscape, look at JSON-LD, which has elevated a form of compression into the application data model by using CURIEs.  CBOR-packed is obviating the need for that.  Clipping the wings of CBOR-packed is not going to help here.

Grüße, Carsten

_______________________________________________
CBOR mailing list -- cbor@ietf.org
To unsubscribe send an email to cbor-leave@ietf.org