[Cbor] Re: Early allocation for packed CBOR (Re: Reminder: CBOR WG Virtual Meeting on 2024-12-11)

Joe Hildebrand <hildjj@cursive.net> Wed, 11 December 2024 06:05 UTC

Return-Path: <hildjj@cursive.net>
X-Original-To: cbor@ietfa.amsl.com
Delivered-To: cbor@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0A563C18DB85 for <cbor@ietfa.amsl.com>; Tue, 10 Dec 2024 22:05:26 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.105
X-Spam-Level:
X-Spam-Status: No, score=-2.105 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cursive.net
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id bEx_1sUkdnZY for <cbor@ietfa.amsl.com>; Tue, 10 Dec 2024 22:05:22 -0800 (PST)
Received: from mail-il1-x129.google.com (mail-il1-x129.google.com [IPv6:2607:f8b0:4864:20::129]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 044DBC1840F9 for <cbor@ietf.org>; Tue, 10 Dec 2024 22:05:21 -0800 (PST)
Received: by mail-il1-x129.google.com with SMTP id e9e14a558f8ab-3a9cb667783so20131725ab.1 for <cbor@ietf.org>; Tue, 10 Dec 2024 22:05:21 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cursive.net; s=google; t=1733897121; x=1734501921; darn=ietf.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=bvYzuCZx0LlIT8cJQlvK/6SPbVzKvfLZOgzyy8pZOi4=; b=DDWYWSJLxgQLnQmhydTw2KutvwsxJ8IZ3UigStOO4c7XVi3IGncwHUpC3hsHdpvm7Q G/73t/U4oErrWybGDo6pkiKLbbwRBtN2zRGioKcbzmoSU0UV1ZCjxe8Fxv4GejMPUNkh 841W7Gmjq42suPSWJu8riyntCjDB1F9dsg26o=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733897121; x=1734501921; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=bvYzuCZx0LlIT8cJQlvK/6SPbVzKvfLZOgzyy8pZOi4=; b=BlDuttp9icfvH8QZ1ZFLn/a2P5I4Gl1U0XEala+3NiGha5nUqxwd2mBew2189UOfsX T4qEcpdNRG6SYKbZnLitzzPicPNA+3vp23cMfScKO+jlKJw9GknO8TvCznVXxId5HfYX JD+j+GHGMYNXriIF3LNljmMpreifcd1qI+yxDYDJVh944K9GwGCsqP+a4Zj+Lb86QLuM +sgWf0cEzHpJuvGFD8KpTgR6LXBGftVQiYd8/xRP9bokkraZHB9QgUOxA2hEfEZ+kfhR lVVdlGnCYlB3qRO+x+HAZJjRxWBjDCwoXxm5l+n1CUu7GsI1NO+iq2GAkhiWj+pefb1+ YYCg==
X-Forwarded-Encrypted: i=1; AJvYcCX5tgPlEcYydNKI4Ll8TuCyCpgp14A/f10nW7y60GpACMX3K5FpAMXlPCGebPQ7PuBk5Hss@ietf.org
X-Gm-Message-State: AOJu0Yz7brhWAncM1EaZUWbQLgqQF+98VpJkOI/PUhgDFZk41umhC/A+ dPh/EN0OIQDVE6gJKK43R5KFQG5rFQsvAr1Fa7RBtYpwf6XViz0c5v1b6xhul4sL0cFuhBwV8Qw =
X-Gm-Gg: ASbGncsdOrkbd0MPEjfucPJYSNGOGxxYbxoku5KdIRcqeKjy1hWyt7L2RJWQlvBJm9J NjvbtdJqv6GbZwH9+cpSYC3rpwizzHPqROI/y+WCUIEFdlcL0EeMfT02xtTGV6SZ3IdojWAzLnZ Zbk6iTpNtjFtEvdvMw7UODEonYl+pdWLmzXWHyDH9QofuWwLmms1BXKb0CRBhreKcujd6N5xY4A saVsQ1Atpq18TfCwUaKdjfDz+KvYHrtrmmApaMV8joj/I4uOZ4wHV0T5u6b/EQW4dig8N6aIvOo fDw=
X-Google-Smtp-Source: AGHT+IH33K/GX/MIP5ZnH/9t+o/HHWoghqVisohftYgzQtv/aEIatz/SE54CCf11YeYbn4LbHRUiqg==
X-Received: by 2002:a92:c545:0:b0:3a7:e3e3:bd57 with SMTP id e9e14a558f8ab-3aa08f65e80mr20704845ab.15.1733897121064; Tue, 10 Dec 2024 22:05:21 -0800 (PST)
Received: from smtpclient.apple ([2601:282:2181:450f:4456:700a:d785:32aa]) by smtp.gmail.com with ESMTPSA id e9e14a558f8ab-3a808e1e29esm37330675ab.56.2024.12.10.22.05.18 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 10 Dec 2024 22:05:19 -0800 (PST)
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.200.121\))
From: Joe Hildebrand <hildjj@cursive.net>
In-Reply-To: <PH7PR02MB92920676E8817271E547F82FB73E2@PH7PR02MB9292.namprd02.prod.outlook.com>
Date: Tue, 10 Dec 2024 23:05:08 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <5FBB4831-3E96-44E3-A2AA-B2D83B6C1B05@cursive.net>
References: <CALaySJKDFscUBGw4CPspXJvUTkXywVHc_FrmhO3ybBWTrwjGXw@mail.gmail.com> <CALaySJJ8-M9x8irtmF2pfDE3GRXU1am9n2a3XeDcmPT+kww+KA@mail.gmail.com> <CALaySJKTQT_9CC-wVVd+fY1NYJ73M8CP22hn=rWrFeTJSJDEsA@mail.gmail.com> <CALaySJKG3oagg6ffLTx8LgvLvnjHHA2DMGgY74E0q=rReAc4PA@mail.gmail.com> <CALaySJLtUR1=G_WH4H+zoJ5LCrHjBgEf1oW104zDtFQighY+gg@mail.gmail.com> <CALaySJLnKxU9m3BNPq4XayrSrorRBG2vuBz1AF-CsEBoSZe7Xg@mail.gmail.com> <CALaySJKaz7C=GN5E=saiDY4KxL+9xCfM0ocZuMStEQ96FnQ4KA@mail.gmail.com> <CALaySJJEXkey9vLAp8VqDXmPsWpxiWN9jjtVnGio1nMQ4K+mDQ@mail.gmail.com> <CALaySJJfc+tET4Vm5UQjHPK5mf61O0iR-1i6=X32CYtWxZLWTQ@mail.gmail.com> <CALaySJKdrk7aPzhT=kbE1B8pq1EBw74nmx_peSJMAoHsG5jyVQ@mail.gmail.com> <CALaySJ+fWX4zEnE5v-Q9R6eCv=kSJjnc-fsXL5PGPgac1GJAcA@mail.gmail.com> <B807C9D3-39A4-4024-BC1D-85DD84EA1735@tzi.org> <DFE56705-CCDD-4172-B577-C873E3DB4898@tzi.org> <5FEA5C07-4A39-4B58-B2AE-F261D111FCE6@cursive.net> <D0618F67-4868-4745-A526-F73DF1A98E1B@tzi.org> <98C6BEDA-C4B2-4657-ABE2-19FE637CE782@cursive.net> <2A875D49-DD88-42D9-969D-0841A6B41F95@tzi.org> <PH7PR02MB92920676E8817271E547F82FB73E2@PH7PR02MB9292.namprd02.prod.outlook.com>
To: Michael Jones <michael_b_jones@hotmail.com>
X-Mailer: Apple Mail (2.3826.200.121)
Message-ID-Hash: BH5X3FKXI3HNWVM62MVFHNVXSG3DLVSU
X-Message-ID-Hash: BH5X3FKXI3HNWVM62MVFHNVXSG3DLVSU
X-MailFrom: hildjj@cursive.net
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cbor.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: Carsten Bormann <cabo@tzi.org>, CBOR <cbor@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [Cbor] Re: Early allocation for packed CBOR (Re: Reminder: CBOR WG Virtual Meeting on 2024-12-11)
List-Id: "Concise Binary Object Representation (CBOR)" <cbor.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/cbor/1YZddksQ5p0k47NTTaxu8KAFmRg>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cbor>
List-Help: <mailto:cbor-request@ietf.org?subject=help>
List-Owner: <mailto:cbor-owner@ietf.org>
List-Post: <mailto:cbor@ietf.org>
List-Subscribe: <mailto:cbor-join@ietf.org>
List-Unsubscribe: <mailto:cbor-leave@ietf.org>

Agree.  RFC 8746 is I think the previous record-holder, I think, at 27, and I still think it should have been handled with at most 4 tags.

Short arrays are really cheap in CBOR.

— 
Joe Hildebrand

> On Dec 10, 2024, at 10:57 PM, Michael Jones <michael_b_jones@hotmail.com> wrote:
> 
>> What would be the right size then? 250 million?  220 million?
> 
> A typical draft allocating tags allocates a number that you can count on one hand.  Each such tag has a human-readable description of its purpose in the registry so people know what to use them for.
> 
> I'd suggest that a reasonable maximum number of tags for a draft to allocate for its purposes is on the order of ten.
> 
> If that's not possible for this draft to achieve that, then I suspect that the draft is somehow abusing the tag mechanism to achieve something other than the normal purpose of tags.
> 
> -- Mike
> 
> -----Original Message-----
> From: Carsten Bormann <cabo@tzi.org> 
> Sent: Tuesday, December 10, 2024 9:40 PM
> To: Joe Hildebrand <hildjj@cursive.net>
> Cc: CBOR <cbor@ietf.org>
> Subject: [Cbor] Re: Early allocation for packed CBOR (Re: Reminder: CBOR WG Virtual Meeting on 2024-12-11)
> 
> On 11. Dec 2024, at 02:57, Joe Hildebrand <hildjj@cursive.net> wrote:
>> 
>> I do not agree that 335 million tags, including most of the remaining 1+1 tags is worth the functionality here.
> 
> The functionality would indeed stay the same with fewer tags allocated.
> What would be the right size then? 250 million?  220 million?
> 
> We are allocating a large number (1/13 of the space) of 1+4 tags (which are cheap) to ensure this mechanism doesn’t run into arbitrary limitations.  This is well worth it, so I don’t see how the absolute number of tags is important here.
> 
> The 1+1 space is much more critical, indeed.
> But I don’t know why you are saying we are using up “most of the remaining 1+1 tags”.
> As I wrote, there are 159 1+1 tags remaining, and the proposed allocation is one fourth of that (sorry for my slightly off math in the previous message), commensurate with the foundational importance of this mechanism.
> 
> I think we don’t have the same perception on how important the CBOR-packed mechanism is for data items that both need to limit their encoding space and stay efficiently implementable on constrained nodes (which rules out data compression like brotli or zstd).
> 
> To give just one example how CBOR-packed can be changing the landscape, look at JSON-LD, which has elevated a form of compression into the application data model by using CURIEs.  CBOR-packed is obviating the need for that.  Clipping the wings of CBOR-packed is not going to help here.
> 
> Grüße, Carsten
> 
> _______________________________________________
> CBOR mailing list -- cbor@ietf.org
> To unsubscribe send an email to cbor-leave@ietf.org