[Cbor] Re: Early allocation for packed CBOR (Re: Reminder: CBOR WG Virtual Meeting on 2024-12-11)

Rohan Mahy <rohan.mahy@gmail.com> Wed, 11 December 2024 15:19 UTC

Return-Path: <rohan.mahy@gmail.com>
X-Original-To: cbor@ietfa.amsl.com
Delivered-To: cbor@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 12783C1840D3 for <cbor@ietfa.amsl.com>; Wed, 11 Dec 2024 07:19:07 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.106
X-Spam-Level:
X-Spam-Status: No, score=-2.106 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ycLPTN1m9HUw for <cbor@ietfa.amsl.com>; Wed, 11 Dec 2024 07:19:06 -0800 (PST)
Received: from mail-ed1-x52b.google.com (mail-ed1-x52b.google.com [IPv6:2a00:1450:4864:20::52b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 8DC81C169424 for <cbor@ietf.org>; Wed, 11 Dec 2024 07:19:06 -0800 (PST)
Received: by mail-ed1-x52b.google.com with SMTP id 4fb4d7f45d1cf-5d27243ba8bso10391728a12.2 for <cbor@ietf.org>; Wed, 11 Dec 2024 07:19:06 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733930345; x=1734535145; darn=ietf.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=pVH1ST7Ajz/38IvYHqPVdNRjM6zOc10kJk8pnEeu24E=; b=KQSF7dhsoIcxGCDv8AOymXOZ+3PLUhCe4aDRCes6qX1pYiGSL3zBj2sDNgKNRznGTx QXTi1dKqdyb6XsJhakPIS78jyaFuvzmKXsR7s9czJGbXHBwc9JsOc3Nnyir4ndemDd/v 7BYG8511rfjxfvcy4YziEruMG8ofYp/X5FLANSXg0ZbGOpjixzXZYbXW1DQJCBPEBe/v vNp9cchQ1enjNFr6cDNmGz1Mj1IdpwSMw3+U/lGSfSuNT7RA1KiQ4jEMYbngNk4M8M/Y HmmXUj7JCF1yPCtHz4vP0quh0Fsu4Y+5FcXQsQMSI0X+bq5Y8a262+1ZzK/nwxBrgHJH 8DCg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733930345; x=1734535145; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=pVH1ST7Ajz/38IvYHqPVdNRjM6zOc10kJk8pnEeu24E=; b=eceBOyZAViVABKa+gCGZ4HRJy7oJLqb7lUKDaOEAv7i/q96rMimTS9uzuQvidN2r6c Mo0GBacHe0FI36qpcsAJk7c/M3laI0ALv7SvJjxqw2iwDbib/AOBKteiQByUHv+GU79n q8AhOQm+RyzXXLDwoyidw4S2eun4Z8qBJ3yhn0WthncYsED7HfV5kLYlmQapELqjzXlW aggMfN5kfWudN860gIhO+jGqVOMwtULjhSMxpfzsB463+CycYj4R3EGLpSgtGJETVHyD PtedsDZQa5QUt+utWIt6uanLifBKhpw+b+IYPQ06n1skYe2Ftb6/gAt+GwqzT5bsNfpu +Uyg==
X-Forwarded-Encrypted: i=1; AJvYcCUNWA8nbLO93XQTA/BesUReNoJGziffSxqajMK2hYeiZqXJiERhOfLQ5h+iUavxJwLSyazN@ietf.org
X-Gm-Message-State: AOJu0YzZORL65qJjj8gsOWqIqtKMe6gBVpwQFIels2563iAo2w1ZAOBn LuZV3MCF5toJB1tfCV58d1RqUh7twX8YA9vo6uEyalhqb7fEuLmUNW0moH6XYSdCojUDr5umDta NoS/4U6cT6LJJ9m0K/1+g3IiO9meF+PY6
X-Gm-Gg: ASbGncv/W1MoIC3PLEz1J7UVsd++wETRq3jKlqK7O2hC+8F1MrVZ0b9+bG28hjtOS+7 Ai89QLRRKJuizMv3T4mfK+0N/CEc/3z0b/xrgCDo19RB1IpTJvQ/PIIJJ5Ab6RDI/SKku0MCT
X-Google-Smtp-Source: AGHT+IGxhIUBlfqSCT414Wh338uMM/5YUbGPccx8gHL520PLkSMV6ueff4l/Y8QTCnc7qAcD606Que3NZv/DB+fRAIY=
X-Received: by 2002:a05:6402:34c1:b0:5d3:e8d1:a43 with SMTP id 4fb4d7f45d1cf-5d43315209amr3004925a12.27.1733930344862; Wed, 11 Dec 2024 07:19:04 -0800 (PST)
MIME-Version: 1.0
References: <CALaySJKDFscUBGw4CPspXJvUTkXywVHc_FrmhO3ybBWTrwjGXw@mail.gmail.com> <CALaySJJ8-M9x8irtmF2pfDE3GRXU1am9n2a3XeDcmPT+kww+KA@mail.gmail.com> <CALaySJKTQT_9CC-wVVd+fY1NYJ73M8CP22hn=rWrFeTJSJDEsA@mail.gmail.com> <CALaySJKG3oagg6ffLTx8LgvLvnjHHA2DMGgY74E0q=rReAc4PA@mail.gmail.com> <CALaySJLtUR1=G_WH4H+zoJ5LCrHjBgEf1oW104zDtFQighY+gg@mail.gmail.com> <CALaySJLnKxU9m3BNPq4XayrSrorRBG2vuBz1AF-CsEBoSZe7Xg@mail.gmail.com> <CALaySJKaz7C=GN5E=saiDY4KxL+9xCfM0ocZuMStEQ96FnQ4KA@mail.gmail.com> <CALaySJJEXkey9vLAp8VqDXmPsWpxiWN9jjtVnGio1nMQ4K+mDQ@mail.gmail.com> <CALaySJJfc+tET4Vm5UQjHPK5mf61O0iR-1i6=X32CYtWxZLWTQ@mail.gmail.com> <CALaySJKdrk7aPzhT=kbE1B8pq1EBw74nmx_peSJMAoHsG5jyVQ@mail.gmail.com> <CALaySJ+fWX4zEnE5v-Q9R6eCv=kSJjnc-fsXL5PGPgac1GJAcA@mail.gmail.com> <B807C9D3-39A4-4024-BC1D-85DD84EA1735@tzi.org> <DFE56705-CCDD-4172-B577-C873E3DB4898@tzi.org> <5FEA5C07-4A39-4B58-B2AE-F261D111FCE6@cursive.net> <D0618F67-4868-4745-A526-F73DF1A98E1B@tzi.org> <98C6BEDA-C4B2-4657-ABE2-19FE637CE782@cursive.net> <2A875D49-DD88-42D9-969D-0841A6B41F95@tzi.org>
In-Reply-To: <2A875D49-DD88-42D9-969D-0841A6B41F95@tzi.org>
From: Rohan Mahy <rohan.mahy@gmail.com>
Date: Wed, 11 Dec 2024 07:18:53 -0800
Message-ID: <CAKoiRuYJZN=h2Qtw1MPMrVTTGS56iBixiOcB8+qHt4jhgXbs5g@mail.gmail.com>
To: Carsten Bormann <cabo@tzi.org>
Content-Type: multipart/alternative; boundary="000000000000455a9c0629001e95"
Message-ID-Hash: FBUGGBT2AR4IYZKEGSLI3OMIMW2EIPGI
X-Message-ID-Hash: FBUGGBT2AR4IYZKEGSLI3OMIMW2EIPGI
X-MailFrom: rohan.mahy@gmail.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cbor.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: Joe Hildebrand <hildjj@cursive.net>, CBOR <cbor@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [Cbor] Re: Early allocation for packed CBOR (Re: Reminder: CBOR WG Virtual Meeting on 2024-12-11)
List-Id: "Concise Binary Object Representation (CBOR)" <cbor.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/cbor/s_rvu-iKj8xIjyBpJBNS2P3i2Kc>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cbor>
List-Help: <mailto:cbor-request@ietf.org?subject=help>
List-Owner: <mailto:cbor-owner@ietf.org>
List-Post: <mailto:cbor@ietf.org>
List-Subscribe: <mailto:cbor-join@ietf.org>
List-Unsubscribe: <mailto:cbor-leave@ietf.org>

I agree with Joe on this one.

> What would be the right size then? 250 million?  220 million?
How many 1+1 tags and 1+2 tags should you be able to consume?  *FIVE* per
RFC seems like a reasonable limit. I have no objection to allocating as
many 1+4 or 1+8 tags as you'd like.

Thanks,
-rohan

On Tue, Dec 10, 2024 at 9:40 PM Carsten Bormann <cabo@tzi.org> wrote:

> On 11. Dec 2024, at 02:57, Joe Hildebrand <hildjj@cursive.net> wrote:
> >
> > I do not agree that 335 million tags, including most of the remaining
> 1+1 tags is worth the functionality here.
>
> The functionality would indeed stay the same with fewer tags allocated.
> What would be the right size then? 250 million?  220 million?
>
> We are allocating a large number (1/13 of the space) of 1+4 tags (which
> are cheap) to ensure this mechanism doesn’t run into arbitrary
> limitations.  This is well worth it, so I don’t see how the absolute number
> of tags is important here.
>
> The 1+1 space is much more critical, indeed.
> But I don’t know why you are saying we are using up “most of the remaining
> 1+1 tags”.
> As I wrote, there are 159 1+1 tags remaining, and the proposed allocation
> is one fourth of that (sorry for my slightly off math in the previous
> message), commensurate with the foundational importance of this mechanism.
>
> I think we don’t have the same perception on how important the CBOR-packed
> mechanism is for data items that both need to limit their encoding space
> and stay efficiently implementable on constrained nodes (which rules out
> data compression like brotli or zstd).
>
> To give just one example how CBOR-packed can be changing the landscape,
> look at JSON-LD, which has elevated a form of compression into the
> application data model by using CURIEs.  CBOR-packed is obviating the need
> for that.  Clipping the wings of CBOR-packed is not going to help here.
>
> Grüße, Carsten
>
> _______________________________________________
> CBOR mailing list -- cbor@ietf.org
> To unsubscribe send an email to cbor-leave@ietf.org
>