Re: [Cbor] Consolidated set of tags for map-like entities

Emile Cormier <emile.cormier.jr@gmail.com> Tue, 16 March 2021 18:38 UTC

Return-Path: <emile.cormier.jr@gmail.com>
X-Original-To: cbor@ietfa.amsl.com
Delivered-To: cbor@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B6EF63A0EAD for <cbor@ietfa.amsl.com>; Tue, 16 Mar 2021 11:38:59 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.096
X-Spam-Level:
X-Spam-Status: No, score=-2.096 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id eO_73AV3cxYG for <cbor@ietfa.amsl.com>; Tue, 16 Mar 2021 11:38:57 -0700 (PDT)
Received: from mail-pf1-x42b.google.com (mail-pf1-x42b.google.com [IPv6:2607:f8b0:4864:20::42b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2BAE83A0E6F for <cbor@ietf.org>; Tue, 16 Mar 2021 11:38:53 -0700 (PDT)
Received: by mail-pf1-x42b.google.com with SMTP id x21so8117667pfa.3 for <cbor@ietf.org>; Tue, 16 Mar 2021 11:38:53 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=a9SOVk3SmrxHawKy57e0ClONtODKqImvUP9Xk009qi8=; b=gLJsyfAJhODamCqBd+CFozr4D13SqmmilEoRNudGZlaoLvYI4LGT0WGBp/XW3RNw5+ jntFxbn6gfZqN6XJZESUYg5pMY5s2JvKumV8wDOzH4n8U5tky2090w0iA/mtqJKsB/DL uD3wzqd2wF7DcXKdB8Tgxa0KVU9ma9+6hTFZlQZjNoxTdBzZrYMpw0kJSVdklfeaHcN+ Cy/YTc48aCccWn63MVNqj4lbcylvzJhX6773vvXEApFLLFEmGfViqbfJwLV/0ONbB7E7 4eNK3cisyTlYapalhkQhqKntcMuQHBBAimF5+u0w1ijRYfMEfCOAqW+8lqiPXCOsIYdi AVFQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=a9SOVk3SmrxHawKy57e0ClONtODKqImvUP9Xk009qi8=; b=tIhvFx1bvJa4MpqkZmts7QkuXSRNVxOGKF/bCQEbYa5BS/ycE7UBCjhEQd12zY/0gt XlAe4j4/mtnwZDtl1ahSDaZwUbTuA5ryMUbeHx9t3JscKjz7QEsTejZcFiNOmUGPA7db Fx1yoyjavq1uZMrpC6d5lhxs5yhQ6u9tsHvmIevoJAjj7uJGWYBw/lgupxgMucqQ5FMD 8SHGKPn1aakSL9P/ur6269ikypfdJsmsg+hy+kJtN4tQXnDkvk5ZB55fec7UuL7om+dG xHS66HxzjFFFet0pdFNY5gRufYkQFqI2gFzcm+VsB+jwKaPCfmEiyzaK6EzK5K26kuLL 68EA==
X-Gm-Message-State: AOAM533ZhFJ66WHSxilu3lj2dC6BU9kYclNqIUdNZgZ52NxtK/CyGTOv Q7cPTN21POF6OeLA4FGwrGOJpvfafzzktO3xU8YespBCtyPRBA==
X-Google-Smtp-Source: ABdhPJw3lA+xkoVGzj1V0yCFgRX+FfdBv04F7dgxzTQGNwDNAB7MPLGzTmy7VtoFn3lhDnzFYTRe3i4LBKnEwlMcT+0=
X-Received: by 2002:aa7:9824:0:b029:1ef:2104:c72d with SMTP id q4-20020aa798240000b02901ef2104c72dmr847954pfl.20.1615919931614; Tue, 16 Mar 2021 11:38:51 -0700 (PDT)
MIME-Version: 1.0
References: <CAM70yxC7o3CNz67Yx3-yLt3tPQaTRaezOO99Ssa-3ppu-NwD=Q@mail.gmail.com> <d9790cc20ed6ef267e656ab7b4f8492f@mothers-arms.co.uk> <CAM70yxBifhSvsmRu3bq3ayrqqMecp2q1LORUvGcK28jujZrOfg@mail.gmail.com>
In-Reply-To: <CAM70yxBifhSvsmRu3bq3ayrqqMecp2q1LORUvGcK28jujZrOfg@mail.gmail.com>
From: Emile Cormier <emile.cormier.jr@gmail.com>
Date: Tue, 16 Mar 2021 15:38:40 -0300
Message-ID: <CAM70yxB+iDW_11p+AHWc7Njcb-jpBS99OJU+70xBw9Pe+20U1g@mail.gmail.com>
To: Kio Smallwood <kio@mothers-arms.co.uk>
Cc: cbor@ietf.org
Content-Type: multipart/alternative; boundary="000000000000826aa905bdabad92"
Archived-At: <https://mailarchive.ietf.org/arch/msg/cbor/Sjxaa8Lc9MMVmb6AoHjlTJQr5j0>
Subject: Re: [Cbor] Consolidated set of tags for map-like entities
X-BeenThere: cbor@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Concise Binary Object Representation \(CBOR\)" <cbor.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/cbor>, <mailto:cbor-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cbor/>
List-Post: <mailto:cbor@ietf.org>
List-Help: <mailto:cbor-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/cbor>, <mailto:cbor-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 16 Mar 2021 18:39:05 -0000

RFC8746 has this to say about homogeneous arrays:

Which CBOR data items constitute elements of the same application type is
> specific to the application.
>

I think this interpretation of "homogenous" should be the same for this
proposal.

On Tue, Mar 16, 2021 at 2:36 PM Emile Cormier <emile.cormier.jr@gmail.com>
wrote:

> Hi Kio,
>
> I'll add an information section on how the various tags relate to
> programming language data structures. I could start with JS and C++ data
> structures, and allow other folks to send or PR me the ones for other
> languages.
>
> For homogeneous key/values, it was actually my intention that the first
> key/value encountered "establishes" the type for the remainder. A decoder
> could reject a homogenous map where a key/value does not match the type
> established by the first.
>
> You've made me realize that the interpretation for "homogenous" could be
> tricky for numeric types. For example, if the first homogenous key is a
> positive integer, can the decoder assume that the following keys may also
> include negative integers and floats? I'll check what it says for
> homogenous arrays in https://tools.ietf.org/html/rfc8746 . It may have
> already been settled there.
>
> This also begs the question: what does "homogeneous" mean for key/value
> types that are themselves arrays or maps?
>
> Thanks for the feedback!
> Emile
>
> On Mon, Mar 15, 2021 at 4:36 PM Kio Smallwood <kio@mothers-arms.co.uk>
> wrote:
>
>> Hi Emile,
>>
>> Thanks for enumerating all of the possibilities. I have a few thoughts:
>>
>> * Would it be worth noting which programming languages and environments
>> already make use of each type? For example, users of the cbor2 python
>> library would only see tag 128 (equivalent to major type 5) tag 129, 130,
>> for ordered and multimaps, and 132 when inter-operating with
>> javascript/json. The rest would be very strange to encounter in a Python
>> datastructure.
>>
>> * For the Homogeneous keys/values, should we (codec implementers) assume
>> that the type of the first key/value encountered in the data item
>> determines the type of the remainder?
>>
>> Thanks,
>>
>> Kio
>>
>>
>> On 2021-03-12 23:50, Emile Cormier wrote:
>>
>> Hi Everyone,
>>
>> I've been corresponding privately with Prof. Bormann about a new tag I
>> proposed for encoding multimaps as arrays or pairs. He's made me aware of
>> your recent discussion about another proposed tag for encoding "ordered"
>> maps, where the insertion order must be preserved. Carsten has indicated to
>> me his desire to consolidate all of these map-related tags together.
>>
>> I would like to contribute to this endeavor of consolidating map-related
>> tags. To get the discussion started, I would like to share with you a draft
>> proposal I've written to serve as a starting point:
>> https://github.com/ecorm/cbor-map-like
>>
>> Here's a brief summary:
>>
>>
>>>
>>> This document proposes a consolidated set of CBOR tags for map-like
>>> entities involving key-value pairs. These tags encode the following
>>> meta-data concerning map-like entities:
>>>
>>>    - the homogeneity of the key and value types,
>>>    - the preservation of the insertion order of the key-value pairs,
>>>    - the uniqueness of the keys, and,
>>>    - the major type used to encode the key-value pairs.
>>>
>>>
>> My interest in CBOR stems from my work on a new C++ serialization library
>> that can support any JSON-like encoding. This library is closed source for
>> now, but I may be able to convince my employer to make it open source in
>> the future.
>>
>> I'm also involved with the WAMP protocol, which allows CBOR as one of its
>> encodings.
>>
>> I'm looking forward to collaborating with you and I hope that we can come
>> to a solution that satisfies everyone's needs.
>>
>> Cheers,
>> Emile Cormier
>>
>> _______________________________________________
>> CBOR mailing list
>> CBOR@ietf.org
>> https://www.ietf.org/mailman/listinfo/cbor
>>
>>
>>