Re: [Cbor] Consolidated set of tags for map-like entities

Emile Cormier <emile.cormier.jr@gmail.com> Tue, 16 March 2021 17:37 UTC

Return-Path: <emile.cormier.jr@gmail.com>
X-Original-To: cbor@ietfa.amsl.com
Delivered-To: cbor@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3B3893A14FB for <cbor@ietfa.amsl.com>; Tue, 16 Mar 2021 10:37:00 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id EsaxCzEJu7rx for <cbor@ietfa.amsl.com>; Tue, 16 Mar 2021 10:36:58 -0700 (PDT)
Received: from mail-pj1-x102f.google.com (mail-pj1-x102f.google.com [IPv6:2607:f8b0:4864:20::102f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 49A6C3A14FD for <cbor@ietf.org>; Tue, 16 Mar 2021 10:36:58 -0700 (PDT)
Received: by mail-pj1-x102f.google.com with SMTP id gb6so11015442pjb.0 for <cbor@ietf.org>; Tue, 16 Mar 2021 10:36:58 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=swQboihZcMb71kED4SaXNs6pv+rC4d2minb4c6BzpxE=; b=j7iEXKgN4aEVaioPPbhPW9ZUmPg4nI8nl0x6lE9gHVmJnztnrVqOUxlF8BioBuF13A YBBfiEcpWLXnSeNRmR1hpLwoGs1L7z/TG0U7bteBLXzcjUYdLLbbFmE2PDlaUavv4lb2 KxpfBLRh71ySw/QP5MoKTTkYh7I4gGnyOdKL3ao9azA+cH+TJbvr4IXvyZKTNBIFKWwy RZChxeuUr1QfGPXrrHWzBBKDulw8mBBwlum/3vJlSQa/lT45sBHzAQnI3YkMdsuPS6Vy Qv4cyErHANlHo5niE3z6uG6IBq9u41hOn8RVCFMBfeaUV/5Uf91ZaH2EWFUidBAstS2h GqOA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=swQboihZcMb71kED4SaXNs6pv+rC4d2minb4c6BzpxE=; b=aMPs1Rt767VGdP49/RWWz3yEg8JyEuD64n+duVZWNs0gTr+183i8rLOHNN/nW4EF2R ConiU1L6sc5T2RbXF0F0W5drViN9cd9YwwUvtLpkUou5PO3Bgqop7nM/RYY2Nqao5iR6 KqW0FRUrOSH3XXvm2usKp1TLPQsLshdDAov7HfMxkHTVp2tzKAthuzUsOY8uk9+d5T0G tqyfKMjQp/GLcHEQaJif28ffGdTioK0otti+xJC9Ky77bNtayHV/v+4Dd5hyVFZpU/pn Gghbr4aMBTRZ4Gf/1yOM5jW1xAE4Qf4IhSFyAHK/1rK3bM4R2TFSS1Yp9G7eaCp3Td/Q wXPg==
X-Gm-Message-State: AOAM531FlnKJpRzudESz1h1pIglus+2ARplcvgT09qDSAm0Ld+qvUh2J Ir/80W1cEpSmk1rlnL6Xe1mrHLVZv7hmlzNHpOVnG0fgqLJzeA==
X-Google-Smtp-Source: ABdhPJwJnw9Tc3/NbOnPSHnamiK+8DZcBOygoomSzVhhGd7Se8CMby2HaJblscVSqq3oCO6NPyZjNZo3FauKVct2Hpc=
X-Received: by 2002:a17:902:4c:b029:e6:6cb9:9153 with SMTP id 70-20020a170902004cb02900e66cb99153mr514055pla.32.1615916216852; Tue, 16 Mar 2021 10:36:56 -0700 (PDT)
MIME-Version: 1.0
References: <CAM70yxC7o3CNz67Yx3-yLt3tPQaTRaezOO99Ssa-3ppu-NwD=Q@mail.gmail.com> <d9790cc20ed6ef267e656ab7b4f8492f@mothers-arms.co.uk>
In-Reply-To: <d9790cc20ed6ef267e656ab7b4f8492f@mothers-arms.co.uk>
From: Emile Cormier <emile.cormier.jr@gmail.com>
Date: Tue, 16 Mar 2021 14:36:45 -0300
Message-ID: <CAM70yxBifhSvsmRu3bq3ayrqqMecp2q1LORUvGcK28jujZrOfg@mail.gmail.com>
To: Kio Smallwood <kio@mothers-arms.co.uk>
Cc: cbor@ietf.org
Content-Type: multipart/alternative; boundary="00000000000017a6f105bdaad00e"
Archived-At: <https://mailarchive.ietf.org/arch/msg/cbor/Di7dfGBJLaYyNKYDMUSIkUN_fO0>
Subject: Re: [Cbor] Consolidated set of tags for map-like entities
X-BeenThere: cbor@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Concise Binary Object Representation \(CBOR\)" <cbor.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/cbor>, <mailto:cbor-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cbor/>
List-Post: <mailto:cbor@ietf.org>
List-Help: <mailto:cbor-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/cbor>, <mailto:cbor-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 16 Mar 2021 17:37:00 -0000

Hi Kio,

I'll add an information section on how the various tags relate to
programming language data structures. I could start with JS and C++ data
structures, and allow other folks to send or PR me the ones for other
languages.

For homogeneous key/values, it was actually my intention that the first
key/value encountered "establishes" the type for the remainder. A decoder
could reject a homogenous map where a key/value does not match the type
established by the first.

You've made me realize that the interpretation for "homogenous" could be
tricky for numeric types. For example, if the first homogenous key is a
positive integer, can the decoder assume that the following keys may also
include negative integers and floats? I'll check what it says for
homogenous arrays in https://tools.ietf.org/html/rfc8746 . It may have
already been settled there.

This also begs the question: what does "homogeneous" mean for key/value
types that are themselves arrays or maps?

Thanks for the feedback!
Emile

On Mon, Mar 15, 2021 at 4:36 PM Kio Smallwood <kio@mothers-arms.co.uk>
wrote:

> Hi Emile,
>
> Thanks for enumerating all of the possibilities. I have a few thoughts:
>
> * Would it be worth noting which programming languages and environments
> already make use of each type? For example, users of the cbor2 python
> library would only see tag 128 (equivalent to major type 5) tag 129, 130,
> for ordered and multimaps, and 132 when inter-operating with
> javascript/json. The rest would be very strange to encounter in a Python
> datastructure.
>
> * For the Homogeneous keys/values, should we (codec implementers) assume
> that the type of the first key/value encountered in the data item
> determines the type of the remainder?
>
> Thanks,
>
> Kio
>
>
> On 2021-03-12 23:50, Emile Cormier wrote:
>
> Hi Everyone,
>
> I've been corresponding privately with Prof. Bormann about a new tag I
> proposed for encoding multimaps as arrays or pairs. He's made me aware of
> your recent discussion about another proposed tag for encoding "ordered"
> maps, where the insertion order must be preserved. Carsten has indicated to
> me his desire to consolidate all of these map-related tags together.
>
> I would like to contribute to this endeavor of consolidating map-related
> tags. To get the discussion started, I would like to share with you a draft
> proposal I've written to serve as a starting point:
> https://github.com/ecorm/cbor-map-like
>
> Here's a brief summary:
>
>
>>
>> This document proposes a consolidated set of CBOR tags for map-like
>> entities involving key-value pairs. These tags encode the following
>> meta-data concerning map-like entities:
>>
>>    - the homogeneity of the key and value types,
>>    - the preservation of the insertion order of the key-value pairs,
>>    - the uniqueness of the keys, and,
>>    - the major type used to encode the key-value pairs.
>>
>>
> My interest in CBOR stems from my work on a new C++ serialization library
> that can support any JSON-like encoding. This library is closed source for
> now, but I may be able to convince my employer to make it open source in
> the future.
>
> I'm also involved with the WAMP protocol, which allows CBOR as one of its
> encodings.
>
> I'm looking forward to collaborating with you and I hope that we can come
> to a solution that satisfies everyone's needs.
>
> Cheers,
> Emile Cormier
>
> _______________________________________________
> CBOR mailing list
> CBOR@ietf.org
> https://www.ietf.org/mailman/listinfo/cbor
>
>
>