[Cbor] Re: cbor.me issue with indefinite form round-trips

Carsten Bormann <cabo@tzi.org> Tue, 13 August 2024 19:15 UTC

Return-Path: <cabo@tzi.org>
X-Original-To: cbor@ietfa.amsl.com
Delivered-To: cbor@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D9F2CC14F695 for <cbor@ietfa.amsl.com>; Tue, 13 Aug 2024 12:15:32 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.895
X-Spam-Level:
X-Spam-Status: No, score=-1.895 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, T_SPF_TEMPERROR=0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id w2mZJDXqSsEf for <cbor@ietfa.amsl.com>; Tue, 13 Aug 2024 12:15:27 -0700 (PDT)
Received: from smtp.zfn.uni-bremen.de (smtp.zfn.uni-bremen.de [IPv6:2001:638:708:32::21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E92BAC14F60B for <cbor@ietf.org>; Tue, 13 Aug 2024 12:15:24 -0700 (PDT)
Received: from smtpclient.apple (p5dc5d809.dip0.t-ipconnect.de [93.197.216.9]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.zfn.uni-bremen.de (Postfix) with ESMTPSA id 4Wk1LJ3DW4zDCdG; Tue, 13 Aug 2024 21:15:20 +0200 (CEST)
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3776.700.51\))
From: Carsten Bormann <cabo@tzi.org>
In-Reply-To: <70de4556b1fa40a28eb01779cf96dd54@jhuapl.edu>
Date: Tue, 13 Aug 2024 21:15:09 +0200
Content-Transfer-Encoding: quoted-printable
Message-Id: <8E56EFEE-CBEC-4424-952A-2F00FBC4A194@tzi.org>
References: <70de4556b1fa40a28eb01779cf96dd54@jhuapl.edu>
To: "Sipos, Brian J." <Brian.Sipos@jhuapl.edu>
X-Mailer: Apple Mail (2.3776.700.51)
Message-ID-Hash: XKU6L5JSTIOEXEQOQSVZPKJPGDMEN6OM
X-Message-ID-Hash: XKU6L5JSTIOEXEQOQSVZPKJPGDMEN6OM
X-MailFrom: cabo@tzi.org
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cbor.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: "cbor@ietf.org" <cbor@ietf.org>
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [Cbor] Re: cbor.me issue with indefinite form round-trips
List-Id: "Concise Binary Object Representation (CBOR)" <cbor.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/cbor/KovJ9zOR4mCB3qi5YYSqoGZy3zw>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cbor>
List-Help: <mailto:cbor-request@ietf.org?subject=help>
List-Owner: <mailto:cbor-owner@ietf.org>
List-Post: <mailto:cbor@ietf.org>
List-Subscribe: <mailto:cbor-join@ietf.org>
List-Unsubscribe: <mailto:cbor-leave@ietf.org>

Hi Brian,

> On 13. Aug 2024, at 20:39, Sipos, Brian J. <Brian.Sipos@jhuapl.edu> wrote:
> 
> All,
> I can’t find any specific issue tracker associated with the https://cbor.me site, so I’m posting in this list because I know some maintainers also read this list.

They do :-)

> Please let me know if there is a specific issue tracker that I should be submitting to instead.

The site weakly points to the cbor.io <http://cbor.io/> issue tracker; maybe the weakness of that reference should be fixed at some point.

>  I recently ran into an issue where the decoder does not properly indicate EDN for indefinite length containers even though the encoder does properly handle them. This means the tool will not fully round-trip indefinite form of arrays and maps which makes dealing with some structures more complicated than it seems like it should be.
>  For example, these inputs will encode properly but then going back to decoding will remove the indefinite-length indicating underscore:
> [_1,2]
> {_1:2}
>  I think this tool is great to have and would like to see this little discrepancy fixed.

The site pretty much still runs on its 2013 code base (which will turn eleven in a couple of days…).
The plan was to wait for draft-ietf-cbor-edn-literals to be approved and then to replace the current guts by ones based on the ABNF in that document.
(Those guts are already available in part in the edn-abnf gem so we have a prototype to work with, but integration into cbor.me <http://cbor.me/> is an outstanding step.)
I had planned to do this earlier, and I was now hoping I could finish this in August while many other things are in a lull in Europe.
I now have no idea when we can finish the current phase of (insert your euphemism here).

But, yes, the plan is to get there.

Grüße, Carsten