IETF Logo Mail Archive

[Cbor] Re: dCBOR: Normalization of Strings

Carsten Bormann <cabo@tzi.org> Mon, 29 July 2024 07:56 UTC

Return-Path: <cabo@tzi.org>
X-Original-To: cbor@ietfa.amsl.com
Delivered-To: cbor@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 806EDC14F6E4 for <cbor@ietfa.amsl.com>; Mon, 29 Jul 2024 00:56:32 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.907
X-Spam-Level:
X-Spam-Status: No, score=-1.907 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9xP6Noq0o6rC for <cbor@ietfa.amsl.com>; Mon, 29 Jul 2024 00:56:28 -0700 (PDT)
Received: from smtp.zfn.uni-bremen.de (smtp.zfn.uni-bremen.de [IPv6:2001:638:708:32::21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 89261C151076 for <cbor@ietf.org>; Mon, 29 Jul 2024 00:56:27 -0700 (PDT)
Received: from [192.168.217.145] (p5dc5d6c5.dip0.t-ipconnect.de [93.197.214.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.zfn.uni-bremen.de (Postfix) with ESMTPSA id 4WXVzr11DfzDCc6; Mon, 29 Jul 2024 09:56:24 +0200 (CEST)
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.7\))
From: Carsten Bormann <cabo@tzi.org>
In-Reply-To: <E8325093-F005-4A56-8AFB-9C1637E19EA4@wolfmcnally.com>
Date: Mon, 29 Jul 2024 09:56:23 +0200
X-Mao-Original-Outgoing-Id: 743932583.022916-793c5ca431d5af82f9562261ed204e2e
Content-Transfer-Encoding: quoted-printable
Message-Id: <EF88C843-A1DF-41FA-B25F-AFDC3CA41377@tzi.org>
References: <E8325093-F005-4A56-8AFB-9C1637E19EA4@wolfmcnally.com>
To: Wolf McNally <wolf@wolfmcnally.com>
X-Mailer: Apple Mail (2.3608.120.23.2.7)
Message-ID-Hash: TKSOKVCYBU2PNA4NN6DEUS6ENJ3HJTMC
X-Message-ID-Hash: TKSOKVCYBU2PNA4NN6DEUS6ENJ3HJTMC
X-MailFrom: cabo@tzi.org
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cbor.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: CBOR <cbor@ietf.org>, Christopher Allen <christophera@lifewithalacrity.com>, Shannon Appelcline <shannon.appelcline@gmail.com>
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [Cbor] Re: dCBOR: Normalization of Strings
List-Id: "Concise Binary Object Representation (CBOR)" <cbor.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/cbor/Jrin4i9d6PaY3WFp0UNuTLPPcOs>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cbor>
List-Help: <mailto:cbor-request@ietf.org?subject=help>
List-Owner: <mailto:cbor-owner@ietf.org>
List-Post: <mailto:cbor@ietf.org>
List-Subscribe: <mailto:cbor-join@ietf.org>
List-Unsubscribe: <mailto:cbor-leave@ietf.org>

On 2024-07-29, at 06:39, Wolf McNally <wolf@wolfmcnally.com> wrote:
> 
> • Encoders MUST only serialize text strings that are in Unicode Normalization Form C (NFC). [2]
> • Decoders MUST require that deserialized text strings are in NFC.

I believe these are good additions to dCBOR.

Note that “normalize everything” is no longer the preferred way to operate with Unicode text [1].  However, with the overriding goal of deterministic representation in mind, going for NFC throughout is probably the right decision.

Grüße, Carsten


[1]: https://www.ietf.org/archive/id/draft-bormann-dispatch-modern-network-unicode-04.html#name-normalization

v2.37.1 | Report a Bug | By Email | System Status