Re: [precis] Category changes with Unicode 6.3

"Martin J. Dürst" <duerst@it.aoyama.ac.jp> Wed, 16 October 2013 07:05 UTC

Return-Path: <duerst@it.aoyama.ac.jp>
X-Original-To: precis@ietfa.amsl.com
Delivered-To: precis@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A616F21F9A65 for <precis@ietfa.amsl.com>; Wed, 16 Oct 2013 00:05:33 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -104.641
X-Spam-Level:
X-Spam-Status: No, score=-104.641 tagged_above=-999 required=5 tests=[AWL=1.149, BAYES_00=-2.599, GB_I_LETTER=-2, HELO_EQ_JP=1.244, HOST_EQ_JP=1.265, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id DFhdEhAX8BsW for <precis@ietfa.amsl.com>; Wed, 16 Oct 2013 00:05:22 -0700 (PDT)
Received: from scintmta02.scbb.aoyama.ac.jp (scintmta02.scbb.aoyama.ac.jp [133.2.253.34]) by ietfa.amsl.com (Postfix) with ESMTP id 7294F11E815F for <precis@ietf.org>; Wed, 16 Oct 2013 00:05:12 -0700 (PDT)
Received: from scmse02.scbb.aoyama.ac.jp ([133.2.253.231]) by scintmta02.scbb.aoyama.ac.jp (secret/secret) with SMTP id r9G74rfr016625; Wed, 16 Oct 2013 16:04:54 +0900
Received: from (unknown [133.2.206.134]) by scmse02.scbb.aoyama.ac.jp with smtp id 2606_ba73_41c77c06_3631_11e3_93cd_001e6722eec2; Wed, 16 Oct 2013 16:04:53 +0900
Received: from [IPv6:::1] (unknown [133.2.210.1]) by itmail2.it.aoyama.ac.jp (Postfix) with ESMTP id E2F74BF521; Wed, 16 Oct 2013 16:04:52 +0900 (JST)
Message-ID: <525E3A7F.9040204@it.aoyama.ac.jp>
Date: Wed, 16 Oct 2013 16:04:31 +0900
From: "\"Martin J. Dürst\"" <duerst@it.aoyama.ac.jp>
Organization: Aoyama Gakuin University
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.9) Gecko/20100722 Eudora/3.0.4
MIME-Version: 1.0
To: Patrik Fältström <paf@frobbit.se>
References: <525DFB1F.8040401@it.aoyama.ac.jp> <7693B3B4-7204-48F0-8C42-EBF5D701BAF4@frobbit.se>
In-Reply-To: <7693B3B4-7204-48F0-8C42-EBF5D701BAF4@frobbit.se>
Content-Type: text/plain; charset="UTF-8"; format="flowed"
Content-Transfer-Encoding: quoted-printable
Cc: "idna-update@alvestrand.no" <idna-update@alvestrand.no>, "precis@ietf.org" <precis@ietf.org>
Subject: Re: [precis] Category changes with Unicode 6.3
X-BeenThere: precis@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Preparation and Comparison of Internationalized Strings <precis.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/precis>, <mailto:precis-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/precis>
List-Post: <mailto:precis@ietf.org>
List-Help: <mailto:precis-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/precis>, <mailto:precis-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 16 Oct 2013 07:05:33 -0000

Hello Patrick,

Many thanks for checking. Great to see that everything is okay.

Regards,   Martin.

On 2013/10/16 14:40, Patrik Fältström wrote:
> Executive summary: Does not impact IDNA2008.
>
> Longer explanation:
>
> On 16 okt 2013, at 05:34, Martin J. Dürst<duerst@it.aoyama.ac.jp>  wrote:
>
>> Excuse me if this has been checked and/or discussed already, but I just downloaded the Unicode 6.3 version (officially published a few days ago) of http://www.unicode.org/Public/UCD/latest/ucd/UnicodeData.txt and found several changes in character classification:
>>
>> OLD
>> 180E;MONGOLIAN VOWEL SEPARATOR;Zs;0;WS;;;;;N;;;;;
>> NEW
>> 180E;MONGOLIAN VOWEL SEPARATOR;Cf;0;BN;;;;;N;;;;;
>
> No change:
>
> $ grep '^180E;' ../6.[23].0/allcodepoints.txt
> ../6.2.0/allcodepoints.txt:180E;DISALLOWED;I;C;MONGOLIAN VOWEL SEPARATOR
> ../6.3.0/allcodepoints.txt:180E;DISALLOWED;I;C;MONGOLIAN VOWEL SEPARATOR
>
>> OLD
>> 1A1B;BUGINESE VOWEL SIGN AE;Mc;0;L;;;;;N;;;;;
>> NEW
>> 1A1B;BUGINESE VOWEL SIGN AE;Mn;0;NSM;;;;;N;;;;;
>
> No change:
>
> $ grep '^1A1B;' ../6.[23].0/allcodepoints.txt
> ../6.2.0/allcodepoints.txt:1A1B;PVALID;I;A;BUGINESE VOWEL SIGN AE
> ../6.3.0/allcodepoints.txt:1A1B;PVALID;I;A;BUGINESE VOWEL SIGN AE
>
>> OLD
>> 2308;LEFT CEILING;Sm;0;ON;;;;;Y;;;;;
>> 2309;RIGHT CEILING;Sm;0;ON;;;;;Y;;;;;
>> 230A;LEFT FLOOR;Sm;0;ON;;;;;Y;;;;;
>> 230B;RIGHT FLOOR;Sm;0;ON;;;;;Y;;;;;
>> NEW
>> 2308;LEFT CEILING;Ps;0;ON;;;;;Y;;;;;
>> 2309;RIGHT CEILING;Pe;0;ON;;;;;Y;;;;;
>> 230A;LEFT FLOOR;Ps;0;ON;;;;;Y;;;;;
>> 230B;RIGHT FLOOR;Pe;0;ON;;;;;Y;;;;;
>
> No change:
>
> $ egrep '^230[89AB];' ../6.[23].0/allcodepoints.txt
> ../6.2.0/allcodepoints.txt:2308;DISALLOWED;I;;LEFT CEILING
> ../6.2.0/allcodepoints.txt:2309;DISALLOWED;I;;RIGHT CEILING
> ../6.2.0/allcodepoints.txt:230A;DISALLOWED;I;;LEFT FLOOR
> ../6.2.0/allcodepoints.txt:230B;DISALLOWED;I;;RIGHT FLOOR
> ../6.3.0/allcodepoints.txt:2308;DISALLOWED;I;;LEFT CEILING
> ../6.3.0/allcodepoints.txt:2309;DISALLOWED;I;;RIGHT CEILING
> ../6.3.0/allcodepoints.txt:230A;DISALLOWED;I;;LEFT FLOOR
> ../6.3.0/allcodepoints.txt:230B;DISALLOWED;I;;RIGHT FLOOR
>
>> Can somebody check whether and how they affect IDNA 2008 and/or precis?
>>
>> Again, if that has already been done, sorry for the noise.
>>
>> Regards,   Martin.
>>
>>
>> P.S.:
>> All the other changes in UnicodeData.txt:
>>
>> Change in numerical value only:
>>
>> OLD
>> 12456;CUNEIFORM NUMERIC SIGN NIGIDAMIN;Nl;0;L;;;;-1;N;;;;;
>> 12457;CUNEIFORM NUMERIC SIGN NIGIDAESH;Nl;0;L;;;;-1;N;;;;;
>> NEW
>> 12456;CUNEIFORM NUMERIC SIGN NIGIDAMIN;Nl;0;L;;;;2;N;;;;;
>> 12457;CUNEIFORM NUMERIC SIGN NIGIDAESH;Nl;0;L;;;;3;N;;;;;
>
> $ egrep '^1245[67];' ../6.[23].0/allcodepoints.txt
> ../6.2.0/allcodepoints.txt:12456;DISALLOWED;I;;CUNEIFORM NUMERIC SIGN NIGIDAMIN
> ../6.2.0/allcodepoints.txt:12457;DISALLOWED;I;;CUNEIFORM NUMERIC SIGN NIGIDAESH
> ../6.3.0/allcodepoints.txt:12456;DISALLOWED;I;;CUNEIFORM NUMERIC SIGN NIGIDAMIN
> ../6.3.0/allcodepoints.txt:12457;DISALLOWED;I;;CUNEIFORM NUMERIC SIGN NIGIDAESH
>
>> New characters (my understanding is that these are taken care of automatically):
>>
>> 061C;ARABIC LETTER MARK;Cf;0;AL;;;;;N;;;;;
>
> $ egrep '^061C;' ../6.[23].0/allcodepoints.txt
> ../6.2.0/allcodepoints.txt:061C;UNASSIGNED;I;J;<reserved>
> ../6.3.0/allcodepoints.txt:061C;DISALLOWED;I;C;ARABIC LETTER MARK
>
>> 2066;LEFT-TO-RIGHT ISOLATE;Cf;0;LRI;;;;;N;;;;;
>> 2067;RIGHT-TO-LEFT ISOLATE;Cf;0;RLI;;;;;N;;;;;
>> 2068;FIRST STRONG ISOLATE;Cf;0;FSI;;;;;N;;;;;
>> 2069;POP DIRECTIONAL ISOLATE;Cf;0;PDI;;;;;N;;;;;
>
> $ egrep '^206[6789];' ../6.[23].0/allcodepoints.txt
> ../6.2.0/allcodepoints.txt:2066;UNASSIGNED;I;CJ;<reserved>
> ../6.2.0/allcodepoints.txt:2067;UNASSIGNED;I;CJ;<reserved>
> ../6.2.0/allcodepoints.txt:2068;UNASSIGNED;I;CJ;<reserved>
> ../6.2.0/allcodepoints.txt:2069;UNASSIGNED;I;CJ;<reserved>
> ../6.3.0/allcodepoints.txt:2066;DISALLOWED;I;C;LEFT-TO-RIGHT ISOLATE
> ../6.3.0/allcodepoints.txt:2067;DISALLOWED;I;C;RIGHT-TO-LEFT ISOLATE
> ../6.3.0/allcodepoints.txt:2068;DISALLOWED;I;C;FIRST STRONG ISOLATE
> ../6.3.0/allcodepoints.txt:2069;DISALLOWED;I;C;POP DIRECTIONAL ISOLATE
>
>     Patrik
>