Re: [I18nrp] Mappings for IDNA2008 ?

Martin J. Dürst <duerst@it.aoyama.ac.jp> Wed, 13 February 2019 07:18 UTC

Return-Path: <duerst@it.aoyama.ac.jp>
X-Original-To: i18nrp@ietfa.amsl.com
Delivered-To: i18nrp@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BF638131031 for <i18nrp@ietfa.amsl.com>; Tue, 12 Feb 2019 23:18:11 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.923
X-Spam-Level:
X-Spam-Status: No, score=-0.923 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FROM_EXCESS_BASE64=0.979, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=itaoyama.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id LiBqlUCrFeM2 for <i18nrp@ietfa.amsl.com>; Tue, 12 Feb 2019 23:18:09 -0800 (PST)
Received: from JPN01-TY1-obe.outbound.protection.outlook.com (mail-eopbgr1400135.outbound.protection.outlook.com [40.107.140.135]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 83F5412D84C for <i18nrp@ietf.org>; Tue, 12 Feb 2019 23:18:09 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=itaoyama.onmicrosoft.com; s=selector1-it-aoyama-ac-jp; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=lxqyMniuIWB/OxDQz2Fjz0f1eG+UD0PQH19w2TNsI+o=; b=Lxfxs5nSn0fcZdPMniAPscqaUP8e6sKSuoYo8USlqz7wl2isA1lGUN4rTKWjvhwjOquszDPP68TuFGFKzOtn4vydSBQp9JuNpUFh8tQuslSNFmEp/6Nzix1yTu5qp7sOTfdX0SKzV0zdE9Mc0S6ZYALv9QyUm44HshSdIkk7gQ4=
Received: from TYAPR01MB5149.jpnprd01.prod.outlook.com (20.179.187.18) by TYAPR01MB1920.jpnprd01.prod.outlook.com (52.133.177.10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1601.19; Wed, 13 Feb 2019 07:18:06 +0000
Received: from TYAPR01MB5149.jpnprd01.prod.outlook.com ([fe80::6d0f:10e4:f18d:70e7]) by TYAPR01MB5149.jpnprd01.prod.outlook.com ([fe80::6d0f:10e4:f18d:70e7%3]) with mapi id 15.20.1622.016; Wed, 13 Feb 2019 07:18:06 +0000
From: "Martin J. Dürst" <duerst@it.aoyama.ac.jp>
To: Patrik Fältström <paf@frobbit.se>
CC: Patrik Fältström <paf=40frobbit.se@dmarc.ietf.org>, Asmus Freytag <asmusf@ix.netcom.com>, "i18nrp@ietf.org" <i18nrp@ietf.org>
Thread-Topic: [I18nrp] Mappings for IDNA2008 ?
Thread-Index: AQHUv4PUGbQc9j/dO0KIwdn0vuyZBA==
Date: Wed, 13 Feb 2019 07:18:06 +0000
Message-ID: <96242bed-ec65-5955-5a4d-5699b9e3cfb9@it.aoyama.ac.jp>
References: <20190204225047.02583200DC1666@ary.qy> <6660b7e2-1d5b-6a5d-3d1c-55a757e24843@ix.netcom.com> <ADDA4540-9169-4EE6-B33E-3A0D9EED0BD7@frobbit.se> <16ff0d27-9508-7fdd-bc89-9d6fd47396b1@ix.netcom.com> <D5B49CC8-7AEF-4E81-8774-F3F1F05682E8@frobbit.se> <320f4bc3-17b1-595b-34c7-8f95f69c0f33@ix.netcom.com> <B87C6774-4FF7-4A18-A81D-D0834401C293@frobbit.se> <bc7b727d-f75c-bbba-4f63-ebd1dcd87085@it.aoyama.ac.jp> <A5549B92-9414-4210-A94D-8E53339D3961@frobbit.se>
In-Reply-To: <A5549B92-9414-4210-A94D-8E53339D3961@frobbit.se>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-clientproxiedby: TY2PR02CA0070.apcprd02.prod.outlook.com (2603:1096:404:e2::34) To TYAPR01MB5149.jpnprd01.prod.outlook.com (2603:1096:404:12e::18)
authentication-results: spf=none (sender IP is ) smtp.mailfrom=duerst@it.aoyama.ac.jp;
x-ms-exchange-messagesentrepresentingtype: 1
x-originating-ip: [133.2.210.64]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 3f5d8615-b871-45f9-12f3-08d691836656
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(7021145)(8989299)(4534185)(7022145)(4603075)(4627221)(201702281549075)(8990200)(7048125)(7024125)(7025125)(7027125)(7023125)(5600110)(711020)(4605077)(2017052603328)(7153060)(7193020); SRVR:TYAPR01MB1920;
x-ms-traffictypediagnostic: TYAPR01MB1920:
x-microsoft-antispam-prvs: <TYAPR01MB1920AB53BED8C221F28A0066CA660@TYAPR01MB1920.jpnprd01.prod.outlook.com>
x-forefront-prvs: 094700CA91
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(366004)(346002)(396003)(39840400004)(376002)(136003)(189003)(199004)(93886005)(66066001)(53936002)(52116002)(54906003)(316002)(66574012)(4326008)(6246003)(6512007)(106356001)(31686004)(85202003)(99286004)(105586002)(786003)(25786009)(76176011)(8936002)(81156014)(305945005)(8676002)(97736004)(7736002)(81166006)(86362001)(31696002)(256004)(14444005)(386003)(68736007)(3846002)(486006)(6436002)(6486002)(14454004)(6116002)(53546011)(11346002)(446003)(102836004)(85182001)(26005)(508600001)(476003)(2906002)(2616005)(6916009)(71190400001)(71200400001)(186003)(74482002)(229853002)(6506007); DIR:OUT; SFP:1102; SCL:1; SRVR:TYAPR01MB1920; H:TYAPR01MB5149.jpnprd01.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:0;
received-spf: None (protection.outlook.com: it.aoyama.ac.jp does not designate permitted sender hosts)
x-microsoft-exchange-diagnostics: 1;TYAPR01MB1920;23:JKizdZyJmVoiL7Iqk35hcDKYZVmcfDxnibKefG1bCnADZObqPXrVHsQBoVY/l5/3Xq+w+saVZF2nVkORNNDaTpr6A8vnq4BSATmpAepljtWLprY9B/MXR5R9z2g1aU+Uj++TgdhvdvUI8cC286stxd4uKg41ZKbdljdaRZRacOlJJEMXgJ3BFYA6RZYtuiOligmuS9vRzyIxK1vJvlU2Yoio8JdqWGQgBKzXfpRHnRFnSL3J9Vb88D09QM4P91WbdXRZSPnlt9sCiXnhRjnFhg8ub9KxBeC+vITQOBMmQxI4b6wLV7iatS5TvClwptf2CnBAYTPDlSADdaxVdaUtDTo+nB4XFiHGCYsvgGz7DrOe+nNWrTZp+NGi5k/1Jq71StHVaY8YCHPyY8hga2Zd2HGPWmVvZUeacMC81SFgPaRewelA3EVeCMf+yeKBM1GQnbgLeAqSTOcEXPANshAJmQo0SLam76LmGZfcqiZZQ9SHlESH/Vmhjic/9YlsmWYF3yuv8NRbr3h2bA9dCLeCkj58h4pCScoXRzqPVMd472dr3A2Bhk9Si1Xdh5Lux2UHmYfVY0wFbo7lv4yZzsc3i4B9pz0Y+eR0UEq47NrK7XkdNblHAxGftp4tQ/itHzHgVS9rL84DZt4crYpl4M0EcsRNJWVP8wvR8XFOt2zrzzhU0TXnQaD9D92Cy9aErDh8I9zsJtyAuAUXBAFaOfA1UAQO6um80nm/pZGXu/CF9o5kqU8Vzk0pHomXeyWS/WoAHx14pPWhqdtCp5I6Z489V7ka4PTFDlYMDGtCnBoDkNKGCAaf+clkaW8IeOSicAH3kHgV3V1yKswUzxZBSgl3n0tN+QZSokJ5+5kswVtMnBy5yeMkK4F9CHA9nW8uxSWEoKEZpotfIdERuB/zvUd50kVYrMxtilCsBdck6laWD9buS+THzqqR1Q0zom/WFgkHnGXoSX9KNMdN/QHYJ6k+lwg4K0uN0fcZo93ZxHHgw5QBcVEWLJ6U32Po87fcmG18Llr8847B59us4FEtZwZJtvASta8bnsShjvY897b1cfW8nEyB1F6hwQoxN0s9M6+vJkMjMfLlXCXiS6VsnX3NGdGGEzLm7nc2CqmklFRb/vTWd1uooywlxq90hqSIJTIV4jVILGp7tniSK/D4GyvR4H7K6AGT1wHz7eOYJPF/V8aI4+UjDnpCxAB6IAhntFrPrjsn2vGuKOC46QLbAZjvlmoR+jmQpbX6Uz94KFTLnSYegxwwQpmpz5DgW80Aen1BSh+vBPWrXmDVGphYwJ6Cr9uU9oPIR2nL1WEdGKczGLWcAjHMx0TsePIigSsrpzfjsukAgUsQLHbbg9B3RZvVUQ==
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: WpQwOic8mcBn0YCERbxUDhFBuZLqxpgpSdlOS6aYsklTOyc0ieAvxPmzglOPirsNVwBQNmranOcNZDyStuRuWj0sTpgF7bs8AsyTD+ztMlLEQMuP+Y2Zj8OA2J/wNl59sO0w/gWY5jjVsq+fdBl5tnAxc1JFwCGw71RFQ0bLlbPqDZ/oYMhK1QE1WVHSC07PhcOfpnB4oEuFuSYo6Dtvi4qqwXm8BRS1axhJjSWwy/0JKH1nF1Gzc4Ri5tyQ2z4LjTOOK/WIh1y5I2JwsIRoF9inNfACiYxyXGHWcNvAljsSIjEBxC1KiU9EFMwlP7IwppSSdxnNzNPvmiDasURDdjt3mbm/0xLjIxr7lTb8ZdL7V76/5cNHa8+dWIickI4+n6HrJw9MGNP4DLUJOJAXvG5hpYY9zSzt8HV3PT8AvSc=
Content-Type: text/plain; charset="utf-8"
Content-ID: <D0C52BA63840754E80BE04A785882E59@jpnprd01.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: it.aoyama.ac.jp
X-MS-Exchange-CrossTenant-Network-Message-Id: 3f5d8615-b871-45f9-12f3-08d691836656
X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Feb 2019 07:18:06.2433 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-id: e02030e7-4d45-463e-a968-0290e738c18e
X-MS-Exchange-Transport-CrossTenantHeadersStamped: TYAPR01MB1920
Archived-At: <https://mailarchive.ietf.org/arch/msg/i18nrp/nI9JUmUwjnw-MSeg3PqwLBHvwDk>
Subject: Re: [I18nrp] Mappings for IDNA2008 ?
X-BeenThere: i18nrp@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Internationalization Review Procedures <i18nrp.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/i18nrp>, <mailto:i18nrp-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/i18nrp/>
List-Post: <mailto:i18nrp@ietf.org>
List-Help: <mailto:i18nrp-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/i18nrp>, <mailto:i18nrp-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 13 Feb 2019 07:18:12 -0000

Hello Patrick, others,

On 2019/02/09 04:16, Patrik Fältström wrote:
> On 8 Feb 2019, at 9:20, Martin J. Dürst wrote:

>> If we take the case of Turkish, then the generic mapping tables are useful because once we have them, a suitable Turkish mapping can be defined as a small delta (e.g. a small preprocessing step) to the generic mapping tables.

> As you need this extra local delta, JUST using the plain mapping is wrong, include errors, and can not be used.
> 
> You MUST use the generic mapping (as you name it) PLUS the specific exceptions.
> 
> And it is definitely not the case that you can do f(x) and then f'(x), i.e. f(f'(x)) but instead you need to use y(x) as the function where y(x) is as you write f(x) modified with the delta that the LOCALE defines.
> 
> If one could do f(f'(x)) then it would be easy.

If f(x) is the generic mapping, and f'(x) is the mapping of the 
exceptions, then f(f'(x)), which applies f' *before* f, should do the job.

Proof: If it doesn't, just change f' to include the cases that were not 
taken into account correctly. You may have to do this several times. In 
the end, you may end up with f' doing all the work, and f no longer 
having to do anything, but there should not be any such cases in 
practice (not the least because each locale will leave mappings for 
scripts and characters not used in that locale to the generic mapping).

As an example, if f' for Turkish is defined as follows:
f'(I) → ı
f'(İ) → i
f'(_x_) → _x_     # leave everything else alone

then things should work for Turkish.

Regards,   Martin.