Re: [I18nrp] Mappings for IDNA2008 ?

Martin J. Dürst <duerst@it.aoyama.ac.jp> Thu, 14 February 2019 06:20 UTC

Return-Path: <duerst@it.aoyama.ac.jp>
X-Original-To: i18nrp@ietfa.amsl.com
Delivered-To: i18nrp@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C89AA130FEC for <i18nrp@ietfa.amsl.com>; Wed, 13 Feb 2019 22:20:08 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.922
X-Spam-Level:
X-Spam-Status: No, score=-0.922 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FROM_EXCESS_BASE64=0.979, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=itaoyama.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id p6KQmAyTzxzs for <i18nrp@ietfa.amsl.com>; Wed, 13 Feb 2019 22:20:07 -0800 (PST)
Received: from JPN01-TY1-obe.outbound.protection.outlook.com (mail-eopbgr1400104.outbound.protection.outlook.com [40.107.140.104]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 91E6F130FDC for <i18nrp@ietf.org>; Wed, 13 Feb 2019 22:20:06 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=itaoyama.onmicrosoft.com; s=selector1-it-aoyama-ac-jp; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9aOeH+o5kf9TW6y1cttwQ0ovRvGDCgPf5PYxdvbGOIo=; b=ld6wWwEG2lKteHJkgFf/bls51k8DH9LYYYnK7hpO5JSZPPNk1lX67MXShNX++eP1YUFc6zsk781bWJUENXGDmZbiCn2MbolabtaeVlROFksstJ64r3GOCN1wRvY6udeBrPpyF277aCfC2G+fvKinkhfyL4jv15/OKzh5TXWp6Q4=
Received: from TYAPR01MB5149.jpnprd01.prod.outlook.com (20.179.187.18) by TYAPR01MB3296.jpnprd01.prod.outlook.com (20.177.105.19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1622.16; Thu, 14 Feb 2019 06:20:04 +0000
Received: from TYAPR01MB5149.jpnprd01.prod.outlook.com ([fe80::6d0f:10e4:f18d:70e7]) by TYAPR01MB5149.jpnprd01.prod.outlook.com ([fe80::6d0f:10e4:f18d:70e7%3]) with mapi id 15.20.1622.016; Thu, 14 Feb 2019 06:20:04 +0000
From: "Martin J. Dürst" <duerst@it.aoyama.ac.jp>
To: Patrik Fältström <paf@frobbit.se>
CC: "i18nrp@ietf.org" <i18nrp@ietf.org>
Thread-Topic: [I18nrp] Mappings for IDNA2008 ?
Thread-Index: AQHUv4PUGbQc9j/dO0KIwdn0vuyZBKXdYX0AgAAJSQCAAAGYAIAAIxUAgAAI4ACAAUNIAA==
Date: Thu, 14 Feb 2019 06:20:03 +0000
Message-ID: <e57b3a06-f452-42f1-cf91-204eacc1c7c9@it.aoyama.ac.jp>
References: <20190204225047.02583200DC1666@ary.qy> <6660b7e2-1d5b-6a5d-3d1c-55a757e24843@ix.netcom.com> <ADDA4540-9169-4EE6-B33E-3A0D9EED0BD7@frobbit.se> <16ff0d27-9508-7fdd-bc89-9d6fd47396b1@ix.netcom.com> <D5B49CC8-7AEF-4E81-8774-F3F1F05682E8@frobbit.se> <320f4bc3-17b1-595b-34c7-8f95f69c0f33@ix.netcom.com> <B87C6774-4FF7-4A18-A81D-D0834401C293@frobbit.se> <bc7b727d-f75c-bbba-4f63-ebd1dcd87085@it.aoyama.ac.jp> <A5549B92-9414-4210-A94D-8E53339D3961@frobbit.se> <96242bed-ec65-5955-5a4d-5699b9e3cfb9@it.aoyama.ac.jp> <2207F716-8033-46B7-A750-FB226B870D86@frobbit.se> <ccfd52e0-25b9-b04d-0bcf-701606077296@ix.netcom.com> <EDE1FBF9-CDBA-476A-BB8A-15CFF60EAA06@frobbit.se> <47f746f8-b314-1263-0925-e049de90856f@it.aoyama.ac.jp> <710086C6-C77F-4D5B-A223-C76110F33DD3@frobbit.se>
In-Reply-To: <710086C6-C77F-4D5B-A223-C76110F33DD3@frobbit.se>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-clientproxiedby: TYAPR01CA0235.jpnprd01.prod.outlook.com (2603:1096:404:11e::31) To TYAPR01MB5149.jpnprd01.prod.outlook.com (2603:1096:404:12e::18)
authentication-results: spf=none (sender IP is ) smtp.mailfrom=duerst@it.aoyama.ac.jp;
x-ms-exchange-messagesentrepresentingtype: 1
x-originating-ip: [133.2.210.64]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 7f6aa93b-bd94-423a-c2fb-08d6924474f5
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(7021145)(8989299)(4534185)(7022145)(4603075)(4627221)(201702281549075)(8990200)(7048125)(7024125)(7025125)(7027125)(7023125)(5600110)(711020)(4605077)(2017052603328)(7153060)(7193020); SRVR:TYAPR01MB3296;
x-ms-traffictypediagnostic: TYAPR01MB3296:
x-microsoft-antispam-prvs: <TYAPR01MB329605DE798CD1DCF8FEEF22CA670@TYAPR01MB3296.jpnprd01.prod.outlook.com>
x-forefront-prvs: 09480768F8
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(136003)(376002)(346002)(39840400004)(366004)(396003)(199004)(189003)(31696002)(8936002)(508600001)(31686004)(6916009)(97736004)(66574012)(14454004)(229853002)(71190400001)(71200400001)(6436002)(86362001)(52116002)(25786009)(316002)(74482002)(85182001)(6486002)(786003)(81166006)(386003)(81156014)(66066001)(53936002)(53546011)(26005)(105586002)(2906002)(8676002)(6506007)(3846002)(6116002)(6512007)(6246003)(85202003)(102836004)(106356001)(305945005)(186003)(476003)(256004)(99286004)(93886005)(76176011)(14444005)(11346002)(446003)(2616005)(486006)(68736007)(4326008)(7736002); DIR:OUT; SFP:1102; SCL:1; SRVR:TYAPR01MB3296; H:TYAPR01MB5149.jpnprd01.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:0; MX:1;
received-spf: None (protection.outlook.com: it.aoyama.ac.jp does not designate permitted sender hosts)
x-microsoft-exchange-diagnostics: 1;TYAPR01MB3296;23:wuAWfaEAOgMgoYRLbORtxfReHCfp++AYTknfzvYaN0YIB6X8kgWCr2Pzm3eqhgWKXJbgV9OUNFC1mlvVM1bX8rtspslBn9YbR9mOVX94l8W/KKfI3KvFYe9UlM0RIiFoiTOcil35wIza3iv/t/JdKAbi4HmARJ+EKjgX+EKQgM/foXcieGk4HGRUHUZ/z/huxH/kdBHIAhfjV7ORFPpSZav4XorYH+VNv8leRoiPmN3QKktCQzlE3YqqR9A849j69Jq1LiB2vGFhzJq+aSag08ri85BR50V53XnneK+29PFNYTZ4nAHUxlHzax8eO0HeTMGilm7/p/+Q2XSwOxhWDYlcX4kYiEq1yGe+YlsTtycZ+68pXCcQTVaNtgabs9eJgU5S/8Wq4GINlDETM50CzH7nWoWkNrjSJ1tndE4WoTmd4Z8keMdnA0G6b1lc/QxSkOyzMbBQVikUHq2rPblvr+KgWYFSTt+Y29dbCOfaeNpugbpdjxzIekIP9t0eENpv87sokhzs/QLIi2tjBbiAhHqd8czLK67LO4OKM3vHQ2wVTZ0FuG2bj6eSQFUd+Rkg+R2B0yPcuu9VSXPeesOJOkN5CVp1P+UEjLkN+gsIqGbp82ZmyrwlgJd/tWMQQdcHngSWT8zb8qugCvFuAo8zz2Eb1+FOLHZCi+0RKWHK0jlTuNEOnWFmqQBfPwOZrUQkUjlI/7htseUXI7a6MUnSZ2ZICkYiQSyDwlI8zrngmbw1hkgdcqgVsSZBM9cStLYKyZovQyFXSwR8kKaXzgFgi0HrxCp4v1tx5rKSACG6kgdzNkY9GAKofYO6HKyhKs2ZWPvyYJFakfeJ1ZB84EakCVW9dxbD1H/nxd13917pQaMx6BHWT8Go8TwYNF3Hj4VgXHa5Nk3OQhsFAEXEeJXMB5I+HzR6Wgn3WFkcnXmgm4VR+fTsp0VEd1FC5GSFavAXgiz7MRhtYtrpu7A0/dtFDQlLWLlgxd3QgLbLJZAZnxgMNSNq0GnOAxY70Yghl3FV2GzeH7JTQHt/QGjYjpxgaR4oWB7VuAMJLe/0xNgbU4jZykJBf4GTJmTH9ehDud3f7qsP220Vpng3Ct3tpzG9dSR1ljhjTliCfiyHp54fcRd35TBtzIvLQNEblMkN7dTDf/Qn5qqBcITXhsSBvJoIdHtFwTjLEzH2IS8Xmb3W9ZtPDBYzSb8Hf3SmJdVrrb117HQkly73HeB2rnxF2EOxGGaOXveYfDPlFw4oXmomj73RGsbNRSpUi7RnZtkI1ONAp+l3yi+qqmMpQe73f+54NEdeA3kkXME/dAxOzt+zqyT28nQyRMan3/Ea3ocLvbjf
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: skt3qmQBGsp+fgkWYUVr+xBlL/KIcPKwaMj2QX/axPDxcu9FbuGRgbUa/1/coX3BhhEXmJ5oJy3KiLW0RXxTcEjnN0OAleAelAJSym6/SIM9hymGUS4V40PAErmwNkU6BMGNYpJ4doGRD/cmOGTFuxsohhq3+sxcGXCLz0d4rqqyNqyP0n1W5MoWCpf6BAXqMZdNfIjZ8/neBP6tRp6dgCacB8mgCwOw28eHveaVb+YbqBKjwOH7Sq8Ghjcl6IfCMCAZEwNOXmthLv8dyFaS8acSS0b6GKnrx15F6AmZUf8P7bXBfR93kZVGH3qnCTRnAUSV+QP6wwaBoy/t/DG1QHLp0bcNPcy+LZoN0SqG/i/VqmymckN8fdCVCLUGerFXh5vGm+v2KB+aC+gZ8o3k8DVww8RW3OBRmHOigJVqzE0=
Content-Type: text/plain; charset="utf-8"
Content-ID: <3F2128F6E73E934DBD3FFAFC32B03C0D@jpnprd01.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: it.aoyama.ac.jp
X-MS-Exchange-CrossTenant-Network-Message-Id: 7f6aa93b-bd94-423a-c2fb-08d6924474f5
X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Feb 2019 06:20:03.4997 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-id: e02030e7-4d45-463e-a968-0290e738c18e
X-MS-Exchange-Transport-CrossTenantHeadersStamped: TYAPR01MB3296
Archived-At: <https://mailarchive.ietf.org/arch/msg/i18nrp/7cFQqsCCV-dO5Ecv6m7K-qoQ4a4>
Subject: Re: [I18nrp] Mappings for IDNA2008 ?
X-BeenThere: i18nrp@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Internationalization Review Procedures <i18nrp.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/i18nrp>, <mailto:i18nrp-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/i18nrp/>
List-Post: <mailto:i18nrp@ietf.org>
List-Help: <mailto:i18nrp-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/i18nrp>, <mailto:i18nrp-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 14 Feb 2019 06:20:09 -0000

Hello Patrik,

On 2019/02/13 20:02, Patrik Fältström wrote:
> 
> 
>> On 13 Feb 2019, at 11:31, Martin J. Dürst <duerst@it.aoyama.ac.jp> wrote:
>>
>> Hello Patrik, others,
>>
>>> On 2019/02/13 17:25, Patrik Fältström wrote:

>>> If f(x)=x’ and in the locale used f(x) should be x and not x’, you have dependencies between f(x) and f’(x) if you want f(f’(x)) to be x’ and f(f”(x)) to be x.
>>
>> Well, I have to admit that I didn't explicitly talk about that case in
>> my 'proof'. For functions in general (e.g. a function such as f(x) =
>> (x+7) mod 15), you are right.
>>
>> But f(x) (the general mapping function) is idempotent (i.e. f(x) =
>> f(f(x)), which means that you can map as many times as you want, you
>> always get the same result). This is also true for any locale-dependent
>> mapping function.
> 
> I can not say it is. It might be a requirement that you set on the function. I don’t know enough about various languages in the world, bidirectionality and punctuation. See latest discussions about punctuation in Armenian language and script and it’s impact on registration.

Do you have a pointer?

>> If it were not the case, human users would be very
>> surprised: a maps to A, but then A maps to a: That wouldn't make any sense.
> 
> No, we talk about f(a)=b and f(b)=c as one thing and f(a)=b and f(b)=a as a different one.
> 
>> Also, and even more important, for the general mapping function, if x is
>> allowed in IDNs, then f(x) = x.
> 
> That’s another requirement. Maybe in one locale you DO map from one to another?
> 
>> This may not be true for a
>> locale-dependent mapping function (i.e. it would be possible for a
>> German mapping function to map (Hungarian) ȁ to ä, although that's not
>> needed because German keyboards won't produce ȁ in the first place).
> 
> It might produce it via copy and paste.

Yes, that would be an issue. But in that case, it was probably intended 
to be a Hungarian ȁ, not a mistyped ä, and therefore mapping would be 
doubtful.

>> So if f(x)=x', that would mean that x is not allowed in IDNs. That would
>> mean that it is impossible that in a specific locale, the desired result
>> of f(f'(x)) is x. It may be different from x', i.e. y, but we can easily
>> get this by defining that f'(x) = y.
>>
>> So applying the (in most if not all cases very small) locale-specific
>> mapping before the general mapping always will work.
> 
> I don’t understand what your goal is.

I tried to explain it in general in my mail to Andrew, and will repeat 
it here:

 >>>>
My general direction of arguing is that if things are reasonably
designed (i.e. idempotent,...), then it makes a lot of sense to split
the mapping into a general one and some locale-specific ones, and the
locale-specific ones will go before the general one. Also, each
locale-specific one should be rather small (the Turkish one, often
brought as an example, essentially consists of mappings for 2 letters).
 >>>>

> What I am saying is that what mapping is done when a string enters the system the first time, mapping is to happen and it is context dependent where context can for example be locale.
> 
> What is wrong with that statement?

Nothing. It's perfectly possible that two statements (yours and mine) 
are both true :-). Your statement is about the point in time of where to 
apply a mapping. My statement is about how mappings can be split into a 
locale-specific and a general part.

>     Patrik

Regards,   Martin.