Re: Unicode escape sequence | Re: draft-ietf-httpbis-header-structure-00, unicode range

Martin J. Dürst <duerst@it.aoyama.ac.jp> Wed, 04 January 2017 02:56 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A121A129B86 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Tue, 3 Jan 2017 18:56:35 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -10.021
X-Spam-Level:
X-Spam-Status: No, score=-10.021 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-3.1, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=itaoyama.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id GG2SaSg010PO for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Tue, 3 Jan 2017 18:56:33 -0800 (PST)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5D272129526 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Tue, 3 Jan 2017 18:56:33 -0800 (PST)
Received: from lists by frink.w3.org with local (Exim 4.80) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1cObhX-0005so-Lm for ietf-http-wg-dist@listhub.w3.org; Wed, 04 Jan 2017 02:53:19 +0000
Resent-Date: Wed, 04 Jan 2017 02:53:19 +0000
Resent-Message-Id: <E1cObhX-0005so-Lm@frink.w3.org>
Received: from mimas.w3.org ([128.30.52.79]) by frink.w3.org with esmtps (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from <duerst@it.aoyama.ac.jp>) id 1cObhS-0005s3-6m for ietf-http-wg@listhub.w3.org; Wed, 04 Jan 2017 02:53:14 +0000
Received: from mail-ty1jpn01on0109.outbound.protection.outlook.com ([104.47.93.109] helo=JPN01-TY1-obe.outbound.protection.outlook.com) by mimas.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from <duerst@it.aoyama.ac.jp>) id 1cObhL-0007vF-B4 for ietf-http-wg@w3.org; Wed, 04 Jan 2017 02:53:09 +0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=itaoyama.onmicrosoft.com; s=selector1-it-aoyama-ac-jp; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=10Tp0VpZ/0mxX3ns7meRkjQeB4m08rHZ9h0YEc01dzI=; b=HBqCs0kT3kAOO0cdYg+YwQ70TIU4IBpgKzIG6SO5wu6F2ogLb9JaA8qmjTj/E7VFpRyXWXlfcHBvus+8xPwJtBM1S8uKeLxbj15AbGNuepwV6GQttCjR8SoTX+Z9qZ1Icn+6SQivOzyA43R+qffxqHzuqUBYsODYBmbSnY2MnWw=
Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=duerst@it.aoyama.ac.jp;
Received: from [192.168.1.3] (118.19.14.21) by TY1PR01MB0651.jpnprd01.prod.outlook.com (10.167.158.14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.817.10; Wed, 4 Jan 2017 02:52:24 +0000
To: Matthew Kerwin <matthew@kerwin.net.au>
References: <20161213173327.C1F7D1714B@welho-filter2.welho.com> <20161213175419.GA7943@LK-Perkele-V2.elisa-laajakaista.fi> <25434.1481665395@critter.freebsd.dk> <201612140628.uBE6SO3L025885@shell.siilo.fmi.fi> <36792.1481701328@critter.freebsd.dk> <CACweHNDKgWQewZHb=Kz3_2=41M58sY5472Q5OwpqPLxorvkzHQ@mail.gmail.com> <37223.1481707288@critter.freebsd.dk> <3a65ca44-f652-3b14-6d64-46f35b32df57@isode.com> <725824b9-de61-2650-4007-fb5b026bc7a6@gmx.de> <87f1efaf-74c5-f02b-d09e-a721afa86032@isode.com> <0cce5fdf-5f1a-4fd3-2e3a-e810a34baccb@gmx.de> <CACweHNBYf-UuxsKNxYakt22rgku9xEP4YK4yL2R+=vMf_uB2Vg@mail.gmail.com> <201612141739.uBEHdwiq024972@shell.siilo.fmi.fi> <CACweHNDbv9dDXqjpU61HvfpgZ6Dt4S-CG=GjwOZcwaZh6LEirQ@mail.gmail.com>
CC: Julian Reschke <julian.reschke@gmx.de>, Alexey Melnikov <alexey.melnikov@isode.com>, HTTP working group mailing list <ietf-http-wg@w3.org>
From: "Martin J. Dürst" <duerst@it.aoyama.ac.jp>
Organization: Aoyama Gakuin University
Message-ID: <6071d7e0-f1b9-3bb7-2a7d-a8ed60500e20@it.aoyama.ac.jp>
Date: Wed, 04 Jan 2017 11:52:20 +0900
User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.6.0
MIME-Version: 1.0
In-Reply-To: <CACweHNDbv9dDXqjpU61HvfpgZ6Dt4S-CG=GjwOZcwaZh6LEirQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Transfer-Encoding: 8bit
X-Originating-IP: [118.19.14.21]
X-ClientProxiedBy: TYXPR01CA0012.jpnprd01.prod.outlook.com (10.168.40.22) To TY1PR01MB0651.jpnprd01.prod.outlook.com (10.167.158.14)
X-MS-Office365-Filtering-Correlation-Id: 09478e03-8666-498e-45a7-08d4344cb636
X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001);SRVR:TY1PR01MB0651;
X-Microsoft-Exchange-Diagnostics: 1; TY1PR01MB0651; 3:cRmQ8Oi/xipuTsr38T/d0LGAlsYNZxyl9uUxDqYRa6MORP5zMx/pQokqYPRBm7Op6QNAlQvPsra7PCpXrD2HxOEWXMWGxmQaa8vO6eAosn6wU1sBeNSgFBU1VzQ+cvJjrNQXZu8cLT80KNKdynbaili8wNHsPuqW6KBaun0s/VT3eletOdpsri0w4hEmj5vmJjFO362NIA12cxam5Pd8HizpcJK/gZQqIOtj17rnYOrPYZOt1+sojsgG4e852tQ6Dge1nNxw4LlOAZ9YlIZDjA==; 25:f+EzmX2dgaEAsnpfWKsS+TNH78ygNHYYTfXqQk/5vaHqkI2m3dTX5Y5dj+ZE+vbMCBzgxeTkm4m1eE9MakjQmCUTuWw+agyufru0LVxLBxZfvgeHEujd0C9FqlXbfRCGnZNhpBIhjkQvzrakWSmpDxhmC1pnQS78WjPCKqFYH8yK2k1T1ht8g0iD8W6UHu/ufriHpVHQzQCK6DtpyvtXAn6DZHoDHqqbX8c5UErPGpvec+l/fv/yZqQLv+6k+f1RTvj2hn3KKcQPWOCXPFzLYu5u3aGAwsgFutzbdQxR15loTesY/HlU18ErY8AzsOujpXgRt3tmSxsRl62k5C3ZQnL5TfbKJjlycg6+3ihUwb6P2m25gUZu+WjXIMfEI/UJP9jc6j4FfTXuzwYNkbwE86CX5Y+Ej/P77V0RB0yM1IvHZA7QMUUHOjFUp87an39HiNSN4Uj29vwuzwbIr5AGcA==
X-Microsoft-Exchange-Diagnostics: 1; TY1PR01MB0651; 31:p9o+aef8tlLYe+g7baGXyhoEqbk7aZs3fH9zKHSFA7diwIGXo/m79wcXhtbUW/Ll+SAhCP7Lyaxa/3AgrW9WreaibVMBGtcqvBX+DxJTOxFuiOJN9ixEOmfCHOAjfFY2Cy1uGyxwwhG7A9fwFCD+hxPFYzh3Eofb1O9+rMYR/3qgocHzcDtGHseSXtGcEAD6wvucnaSnG+0WSlnpQodgogXGZ8RKPfM68uSl38rE5WBxB+8a97eNX939T25Pghbdei1q6AGF+mrVIl40RNEasQ==
X-Microsoft-Antispam-PRVS: <TY1PR01MB06511050564A4F94577CAB22CA610@TY1PR01MB0651.jpnprd01.prod.outlook.com>
X-Exchange-Antispam-Report-Test: UriScan:(120809045254105)(144208319314845);
X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040375)(2401047)(8121501046)(5005006)(3002001)(10201501046)(6041248)(20161123564025)(20161123562025)(2016111802025)(20161123555025)(20161123560025)(6072148)(6043046); SRVR:TY1PR01MB0651; BCL:0; PCL:0; RULEID:; SRVR:TY1PR01MB0651;
X-Microsoft-Exchange-Diagnostics: 1; TY1PR01MB0651; 4:faNTDB2wNLJUhU55XWZgvZcxsQ+iuRXdyuMEUu/WWy9x+AnijBBLJfGpqQpi6cxGNtSzgOFWI+D88ba4GshE9bzc9tRpD3cz5q6eZmXxSGT/iKUzN/C1elPcJoMAXziPq55vxfH3JplUUp+8/Nuxy7XgM0XHlhnbD2O441RTxuQH35HJpUHWWcWLETqS9mN3Gl9Z2Yhg+38sLZZfoGhtdVhRKxDnxWS/bGWDCW0F1XNbmda3vO5PRtk37FvXOzPZXuv1AL0lEvNaSfpDHx+T/r0q/3RD/KBugS6ufozprNBoK5l6gBJxdrE5qxZf68JUXi2zW9PtsXTpLBSnv45HIJESf9s+HxwyaedpTuXNd7JrBcB6KryFTyuhIk6M/472aEcaHGCkxmI3tX5fdafqa0eMMUG2ZLIcBCeyMX6aths55e8cmEeoFHfANLPaz9zJbsauoa2MSzgSYDrZ8/4hdFTdLajLUV0CStt+Byj1J3KAqdKJJoesozGPl6qNsdyswmhRWe4zELvtBUDk+nrjfKoMnp5LEW3xc9uiwh6kbZQ6HOSC/nrNEDyQ9M1KB3LB0Dnn9x2f5MV7n6Xfa7sTNvBaNS4ttqiAbn+s8v2hF541QpcmYFWw1HNuXcL8HtPcA4WI+5Fanotky7jXzFN9KkADdgOArVTstmVUVOCYbFJLmdsfb3Ip4/4pBERPgLMz
X-Forefront-PRVS: 0177904E6B
X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10019020)(4630300001)(6049001)(6009001)(7916002)(39410400002)(39830400002)(39450400003)(189002)(199003)(24454002)(50986999)(64126003)(7736002)(54906002)(8676002)(54356999)(76176999)(81156014)(305945005)(81166006)(38730400001)(90366009)(2870700001)(23676002)(93886004)(42186005)(4001350100001)(92566002)(31696002)(5660300001)(50466002)(31686004)(229853002)(6666003)(110136003)(230783001)(101416001)(65826007)(42882006)(105586002)(2950100002)(6916009)(86362001)(68736007)(106356001)(117156001)(8666007)(25786008)(3846002)(6116002)(33646002)(77096006)(65806001)(83506001)(189998001)(74482002)(65956001)(66066001)(47776003)(4326007)(6486002)(2906002)(97736004); DIR:OUT; SFP:1102; SCL:1; SRVR:TY1PR01MB0651; H:[192.168.1.3]; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:0; LANG:en;
Received-SPF: None (protection.outlook.com: it.aoyama.ac.jp does not designate permitted sender hosts)
X-Microsoft-Exchange-Diagnostics: 1;TY1PR01MB0651;23:Hxq+jUSdvBQqo3SUF/KFfAWNUp4lgUxE31OJyosFLIqjB89Dicf99FgMLDwOO4QWEblRJvSe28byvxGXSBsuHRGp9oTSbj83R/mYUlm80CY9wlxibvkVuBmzVmqpQnSbCj3QWyhuKyWImqXajRW/4+4jjR7kfYyQMrHD+x10AqGAtXh26H9K/bQkNYl59zw0fNYnYcaXjrMNmFpAQTQyQ/4YisnqOSooS3xkJEP2zByFbcFxNaDjNZHFbXIvYI+3fZ+0nL4Pze/uDzlWNobFvzTnZKFI49Y9xk9n4+rJkTdTv5d1PrmP5xfA2mBAaDH5mOE77PeJM/SFe6aggcXi5TBzqJVzPe6XkUVoRq2K5aDiC60gwPCq/iKLguD0n4Ft4ioVksaBjnocEJ4+7fvMKduYTV7vwjULtsJBXbc59SK+9/X10cDSBkg6bjKS06igkwAtysXRw50wEThDK1OfDYhpHqwWp+djWfJAhNtw1v5KkCd2rKsvME7j+wzWrXSRoHRjD0dykfIaqIo+4Hym3dDuxzQlVOivv+Amy7KmkOw6PFWxMfWK/3Yi+CPwftwcxI/9RQYxWmkfrhKQqWRms/bEMfIOcI+m5DLNP2Ug8h+igujgvvr1HdtfkoVJ75aDrN/UGflIqk0A/3/58YL77P+XR2s4h8kwYeovxLC0x7RKIN3jnp6sakhRpi367QZRwBlHuQL0J1w9iTNtWQXnvQ6k9QN2yicdqOCwFaRxCugDOq5QbazslEU4h+yQnnPuFuuGwuvxYso3kWR6phweW2zhDEDN2rLWu4T7VM9BtwKTL2VGZzRp6JarM6Uk6v4x4g35lMRDjaQkjDtkK2RBiURxMnhiPoJoW4zVtUcYXoZ0hqQE+rVjIXYBaufzUi82nh54pPIDuHqrrW2sgqSTZyQwi9obmL60meVdt1cKoCTWZBOXOrfPnmBDBrBFJnRfvphcLpSsOe/8GoTV5nMw3Uc++jLVaKE83IsHJ4NfjWmAtWUXrcUElIx4IP81wz0J7JAmy5NufdoOEKxVp9upGEefdFIijARif29YD8xdBt1bpHh4O92KquttgZh4Z0mqpqMm6g1bmMmt4dbIvYbjkRTZYVmeYP0wLkLp1GMfVBhkRGIX7lOqIPMa0G52JMQO4IezhPTuE59rmRdJ5uEjb/aBhA5FmTVM6T/cR80doJkVXMMmQs9qmmA+AOIFd9DwRXFRvkdh5O+4fQsQcAjJV0kjoNIKN3ZSEPEhr83uMKqRwLArczjJcqM2uAiy91zcwzfEuYt8xLAgKSNpKg5vtYnLbQQ6sMcMsd+JFX+FN6XkbzXgclgoBgT3DMRA/G3F/0pf4Q9QODg0/H8YdqugV2yEScPpT2hxqOMsJhCQ5kVxi84dJIZc/VfUwle4s+llf7DXcALlyZbqHHGEYiiIXisByaBxy20WWE+Q2GzScGRD/NSP194VrPhR1DXDQGhdxikPpC5yQgQABTFXVahNtqMLm9hhGJjgayZNWixbyXA=
X-Microsoft-Exchange-Diagnostics: 1; TY1PR01MB0651; 6:BPJC3709oGjlrUkEqCdFHU9ic41bzrvVWFjsavwVxgqihE4lek2u1iKVID3HAI1Fx4ChEnDgHsCfAyBFMYYFwlbdtkRVrR0UTCc9ihQhyW5d85Qgdt+dZVUETQMg8Mod0vxZEygRu0L8twSVlqa4Ytf/chsz+h3aBdMdobV2F+EO4Dg1Veiy3V+xpyMOdU0W3bOrLgV9jYDf5xQP9FCUwZkGu/CaXk0mNzG8bkggiMHEzP3XwFneH20cmk+7mm404AI8yFKAWKyAGNf6QSzdWmcnwSxMdrxq7+loX9Fp6kQiT6ohWuBCt+2GswYdMha1ykhzsmTAq2ZMlzHVlfO8ghuQ1N2yBMW1BBlfzsTtFd9QQo7M1W6baLwUr17/CgSzptomlbs8noPMVXI6LPR8/yR8jQxEUvj1zAPsuCOFAMeeXBAUlQd5MPMAzkX3WRcn; 5:rP057TSbolKp/VfNH1WwFQstuz+UHSt+kjaUBcYaqZBV+iQG0ST5moPJTt3GzkBb3BSDlEtszDOjA7CrWXXXqSUXKJ3oXAurcSslemO3SbSc2cURVQXXDPGiJ3fh+56mpI96DGoTQ40Q0LOGGBQnXg==; 24:+mrQCT5CuIMhXq22gQufxF/6PI/RDhl2LwxmkGOeABMuAXrB1gO98pnaEGSV55zTpGlU/tyxtItQ7K4f1L0WgRasonuLkp61QfgBFp02ZBA=
SpamDiagnosticOutput: 1:99
SpamDiagnosticMetadata: NSPM
X-Microsoft-Exchange-Diagnostics: 1; TY1PR01MB0651; 7:9ERLdS+zL7iEJCmqj+mwzGDNQTiR+RhK17FRSo8zvMsKX27YvHEfrCnHUwzVI5cLW24AC+/SFVJtkBOiad7CRTCGJzrYrfM2BflWcu7QnPLY5kGjPVqQE6Bgv+tdf3E4XkVq3+kQzPSjqCEX6nJ4QUKMkNom6OgH0bCXyVfSS9huvIGLswY97iGxHxetmt/IScO7jMABQQDAVht7yVHYvfimQA3YZl9LmFvNuhqyRs7DCtnYNdzJQ1S35CdxoLGLjE/DSxvr5xIOEGp5XNBA2UG+zLO3CGFLR3mWUTMcwrAOOZsqgcY2LREEN84KOfhYt91kdLNUae7BtDqChe84WWTlUm62t2nZYkDnZ83Ocsi0nUqDuPFsJyDWWojHuADH/51r1rWaqFSNyqajlWVxP4dUvQZ2TffOPPAzn1ZiqlMX7co61qn6rq9psWHcZO5vvKDJJPA9Yu2Whb2beQZWdQ==
X-OriginatorOrg: it.aoyama.ac.jp
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 04 Jan 2017 02:52:24.3830 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-Transport-CrossTenantHeadersStamped: TY1PR01MB0651
Received-SPF: pass client-ip=104.47.93.109; envelope-from=duerst@it.aoyama.ac.jp; helo=JPN01-TY1-obe.outbound.protection.outlook.com
X-W3C-Hub-Spam-Status: No, score=-6.2
X-W3C-Hub-Spam-Report: BAYES_50=0.8, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, W3C_AA=-1, W3C_DB=-1, W3C_IRA=-1, W3C_IRR=-3, W3C_WL=-1
X-W3C-Scan-Sig: mimas.w3.org 1cObhL-0007vF-B4 bda776923a41969a53dff99dcc9147cc
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Unicode escape sequence | Re: draft-ietf-httpbis-header-structure-00, unicode range
Archived-At: <http://www.w3.org/mid/6071d7e0-f1b9-3bb7-2a7d-a8ed60500e20@it.aoyama.ac.jp>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/33263
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

Sorry to be late, cleanup during the holidays.

On 2016/12/15 10:57, Matthew Kerwin wrote:

> ​I have should noted here that Ruby uses this \u{N...} syntax, including
> the lower limit of one hexadecimal digit.  This is a valid string literal
> in Ruby:
>
> "\u{df}\u{9}\u{1f602}"​

Not only that, but Ruby allows \uABCD in case there are exactly 4 hex 
digits. Also, you can write the above as \u{df 9 1f602}, too. Ruby puts 
writers' and readers' convenience above other concerns, but this doesn't 
mean that we can't use it.


> ​There is precedent, although I'm not sure if it's a good precedent: the
> "content" attribute in CSS uses:
>
>     %5c 1*6HEXDIGIT
>
> ...which is both undelimited (which I oppose) and without an explicit
> hexadecimal indicator (about which I'm mostly ambivalent.)​

Yes. That lead to some of the stuff in 
https://www.w3.org/TR/charmod/#sec-Escaping, in particular 
https://www.w3.org/TR/charmod/#C044.


As for the \u'ABCD' recommendation in 
https://tools.ietf.org/html/rfc5137#section-5.1:

On 2016/12/14 19:38, Alexey Melnikov wrote:
 > On 14/12/2016 10:21, Julian Reschke wrote:

 >> Has this ever been used in a protocol?

I think this is a very good question. RFC 5137 doesn't even give a full 
example of its very own notation. Also, I don't think \u'ABCD' existed 
before RFC 5137. It smells quite a bit of https://xkcd.com/927/ (but I 
may be wrong, and of course, this area is prone for such phenomena).

 > Some:
 > https://datatracker.ietf.org/doc/rfc5137/referencedby/

That record is very sparse.

 > This was also extensively used in other RFCs without referencing the BCP.

Pointers, please.


Regards,   Martin.