Re: Unicode escape sequence | Re: draft-ietf-httpbis-header-structure-00, unicode range

Kazuho Oku <kazuhooku@gmail.com> Thu, 15 December 2016 22:18 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 996A01294D4 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 15 Dec 2016 14:18:20 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.897
X-Spam-Level:
X-Spam-Status: No, score=-9.897 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, RCVD_IN_DNSWL_HI=-5, RP_MATCHES_RCVD=-2.896, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 5yFJDHy6emyY for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 15 Dec 2016 14:18:18 -0800 (PST)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BE5241294B1 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Thu, 15 Dec 2016 14:18:18 -0800 (PST)
Received: from lists by frink.w3.org with local (Exim 4.80) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1cHeIl-0004PX-Nm for ietf-http-wg-dist@listhub.w3.org; Thu, 15 Dec 2016 22:14:59 +0000
Resent-Date: Thu, 15 Dec 2016 22:14:59 +0000
Resent-Message-Id: <E1cHeIl-0004PX-Nm@frink.w3.org>
Received: from titan.w3.org ([128.30.52.76]) by frink.w3.org with esmtps (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from <kazuhooku@gmail.com>) id 1cHeIY-0004M1-Cm for ietf-http-wg@listhub.w3.org; Thu, 15 Dec 2016 22:14:46 +0000
Received: from mail-qk0-f195.google.com ([209.85.220.195]) by titan.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.84_2) (envelope-from <kazuhooku@gmail.com>) id 1cHeIR-00023x-M4 for ietf-http-wg@w3.org; Thu, 15 Dec 2016 22:14:41 +0000
Received: by mail-qk0-f195.google.com with SMTP id t184so574598qkd.1 for <ietf-http-wg@w3.org>; Thu, 15 Dec 2016 14:14:19 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=d3Qx0UyFjQ0hUYtqP2Hc2hGI0WPiWEEp9bKmICYJ5SM=; b=GYy39NK20Pq07BeQUrr1Lc4eVWHpcIKxLjWhmWUX+dKX3L17VZ+zEW8ucoZsDslp5G 7UVO6EcgDyU0BSigqzMxlB/HNr6G6oS+/heK2bkkOhxBMQrjAukrcjN+jbV5xFRh3NdI 73dkUJ+q1GNLaVQ9x9013ZZofZ2xD+TefV22XAR7U2yi22q2b4BztKaypvp7MIkDvPL4 a7ZDDzt1fZ8y1PHyFj/vuDA+yi7PygQDjmY1Z+GVTpiAAUcPmhgd8Udu2tK5PIWEYWH6 RBO03eKOD3ll0PJ3+pum5lIeE14BczPnPouQbPITlfoluvVVCX3p4qOyO2QtX4ECOdj3 5ZUw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=d3Qx0UyFjQ0hUYtqP2Hc2hGI0WPiWEEp9bKmICYJ5SM=; b=VVRX6qk3t9BGiioZZ8haGa+3iXFX76dPHjfFPMIt/1nfsZCKIZXBRUDfVByGbF3ciJ NkRoCYn/lXXKwY2QPqSMx4smypRVBVN6cS3yI2ipiMkKH4fu6Q5YCagbmMpRLEptvMSQ UofKkqa4p1hV06EmlAua9u4Tg02tNSu/aANRmhb0jOgJlVOAbYJGxN+AfMhu6NU30eUf wV9dmQG8V6DvojvbyBYhWJWALfv+TKwi7UF1aNI8w7mlHF04EcLIk9yJttgxELNe58TD 0kV/RCn2ULaFZCdTZaHkj/ATByc5zvJkVHBBo0yRHkY6li5/+5ebYwsn7Y09GTht//Mq lFqw==
X-Gm-Message-State: AIkVDXJ85PiMLzJknZkpYjVqtGpQtsAK4Fil5QfKxiq4r7uRzG5Cey6r5L6iMN8RHqbI95eYMkjlytO+fZjcxw==
X-Received: by 10.55.7.17 with SMTP id 17mr2995182qkh.228.1481840053822; Thu, 15 Dec 2016 14:14:13 -0800 (PST)
MIME-Version: 1.0
Received: by 10.140.84.177 with HTTP; Thu, 15 Dec 2016 14:14:13 -0800 (PST)
In-Reply-To: <201612140628.uBE6SO3L025885@shell.siilo.fmi.fi>
References: <20161213173327.C1F7D1714B@welho-filter2.welho.com> <20161213175419.GA7943@LK-Perkele-V2.elisa-laajakaista.fi> <25434.1481665395@critter.freebsd.dk> <201612140628.uBE6SO3L025885@shell.siilo.fmi.fi>
From: Kazuho Oku <kazuhooku@gmail.com>
Date: Fri, 16 Dec 2016 07:14:13 +0900
Message-ID: <CANatvzzVa27UaMU=q42VZ-DDOaGdvJCn3oP4=1Oz5L5akBgBiw@mail.gmail.com>
To: Kari Hurtta <hurtta-ietf@elmme-mailer.org>
Cc: Poul-Henning Kamp <phk@phk.freebsd.dk>, Ilari Liusvaara <ilariliusvaara@welho.com>, HTTP working group mailing list <ietf-http-wg@w3.org>, Poul-Henning Kamp <phk@varnish-cache.org>
Content-Type: text/plain; charset="UTF-8"
Received-SPF: pass client-ip=209.85.220.195; envelope-from=kazuhooku@gmail.com; helo=mail-qk0-f195.google.com
X-W3C-Hub-Spam-Status: No, score=-5.2
X-W3C-Hub-Spam-Report: AWL=-1.158, BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, W3C_AA=-1, W3C_WL=-1
X-W3C-Scan-Sig: titan.w3.org 1cHeIR-00023x-M4 b69804d9dffaec8ba425a9923474d4ff
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Unicode escape sequence | Re: draft-ietf-httpbis-header-structure-00, unicode range
Archived-At: <http://www.w3.org/mid/CANatvzzVa27UaMU=q42VZ-DDOaGdvJCn3oP4=1Oz5L5akBgBiw@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/33201
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

2016-12-14 15:28 GMT+09:00 Kari Hurtta <hurtta-ietf@elmme-mailer.org>:
> Poul-Henning Kamp <phk@phk.freebsd.dk>: (Tue Dec 13 23:43:15 2016)
>> --------
>> In message <20161213175419.GA7943@LK-Perkele-V2.elisa-laajakaista.fi>, Ilari Li
>> usvaara writes:
>>
>> >> 3.  HTTP/1 Serialization of HTTP Header Common Structure
>> >> https://tools.ietf.org/html/draft-ietf-httpbis-header-structure-00#section-3
>
>> >astral planes (and I hope the escape system there would be more sane
>> >than the one JSON has...)
>
> I think that one escape sequence is more sane than something like
> \uD834\uDD1E  for one unicode codepoint.

Agreed.

Surrogate pairs are a remnant of old systems that expected all unicode
characters would fit into 16-bit, which turned out to be false. They
make sense only when the underlying system is using UTF-16.

Considering the fact that most of the programming languages (and
operating systems) are moving away from UTF-16, I think creating a new
standard that permits the use of surrogate pairs would be considered a
bad move in the long run.

>> Any suggestions ?
>
> Ilari Liusvaara told that 10FFFD is the last codepoint. So 6
> hex digits is sufficient.
>
> Either
>         ( "\" "X" 6*HEXDIG )
>
> or
>
>          ( "\" "X" 1*6HEXDIG "#" )
> or
>
>          ( "\" "#" 1*6HEXDIG "#" )
>
> or   escape characters may be some other also.
>      This was my first suggestion.
>
> I did not suggested \u  or \U  because these
> two are used with different length.
>
>> --
>> Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
>> phk@FreeBSD.ORG         | TCP/IP since RFC 956
>> FreeBSD committer       | BSD since 4.3-tahoe
>> Never attribute to malice what can adequately be explained by incompetence.
>
> / Kari Hurtta
>



-- 
Kazuho Oku