draft-ietf-httpbis-header-structure-00, unicode range

Kari Hurtta <hurtta-ietf@elmme-mailer.org> Tue, 13 December 2016 17:36 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 46AF012969B for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Tue, 13 Dec 2016 09:36:56 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.797
X-Spam-Level:
X-Spam-Status: No, score=-9.797 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HEADER_FROM_DIFFERENT_DOMAINS=0.001, RCVD_IN_DNSWL_HI=-5, RP_MATCHES_RCVD=-2.896, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ZaGQr3EdSjkc for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Tue, 13 Dec 2016 09:36:54 -0800 (PST)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 8204C129524 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Tue, 13 Dec 2016 09:36:52 -0800 (PST)
Received: from lists by frink.w3.org with local (Exim 4.80) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1cGqxu-0000cG-Gl for ietf-http-wg-dist@listhub.w3.org; Tue, 13 Dec 2016 17:34:10 +0000
Resent-Date: Tue, 13 Dec 2016 17:34:10 +0000
Resent-Message-Id: <E1cGqxu-0000cG-Gl@frink.w3.org>
Received: from mimas.w3.org ([128.30.52.79]) by frink.w3.org with esmtps (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from <khurtta@welho.com>) id 1cGqxm-0000bT-FP for ietf-http-wg@listhub.w3.org; Tue, 13 Dec 2016 17:34:02 +0000
Received: from welho-filter2.welho.com ([83.102.41.24]) by mimas.w3.org with esmtp (Exim 4.84_2) (envelope-from <khurtta@welho.com>) id 1cGqxf-00014g-HI for ietf-http-wg@w3.org; Tue, 13 Dec 2016 17:33:57 +0000
Received: from localhost (localhost [127.0.0.1]) by welho-filter2.welho.com (Postfix) with ESMTP id C1F7D1714B; Tue, 13 Dec 2016 19:33:27 +0200 (EET)
X-Virus-Scanned: Debian amavisd-new at pp.htv.fi
Received: from welho-smtp2.welho.com ([IPv6:::ffff:83.102.41.85]) by localhost (welho-filter2.welho.com [::ffff:83.102.41.24]) (amavisd-new, port 10024) with ESMTP id bmppZbPGIGDc; Tue, 13 Dec 2016 19:33:27 +0200 (EET)
Received: from hurtta09lk.keh.iki.fi (89-27-35-245.bb.dnainternet.fi [89.27.35.245]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by welho-smtp2.welho.com (Postfix) with ESMTPS id 0FE2021C; Tue, 13 Dec 2016 19:33:27 +0200 (EET)
To: HTTP working group mailing list <ietf-http-wg@w3.org>
Date: Tue, 13 Dec 2016 19:33:26 +0200
Sender: hurtta@hurtta09lk.keh.iki.fi
From: Kari Hurtta <hurtta-ietf@elmme-mailer.org>
CC: Poul-Henning Kamp <phk@varnish-cache.org>, Kari Hurtta <hurtta-ietf@elmme-mailer.org>
X-Mailer: ELM [version ME+ 2.5 PLalpha44+]
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Type: text/plain; charset="US-ASCII"
Message-Id: <20161213173327.C1F7D1714B@welho-filter2.welho.com>
Received-SPF: none client-ip=83.102.41.24; envelope-from=khurtta@welho.com; helo=welho-filter2.welho.com
X-W3C-Hub-Spam-Status: No, score=-4.9
X-W3C-Hub-Spam-Report: AWL=0.235, BAYES_20=-0.001, HEADER_FROM_DIFFERENT_DOMAINS=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RP_MATCHES_RCVD=-3.099, W3C_AA=-1, W3C_WL=-1
X-W3C-Scan-Sig: mimas.w3.org 1cGqxf-00014g-HI 05673a79358d6831e7deb332b8d0cf2a
X-Original-To: ietf-http-wg@w3.org
Subject: draft-ietf-httpbis-header-structure-00, unicode range
Archived-At: <http://www.w3.org/mid/20161213173327.C1F7D1714B@welho-filter2.welho.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/33163
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

2.  Definition of HTTP Header Common Structure
https://tools.ietf.org/html/draft-ietf-httpbis-header-structure-00#section-2

|     unicode_string = * unicode_codepoint
|             # XXX: Is there a place to import this from ?
|             # Unrestricted unicode, because there is no sane
|             # way to restrict or otherwise make unicode "safe".

What is range of unicode_codepoint ?

Next section implies that it is only plane 0 ?
( range 0x0000 - 0xFFFF )

3.  HTTP/1 Serialization of HTTP Header Common Structure
https://tools.ietf.org/html/draft-ietf-httpbis-header-structure-00#section-3

|     h1_unicode_string = DQUOTE *(
|                         ( "\" DQUOTE )
|                         ( "\" "\" ) /
|                         ( "\" "u" 4*HEXDIG ) /
|                         0x20-21 /
|                         0x23-5B /
|                         0x5D-7E /
|                         UTF8-2 /
|                         UTF8-3 /
|                         UTF8-4
|                         ) DQUOTE
|     # This is UTF8 with HTTP1 unfriendly codepoints
|     # (00-1f, 7f) neutered with \uXXXX escapes.


here seems unicode to limited to plane 0
( 0x0000 - 0xFFFF )

Or is unicode values > 0xFFFF
encoded with surrogates  (values 0xd8000 - 0xdffff) ?
( UCS-2 or UTF-16 is used )

/ Kari Hurtta