Re: Unicode escape sequence | Re: draft-ietf-httpbis-header-structure-00, unicode range

Martin Thomson <martin.thomson@gmail.com> Wed, 14 December 2016 11:41 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B9DE21299DA for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 14 Dec 2016 03:41:27 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.897
X-Spam-Level:
X-Spam-Status: No, score=-9.897 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, RCVD_IN_DNSWL_HI=-5, RP_MATCHES_RCVD=-2.896, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3hKEOkUn_SrV for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 14 Dec 2016 03:41:26 -0800 (PST)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 47D85129580 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Wed, 14 Dec 2016 03:41:26 -0800 (PST)
Received: from lists by frink.w3.org with local (Exim 4.80) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1cH7tL-0000OE-O1 for ietf-http-wg-dist@listhub.w3.org; Wed, 14 Dec 2016 11:38:35 +0000
Resent-Date: Wed, 14 Dec 2016 11:38:35 +0000
Resent-Message-Id: <E1cH7tL-0000OE-O1@frink.w3.org>
Received: from titan.w3.org ([128.30.52.76]) by frink.w3.org with esmtps (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from <martin.thomson@gmail.com>) id 1cH7t3-0000Ke-13 for ietf-http-wg@listhub.w3.org; Wed, 14 Dec 2016 11:38:17 +0000
Received: from mail-qk0-f180.google.com ([209.85.220.180]) by titan.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.84_2) (envelope-from <martin.thomson@gmail.com>) id 1cH7sx-0003pZ-Bh for ietf-http-wg@w3.org; Wed, 14 Dec 2016 11:38:11 +0000
Received: by mail-qk0-f180.google.com with SMTP id q130so16304131qke.1 for <ietf-http-wg@w3.org>; Wed, 14 Dec 2016 03:37:51 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=dGMAuEnIUQq0uXXp2Gx4h5gKJcSdj/a6U9kzPnDztY4=; b=BoRVfidnxHeizSzFnvyuF6gzhdu4nKrFbVIPWP6QIN2tkNP8jT8qdrxEvG/nTOdSXL x9v6/RDqxY296eMZfOxvXl41G+x5nXI+jPxm3eDhNEcWQAc6W9cAcBlFgEjix4PViu7/ 6l8mDg1opzBzcvvjdMyhRb1rjS7GL2xkxxFoNz2aczJJxixSnf1P+BifPl9MhEKmhLzQ PSf+7sZjoVwNlbBfrgwpdtngadAyXazlniSAvX4HnvbAZfvPqrIqzTVDYXHFVq2nzCR5 M7pbMck+mxHmduTo8skIL51wd+szFMBglfLNDdZ/IHVZdAnlIfpKHcjSEhPTF6bXw5zc IFyw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=dGMAuEnIUQq0uXXp2Gx4h5gKJcSdj/a6U9kzPnDztY4=; b=qR/HLoA9a7q52+5310HKbwt0OByD48tE0B0JmCJ9VatOdH9liePd38t1SEBFcwvl+n XeRJn4RoDN0Dep0cLP7n/lqPb1OT0V/7Z3o5D7G8agX6u1qAlCOHyadtTA9ismkDk6Cc y5d729W2zUQhCCqXi0kQtIBF64vM0UJeTcBMWqHQKfnnU/jkr4BBH1kH1Om4VIqS7jbd hAdugoz+ZlUzpamoKfFM/Imhr3Sk2s0QoKtBfsF15os+hq4geCX6vzVGHasPj+Arvx1t U5B7g9vHP7N2/NAxQ2zX0La0/HWe8fd10pXjzFrjFmU22NPT4jHVRvCNDwYqfykFZwt+ xJQA==
X-Gm-Message-State: AKaTC03YG8IYMJtq09TmCyrG8gsFNksPA+1wfY1aTZMoemYvZtcRN9pZ7+GdR/XZhUbKIDzEeJHZ8YsP+WUGcA==
X-Received: by 10.55.126.193 with SMTP id z184mr54739319qkc.115.1481715465514; Wed, 14 Dec 2016 03:37:45 -0800 (PST)
MIME-Version: 1.0
Received: by 10.140.38.233 with HTTP; Wed, 14 Dec 2016 03:37:45 -0800 (PST)
In-Reply-To: <60914.1481712680@critter.freebsd.dk>
References: <20161213173327.C1F7D1714B@welho-filter2.welho.com> <20161213175419.GA7943@LK-Perkele-V2.elisa-laajakaista.fi> <25434.1481665395@critter.freebsd.dk> <201612140628.uBE6SO3L025885@shell.siilo.fmi.fi> <36792.1481701328@critter.freebsd.dk> <CACweHNDKgWQewZHb=Kz3_2=41M58sY5472Q5OwpqPLxorvkzHQ@mail.gmail.com> <37223.1481707288@critter.freebsd.dk> <3a65ca44-f652-3b14-6d64-46f35b32df57@isode.com> <55880.1481711031@critter.freebsd.dk> <95057a05-6714-9154-8cf8-7cd302c86715@gmx.de> <60914.1481712680@critter.freebsd.dk>
From: Martin Thomson <martin.thomson@gmail.com>
Date: Wed, 14 Dec 2016 22:37:45 +1100
Message-ID: <CABkgnnWzOhkznH2HzweNegYo4dDHE+DT0PM=eCSvVr+-Wkup1A@mail.gmail.com>
To: Poul-Henning Kamp <phk@phk.freebsd.dk>
Cc: Julian Reschke <julian.reschke@gmx.de>, Alexey Melnikov <alexey.melnikov@isode.com>, Matthew Kerwin <matthew@kerwin.net.au>, Kari Hurtta <hurtta-ietf@elmme-mailer.org>, Ilari Liusvaara <ilariliusvaara@welho.com>, HTTP working group mailing list <ietf-http-wg@w3.org>, Poul-Henning Kamp <phk@varnish-cache.org>
Content-Type: text/plain; charset="UTF-8"
Received-SPF: pass client-ip=209.85.220.180; envelope-from=martin.thomson@gmail.com; helo=mail-qk0-f180.google.com
X-W3C-Hub-Spam-Status: No, score=-6.4
X-W3C-Hub-Spam-Report: AWL=0.359, BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, W3C_AA=-1, W3C_DB=-1, W3C_IRA=-1, W3C_WL=-1
X-W3C-Scan-Sig: titan.w3.org 1cH7sx-0003pZ-Bh c60477a4a1fc7348dc02778212ecb9d2
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Unicode escape sequence | Re: draft-ietf-httpbis-header-structure-00, unicode range
Archived-At: <http://www.w3.org/mid/CABkgnnWzOhkznH2HzweNegYo4dDHE+DT0PM=eCSvVr+-Wkup1A@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/33191
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

On 14 December 2016 at 21:51, Poul-Henning Kamp <phk@phk.freebsd.dk> wrote:
> Well, UTF-8 would also go through HPACK, but by eye-ball it seems
> that it would be more efficient.

If you have lots of ASCII still, you can probably Huffman encode,
though if you have lots of non-ASCII, you need to watch out: a three
octet UTF-8 encoded codepoint turns into (worst case) 82 bits.  Best
case is 58 bits (both of which are invalid, so maybe not).

I can't remember, is there actually a good reason why we can't just
start shoving UTF-8 in header fields?  I mean, h2 is probably OK with
this.