Return-Path: <duerst@it.aoyama.ac.jp>
X-Original-To: hybi@core3.amsl.com
Delivered-To: hybi@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix)
 with ESMTP id 464B628C118 for <hybi@core3.amsl.com>;
 Tue, 27 Oct 2009 04:15:48 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 0.792
X-Spam-Level: 
X-Spam-Status: No, score=0.792 tagged_above=-999 required=5 tests=[AWL=-0.018,
 BAYES_00=-2.599, HELO_EQ_JP=1.244, HOST_EQ_JP=1.265, J_CHICKENPOX_66=0.6,
 MIME_8BIT_HEADER=0.3]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com
 [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id mhWzQCaM7TUz for
 <hybi@core3.amsl.com>; Tue, 27 Oct 2009 04:15:47 -0700 (PDT)
Received: from scmailgw01.scop.aoyama.ac.jp (scmailgw01.scop.aoyama.ac.jp
 [133.2.251.41]) by core3.amsl.com (Postfix) with ESMTP id 365473A6927 for
 <hybi@ietf.org>; Tue, 27 Oct 2009 04:15:47 -0700 (PDT)
Received: from scmse02.scbb.aoyama.ac.jp (scmse02.scbb.aoyama.ac.jp
 [133.2.253.159]) by scmailgw01.scop.aoyama.ac.jp (secret/secret) with SMTP id
 n9RBG0lc028349 for <hybi@ietf.org>; Tue, 27 Oct 2009 20:16:00 +0900
Received: from (unknown [133.2.206.133]) by scmse02.scbb.aoyama.ac.jp with
 smtp id 5fc4_1b6f8ce2_c2ea_11de_8693_001d096c5782;
 Tue, 27 Oct 2009 20:16:00 +0900
Received: from [IPv6:::1] ([133.2.210.1]:35521) by itmail.it.aoyama.ac.jp with
 [XMail 1.22 ESMTP Server] id <S12458C1> for <hybi@ietf.org> from
 <duerst@it.aoyama.ac.jp>; Tue, 27 Oct 2009 20:12:32 +0900
Message-ID: <4AE6D661.1090007@it.aoyama.ac.jp>
Date: Tue, 27 Oct 2009 20:15:45 +0900
From: =?ISO-8859-1?Q?=22Martin_J=2E_D=FCrst=22?= <duerst@it.aoyama.ac.jp>
Organization: Aoyama Gakuin University
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US;
 rv:1.9.1b3pre) Gecko/20090108 Eudora/3.0b1pre
MIME-Version: 1.0
To: Greg Wilkins <gregw@webtide.com>
References: <8B0A9FCBB9832F43971E38010638454F0F1EA72C@SISPE7MB1.commscope.com>	<Pine.LNX.4.62.0910270903080.9145@hixie.dreamhostps.com>
 <4AE6C6A8.6090307@webtide.com>
In-Reply-To: <4AE6C6A8.6090307@webtide.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8bit
Cc: "hybi@ietf.org" <hybi@ietf.org>, "Thomson,
 Martin" <Martin.Thomson@andrew.com>
Subject: Re: [hybi] WS framing alternative
X-BeenThere: hybi@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: Server-Initiated HTTP <hybi.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/hybi>,
 <mailto:hybi-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/hybi>
List-Post: <mailto:hybi@ietf.org>
List-Help: <mailto:hybi-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hybi>,
 <mailto:hybi-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 27 Oct 2009 11:15:48 -0000

On 2009/10/27 19:08, Greg Wilkins wrote:

> Existing UTF-8 to character conversions will error if they get a partial
> multipart character,

No, good transcoding libraries have options that say what to do in such 
a case. Iconv is definitely an example, String#encode in Ruby is another.

> so you can start conversion to characters until
> you have the entire message.

I assume you wanted to say "cannot start conversion". False as explained 
above.

> Efficient implementations will be forced
> to reimplement utf-8 converters to scan for 0x00 while converting.

No. These two concerns can be separated completely.

And there's the case that no conversion from utf-8 to characters is 
needed (when your implementation uses utf-8 for its internal 
representation, as e.g. in Perl or (mostly) in Ruby). (Still, you better 
check for consistent UTF-8 byte sequences.)

Regards,   Martin.

-- 
#-# Martin J. Dürst, Professor, Aoyama Gakuin University
#-# http://www.sw.it.aoyama.ac.jp   mailto:duerst@it.aoyama.ac.jp