Re: [hybi] Interface for Large Frames

"Andy Green (林安廸)" <andy@warmcat.com> Wed, 22 June 2011 22:18 UTC

Return-Path: <andy@warmcat.com>
X-Original-To: hybi@ietfa.amsl.com
Delivered-To: hybi@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8C6BC1F0C47 for <hybi@ietfa.amsl.com>; Wed, 22 Jun 2011 15:18:12 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.466
X-Spam-Level:
X-Spam-Status: No, score=-2.466 tagged_above=-999 required=5 tests=[AWL=-0.167, BAYES_00=-2.599, MIME_8BIT_HEADER=0.3]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id gxVO0QLhGiwA for <hybi@ietfa.amsl.com>; Wed, 22 Jun 2011 15:18:12 -0700 (PDT)
Received: from warmcat.com (warmcat.com [87.106.134.80]) by ietfa.amsl.com (Postfix) with ESMTP id F2A141F0C45 for <hybi@ietf.org>; Wed, 22 Jun 2011 15:18:11 -0700 (PDT)
Message-ID: <4E026A1C.2030603@warmcat.com>
Date: Wed, 22 Jun 2011 23:18:04 +0100
From: "\"Andy Green (林安廸)\"" <andy@warmcat.com>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.17) Gecko/20110531 Fedora/3.1.10-2.fc16 Thunderbird/3.1.10
MIME-Version: 1.0
To: Bob Gezelter <gezelter@rlgsc.com>
References: <20110622145847.ef1fc80126c74c6c202a919c41c7bb0b.c4cc844e80.wbe@email03.secureserver.net>
In-Reply-To: <20110622145847.ef1fc80126c74c6c202a919c41c7bb0b.c4cc844e80.wbe@email03.secureserver.net>
Content-Type: text/plain; charset="UTF-8"; format="flowed"
Content-Transfer-Encoding: 7bit
Cc: hybi@ietf.org
Subject: Re: [hybi] Interface for Large Frames
X-BeenThere: hybi@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Server-Initiated HTTP <hybi.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hybi>, <mailto:hybi-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/hybi>
List-Post: <mailto:hybi@ietf.org>
List-Help: <mailto:hybi-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hybi>, <mailto:hybi-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 22 Jun 2011 22:18:12 -0000

On 06/22/2011 10:58 PM, Somebody in the thread at some point said:
> The FILE methods in stdio.h include a "number of bytes" parameter. In
> the context of the WebSocket protocol, the natural unit would appear to
> be the frame. Once the frame has been retrieved by a user, then a
> character-by-character state machine may (emphasis MAY) be appropriate,
> however, the interface is best (most efficient) if entire frames can be
> transferred at a time.

That's true but it's inherently fragile when 63-bit length frames are 
allowed by the protocol but cannot be buffered.  It means there's a 
ceiling where the code must act different or break based on its 
buffering arrangements.

Requiring maximum frame size buffers per connection may also present 
scaling problems.

> If programs must pull one character at a time, the efficiency will be
> poor, with a large amount of overhead being consumed moving up and down
> the call tree.

Well, it depends.  You'll notice that "...and just buffer payload 
locally using any size buffer or none at all...", so buffering at the 
layer that contains the state machine is possible with this technique 
and reduces the calls to the handler dramatically even with a small 
buffer.  And with this technique, there's no dependency on that buffer 
size compared to max frame size so scalability is improved.

-Andy