Re: [hybi] frame length encoding

John Tamplin <jat@google.com> Sat, 21 August 2010 21:36 UTC

Return-Path: <jat@google.com>
X-Original-To: hybi@core3.amsl.com
Delivered-To: hybi@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 96E5F3A695A for <hybi@core3.amsl.com>; Sat, 21 Aug 2010 14:36:25 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -105.195
X-Spam-Level:
X-Spam-Status: No, score=-105.195 tagged_above=-999 required=5 tests=[AWL=0.781, BAYES_00=-2.599, FM_FORGED_GMAIL=0.622, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id j7+63ykdbA63 for <hybi@core3.amsl.com>; Sat, 21 Aug 2010 14:36:20 -0700 (PDT)
Received: from smtp-out.google.com (smtp-out.google.com [74.125.121.35]) by core3.amsl.com (Postfix) with ESMTP id B5D383A6972 for <hybi@ietf.org>; Sat, 21 Aug 2010 14:33:51 -0700 (PDT)
Received: from hpaq7.eem.corp.google.com (hpaq7.eem.corp.google.com [172.25.149.7]) by smtp-out.google.com with ESMTP id o7LLXgn9016351 for <hybi@ietf.org>; Sat, 21 Aug 2010 14:33:42 -0700
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=google.com; s=beta; t=1282426422; bh=AbyGKz+oAEN1jx73cN0LPxRXTUE=; h=MIME-Version:In-Reply-To:References:From:Date:Message-ID:Subject: To:Cc:Content-Type; b=JrEC8yOOIoBdTVkXq0Phv2+EYhrCDhBjwTLnIsgRcYxkRXYmaKAvVx3noGcklVHqh s5hd4ip5LCGccILSxzxsA==
DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=mime-version:in-reply-to:references:from:date:message-id: subject:to:cc:content-type:x-system-of-record; b=rC3261MZPmBBR7MpLU7QYOWnqxwQ9L51JvTwfJUOKNQVPWNbWgEeAOd4NMQqRzJe6 R9ToevKJWZNOKvZSGfJhw==
Received: from gyb13 (gyb13.prod.google.com [10.243.49.77]) by hpaq7.eem.corp.google.com with ESMTP id o7LLXeVV019187 for <hybi@ietf.org>; Sat, 21 Aug 2010 14:33:40 -0700
Received: by gyb13 with SMTP id 13so2038992gyb.7 for <hybi@ietf.org>; Sat, 21 Aug 2010 14:33:40 -0700 (PDT)
Received: by 10.150.95.4 with SMTP id s4mr3239230ybb.324.1282426420215; Sat, 21 Aug 2010 14:33:40 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.151.60.3 with HTTP; Sat, 21 Aug 2010 14:33:20 -0700 (PDT)
In-Reply-To: <AANLkTinRgLYg=-hhgtUD__=PqM82Y0nB6HPGkMca3-pw@mail.gmail.com>
References: <AANLkTimKbmcpgx8k0uXUWvCO=8w9pPrtV=3y4qh6363k@mail.gmail.com> <20100820192927.GA32620@1wt.eu> <4C6EEA55.2050205@hs-weingarten.de> <AANLkTinHqxUOZaVANFpC52t8FfgNw2L5_A-s9Az3Fm7p@mail.gmail.com> <AANLkTinvkxMP8FYz9xjDu_Kt9FfzYotgsqXUDB4MZMEo@mail.gmail.com> <AANLkTim3KRq1arso7wN_b+1TH3sWabYW6uFu7AbYw6-P@mail.gmail.com> <AANLkTikhhajho895WyEoJMwMk9GJ98kA0Mjy5qr4apC8@mail.gmail.com> <AANLkTi=kdk6BRvza_7bpoLNTFzUkjcRRijGLMe_NGXZV@mail.gmail.com> <AANLkTi=VE298Tg+qyfufhzMswE5pBxtPZhA0t2k=sf2A@mail.gmail.com> <AANLkTin2sNji3J98VqacammHFS=DJHmpq5zY_mTFNt8Z@mail.gmail.com> <AANLkTinRgLYg=-hhgtUD__=PqM82Y0nB6HPGkMca3-pw@mail.gmail.com>
From: John Tamplin <jat@google.com>
Date: Sat, 21 Aug 2010 17:33:20 -0400
Message-ID: <AANLkTinQ1C36LfbzZZ39CJCasrzvd3MUb+FK-Bq-EdNA@mail.gmail.com>
To: Pieter Hintjens <ph@imatix.com>
Content-Type: multipart/alternative; boundary="000e0cd6ade03a4275048e5c2bf9"
X-System-Of-Record: true
Cc: Hybi <hybi@ietf.org>
Subject: Re: [hybi] frame length encoding
X-BeenThere: hybi@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: Server-Initiated HTTP <hybi.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/hybi>, <mailto:hybi-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/hybi>
List-Post: <mailto:hybi@ietf.org>
List-Help: <mailto:hybi-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hybi>, <mailto:hybi-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 21 Aug 2010 21:36:26 -0000

On Sat, Aug 21, 2010 at 4:27 PM, Pieter Hintjens <ph@imatix.com> wrote:

> CPU core count increases but I think it's fair to say CPU speeds have
> hit the top of the curve.  Thus we're constrained by the capacity of
> one core to process the data off a network, while network capacity
> continues to double every 18-24 months.


I'm not sure I would agree with you on the network bandwidth.  Many places I
know of still use 100baseT to the desktop, 17 years after its introduction
and are only slowly migrating to GigE (itself 11 years old) as
infrastructure costs have come down to about equal.  I don't know of anyone
running higher than GigE to the desktop.  Beyond that, anecdotally the
typical size of the Internet connection at businesses doesn't seem to have
increased since I was in the ISP business 10 years ago (home and mobile
definitely has, though I still don't think at your suggested rate of
doubling).

I will grant your doubling pattern in Infiniband and Myrinet offerings, but
I doubt any significant portion of WebSocket traffic will be running on such
networks.


> Indeed, there are probably very few people in the open source world
> concerned with efficiency at the level we are.  I've explained our
> experience, and will leave it at that.
>

It may also be that WebSocket, which is primarily designed to give TCP-like
capabilities to web browsers, is not appropriate for your backend network --
perhaps a frontend would speak WebSocket to end-users, and then a protocol
more optimized for your needs going back to your servers.

Anyway, I agree with you that getting agreement on the framing, as long as
it is reasonable, is more important than what it actually is so we can get
on to the next problem.

-- 
John A. Tamplin
Software Engineer (GWT), Google