Re: delta encoding and state management

Patrick McManus <pmcmanus@mozilla.com> Thu, 24 January 2013 14:51 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id DE58021F8A1C for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 24 Jan 2013 06:51:45 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.569
X-Spam-Level:
X-Spam-Status: No, score=-9.569 tagged_above=-999 required=5 tests=[AWL=0.092, BAYES_00=-2.599, FM_FORGED_GMAIL=0.622, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-8, SARE_MILLIONSOF=0.315]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id e1C+aOj7vgI3 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 24 Jan 2013 06:51:44 -0800 (PST)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id D7A3A21F8A40 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Thu, 24 Jan 2013 06:51:43 -0800 (PST)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1TyO8x-0000Ke-Gc for ietf-http-wg-dist@listhub.w3.org; Thu, 24 Jan 2013 14:51:07 +0000
Resent-Date: Thu, 24 Jan 2013 14:51:07 +0000
Resent-Message-Id: <E1TyO8x-0000Ke-Gc@frink.w3.org>
Received: from lisa.w3.org ([128.30.52.41]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <patrick.ducksong@gmail.com>) id 1TyO8s-0000JO-92 for ietf-http-wg@listhub.w3.org; Thu, 24 Jan 2013 14:51:02 +0000
Received: from mail-oa0-f50.google.com ([209.85.219.50]) by lisa.w3.org with esmtps (TLS1.0:RSA_ARCFOUR_SHA1:16) (Exim 4.72) (envelope-from <patrick.ducksong@gmail.com>) id 1TyO8r-0005BV-2Y for ietf-http-wg@w3.org; Thu, 24 Jan 2013 14:51:02 +0000
Received: by mail-oa0-f50.google.com with SMTP id n16so9978061oag.9 for <ietf-http-wg@w3.org>; Thu, 24 Jan 2013 06:50:35 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=d8rzyY9gOB0gY3VKQ8DlakSYu8OZ3aT9KoTJvkj5Yto=; b=DW7R/yTWj1OUOOelLN1mY5J+KuTSARwwqETLvNIyin/AQeCkEsOyyn/5sNDaSGlJSH HODvBVrGGvOhwty2AKsr9uMBa3UXzG1/09Dcm/YkeAoQdfkI8RCxWrUgyH13Pr2EfvFs rRmGDa/C7EvQv5C5nv2ctYCf7/IVogGpO4McPnT+mGUPlGNEGkJ0S3t1o/neJ3vvYHNS fOndidGSQNOjydTIaQEeAi28RIjjfm+e4yfPgFmRWA6Wfbhi5Y3qJ0UNgA0U9XEN0tRq w4LJtvZy6EGX0iPMJpVdxHrwaNs1HOFDKuuHLy2YtubmM+jFpfwUblwoBds+eL96TZkQ Rqrw==
MIME-Version: 1.0
X-Received: by 10.60.32.33 with SMTP id f1mr1666806oei.122.1359039035081; Thu, 24 Jan 2013 06:50:35 -0800 (PST)
Sender: patrick.ducksong@gmail.com
Received: by 10.76.132.165 with HTTP; Thu, 24 Jan 2013 06:50:34 -0800 (PST)
In-Reply-To: <20130124070818.GH6590@1wt.eu>
References: <CABP7Rbeb6MOYmYPhhsKFFtQwE0JxuPyShXY0zpkA5YX2JPSY_w@mail.gmail.com> <CAA4WUYhg2qt_z_TrOAH0ax6mUpYPNeG4x740CgQi5Voq=50K_Q@mail.gmail.com> <20130122212748.GJ30692@1wt.eu> <CAA4WUYj51jRFosut2RsdE46SqoMDqa_r5EB7g4pj5eC2i73j7Q@mail.gmail.com> <20130122224646.GO30692@1wt.eu> <CAA4WUYjuCGyJjA2nN_-oh8TunrA7owWFQRhLg-ps+fkp9T47Ew@mail.gmail.com> <20130123000018.GR30692@1wt.eu> <CAA4WUYjGiA0WP6o3ub5ZPTh-zYZ9Jth6w2GfuMT+WarT69GW-A@mail.gmail.com> <20130123073357.GB32648@1wt.eu> <CAOdDvNoOnscRCA54n07Suxe9UQieq32SkwvMxNnEdSnK94s_PA@mail.gmail.com> <20130124070818.GH6590@1wt.eu>
Date: Thu, 24 Jan 2013 09:50:34 -0500
X-Google-Sender-Auth: ybvzUvmTMSWkBlyIBxjnv4d24K8
Message-ID: <CAOdDvNrR+pCKujywHjbJ+ksEkLZE-H=AvD3wJnvGf+_7Hv=Ldg@mail.gmail.com>
From: Patrick McManus <pmcmanus@mozilla.com>
To: Willy Tarreau <w@1wt.eu>
Cc: "William Chan (?????????)" <willchan@chromium.org>, James M Snell <jasnell@gmail.com>, Nico Williams <nico@cryptonector.com>, Roberto Peon <grmocg@gmail.com>, "ietf-http-wg@w3.org" <ietf-http-wg@w3.org>
Content-Type: multipart/alternative; boundary="e89a8fb1f6c8ec05fb04d409ee66"
Received-SPF: pass client-ip=209.85.219.50; envelope-from=patrick.ducksong@gmail.com; helo=mail-oa0-f50.google.com
X-W3C-Hub-Spam-Status: No, score=-3.4
X-W3C-Hub-Spam-Report: AWL=-2.711, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001
X-W3C-Scan-Sig: lisa.w3.org 1TyO8r-0005BV-2Y fb6822b4170528cd6727c5b33277b41e
X-Original-To: ietf-http-wg@w3.org
Subject: Re: delta encoding and state management
Archived-At: <http://www.w3.org/mid/CAOdDvNrR+pCKujywHjbJ+ksEkLZE-H=AvD3wJnvGf+_7Hv=Ldg@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/16150
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

On Thu, Jan 24, 2013 at 2:08 AM, Willy Tarreau <w@1wt.eu> wrote:

>
> You don't count the trend in user count which is faster than the trend
> in RAM price unfortunately. I've had several times people ask me what
> to change in their kernel to go beyond 1 million concurrent connections
> in haproxy. A few years ago, they were only talking about several tens
> of thousands. With everything device connected to everything all the
> time, I don't expect this trend to revert any time soon :-/
>

Hey Wily,

you're a wicked smart guy with customers backed by millions of people and
resources. Your problem is a "simple" (jokingly!) matter of engineering
bigger systems.

The latency problem is inherent in the speed of light and can't be fixed in
the same way. I remain convinced that it should trump other objectives when
designing the protocol.

That being said, I'm not here arguing for RAM bloat! All I said is that if
state can be justified by an improvement against the latency problem then
it is truly justified. If another scheme can do the same with less state -
then that's more awesome!

-Patrick