Re: HTTP router point-of-view concerns

"Martin Nilsson" <nilsson@opera.com> Sun, 14 July 2013 22:34 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 945C121F9BD8 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Sun, 14 Jul 2013 15:34:28 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -10.599
X-Spam-Level:
X-Spam-Status: No, score=-10.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id bFo9Hv6ey0Yp for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Sun, 14 Jul 2013 15:34:22 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id 03DEC21F9BC0 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Sun, 14 Jul 2013 15:34:21 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1UyUrB-0006m4-I5 for ietf-http-wg-dist@listhub.w3.org; Sun, 14 Jul 2013 22:33:29 +0000
Resent-Date: Sun, 14 Jul 2013 22:33:29 +0000
Resent-Message-Id: <E1UyUrB-0006m4-I5@frink.w3.org>
Received: from lisa.w3.org ([128.30.52.41]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <nilsson@opera.com>) id 1UyUr1-0006jE-TL for ietf-http-wg@listhub.w3.org; Sun, 14 Jul 2013 22:33:19 +0000
Received: from mail-pa0-f54.google.com ([209.85.220.54]) by lisa.w3.org with esmtps (TLS1.0:RSA_ARCFOUR_SHA1:16) (Exim 4.72) (envelope-from <nilsson@opera.com>) id 1UyUr1-0008Nr-9k for ietf-http-wg@w3.org; Sun, 14 Jul 2013 22:33:19 +0000
Received: by mail-pa0-f54.google.com with SMTP id kx10so10623729pab.41 for <ietf-http-wg@w3.org>; Sun, 14 Jul 2013 15:32:52 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=content-type:to:subject:references:date:mime-version :content-transfer-encoding:from:organization:message-id:in-reply-to :user-agent:x-gm-message-state; bh=Q9O0/1mN9Jwn+xHkHCJmixN/CS4w0ts1vGlW1aPE21g=; b=G/rI3XF6o/1uwpGULD/E4sPQv4G6EY+hNsKGYJ4fTo4QiOncYWN9GPfSwSU1vSMqq2 wofukIOhTts3S7/eXcpkqKLS2KDpV4VebH/ym+vQe+Wk2kPWanwBzttj/Y/HmmcoHhy9 3viB1AXkh+zrefBapcx5yxzTvIXIDJGxkZXxUfxMFYcvsGt+QZXVP5fY9K2NIYhgflQw fxuktbpI8dXzMtMT35b+QpQUpdAEMYPtQMVLtsJo4p/t7yAimMe+w5OxXvtZYn65PeKH P0iisJfhqa21FhRIOYRUqIKwD/DnXBZWLWl7yMMFDS7nyoLSDIlxi1/UvQpmgR7nXy/f 59bg==
X-Received: by 10.66.119.74 with SMTP id ks10mr52950914pab.179.1373841172833; Sun, 14 Jul 2013 15:32:52 -0700 (PDT)
Received: from uranium ([38.110.160.4]) by mx.google.com with ESMTPSA id sq5sm60699773pab.11.2013.07.14.15.32.51 for <ietf-http-wg@w3.org> (version=TLSv1 cipher=RC4-SHA bits=128/128); Sun, 14 Jul 2013 15:32:52 -0700 (PDT)
Content-Type: text/plain; charset="iso-8859-15"; format="flowed"; delsp="yes"
To: ietf-http-wg@w3.org
References: <CA+qvzFPUpcm6kUtJx+rTw8Dpp4Gtx4Bmr3XPDhjNsjchUfN9_w@mail.gmail.com> <51DE1E32.9010801@treenet.co.nz> <CAP+FsNdcYhA=V5Z+zbt70b5e7WmcmXgjG5M9L3vfXeXfTwmRnw@mail.gmail.com> <51DE327C.7010901@treenet.co.nz> <CABkgnnXeqD6wh0dcJ1Dz=4PLAJNkDeGcCuzMr9ATd_7xS7nbGQ@mail.gmail.com> <CABP7RbcUkLf3CTAB4jwicnsiKWLGVY6=hX0k=0256SR_gcVt9A@mail.gmail.com> <092D65A8-8CB7-419D-B6A4-77CAE40A0026@gmail.com> <3835.1373612286@critter.freebsd.dk> <CD9E163F-1225-4DA8-9982-8BDBD16B1051@mnot.net> <1772.1373629495@critter.freebsd.dk> <C0C65ACC-673E-4E07-B2D0-B84723755E6F@apple.com> <CA+qvzFPya3nVZBV2Wes2gWQqgTa34gXb9DK8zhoK1GNx52XCXQ@mail.gmail.com> <CAOdDvNot=0ir9095ffQW14j5AbaCL5WQwUWGmH9v3a05mFf_nA@mail.gmail.com>
Date: Mon, 15 Jul 2013 00:32:50 +0200
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
From: Martin Nilsson <nilsson@opera.com>
Organization: Opera Software
Message-ID: <op.wz8gw0ofiw9drz@uranium>
In-Reply-To: <CAOdDvNot=0ir9095ffQW14j5AbaCL5WQwUWGmH9v3a05mFf_nA@mail.gmail.com>
User-Agent: Opera Mail/12.02 (Win32)
X-Gm-Message-State: ALoCoQnb3LlpmWnou1opX+1nNLDI8ul/+0GOHdQKsRBxR1YiKqDpx5BqaJHJQNMEc/honqiv6pbQ
Received-SPF: pass client-ip=209.85.220.54; envelope-from=nilsson@opera.com; helo=mail-pa0-f54.google.com
X-W3C-Hub-Spam-Status: No, score=-2.6
X-W3C-Hub-Spam-Report: BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001
X-W3C-Scan-Sig: lisa.w3.org 1UyUr1-0008Nr-9k 541be2c5be210a464b12e896737b0103
X-Original-To: ietf-http-wg@w3.org
Subject: Re: HTTP router point-of-view concerns
Archived-At: <http://www.w3.org/mid/op.wz8gw0ofiw9drz@uranium>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/18770
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

On Fri, 12 Jul 2013 14:59:30 +0200, Patrick McManus <pmcmanus@mozilla.com>  
wrote:

> cookies and user agents, while very redundant, are not 100% consistent  
> between transactions. Especially in >proxying scenarios, but other  
> places too.
>
> And even if we removed those, a request header would still be ~300 bytes  
> - which is just too big to support the >many dozens of subresources that  
> commonly make up a page today in one rtt.
>

Taking a snapshot of 250k requests from mobile devices gives an average of  
567 bytes per request. This is for short URLs and no cookies (except those  
injected by operators) are included.

    0 : 18.9%
  100 :  1.6%
  200 :  7.7%
  300 :  9.8%
  400 :  8.4%
  500 : 11.1%
  600 : 11.4%
  700 :  9.5%
  800 :  7.7%
  900 :  4.7%
1000 :  2.4%

Almost all of these are however request invariant, so just setting these  
on a connection level solves most of the problem without compression or  
compact encoding.

/Martin Nilsson