Re: [tcpm] Increasing the Initial Window - Notes

Jerry Chu <hkchu@google.com> Wed, 10 November 2010 22:39 UTC

Return-Path: <hkchu@google.com>
X-Original-To: tcpm@core3.amsl.com
Delivered-To: tcpm@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 097C53A679F for <tcpm@core3.amsl.com>; Wed, 10 Nov 2010 14:39:28 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -109.977
X-Spam-Level:
X-Spam-Status: No, score=-109.977 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, FM_FORGED_GMAIL=0.622, RCVD_IN_DNSWL_HI=-8, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id FgUMkXfVxgNx for <tcpm@core3.amsl.com>; Wed, 10 Nov 2010 14:39:14 -0800 (PST)
Received: from smtp-out.google.com (smtp-out.google.com [74.125.121.35]) by core3.amsl.com (Postfix) with ESMTP id B19FF3A6781 for <tcpm@ietf.org>; Wed, 10 Nov 2010 14:38:07 -0800 (PST)
Received: from kpbe14.cbf.corp.google.com (kpbe14.cbf.corp.google.com [172.25.105.78]) by smtp-out.google.com with ESMTP id oAAMcYxN004923 for <tcpm@ietf.org>; Wed, 10 Nov 2010 14:38:34 -0800
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=google.com; s=beta; t=1289428715; bh=Adeet5c0RMF7z7k0WAjx9ux0zQE=; h=MIME-Version:In-Reply-To:References:Date:Message-ID:Subject:From: To:Cc:Content-Type:Content-Transfer-Encoding; b=CfuBlW7oC3LsGc89YWt9CAeDp3NMKVWjokEneG8vtv1HbH9Ws40vBk7kj8Jc7AdYZ RkkqC+pEkXHRZefTQdE6A==
Received: from ywa8 (ywa8.prod.google.com [10.192.1.8]) by kpbe14.cbf.corp.google.com with ESMTP id oAAMbrTj007538 for <tcpm@ietf.org>; Wed, 10 Nov 2010 14:38:33 -0800
Received: by ywa8 with SMTP id 8so303208ywa.27 for <tcpm@ietf.org>; Wed, 10 Nov 2010 14:38:32 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=beta; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=JEqBYSlntnQeQGt2Eo5ZUwRmmDvHmfga5X4WGpLfCng=; b=AennuV93oW/psY/hqsRwKI9a+k3Ppp40g1CoGzWGmv5GI2K208djrN+m4wfk4cBTXv Dzf8XuoUtIUAukWvEYlg==
DomainKey-Signature: a=rsa-sha1; c=nofws; d=google.com; s=beta; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=TMWp5fs82taR0eNQPQaEzjYsi0M8p7vX1AHrzjezk99bNO/D45A51+5gAFLdFhNUMQ H7ObHUmI7o6DHaWmE3IA==
MIME-Version: 1.0
Received: by 10.150.91.13 with SMTP id o13mr431068ybb.6.1289428711845; Wed, 10 Nov 2010 14:38:31 -0800 (PST)
Received: by 10.150.145.4 with HTTP; Wed, 10 Nov 2010 14:38:31 -0800 (PST)
In-Reply-To: <20101110152857.GA5094@hell>
References: <20101110152857.GA5094@hell>
Date: Wed, 10 Nov 2010 14:38:31 -0800
Message-ID: <AANLkTi=c184mDTJmwJjQuQe48_M4CRmHgsQRpSf6v9rb@mail.gmail.com>
From: Jerry Chu <hkchu@google.com>
To: Hagen Paul Pfeifer <hagen@jauu.net>
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: quoted-printable
X-System-Of-Record: true
Cc: tcpm <tcpm@ietf.org>, tmrg <tmrg-interest@icsi.berkeley.edu>, Matt Mathis <mattmathis@google.com>
Subject: Re: [tcpm] Increasing the Initial Window - Notes
X-BeenThere: tcpm@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: TCP Maintenance and Minor Extensions Working Group <tcpm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tcpm>, <mailto:tcpm-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tcpm>
List-Post: <mailto:tcpm@ietf.org>
List-Help: <mailto:tcpm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tcpm>, <mailto:tcpm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 10 Nov 2010 22:39:28 -0000

On Wed, Nov 10, 2010 at 7:29 AM, Hagen Paul Pfeifer <hagen@jauu.net> wrote:
>
> Cause tomorrow Jerry will talk about the IW10 topic my 50 cents in advance.
> First some skeptical notes, secondly a alternative approach to increase the
> IW.
>
> I am skeptical about this draft because IMHO renounce the conservative principle
> towards a aggressive and HTML centric approach (the HTML example is a bad
> allegation, but for FTP and friends slow start is fast enough ;-). My costumer,

TCP's slow start being too slow for not just HTTP traffic but also
median size data
transfers has been a well-known issue in the community and active research on
faster startup schemes has been ongoing for years. But you seem to be against
the rest of us and saying this is not a problem at all?

>
> and probably other networks too, operates multi-hop radio networks with a
> bandwidth of less then 100kB/s.

Folks from Nokia have been actively investigating the effect of IW10 in a radio
network so I'll defer to their findings. I'd only make two points from
our testbed
study on slow (96Kbps) links:

1. There is no denying that IW10 tends to cause higher packet drop rate during
congestion. (Don't get too turned off by some high packet drop rate in my slides
because some of the testcases were designed to be extreme in order to get to
the worst case, and it looks like the worst case we've found for IW10, it was
also terrible for IW3 (e.g., UCT > 50secs).

2. Regardless of IW10's higher packet drop rate, it's flow completion time has
been consistently better, or at least not worse than IW3's. Some explanation
of it was given in my slides.

3. In a multi-hop multi-congestion-point mobile network the high packet drop
rate may cause more damage due to the waste of bandwidth on the path
leading to the final congestion drop point. Our testbed has only one congestion
point so doesn't exhibit this problem. I think folks from Nokia are concerned
with this problem and I'll defer this to them.

>
> An increased IW of 10 define 10*~MSS byte as the smallest atomic in-flight
> value. New data are always pushed into the network in this quantum - a way to
> much for the standard TCP CC mechanism to tune into a steady state for network
> with a low BDP.

Do you have any real numbers to backup your claim here? Numbers from our live
tests at Google's frontends seem to contradict to your statement here.

>
> In the discussion I miss the impact of the proposed modification regarding
> networks that operates already at a functioning boundary. Are we at a time
> where we loss these types of networks? Where are the simulation results that
> show that the impact at this kind of networks is acceptable?

See past email threads and slides.

>
>
>
> Alternative idea: can we shift the idea towards a more robust basis. What about
> a increased IW of 10 if we know that the path is capable of an increased IW?
>
> Pseudo Algorithm for a new connection:
>
>        a) No cached CC data available
>
>                IW = 4 (standard mechanism a la RFC 5681, 3390)
>                CC mechanism as usual but save CC parameters - especially cwnd - per route
>
>
>        b) CC data per route is available
>
>                IF (cached_cwnd >= 10)
>                        IW = 10
>                else
>                        IW = 4
>
>
> After n minutes, previously saved CC data is marked as invalid, similar to the
> existing "back to slow start after n minutes idle" mechanism.
>
> Idea: networks with a low BDP will signal by packet drop or ECN marking that
> congestion occur and the BDP is saturated. Why not use actual network
> information to setup the IW but preserve the conservative nature of TCP?
>
> Maybe this is an approach for further discussions, I have a curious feeling
> that in 2 years the same discussion will start with a IW of 23 ... So maybe we
> should drop the static IW approach completely and define IW as
> cached_steady_state_cwnd / 2 for cached routes and IW = 4 for startup all other
> cases.

You are late to the party :). All the above and more has been
presented/discussed/
debated in the past already. To make it short, we first tried tweaking Linux dst
cache like you described above but found it not very effective (e.g., cache hit
rate was low...) Then we tried an off-line history database approach
but found it
too complicated. Finally we decided a moderate increase of IW is the right, and
timely solution (until someone else like you could find the optimal or
completely
scalable solution to solve the global warming problem :). Following the KISS
principle, we'd open to any amendment based on info collected during 3WHS
but will be prejudiced against any other states that need to collected and kept
from the past.

I see your name on the attendee list. If you like to chat more you can find me
at CONEX this morning. I'll probably take a front row seat there.

Best,

Jerry

>
>
> Best regards, Hagen