Re: [aqm] [Bloat] TCP BBR paper is now generally available

Eric Dumazet <eric.dumazet@gmail.com> Sat, 03 December 2016 23:15 UTC

Return-Path: <eric.dumazet@gmail.com>
X-Original-To: aqm@ietfa.amsl.com
Delivered-To: aqm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 30DE412943E for <aqm@ietfa.amsl.com>; Sat, 3 Dec 2016 15:15:47 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2
X-Spam-Level:
X-Spam-Status: No, score=-2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id aVyhZRxG8bpE for <aqm@ietfa.amsl.com>; Sat, 3 Dec 2016 15:15:42 -0800 (PST)
Received: from mail-pg0-x242.google.com (mail-pg0-x242.google.com [IPv6:2607:f8b0:400e:c05::242]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1F70212943C for <aqm@ietf.org>; Sat, 3 Dec 2016 15:15:42 -0800 (PST)
Received: by mail-pg0-x242.google.com with SMTP id p66so11850013pga.2 for <aqm@ietf.org>; Sat, 03 Dec 2016 15:15:42 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:subject:from:to:cc:date:in-reply-to:references :mime-version:content-transfer-encoding; bh=iG9zFPRSZYsa/2zZrSX2fKLCz8ic6+kk2WZjT36DByg=; b=PLpXahoFWGjJBveEdX7KldIbp1mIVj7MBltzmlXIJh+2NssRp01SDHlrXBgCe7GtOD eto7fqr244P7Gl6SuFjkzye51iCrweq+1HuSTWCTURHs2EhYcfaDaWeIdaXlsU6/orKO mnMXzsI4eJ8tZzFtE1tJ5DCX4wfCYvT1lL9UbLuCY+TlHVGoA3AxR4py55eeyb75kcjb t/waXVoRm1gh7wEbF7ppO2N62c6sLzwRJVyID7iKTIzM2bkUqsgrPVTN5lKuNyeW0nfp 55HcfudJFXlPYi7U7kiLmmjJXwMFFLE40ywHhHkV5x1eipyWB0r9I9zdtIdQ17/F3dlC 4//Q==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:subject:from:to:cc:date:in-reply-to :references:mime-version:content-transfer-encoding; bh=iG9zFPRSZYsa/2zZrSX2fKLCz8ic6+kk2WZjT36DByg=; b=KWXoEFDzbA3bDGOxizGKLeM5rzV+NUOsoI2Trd6yg8GNTuTXLhmq1WU+ekn5G46fZ2 zKcO+Pba1B7x+B8qsZWRcc+1qkFEHtUUyaidK02isaiMH5dlGRr+Q8hhcAO5cKGoSS5T GLqNXMNdjgJiiFbaLTKbqKftsyEiOMD079f79FwRTaSN3cA9xfZ0qK5i3/byrbV3WWdi ZWe9ksm2f1HoD0HeWtNfXwPAhza20wgf3zw/xejZcg5NCeF5EtaWmTaoSxhAanXLn3gr K+gA6hN6lSd+D7e4WyoizR+PW9MQjGVdpwXGFtNVn5W1rjQAtG3Eo6sa/TVTIy1oP4er 13wA==
X-Gm-Message-State: AKaTC02UtdjdCfMAGAqtp15Ku+EU/f5uhCdzjZA3BCroU4R7RXht+tHR0+Iv6LeLrnZX+w==
X-Received: by 10.84.129.100 with SMTP id 91mr109088728plb.73.1480806941619; Sat, 03 Dec 2016 15:15:41 -0800 (PST)
Received: from [172.19.250.57] ([172.19.250.57]) by smtp.googlemail.com with ESMTPSA id t20sm17107796pfk.48.2016.12.03.15.15.40 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 03 Dec 2016 15:15:41 -0800 (PST)
Message-ID: <1480806940.18162.434.camel@edumazet-glaptop3.roam.corp.google.com>
From: Eric Dumazet <eric.dumazet@gmail.com>
To: "Steinar H. Gunderson" <sgunderson@bigfoot.com>
Date: Sat, 03 Dec 2016 15:15:40 -0800
In-Reply-To: <20161203230335.GA40411@sesse.net>
References: <1480721486.18162.392.camel@edumazet-glaptop3.roam.corp.google.com> <CADVnQym9iPJ+GR7BN9fPRe3on_j=OxUD0D83DS6Dzf1xLKvtnA@mail.gmail.com> <20161203191353.GA972@sesse.net> <1480796415.18162.408.camel@edumazet-glaptop3.roam.corp.google.com> <9A821B94-143B-446F-8852-2EB0158DD57C@gmail.com> <1480799260.18162.418.camel@edumazet-glaptop3.roam.corp.google.com> <20161203213428.GB38041@sesse.net> <1480801837.18162.419.camel@edumazet-glaptop3.roam.corp.google.com> <20161203221338.GC38041@sesse.net> <1480805737.18162.425.camel@edumazet-glaptop3.roam.corp.google.com> <20161203230335.GA40411@sesse.net>
Content-Type: text/plain; charset="UTF-8"
X-Mailer: Evolution 3.10.4-0ubuntu2
Mime-Version: 1.0
Content-Transfer-Encoding: 7bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/aqm/-Q5o0qPvKhZKUU7b3bM4xtI4bLE>
Cc: Jonathan Morton <chromatix99@gmail.com>, Neal Cardwell <ncardwell@google.com>, "aqm@ietf.org" <aqm@ietf.org>, bloat <bloat@lists.bufferbloat.net>
Subject: Re: [aqm] [Bloat] TCP BBR paper is now generally available
X-BeenThere: aqm@ietf.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: "Discussion list for active queue management and flow isolation." <aqm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/aqm>, <mailto:aqm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/aqm/>
List-Post: <mailto:aqm@ietf.org>
List-Help: <mailto:aqm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/aqm>, <mailto:aqm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 03 Dec 2016 23:15:47 -0000

On Sun, 2016-12-04 at 00:03 +0100, Steinar H. Gunderson wrote:
> On Sat, Dec 03, 2016 at 02:55:37PM -0800, Eric Dumazet wrote:
> > Note that starting from linux-4.4, e1000e gets gro_flush_timeout that
> > would help this precise workload
> > 
> > https://git.kernel.org/cgit/linux/kernel/git/davem/net.git/commit/?id=32b3e08fff60494cd1d281a39b51583edfd2b18f
> > 
> > Maybe you can redo the experiment in ~5 years when distro catches up ;)
> 
> I can always find a backport, assuming the IPMI is still working. But it
> really wasn't like this earlier :-) Perhaps something changed on the path,
> unrelated to BBR.

If the tcpdump is taken on receiver, how would you explain these gaps ?
Like the NIC was frozen for 40 ms  !

11:14:06.023821 IP6 C > S: Flags [.], ack 368888520, win 23422, options [nop,nop,TS val 864457007 ecr 3498315976], length 0
11:14:06.023823 IP6 C > S: Flags [.], ack 368891028, win 23430, options [nop,nop,TS val 864457007 ecr 3498315976], length 0
11:14:06.023829 IP6 C > S: Flags [.], ack 368899248, win 23407, options [nop,nop,TS val 864457007 ecr 3498315976], length 0
11:14:06.023834 IP6 C > S: Flags [.], ack 368907468, win 23415, options [nop,nop,TS val 864457007 ecr 3498315976], length 0
11:14:06.023835 IP6 C > S: Flags [.], ack 368915688, win 23392, options [nop,nop,TS val 864457007 ecr 3498315976], length 0
<gap : Not tsval is still 864457007 >
11:14:06.062751 IP6 C > S: Flags [.], ack 368923908, win 23415, options [nop,nop,TS val 864457007 ecr 3498315977], length 0
11:14:06.062767 IP6 C > S: Flags [.], ack 368929620, win 23400, options [nop,nop,TS val 864457007 ecr 3498315977], length 0
11:14:06.062770 IP6 C > S: Flags [.], ack 368932128, win 23430, options [nop,nop,TS val 864457007 ecr 3498315977], length 0
11:14:06.062771 IP6 C > S: Flags [.], ack 368943204, win 23400, options [nop,nop,TS val 864457007 ecr 3498315977], length 0
11:14:06.062773 IP6 C > S: Flags [.], ack 368948568, win 23422, options [nop,nop,TS val 864457008 ecr 3498315977], length 0
11:14:06.062775 IP6 C > S: Flags [.], ack 368956788, win 23400, options [nop,nop,TS val 864457008 ecr 3498315977], length 0
11:14:06.062776 IP6 C > S: Flags [.], ack 368965008, win 23415, options [nop,nop,TS val 864457008 ecr 3498315977], length 0
11:14:06.062778 IP6 C > S: Flags [.], ack 368976084, win 23385, options [nop,nop,TS val 864457008 ecr 3498315977], length 0