Re: [aqm] Dummynet AQM v0.1- CoDel and FQ-CoDel for FreeBSD's ipfw/dummynet

Dave Täht <dave@taht.net> Mon, 29 February 2016 18:55 UTC

Return-Path: <dave@taht.net>
X-Original-To: aqm@ietfa.amsl.com
Delivered-To: aqm@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B13A71B39FC for <aqm@ietfa.amsl.com>; Mon, 29 Feb 2016 10:55:11 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.607
X-Spam-Level:
X-Spam-Status: No, score=-1.607 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, MIME_8BIT_HEADER=0.3, RP_MATCHES_RCVD=-0.006, SPF_PASS=-0.001] autolearn=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id U59fTzH2vJzG for <aqm@ietfa.amsl.com>; Mon, 29 Feb 2016 10:55:09 -0800 (PST)
Received: from mail.taht.net (mail.taht.net [176.58.107.8]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1FB201B39E9 for <aqm@ietf.org>; Mon, 29 Feb 2016 10:55:09 -0800 (PST)
Received: from dair-1314.local (c-73-252-201-217.hsd1.ca.comcast.net [73.252.201.217]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.taht.net (Postfix) with ESMTPSA id 745561F4B6 for <aqm@ietf.org>; Mon, 29 Feb 2016 18:55:07 +0000 (UTC)
To: AQM IETF list <aqm@ietf.org>
References: <6545444AE21C2749939E637E56594CEA3C187192@gsp-ex02.ds.swin.edu.au> <56D1DB2E.1050903@taht.net> <56D1E2AF.8030802@student.kit.edu>
From: Dave Täht <dave@taht.net>
Message-ID: <56D494FF.5070209@taht.net>
Date: Mon, 29 Feb 2016 10:59:11 -0800
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:38.0) Gecko/20100101 Thunderbird/38.6.0
MIME-Version: 1.0
In-Reply-To: <56D1E2AF.8030802@student.kit.edu>
Content-Type: text/plain; charset="windows-1252"
Content-Transfer-Encoding: 8bit
Archived-At: <http://mailarchive.ietf.org/arch/msg/aqm/S2E6PyLTUF4LHNUxK0PwvM9Zb6w>
Subject: Re: [aqm] Dummynet AQM v0.1- CoDel and FQ-CoDel for FreeBSD's ipfw/dummynet
X-BeenThere: aqm@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "Discussion list for active queue management and flow isolation." <aqm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/aqm>, <mailto:aqm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/aqm/>
List-Post: <mailto:aqm@ietf.org>
List-Help: <mailto:aqm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/aqm>, <mailto:aqm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 29 Feb 2016 18:55:11 -0000


On 2/27/16 9:53 AM, Polina Goltsman wrote:
> 
> 
> On 02/27/2016 06:21 PM, Dave Täht wrote:
>>
>> On 2/26/16 6:17 AM, Rasool Al-Saadi wrote:
>>> Dear all,
>>>
>>> I would like to announce that we (myself and Grenville Armitage)
>>> released Dummynet AQM v0.1, which is an independent implementation of
>>> CoDel and FQ-CoDel for FreeBSD's ipfw/dummynet framework, based on
>>> the IETF  CoDel [1] and FQ-CoDel [2] Internet-Drafts.
>>> We prepared patches for FreeBSD11-CURRENT-r295345  and FreeBSD
>>> 10.x-RELEASE (10.0, 10.1, 10.2), and a technical report  of our
>>> implementation.
>>>
>>> Patches and documentation can be found in:
>>> http://caia.swin.edu.au/freebsd/aqm
>>>
>>> Technical report:
>>> http://caia.swin.edu.au/reports/160226A/CAIA-TR-160226A.pdf
>> In browsing this it appears that shaped rates were tested only (?). I am
>> curious what native performance (10,100,1gbit) looked like. I think that
>> freebsd lacks a BQL-like mechanism to control the driver queues, and on
>> the other hand freebsd did not go as nuts with offloads as linux did. Is
>> this code generally applicable (to things like pfsense?)
>>
>> Aside from that, looks pretty good. I am curious also as to what caused
>> the offset difference in sawtooth pattern between linux and bsd
>> implementations (like in fig 2) Different initcwnd? ssthresh? don't seem
>> to be it -  linux reno vs bsd reno?
> I can't distinguish between the maximum congestion windows, but Linux's RTT
> (especially the minimum one) is smaller on all three figures (2,3, and 4),
> and packet losses for FreeBSD are a little less frequent. So, assuming that
> the AQM behaves the same, there is another queue somewhere.

Two other variables worth tweaking on a linux server and client (besides
the kernel version) are sch_fq and tcp_limit_output_bytes. On bare metal
this was set to 4k or so, which proved too small to drive linux wifi's
existing drivers on certain tests, got bumped to 128k, and then the xen
folk noticed that regressed their throughput by like 30%, so it got
bumped again to 256k default.

I liked it at 4k. A lot. :) it is plausible that tweaking
tcp_limit_output_bytes will change your results.

> What is strange is that Linux's goodput is higher on figures 2 and 3
> despite
> lower queueing delay. On the other hand for Cubic both delay and goodput
> are
> slightly smaller. Is that advanced loss recovery in Linux?
> 
> Also, is it normal that NewReno resets its congestion window (to initcwnd)
> after each packet loss aka. why it looks like Tahoe? Does CoDeL go into
> dropping more than one packet per RTT if the RTT is much smaller than an
> interval?
>>>
>>>
>>> [1] "Controlled Delay Active Queue Management", 
>>> https://tools.ietf.org/html/draft-ietf-aqm-codel-02
>>> [2] "FlowQueue-Codel" ,
>>> https://tools.ietf.org/html/draft-ietf-aqm-fq-codel-04
>>>
>>> Regards,
>>> Rasool Al-Saadi
>>>
>>> _______________________________________________
>>> aqm mailing list
>>> aqm@ietf.org
>>> https://www.ietf.org/mailman/listinfo/aqm
>>>
>> _______________________________________________
>> aqm mailing list
>> aqm@ietf.org
>> https://www.ietf.org/mailman/listinfo/aqm
>