Re: [aqm] Gathering Queue Length Statistics
Dave Taht <dave.taht@gmail.com> Wed, 25 February 2015 18:24 UTC
Return-Path: <dave.taht@gmail.com>
X-Original-To: aqm@ietfa.amsl.com
Delivered-To: aqm@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6A7FE1A037D for <aqm@ietfa.amsl.com>; Wed, 25 Feb 2015 10:24:52 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.101
X-Spam-Level:
X-Spam-Status: No, score=-0.101 tagged_above=-999 required=5 tests=[BAYES_40=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, SPF_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id MMGVD2qodKpZ for <aqm@ietfa.amsl.com>; Wed, 25 Feb 2015 10:24:50 -0800 (PST)
Received: from mail-oi0-x232.google.com (mail-oi0-x232.google.com [IPv6:2607:f8b0:4003:c06::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id EE8291A1AA1 for <aqm@ietf.org>; Wed, 25 Feb 2015 10:24:45 -0800 (PST)
Received: by mail-oi0-f50.google.com with SMTP id v1so4864025oia.9 for <aqm@ietf.org>; Wed, 25 Feb 2015 10:24:45 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=y4honxBn3fcSQpS/CSKrGkAxHn5njeU58DGryL/naA4=; b=Xov00oEO8bbbHePMYXdpggwprgvekrozl8OdoWFldkiNj+yKVVQ8ciV5XwvynHmoQE v3PgsfA2FEBWKtkJ7ZcBNHyDBmkYzm8857k1Dq3uyCrijJw09lrBd1rE8NBfcGMTBphG iGqyLYossoxvGdEGcSteixOFjzpt0FIRMwka7EILXKi9uPgASXxUmvL6qayFT6mRqjec Tejolh9sRTh2YQFRIpspQFFwJM4H2tAhJQdLk8VhgDhGx8u1gxCqoxCZhRxRLbVyrS9l pDhgMIQbrv+YwiSXUcftjEvKZsx95DUdI0PBH68cehFVHZc0IzjaY2iiq5t3Q+PRFQAo WhzA==
MIME-Version: 1.0
X-Received: by 10.60.57.9 with SMTP id e9mr3257126oeq.24.1424888685290; Wed, 25 Feb 2015 10:24:45 -0800 (PST)
Received: by 10.202.51.66 with HTTP; Wed, 25 Feb 2015 10:24:45 -0800 (PST)
In-Reply-To: <BAY176-W35105790F5BC047AA12309A5170@phx.gbl>
References: <BAY176-W35105790F5BC047AA12309A5170@phx.gbl>
Date: Wed, 25 Feb 2015 10:24:45 -0800
Message-ID: <CAA93jw5dPhLmamcSHxD92b50XxmkkZNy28SWMkOSRFzBY3keBA@mail.gmail.com>
From: Dave Taht <dave.taht@gmail.com>
To: Ryan Doyle <rpdoyle@live.unc.edu>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: <http://mailarchive.ietf.org/arch/msg/aqm/JKQKZxDHbG_Ps7k6PzFI6BUlnWY>
Cc: "aqm@ietf.org" <aqm@ietf.org>
Subject: Re: [aqm] Gathering Queue Length Statistics
X-BeenThere: aqm@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "Discussion list for active queue management and flow isolation." <aqm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/aqm>, <mailto:aqm-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/aqm/>
List-Post: <mailto:aqm@ietf.org>
List-Help: <mailto:aqm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/aqm>, <mailto:aqm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 25 Feb 2015 18:24:52 -0000
On Wed, Feb 25, 2015 at 9:53 AM, Ryan Doyle <rpdoyle@live.unc.edu> wrote: > Hello, > > I am a senior undergraduate student at the University of North Carolina at > Chapel Hill and am studying the effectiveness of AQMs. I have set up a lab > network and plan on running different sets of experiments with different > AQMs. My router machines are running Linux kernel version 3.16.0. > > I am using the fq_codel, codel, and pie qdiscs for my research and am > wondering if there is a way to collect statistics regarding the average > queue length since a qdisc was enabled? I have looked at tc's "-s" flag for > statistics, but they show nothing about queue length and I have been unable > to find anything else that might help me get queue length statistics. Oh, god. I am getting incredibly sensitive about average queue length, and I realize that that is not what you meant. But since not enough people have seemingly read this or any of the related materials, here it is again. http://www.pollere.net/Pdfdocs/QrantJul06.pdf And I of course always recommend van´s talk on the fountain model for thinking about closed loop servo systems. http://www.bufferbloat.net/projects/cerowrt/wiki/Bloat-videos In the bufferbloat project... We have developed many tools that drive aqms hard, see netperf-wrapper on github for that, which measures e2e delay without requiring any tools on the routers inbetween. e2e delay in my mind is way more important than average queue length. And you can derive the queue length(s) from tcp timestamps in those netperf-wrapper tests, from additional packet captures, if you must. If you absolutely MUST derive average queue length from the box, you can poll the interface frequently with tc -s qdisc show as well as with ifconfig- and parse out the number of packets and the number of bytes. But you can do MUCH more valid statistical analysis than that, with that sort of data set - and if you poll too frequently you will heisenbug your tests, as those data collection calls take locks that interfere with the path. and we have all sorts of advice about traps for the unwary here: http://www.bufferbloat.net/projects/codel/wiki/Best_practices_for_benchmarking_Codel_and_FQ_Codel Please use things like CDFs to see the range of delays, rather than averages. It is what happens at above 90% of the range that makes bufferbloat maddening to ordinary users. I am summarily rejecting any papers that I review that report average queue length as if it meant anything. And for a few other reasons. You have been warned. I really lost my temper after the last paper I reviewed last weekend and the resulting flamage is all over the bloat list and codel lists, and starts here: https://lists.bufferbloat.net/pipermail/codel/2015-February/000872.html > Best, > Ryan Doyle > > _______________________________________________ > aqm mailing list > aqm@ietf.org > https://www.ietf.org/mailman/listinfo/aqm > -- Dave Täht Let's make wifi fast, less jittery and reliable again! https://plus.google.com/u/0/107942175615993706558/posts/TVX3o84jjmb
- [aqm] Gathering Queue Length Statistics Ryan Doyle
- Re: [aqm] Gathering Queue Length Statistics Fred Baker (fred)
- Re: [aqm] Gathering Queue Length Statistics Dave Taht
- Re: [aqm] Gathering Queue Length Statistics Daniel Havey
- Re: [aqm] Gathering Queue Length Statistics Jesper Dangaard Brouer
- Re: [aqm] Gathering Queue Length Statistics Dave Taht
- Re: [aqm] Gathering Queue Length Statistics grenville armitage
- Re: [aqm] Gathering Queue Length Statistics Ryan Doyle
- Re: [aqm] Gathering Queue Length Statistics Mikael Abrahamsson
- Re: [aqm] Gathering Queue Length Statistics Toke Høiland-Jørgensen
- [aqm] Is bufferbloat a real problem? Daniel Havey
- Re: [aqm] Is bufferbloat a real problem? Curtis Villamizar
- Re: [aqm] Is bufferbloat a real problem? Daniel Havey
- Re: [aqm] Is bufferbloat a real problem? Daniel Havey
- Re: [aqm] Is bufferbloat a real problem? David Collier-Brown
- Re: [aqm] Is bufferbloat a real problem? KK
- Re: [aqm] Is bufferbloat a real problem? David Collier-Brown
- Re: [aqm] Is bufferbloat a real problem? Mikael Abrahamsson
- Re: [aqm] Is bufferbloat a real problem? Curtis Villamizar
- Re: [aqm] Is bufferbloat a real problem? Curtis Villamizar
- Re: [aqm] Is bufferbloat a real problem? Curtis Villamizar