Re: [aqm] Gathering Queue Length Statistics

Daniel Havey <dhavey@yahoo.com> Wed, 25 February 2015 19:17 UTC

Return-Path: <dhavey@yahoo.com>
X-Original-To: aqm@ietfa.amsl.com
Delivered-To: aqm@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id EFAB21A7022 for <aqm@ietfa.amsl.com>; Wed, 25 Feb 2015 11:17:41 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.71
X-Spam-Level:
X-Spam-Status: No, score=-0.71 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_ILLEGAL_IP=1.3, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01] autolearn=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Mfmv1Jnl3Bnc for <aqm@ietfa.amsl.com>; Wed, 25 Feb 2015 11:17:40 -0800 (PST)
Received: from nm45-vm1.bullet.mail.bf1.yahoo.com (nm45-vm1.bullet.mail.bf1.yahoo.com [216.109.115.60]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 219191A8758 for <aqm@ietf.org>; Wed, 25 Feb 2015 11:16:50 -0800 (PST)
Received: from [66.196.81.171] by nm45.bullet.mail.bf1.yahoo.com with NNFMP; 25 Feb 2015 19:16:49 -0000
Received: from [98.139.212.226] by tm17.bullet.mail.bf1.yahoo.com with NNFMP; 25 Feb 2015 19:16:49 -0000
Received: from [127.0.0.1] by omp1035.mail.bf1.yahoo.com with NNFMP; 25 Feb 2015 19:16:40 -0000
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 886713.22029.bm@omp1035.mail.bf1.yahoo.com
Received: (qmail 39896 invoked by uid 60001); 25 Feb 2015 19:16:40 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1424891800; bh=KQvrhxTUbnIIg1kXdVuFRG2i8Aqf+s7E7MGR2z8EZUI=; h=Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=JCu/iqMQztjE2YDWbYWZ2ve7xteZvRKiSBDShLpI6lqjqpw8u6I/cf09wULFDl905gpVo5AIuAPRaC6nlMUuDatZ9Y2oPJ/sIKf5QVz20rH1g1QvazBG9WnOWJvdkWzn6N5i5MlDqH8EB8raJ4khnsldaSAjSi6L93nWZ5XdUW0=
X-YMail-OSG: Uua5NhwVM1mc2hknbvrG3Pz_q.W_3HSt.vH4xgDWFn9YBB8 Q1bSkv.kbFEOauxDDkDp9Sxa8brjP1nDJVytFo_8r2RcL2MOBSbQZr1rM75H aBvAy8XAyT8vox_d32tBhxrSxLglHtA2JOUuBjpUzBqGEsdrSt2YVyfZYeGA MGU9U3bkH58kePcgwyoJXLff4PMq5_vZ2d0VqsGw8NYzbzcnpB4.Nf6UNodp k0422RWaZxEo5XgvadFxc4vEDhxTfuIr.Nk5ZZsrpbv8KPUDncN2qF9jyloG sSuW3cU2TIcQQRVU5dIH.Q5MYewsaJ5HjfeUN7OcbdOjTerSFdprRc.c0Oiy dyCXedbHeLiQ_TmFjS8jdIiC2MDt_erIFA6g8eApl.oyBwvDQj7_Fvousd0a p53oKqkcel6g1J6hOvEq9OY.6YNCS5dMdGGHEYrLmfF1tuGX0uCFbTn.yna6 mWr09RG.zRVGd3DlPhVf9bn_YX4Ifmz.Ra0qKOpoT6v7nS_rG7RFqQwdaLvn 3Dk9Af3ooRkrfffYFhq6zODsXD5CsoXdppbRRPI4JTRKHfsC0XgxxwpPBeB1 rJs500cSHLhcRCuUnZuXC9aSVQPJb5Jjsv_cv3To03.cbnxOv5KwTw_Y0ri2 YMb389kPA3H5uxz70Y4KLKkrwcGipkDd.34OcSe1ZEGX9BWYxUhJjCf28xl5 MW9B4qmXOcsz8THdIyWEhhStUMC7RZGtBrR.wGEa6d4mSeej8lDLmMWUEQ9T Q9uSISdGF1W4Rr_kA.xQwFVfpb5lXjZ2G2tJ6HzYQhrzUXImtZDqfoWTSHiH jdHo1KPaGC9Qru6Cv.uCKB39mkf8tiI4IW83lenDKt0SvLqq.3tE.uWh5qZY K5M2c2xbW9GRQQ8vyP8opP21AC.vzwY.dk92rLamBtBsf
Received: from [238.183.110.161] by web141601.mail.bf1.yahoo.com via HTTP; Wed, 25 Feb 2015 11:16:40 PST
X-Rocket-MIMEInfo: 002.001, SmVleiBEYXZlLCBkb24ndCBzY2FyZSB0aGUga2lkISAgOl4pICBIZSdzIG9ubHkgYW4gdW5kZXJncmFkIQ0KDQpMb29rIFJ5YW4sIERhdmUgcmVhbGx5IGRvZXMgaGF2ZSB5b3VyIGJlc3QgaW50ZXJlc3QgYXQgaGVhcnQgYW5kIHRoYXQgaXMgd2h5IGhlIHdhbnRzIHlvdSB0byB1c2UgQ0RGcyBpbnN0ZWFkIG9mIGF2ZXJhZ2VzLiAgQW5kIGhlIGlzIHJpZ2h0LCBJIHRoaW5rIHlvdSBzaG91bGQgdXNlIENERnMgYWxzby4gIEluIGZhY3QsIHNhdmUgeW91cnNlbGYgYSBwaWxlIG9mIHJlcGV0aXR2ZSB3b3JrIGEBMAEBAQE-
X-Mailer: YahooMailClassic/377 YahooMailWebService/0.8.203.740
Message-ID: <1424891800.38947.YahooMailBasic@web141601.mail.bf1.yahoo.com>
Date: Wed, 25 Feb 2015 11:16:40 -0800
From: Daniel Havey <dhavey@yahoo.com>
To: Ryan Doyle <rpdoyle@live.unc.edu>, Dave Taht <dave.taht@gmail.com>
In-Reply-To: <CAA93jw5dPhLmamcSHxD92b50XxmkkZNy28SWMkOSRFzBY3keBA@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Archived-At: <http://mailarchive.ietf.org/arch/msg/aqm/Znr93MnmpQqdFqaOV298AenY8YI>
Cc: "aqm@ietf.org" <aqm@ietf.org>
Subject: Re: [aqm] Gathering Queue Length Statistics
X-BeenThere: aqm@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: dhavey@yahoo.com
List-Id: "Discussion list for active queue management and flow isolation." <aqm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/aqm>, <mailto:aqm-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/aqm/>
List-Post: <mailto:aqm@ietf.org>
List-Help: <mailto:aqm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/aqm>, <mailto:aqm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 25 Feb 2015 19:17:42 -0000

Jeez Dave, don't scare the kid!  :^)  He's only an undergrad!

Look Ryan, Dave really does have your best interest at heart and that is why he wants you to use CDFs instead of averages.  And he is right, I think you should use CDFs also.  In fact, save yourself a pile of repetitve work and just use Toke's tools.  They will produce better results and require less work from you :)

Trust me on this.  I have done both and Toke's tools are waaaaay better and easier than anything you (or I) will come up with.  Install Toke's tools and then you will have a cornucopia of awesome and repeatable results that you can just plug in to your final paper.  Go for it :^)

thanxs ;^)
...Daniel


--------------------------------------------
On Wed, 2/25/15, Dave Taht <dave.taht@gmail.com> wrote:

 Subject: Re: [aqm] Gathering Queue Length Statistics
 To: "Ryan Doyle" <rpdoyle@live.unc.edu>
 Cc: "aqm@ietf.org" <aqm@ietf.org>
 Date: Wednesday, February 25, 2015, 10:24 AM
 
 On Wed, Feb 25, 2015 at
 9:53 AM, Ryan Doyle <rpdoyle@live.unc.edu>
 wrote:
 > Hello,
 >
 > I am a senior undergraduate student at the
 University of North Carolina at
 > Chapel
 Hill and am studying the effectiveness of AQMs. I have set
 up a lab
 > network and plan on running
 different sets of experiments with different
 > AQMs. My router machines are running Linux
 kernel version 3.16.0.
 >
 > I am using the fq_codel, codel, and pie
 qdiscs for my research and am
 > wondering
 if there is a way to collect statistics regarding the
 average
 > queue length since a qdisc was
 enabled? I have looked at tc's "-s" flag
 for
 > statistics, but they show nothing
 about queue length and I have been unable
 > to find anything else that might help me
 get queue length statistics.
 
 Oh, god. I am getting incredibly sensitive
 about average queue length,
 and I realize
 that that is not what you meant. But since not enough
 people have seemingly read this or any of the
 related materials, here
 it is again.
 
 http://www.pollere.net/Pdfdocs/QrantJul06.pdf
 
 And I of course always
 recommend van´s talk on the fountain model for
 thinking about closed loop servo systems.
 
 http://www.bufferbloat.net/projects/cerowrt/wiki/Bloat-videos
 
 In the bufferbloat
 project...
 
 We have
 developed many tools that drive aqms hard, see
 netperf-wrapper
 on github for that, which
 measures e2e delay without requiring any
 tools on the routers inbetween. e2e delay in my
 mind is way more
 important than average
 queue length. And you can derive the queue
 length(s) from tcp timestamps in those
 netperf-wrapper tests, from
 additional
 packet captures, if you must.
 
 If you absolutely MUST derive average queue
 length from the box, you
 can poll the
 interface frequently with tc -s qdisc show as well as
 with ifconfig- and parse out the number of
 packets and the number of
 bytes. But you can
 do MUCH more valid statistical analysis than that,
 with that sort of data set - and if you poll
 too frequently you will
 heisenbug your
 tests, as those data collection calls take locks that
 interfere with the path. and we have all sorts
 of advice about traps
 for the unwary
 here:
 
 http://www.bufferbloat.net/projects/codel/wiki/Best_practices_for_benchmarking_Codel_and_FQ_Codel
 
 
 Please use
 things like CDFs to see the range of delays, rather than
 averages. It is what happens at above 90% of
 the range that makes
 bufferbloat maddening
 to ordinary users.
 
 I am
 summarily rejecting any papers that I review that report
 average
 queue length as if it meant
 anything. And for a few other reasons. You
 have been warned. I really lost my temper after
 the last paper I
 reviewed last weekend and
 the resulting flamage is all over the bloat
 list and codel lists, and starts here:
 
 https://lists.bufferbloat.net/pipermail/codel/2015-February/000872.html
 
 
 > Best,
 > Ryan Doyle
 >
 >
 _______________________________________________
 > aqm mailing list
 > aqm@ietf.org
 > https://www.ietf.org/mailman/listinfo/aqm
 >
 
 
 
 -- 
 Dave
 Täht
 Let's make wifi fast, less jittery
 and reliable again!
 
 https://plus.google.com/u/0/107942175615993706558/posts/TVX3o84jjmb
 
 _______________________________________________
 aqm mailing list
 aqm@ietf.org
 https://www.ietf.org/mailman/listinfo/aqm