Re: [tsvwg] thoughts on operational queue settings (Re: CC/bleaching thoughts for draft-ietf-tsvwg-le-phb-04)

Toerless Eckert <tte@cs.fau.de> Mon, 16 April 2018 18:07 UTC

Return-Path: <eckert@i4.informatik.uni-erlangen.de>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 20E83127909 for <tsvwg@ietfa.amsl.com>; Mon, 16 Apr 2018 11:07:54 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.95
X-Spam-Level:
X-Spam-Status: No, score=-3.95 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HEADER_FROM_DIFFERENT_DOMAINS=0.25, RCVD_IN_DNSWL_MED=-2.3] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0I4OABFQDmyb for <tsvwg@ietfa.amsl.com>; Mon, 16 Apr 2018 11:07:51 -0700 (PDT)
Received: from faui40.informatik.uni-erlangen.de (faui40.informatik.uni-erlangen.de [131.188.34.40]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C125A12426E for <tsvwg@ietf.org>; Mon, 16 Apr 2018 11:07:51 -0700 (PDT)
Received: from faui48f.informatik.uni-erlangen.de (faui48f.informatik.uni-erlangen.de [IPv6:2001:638:a000:4134::ffff:52]) by faui40.informatik.uni-erlangen.de (Postfix) with ESMTP id 9D6FC58C4B4; Mon, 16 Apr 2018 20:07:47 +0200 (CEST)
Received: by faui48f.informatik.uni-erlangen.de (Postfix, from userid 10463) id 85D7E440214; Mon, 16 Apr 2018 20:07:47 +0200 (CEST)
Date: Mon, 16 Apr 2018 20:07:47 +0200
From: Toerless Eckert <tte@cs.fau.de>
To: Brian E Carpenter <brian.e.carpenter@gmail.com>
Cc: Mikael Abrahamsson <swmike@swm.pp.se>, tsvwg@ietf.org
Message-ID: <20180416180747.m3bbyuec2fg4elb5@faui48f.informatik.uni-erlangen.de>
References: <20180412012544.tmnzec3zddlyrmlb@faui48f.informatik.uni-erlangen.de> <39fb9195-b46f-945f-d414-936f97a59d87@gmail.com> <alpine.DEB.2.20.1804120818210.18650@uplift.swm.pp.se> <20180412080515.g5qkjqmluru26nib@faui48f.informatik.uni-erlangen.de> <alpine.DEB.2.20.1804121007560.18650@uplift.swm.pp.se> <20180412091235.i3dj3j4ktvriq5fq@faui48f.informatik.uni-erlangen.de> <alpine.DEB.2.20.1804130612030.18650@uplift.swm.pp.se> <20180413172245.kkjxajwdlp2hifkd@faui48f.informatik.uni-erlangen.de> <alpine.DEB.2.20.1804140757180.18650@uplift.swm.pp.se> <c911642d-cd7a-93ee-6b8e-d1e19fae182e@gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <c911642d-cd7a-93ee-6b8e-d1e19fae182e@gmail.com>
User-Agent: NeoMutt/20170113 (1.7.2)
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/zuUjQc_nnDwopwsYk2GEZPyHYdA>
Subject: Re: [tsvwg] thoughts on operational queue settings (Re: CC/bleaching thoughts for draft-ietf-tsvwg-le-phb-04)
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 16 Apr 2018 18:07:54 -0000

On Sat, Apr 14, 2018 at 06:50:43PM +1200, Brian E Carpenter wrote:
> > This however caused ~50ms of buffer bloat when there was competing BE 
> > traffic.
> 
> If buffer bloat is a problem for an "LE" application, it seems to me
> that the application is badly designed.

Right. I was asking the question mostly because of the need for
buffer space. With the results Mikael showed (thanks, great detail, Mikael),
i would say the recommendation to LE could be:

-> Afford as much buffer space to LE queue as you can based on HW
   capabilities of the device, up to the same buffer space used for
   BE. This might end you up using 2 times the amount of buffer space
   as you needed with only BE though.

   If you can afford these large amount of buffer space for the LE
   queue, you will create buffer-bloat for LE traffic when three is
   a lot of BE traffic competing - and LE therefore reduced to its
   weighted fair share of the link. Unlike BE traffic that often
   carries latency sensitive traffic such as real-time audio or
   even video, this buffer bloat should never be a problem for LE
   traffic. LE never promises any specific delay. Applying LE
   PHB to latency conscious traffic is wrong.

-> If you can not afford more buffer space on a device for LE, simply
   scale the LE queue respective to its weighted fair share of the
   link, for example only 5% of the BE queue if BE has 5% share.
   In this case, BE traffic will likely not able to fully utilize the
   link in the complete absence of BE traffic, but due to flow
   control issues max out at a lower rate. An example test showed
   the following results:
   effective LE buffer size before start of RED drop: 0.5 msec
   10 TCP flows (QUBIC), 1 Gbps link: 75..90% utilization max.
   Results would expected to be worse with slower links, better with
   faster links.

Now we'd just need to find a good place/draft to document these
type of BCP operational aspects of LE. Not sure if the PHB draft
is the right place. Would make life easier of course if it was.

Cheers
    Toerless

WARNING: only rants following, proceed at your own risk.

> Designing applications and transports to make good use of LE
> seems like a good PhD topic to me. I certainly wouldn't expect
> off-the-shelf FTP and TCP to do well, for example.

Have the PHD requirements dropped to the floor  since i left
university ?

I think even the hybrid BE/LE algorithm i suggested to document
for deadline based LE applications would at best qualify for a
bachelor thesis. If you do a lot of simulations to measure/simulate
queuing behavior LE vs. others using different applications, that
would qualify IMHO for a master thesis due to sheer amount of
work. 

For PhD the work itself would need to come up with something new.

While i do like novely in general, i also know the history of
young PhD joining the industry, pushing their novel scheduling
or aqm thesis into products, and then lots of poor operators
suffering with more and more incompatible nerd-knobs to manage
QoS in their network using multiple type of products. So...
i would be somewhat more careful here.

The root cause btw is the pressure of doing something novel raised
against PhD students often leads to just doing something unnecessarily
different because there just isn't that much "better" possible.
Finished PhD trying to apply their thesis at work because they have
made themselves believe it is better. Oh well, thats just missing
operational experience. And leaves a lot of really important
incremental improvement work unsolved because it's not novel enough
for research but still to difficult to productice due to dependencies
in the industry.