Re: [tsvwg] [Ecn-sane] per-flow scheduling

Sebastian Moeller <moeller0@gmx.de> Fri, 21 June 2019 07:00 UTC

Return-Path: <moeller0@gmx.de>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 09E7312015D for <tsvwg@ietfa.amsl.com>; Fri, 21 Jun 2019 00:00:13 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.648
X-Spam-Level:
X-Spam-Status: No, score=-1.648 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=gmx.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id RJS1ODv5vA1K for <tsvwg@ietfa.amsl.com>; Fri, 21 Jun 2019 00:00:11 -0700 (PDT)
Received: from mout.gmx.net (mout.gmx.net [212.227.15.18]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A005712014A for <tsvwg@ietf.org>; Fri, 21 Jun 2019 00:00:10 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1561100356; bh=gNXxyWQSYIDdCpQ6/44NY45HD6RrNkx75gP6dUixOLQ=; h=X-UI-Sender-Class:Subject:From:In-Reply-To:Date:Cc:References:To; b=S+x8fL8X+uogWxv3A7LYHBgutgIqpxRxnjUoI7kH1G1Act4mHe3PIKqTX4CT/6MZB SYRRa/NMcq9rn+Nev5e5ffg+aj/z4modBbqiHZqKNTdjEDv3h3trmffzyUqiEWDi1T 4twkETxHkGRzna0pHxI8XciFBPAo17EXxicHPJs4=
X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c
Received: from hms-beagle2.lan ([77.185.38.99]) by mail.gmx.com (mrgmx002 [212.227.17.190]) with ESMTPSA (Nemesis) id 0LomJ1-1iGKcx0gWp-00gnA3; Fri, 21 Jun 2019 08:59:16 +0200
Content-Type: text/plain; charset="us-ascii"
Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\))
From: Sebastian Moeller <moeller0@gmx.de>
In-Reply-To: <350f8dd5-65d4-d2f3-4d65-784c0379f58c@bobbriscoe.net>
Date: Fri, 21 Jun 2019 08:59:14 +0200
Cc: "Holland, Jake" <jholland@akamai.com>, "ecn-sane@lists.bufferbloat.net" <ecn-sane@lists.bufferbloat.net>, tsvwg IETF list <tsvwg@ietf.org>
Content-Transfer-Encoding: quoted-printable
Message-Id: <46D1ABD8-715D-44D2-B7A0-12FE2A9263FE@gmx.de>
References: <350f8dd5-65d4-d2f3-4d65-784c0379f58c@bobbriscoe.net>
To: Bob Briscoe <ietf@bobbriscoe.net>
X-Mailer: Apple Mail (2.3445.104.11)
X-Provags-ID: V03:K1:QEuTWEnhlhk5VqoZX2fH7ymWTnWwqKL/eEfCINl9HDoqd0DTtfu OwgMsUtyc6OeG3ulYd4i/TarigiG/Kd6BsZ3Hdob++qVsksa55Q8h14h/h2mLTveGoJEgM5 CDa7jWDbh+VRe1OcrSnGmal3P5iVrnxbi2buagxqAkHauJQlVHSkkNMZxBOPue/W2EfApr7 eSq4mGwX3zxRSuK1vvP9A==
X-UI-Out-Filterresults: notjunk:1;V03:K0:BDATKlfEqGU=:nKa2W9aur2gRvxZroWGDxx duzxQp8XgNzsPZxCvBfT3g74YpbC0qZJ5eNyHb0ZfKAG4HCNKgC9pKOamLIhps46WygUjz+zt 7UbN9kPcdFFrJ9JkdzpkGgTLZtZYcYjgqWqqSlXynONIs9HgZDsArHBYujMQj9F29SCN2Sm9w wpLx1CG1XwzhCYF2aJqyGGLgX/q4C+cTJL6DMSxZE/RFuPIUlGqH7UPIJQjfOZ9mHg5g2L48z UcVFDJ4jI7NDqIlzlgEHh7CqCmwUVESD/c/lG/qxa7nd7V6XImKaJYJ1ekw7zzWg/wFx2t349 rml8RV0ur40gfTILPJJQs+S8Iio2EfjT2O9FDFkkncCJXRN/Vs2fjlb0Yf2wuoyDzqWFg9Upc EtXEfO4531YuOE30rLqBjY24McmAWKgbgrWhmYHeDXAInO1y8eLjD5fv4MZ4oHUP2vcrcLUeU +DgXBYD0c7Pw+N4Mb6bq06cZcFoJK1/5adJZqcDNHnPlsvtnBJE6ag4RvzQBPsL8fJj0XDNBj REfn0ZrQ+QuoEnf2PcBYE2YfAAirYxtPh6FquMF4XZO/T+4nG/p9j3DD/X22wW/zGpwNmw1id 79vB28HTMFMvgfkB/0WNaLPcsGCWgtoVBz1rk6RAjE6VezRgk1vptuN7pkr905coUGl07LnP2 hcj0eYfisYYGJ8q6O1mTGyT05qreDDH1X66tlrBRUKYJ4SgeJgPhEc3xxWxt3XjPCIFfZGAL+ Zszzhc2p/9sHSf+e8ZVSQu9bblyAwLP5RK4oiRnUrNUljUH7dlfqXVF7pMwc1ZwQNWcp38i4N NccBmAgI2A/slk4w2gUMFuHlzUIw4fqJrulzPbISPx+cXiCLtQDdLG94bx2eecyIldorhR1wO F8tenFZ9N0KQgSHArV+W4H6BIRFVlw18A4bcTL3+OR1Yc7H5exjArh7xGNW5fCsnh2fg7sIE6 5Na1GH4RrVi6tw0aYeEI5QM739uXTQpa/T3HtFMMZqAXjr9grKXMF
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/9mAw6Xmq6enhU_smTXCGVhRxDtk>
Subject: Re: [tsvwg] [Ecn-sane] per-flow scheduling
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 21 Jun 2019 07:00:13 -0000


> On Jun 19, 2019, at 16:12, Bob Briscoe <ietf@bobbriscoe.net> wrote:
> 
> Jake, all,
> 
> You may not be aware of my long history of concern about how per-flow scheduling within endpoints and networks will limit the Internet in future. I find per-flow scheduling a violation of the e2e principle in such a profound way - the dynamic choice of the spacing between packets - that most people don't even associate it with the e2e principle.

Maybe because it is not a violation of the e2e principle at all? My point is that with shared resources between the endpoints, the endpoints simply should have no expectancy that their choice of spacing between packets will be conserved. For the simple reason that it seems generally impossible to guarantee that inter-packet spacing is conserved (think "cross-traffic" at the bottleneck hop along the path and general bunching up of packets in the queue of a fast to slow transition*). I also would claim that the way L4S works (if it works) is to synchronize all active flows at the bottleneck which in tirn means each sender has only a very small timewindow in which to transmit a packet for it to hits its "slot" in the bottleneck L4S scheduler, otherwise, L4S's low queueing delay guarantees will not work. In other words the senders have basically no say in the "spacing between packets", I fail to see how L4S improves upon FQ in that regard.


 IMHO having per-flow fairness as the defaults seems quite reasonable, endpoints can still throttle flows to their liking. Now per-flow fairness still can be "abused", so by itself it might not be sufficient, but neither is L4S as it has at best stochastic guarantees, as a single queue AQM (let's ignore the RFC3168 part of the AQM) there is the probability to send a throtteling signal to a low bandwidth flow (fair enough, it is only a mild throtteling signal, but still).
But enough about my opinion, what is the ideal fairness measure in your mind, and what is realistically achievable over the internet?


Best Regards
	Sebastian




> 
> I detected that you were talking about FQ in a way that might have assumed my concern with it was just about implementation complexity. If you (or anyone watching) is not aware of the architectural concerns with per-flow scheduling, I can enumerate them.
> 
> I originally started working on what became L4S to prove that it was possible to separate out reducing queuing delay from throughput scheduling. When Koen and I started working together on this, we discovered we had identical concerns on this.
> 
> 
> 
> Bob
> 
> 
> -- 
> ________________________________________________________________
> Bob Briscoe                               http://bobbriscoe.net/
> 
> _______________________________________________
> Ecn-sane mailing list
> Ecn-sane@lists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/ecn-sane