Re: [tsvwg] path forward on L4S issue #16

Sebastian Moeller <moeller0@gmx.de> Tue, 09 June 2020 14:56 UTC

Return-Path: <moeller0@gmx.de>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 487A13A0807 for <tsvwg@ietfa.amsl.com>; Tue, 9 Jun 2020 07:56:28 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.649
X-Spam-Level:
X-Spam-Status: No, score=-1.649 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=gmx.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zU--0D4Hpe_D for <tsvwg@ietfa.amsl.com>; Tue, 9 Jun 2020 07:56:26 -0700 (PDT)
Received: from mout.gmx.net (mout.gmx.net [212.227.15.15]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 060253A07F0 for <tsvwg@ietf.org>; Tue, 9 Jun 2020 07:56:25 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1591714582; bh=7h4GoDENc/vjC2CdBdD7tdVSli5EDX66LtKEAMQh0lA=; h=X-UI-Sender-Class:Subject:From:In-Reply-To:Date:Cc:References:To; b=VSE37y6QEHcWBh+db3XlU+rwtI2a65asAtn4epX3cNyxKLf87ecRTgq3AtzcGuzhA JAGTuhGOWOAEPlJ4u9s8w+2eVwJJqrUqwg4LwukMDHNsfGVNtKtGx/jKKxhwBenEq+ cS83nWsqwdVLNOtT2Pq9H9UferQojrlC6bC4z/RE=
X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c
Received: from [10.11.12.3] ([134.76.241.253]) by mail.gmx.com (mrgmx004 [212.227.17.190]) with ESMTPSA (Nemesis) id 1M3lc9-1jhqKL0a1r-000sKC; Tue, 09 Jun 2020 16:56:22 +0200
Content-Type: text/plain; charset="us-ascii"
Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.14\))
From: Sebastian Moeller <moeller0@gmx.de>
In-Reply-To: <VI1PR0701MB287768D465C37DC46A459C12C2820@VI1PR0701MB2877.eurprd07.prod.outlook.com>
Date: Tue, 09 Jun 2020 16:56:20 +0200
Cc: Jonathan Morton <chromatix99@gmail.com>, "tsvwg@ietf.org" <tsvwg@ietf.org>
Content-Transfer-Encoding: quoted-printable
Message-Id: <832E702F-B591-4D62-81EE-150CB6B0F233@gmx.de>
References: <HE1PR0701MB2876AA3CBBA215B9FB895B0AC2820@HE1PR0701MB2876.eurprd07.prod.outlook.com> <3637517F-63A0-4862-9885-AB5EA7E6C273@gmail.com> <VI1PR0701MB2877E21B7F406C3DFCFF08BCC2820@VI1PR0701MB2877.eurprd07.prod.outlook.com> <92525827-39B6-4E88-B453-660F8FE22523@gmx.de> <VI1PR0701MB287768D465C37DC46A459C12C2820@VI1PR0701MB2877.eurprd07.prod.outlook.com>
To: Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
X-Mailer: Apple Mail (2.3445.104.14)
X-Provags-ID: V03:K1:5zQLXzBwCagWwkhBsaRUtE/yoi9Bjr32q7GdVNbmBP2EUN1mL7q 7c7hY+NL60e7HCOrFblHFL5c4EbEiDT3JNhSehapzzisBC/2guAskOyV5J9rXKoKlA+eGS1 TQWz5wjJftiz6SOvcDToWmWz2+1bq05ZruB4r9/0VerC/QWprm99XUY0uU7n6SIRfuO3yIq O4Kf/N71t0puNX4QHn/LQ==
X-UI-Out-Filterresults: notjunk:1;V03:K0:CS9T+Rl+glA=:ESLdwczYZHoLeKGz+FYD98 V5sbzK8eGhRGm7Vn3QI0Xe8qJetdqVPuN8/CbTxnF01i64jCXLm/DdS6pLzLW0seaSIQze4uu ZrEsEmWOrdcOobf28YPNgpgLcU74LzlVvm18zkB0//7nzQH/BN1IXan82D35BYWL1ntNlG4Ge NkTJfrM6B2i1DM4fFOP3vt5oDLOZH8mfbuGNhEsia//Ion9QM1qo1MU72dbyhH6KcAZZjheV+ GXE1kOC3JRJ7bACntee923wfcAaa9Q9KZ/dPHdpVHphPrK73E8Yc00s1JpWhw0KsOlZ7UFj2S 0mSKAfiJl3Of9gpHXSfbZDWrrBUNWqqcb6a/6zl3w5ZzHE59zXvVPrJz6zqWM2Kidnh2Khz6U xLJl0n4arKmaM5OSs9u1+RmW15J9MSx3iIK6rfjzoSrVyBetKvHfn5xSUMEBdgmQk4bxKalUV WLjxWk0QNIn6JviQ/ELI+A/hrhP+E/dqtXvdI3YBMYrAUTqm63F/d3A8SYPJqtJVMa6G977Sa 3ziUc0b8PDUSxVM0PfiKiF34tUA/v15EfyXZ9ihmAej6BeuKWIlaW0Vj83M0wTFRNCfNQQqEc 9nOQMXeCgjT2EWipQ1obCKtu5pUsO/aMzeMqKB1uEk/kgpWMLocCxSrv6tZKA8xlRwG22D8Cr 6NXInNb2jjFwaY7j/VSsxXb831MzuuKMEdEGyv/BtRZ/rF18x1rzJgoIW37QOmAjybt3lmb3U otv+IrVAKUi4+n1xGSPlMUoZHwVyhDP7WL0oIYVH86btPTf1UGgcrMxKXe8a2AeXJDI9FqkrM YGK8btMfWHmZ4ygG3QlVHvymKZLolG+B6cHI4ALzlFriDElUbL+1BNOj0gbcH7beCWsKVas2N NXWSTvTvy0+1kXGYbgQloswQDuU9suyIolu2B2heVfX8+srRfqFXaGaLVN1Bp9iCoURUTAsbn Un1I0eF3ZqPkSSo1bT+zSJZoM9MASyptMmRGRYNa/Y7RwwhMuyEkskNa7eVWQMiOYIZ49ArtU Vut0XPVyuZSoyJ91mVN9e9uAHQXgUYjwXkWg7T6nJlyLDGYQPDlFjf7n3aQAooHZHCeVVwXeY jnxANb7ktnPiDO13p0jtVig1OR41HWG+51AERukbgV1vKLIP/YuRlkWDW7/JFUhGIkVtIiY3E P6Qx+Ozq8/VhmYW7l8ZkBke6pB/2gHBw8urg0wTiUMAAZNpZZJb2ZAg0ykSlKo17fYK0RRTkF Py5TUCdKceLOWibP3
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/0QIxH1oCaQ3hojvt8x6bN-8ukbM>
Subject: Re: [tsvwg] path forward on L4S issue #16
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Jun 2020 14:56:28 -0000

Hi Ingemar,


> On Jun 9, 2020, at 16:43, Ingemar Johansson S <ingemar.s.johansson@ericsson.com> wrote:
> 
> Hi
> Why don't you run the testing yourself to get the answers you look for?. 

	[SM] Good question. But I believe you are taking this as a scream question, while I consider this to be an L4S question. I am fine with scream being a research project and all, not having gone out of its way to test all possible adversarial traffic patterns, after all nobody is forced to use scream.
	With the envisioned roll-out of L4S as the "mandatory" CC of the future of the whole internet, the situation looks quite different IMHO. Mandatory here does not mean that everybody is forced to actively use L4S-aware transport protocols, but that all traffic traversing a L4S hops will suffer the consequences.

> 
> You can download and build the SCReAM BW test tool (follow the steps below).
> I can guarantee that you'll find cases where it does not work In a
> satisfactory way. But as with most other congestion control work it is work
> in progress, sometimes that progress is good, sometimes not so good due to
> other projects that are more important.

	[SM] +1; please accept my apology, I did not want to diss scream in any way here, I really just want to re-focus the discussion on the issues I see with L4S and its lack of sufficient realistic testing. Again, for scream as mostly a research vehicle this is fine, and asking me to roll up my sleeves and get into testing is good advice. Now, if L4S would be just a research vehicle we would not even have this discussion.

Best Regards
	Sebastian


> 
> /Ingemar
> ==============================
> How to get and build the SCReAM BW test tool on Linux PC's
> 
> cd ~/somewhere 
> git clone https://github.com/EricssonResearch/scream.git
> cd code/bw-test-tool
> cmake .
> make
> 
> What needs to be installed in advance is
> git
> cmake 
> make
> gcc (or g++ ?) I install both
> 
> Read the SCReAM-BW-test-tool.pptx
> ==============================
> 
>> -----Original Message-----
>> From: Sebastian Moeller <moeller0@gmx.de>
>> Sent: den 9 juni 2020 16:21
>> To: Ingemar Johansson S
>> <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org>
>> Cc: Jonathan Morton <chromatix99@gmail.com>; Ingemar Johansson S
>> <ingemar.s.johansson@ericsson.com>; tsvwg@ietf.org
>> Subject: Re: [tsvwg] path forward on L4S issue #16
>> 
>> Ingemar,
>> 
>> I have a feeling that this discussion thread is based on a disconnect. I
> believe
>> that most here agree that Scream is a nice and interesting project worth
>> pursuing. The only contentious point is whether scream working well with
>> current L4S AQM behavior over a single simulated hop, can make up for the
>> apparent lack of testing under even mildly adversarial conditions (aka
> real
>> internet conditions) of the core L4S implementation and design. If you
> have
>> made such measurements in the context of scream's development, please
>> do not hesitate to present them here.
>> 
>> incomplete listing of mildly adversarial conditions:
>> 1) bi-directionally saturating traffic
>> 2) asymmetric links
>> 3) long networks paths, >>5 hops
>> 4) paths with parallel segments
>> 5) unfriendly greedy traffic with less than expected yielding behavior ...
>> 
>> Data demonstrating L4S immunity against negative behaviour under any of
>> these conditions, is IMHO quite helpful for the continuing discussion.
>> 
>> Best Regards
>> 	Sebastian
>> 
>> 
>> 
>>> On Jun 9, 2020, at 16:11, Ingemar Johansson S
>> <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org> wrote:
>>> 
>>> Jonathan, you kick in open doors..
>>> 
>>> I urge interested people (if any?) to follow the discussion thread
>>> instead to get an understanding what causes the lower throughput with
>> L4S.
>>> https://mailarchive.ietf.org/arch/msg/tsvwg/FFQH_XG0-
>> wbLIt7JRJ33dH8Fyf
>>> c/
>>> 
>>> /Ingemar
>>> 
>>>> -----Original Message-----
>>>> From: Jonathan Morton <chromatix99@gmail.com>
>>>> Sent: den 9 juni 2020 12:10
>>>> To: Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
>>>> Cc: tsvwg@ietf.org
>>>> Subject: Re: path forward on L4S issue #16
>>>> 
>>>>> On 9 Jun, 2020, at 10:33 am, Ingemar Johansson S
>>>> <ingemar.s.johansson@ericsson.com> wrote:
>>>>> 
>>>>> "Even though it is more than a magnitude difference in queue delay
>>>>> between CoDel-ECN and L4S, it is fair to say that these simple
>>>>> simulations should of course be seen as just a snapshot."
>>>> 
>>>> Not to mention a magnitude difference in throughput.
>>>> 
>>>> - Jonathan Morton
>