Re: [tsvwg] SCE-L4S Flent "bakeoff" tests - thanks

<Ruediger.Geib@telekom.de> Mon, 16 September 2019 06:13 UTC

Return-Path: <Ruediger.Geib@telekom.de>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F26F51200B8 for <tsvwg@ietfa.amsl.com>; Sun, 15 Sep 2019 23:13:18 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.299
X-Spam-Level:
X-Spam-Status: No, score=-4.299 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_MED=-2.3, SPF_HELO_NONE=0.001, SPF_NONE=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=telekom.de
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9dqiEwaMHCo2 for <tsvwg@ietfa.amsl.com>; Sun, 15 Sep 2019 23:13:16 -0700 (PDT)
Received: from mailout31.telekom.de (mailout31.telekom.de [194.25.225.143]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 19877120048 for <tsvwg@ietf.org>; Sun, 15 Sep 2019 23:13:15 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telekom.de; i=@telekom.de; q=dns/txt; s=dtag1; t=1568614391; x=1600150391; h=from:to:cc:subject:date:message-id: content-transfer-encoding:mime-version; bh=SnOe8kFrW6DHLbrx1hJ55fHxDqcx6Xf8uSQoDa2gpyM=; b=lG/TL7REFR6EKvarBAnW4SHfhzstWU/EVJ6bWXvbYNgsplWnyYmjL+Ja rzmre5W5J0gmR0Vw6X+Ti5HN/mlgNjYzYOdphmGYOa6nkvTCvmZquXlqP p9B5gZztxR3lhMYJq+M6c9mxKCLcFoC0he4lmvIYNzFTXnfE60nhZh3mi kuUA7yp+97AjMYn5VT9BSpyU+nbBErDIt7BmglmSfQ6M9cmIBGU4dL2YO wcdCTP786D1JWxw6lihhG+yjBCWTslhaMt+yLo9PtNO3LK4kYR/u+VZvy NaZNSGhHGOHPxeju7oor3LTBzxnB3n3AAwYLJBgP5Hrp+ntt4ISgm4lcv w==;
Received: from qdec94.de.t-internal.com ([10.171.255.41]) by MAILOUT31.dmznet.de.t-internal.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 16 Sep 2019 08:13:08 +0200
X-IronPort-AV: E=Sophos;i="5.64,510,1559512800"; d="scan'208";a="500890733"
X-MGA-submission: =?us-ascii?q?MDFIePdxi3lS9L+7Zo7yS1BeBpsntJTuKcICce?= =?us-ascii?q?oAq4yCyLkK5KlWxJrXeLE/c8T2qCyld8Ss8BiYrNXKezvwdGjudRuuLO?= =?us-ascii?q?kRQ2cHaqEFt3+dq9lj3C0Q2noWUAKoRHNq7/OHELF8ycidNEg7q6759j?= =?us-ascii?q?choGQP7BcCoC8wWTqZ0PFXPw=3D=3D?=
Received: from he105715.emea1.cds.t-internal.com ([10.169.118.51]) by QDEC97.de.t-internal.com with ESMTP/TLS/AES256-SHA; 16 Sep 2019 08:13:12 +0200
Received: from HE105715.EMEA1.cds.t-internal.com (10.169.118.51) by HE105715.emea1.cds.t-internal.com (10.169.118.51) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 16 Sep 2019 08:13:12 +0200
Received: from HE106564.emea1.cds.t-internal.com (10.171.40.16) by HE105715.EMEA1.cds.t-internal.com (10.169.118.51) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Mon, 16 Sep 2019 08:13:12 +0200
Received: from GER01-FRA-obe.outbound.protection.outlook.de (51.4.80.24) by O365mail01.telekom.de (172.30.0.234) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 16 Sep 2019 08:13:09 +0200
Received: from LEJPR01MB1178.DEUPRD01.PROD.OUTLOOK.DE (10.158.145.12) by LEJPR01MB0907.DEUPRD01.PROD.OUTLOOK.DE (10.158.146.17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2263.21; Mon, 16 Sep 2019 06:13:11 +0000
Received: from LEJPR01MB1178.DEUPRD01.PROD.OUTLOOK.DE ([fe80::987d:70fa:4d72:d6da]) by LEJPR01MB1178.DEUPRD01.PROD.OUTLOOK.DE ([fe80::987d:70fa:4d72:d6da%5]) with mapi id 15.20.2263.023; Mon, 16 Sep 2019 06:13:11 +0000
From: <Ruediger.Geib@telekom.de>
To: <pete@heistp.net>
CC: <tsvwg@ietf.org>
Thread-Topic: [tsvwg] SCE-L4S Flent "bakeoff" tests - thanks
Thread-Index: AdVsVbOxuTz8WtR/QKSLBaJBoH6bdg==
Date: Mon, 16 Sep 2019 06:13:11 +0000
Message-ID: <LEJPR01MB11788CFFC04C2CD16DC1537C9C8C0@LEJPR01MB1178.DEUPRD01.PROD.OUTLOOK.DE>
Accept-Language: de-DE, en-US
Content-Language: de-DE
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=Ruediger.Geib@telekom.de;
x-originating-ip: [164.19.3.55]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 2ce860b0-d4d1-4474-7a39-08d73a6cf3b7
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(5600167)(711020)(4605104)(1401327)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7193020); SRVR:LEJPR01MB0907;
x-ms-traffictypediagnostic: LEJPR01MB0907:
x-ms-exchange-purlcount: 2
x-microsoft-antispam-prvs: <LEJPR01MB09076C3F10BB468CE55C36CF9C8C0@LEJPR01MB0907.DEUPRD01.PROD.OUTLOOK.DE>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-forefront-prvs: 0162ACCC24
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(376002)(346002)(39860400002)(366004)(136003)(396003)(199004)(189003)(51914003)(4326008)(102836004)(7696005)(6916009)(186003)(9686003)(71200400001)(71190400001)(256004)(14454004)(2906002)(478600001)(5660300002)(7736002)(6116002)(305945005)(85182001)(486006)(476003)(966005)(26005)(3846002)(86362001)(66446008)(64756008)(8936002)(66556008)(66476007)(8676002)(76116006)(52396003)(85202003)(81156014)(81166006)(316002)(66946007)(33656002)(6306002)(53936002)(55016002)(66066001)(777600001); DIR:OUT; SFP:1101; SCL:1; SRVR:LEJPR01MB0907; H:LEJPR01MB1178.DEUPRD01.PROD.OUTLOOK.DE; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1;
received-spf: None (protection.outlook.com: telekom.de does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: 757hN4K9tgR34Ce9FtPoD8tQqCrQVb/bU5+VWEu5q0xTmg3cEwfiYoTeJ0yMoRCB3FSjxDBpueaT2v6OQ/szZbUuRTW6XnDl2NYzzNJizmAJNf6/Yil7fybLm2+PLOJgkVkhjXy6LhFfLrdWNHizpbSjE2fUUx/8iNDfIDwkwGcN8KTjhNVXc8JKlcOaewvFObMVjr8BhWsEj4tBupGaJu8tgdU4DI02f9nXKoKVagoh1Zi8GO0fr6yH2+EDiew24VkYLCZSZgwzyNu5Q8epAhebNwXVww+CPaY3WazsdyzLk5Uc2yWPuWGWSjImJj+UndLsQtIdoUh7FCISMBTi5K5PimSOj/IGJnxi1LZ4vJCnS1XYzns/XxG5kNcyY2G8zATnndYsoMqjkzu2E3zoxlYBOE8pSBPEpq4Q1kvfUSU=
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 2ce860b0-d4d1-4474-7a39-08d73a6cf3b7
X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Sep 2019 06:13:11.4741 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bde4dffc-4b60-4cf6-8b04-a5eeb25f5c4f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: tvZf/3kfTj5Sxh9h25P43NpRaNesbE/C70bZ4P+R803a5/TzCPY7T00FXwlpFiZRfgXtj5R5VrHHeLO/lCExyY6NY496Nag6PrTQv/0HQSU=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: LEJPR01MB0907
X-OriginatorOrg: telekom.de
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/jRI3NlKSp61pPYvabaL76wsAUaA>
Subject: Re: [tsvwg] SCE-L4S Flent "bakeoff" tests - thanks
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 16 Sep 2019 06:13:19 -0000

Hi Pete,

thanks for the effort and the information,

Ruediger

-----Ursprüngliche Nachricht-----
Von: tsvwg <tsvwg-bounces@ietf.org> Im Auftrag von Pete Heist
Gesendet: Donnerstag, 12. September 2019 22:17
An: tsvwg@ietf.org
Betreff: [tsvwg] SCE-L4S Flent "bakeoff" tests

The following repo is now available with a set of Flent tests and results comparing the behavior of SCE and L4S in six scenarios, five that were discussed at the IETF 105 hackathon and a sixth more recent one:

https://github.com/heistp/sce-l4s-bakeoff/

The main README contains the details:
- info about the test setup
- the scenarios and links to results obtained in our Portland data center, along with observations
- installation instructions, for the foolhardy
- current and future plans

These tests cover the previously mentioned issue #17 (Interaction w/ FQ AQMs), and raise a few more. I’ll gladly boil the observations down into a list if that helps. The plan is to iterate on these tests up until IETF 106, to help provide the IETF and community with more information regarding these two proposals.

While the tsvwg mailing list can be used for discussion, if there are specific action items for the tests themselves (corrections, new tests, etc), those may also be submitted as issues on the repo (https://github.com/heistp/sce-l4s-bakeoff/issues), so we can keep track of them.

Lastly, a technical detail, the currently posted run is missing its associated pcap files due to a botched rsync, so I’ll start another run and push that tomorrow. Meanwhile, the data files and plots are still useful without those.

Regards,
Pete Heist