[tsvwg] SCE-L4S Flent "bakeoff" tests
Pete Heist <pete@heistp.net> Thu, 12 September 2019 20:17 UTC
Return-Path: <pete@heistp.net>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6D07F12001B for <tsvwg@ietfa.amsl.com>; Thu, 12 Sep 2019 13:17:08 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2
X-Spam-Level:
X-Spam-Status: No, score=-2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=heistp.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id DtAYO_bC3KRw for <tsvwg@ietfa.amsl.com>; Thu, 12 Sep 2019 13:17:06 -0700 (PDT)
Received: from mail-qk1-x734.google.com (mail-qk1-x734.google.com [IPv6:2607:f8b0:4864:20::734]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C2420120018 for <tsvwg@ietf.org>; Thu, 12 Sep 2019 13:17:06 -0700 (PDT)
Received: by mail-qk1-x734.google.com with SMTP id x134so25841561qkb.0 for <tsvwg@ietf.org>; Thu, 12 Sep 2019 13:17:06 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=heistp.net; s=google; h=from:content-transfer-encoding:mime-version:subject:message-id:date :to; bh=Im9hwOFaWQgx2Nuz/TtWRDK6FzS7PZg6fVVC/4x4+SU=; b=U1KDmXdF6opeo4aR+XhG+nSBwodZFPtIZlvBefDYYZaRGXXQq6ht9bCUyw9Jq8AhmE Bu1m7fn27bGd4YvNd94ji8ZWHBfEHtgHNHEgU7JiZ3FbNJt4gOuK2IUa6y1PPNtRR2fg x1spIuKbHQUS3ur/iJj7/Bh8DgGwNUN+HE8taZZcyp6L28uUKp2US3s8z7raDhb1wdF8 VaSeAohTjkx9uR1NI0RYSfw0sudoW9DItTqfrdhnvKfp/7Ki5O20mqewemB1DQKS0NQr ovr95o/zQvrNpcZBjE97QG/cIODbwHpWNnRF/F9wc/vGcpweN7xM8FGMzLG5P8wI61HG jgDw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:message-id:date:to; bh=Im9hwOFaWQgx2Nuz/TtWRDK6FzS7PZg6fVVC/4x4+SU=; b=mEE8BEaD9AQ1PYY5kTAnbP4ENE7+X+il0kPHiopBtkThyB6Ds2K1zN+qygwhde022n xj9IPEwjQYJHh1gwXXXliFaMuJxGE0QpBIDI82A1iGUwvu1lqCEtj1zZb7NOJ+Z1fmol TioqRgUWzBowzZstZm6f7zO9wTSdm/f2c26FJwczeQQofFGo55A3UYrD4n4bY5/bsPXG 636yg/iV3rHEUFT3zNOSpfO92mALodCUVWyGXpz3OKiPp8X2iA47EG0h374EFNBnlPe8 zlaLowdlixjlBUv0VblxC0CPMBUp5yZSbnXhxj1wwBUXHtdWnRE1RCIAK5qgihI4Ipm+ tniQ==
X-Gm-Message-State: APjAAAU/kr1MYOMAmrHfdpppoXPPsH0NBh9eEm0H/CcRCYnBbMrNIN9h Po4EW3hfQlqbXZJi5eEexpBFgy/AIDk=
X-Google-Smtp-Source: APXvYqwZkgoYGUw/SWsp2iRYJcbZKRkIj5otSDuon0k7ssd9wxstQ9ChVkwDHGUGGINtG1I4KaFeJg==
X-Received: by 2002:a05:620a:4d6:: with SMTP id 22mr7126692qks.15.1568319425498; Thu, 12 Sep 2019 13:17:05 -0700 (PDT)
Received: from yoda.lt2.drhleny.cz ([185.15.109.151]) by smtp.gmail.com with ESMTPSA id 60sm12505784qta.77.2019.09.12.13.17.04 for <tsvwg@ietf.org> (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 12 Sep 2019 13:17:05 -0700 (PDT)
From: Pete Heist <pete@heistp.net>
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\))
Message-Id: <5FA270AB-2E03-4C25-BE6E-71DEC11ED872@heistp.net>
Date: Thu, 12 Sep 2019 22:17:02 +0200
To: tsvwg@ietf.org
X-Mailer: Apple Mail (2.3445.9.1)
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/wMm_CMC67vemyg4ZXM1WbYDiHA4>
Subject: [tsvwg] SCE-L4S Flent "bakeoff" tests
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 12 Sep 2019 20:17:09 -0000
The following repo is now available with a set of Flent tests and results comparing the behavior of SCE and L4S in six scenarios, five that were discussed at the IETF 105 hackathon and a sixth more recent one: https://github.com/heistp/sce-l4s-bakeoff/ The main README contains the details: - info about the test setup - the scenarios and links to results obtained in our Portland data center, along with observations - installation instructions, for the foolhardy - current and future plans These tests cover the previously mentioned issue #17 (Interaction w/ FQ AQMs), and raise a few more. I’ll gladly boil the observations down into a list if that helps. The plan is to iterate on these tests up until IETF 106, to help provide the IETF and community with more information regarding these two proposals. While the tsvwg mailing list can be used for discussion, if there are specific action items for the tests themselves (corrections, new tests, etc), those may also be submitted as issues on the repo (https://github.com/heistp/sce-l4s-bakeoff/issues), so we can keep track of them. Lastly, a technical detail, the currently posted run is missing its associated pcap files due to a botched rsync, so I’ll start another run and push that tomorrow. Meanwhile, the data files and plots are still useful without those. Regards, Pete Heist
- [tsvwg] SCE-L4S Flent "bakeoff" tests Pete Heist