Re: [tsvwg] L4S drafts: Next Steps
Sebastian Moeller <moeller0@gmx.de> Sat, 20 March 2021 16:22 UTC
Return-Path: <moeller0@gmx.de>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 32FBE3A25CE; Sat, 20 Mar 2021 09:22:10 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.648
X-Spam-Level:
X-Spam-Status: No, score=-1.648 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=gmx.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id cArCpRaSgsD5; Sat, 20 Mar 2021 09:22:09 -0700 (PDT)
Received: from mout.gmx.net (mout.gmx.net [212.227.17.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7FF263A25D3; Sat, 20 Mar 2021 09:22:07 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1616257320; bh=mI42Jn//+ztjggJ9fJFIt+TST137Lb/fFW0ioqrdIk0=; h=X-UI-Sender-Class:Subject:From:In-Reply-To:Date:Cc:References:To; b=Pgc0X4PxqU3JvVOE0AaNzUvKMU6qdIp2LyBr9X0ZiNg4L2YU1Vbf5pc4Qws/7zEFf Mn7vH/5bC0GZLYdH1ZQ1lavVlNAbFyhjluL8HYXDd/Y+/f2ZuXegMcEhOLFTJt+4bB v5XGtaOyEzOgSIxhHGMtwKmOdyVAyPV3vbvdX78E=
X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c
Received: from [192.168.42.229] ([77.3.78.131]) by mail.gmx.net (mrgmx104 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MaJ81-1l9gH43zRF-00WAsm; Sat, 20 Mar 2021 17:22:00 +0100
Content-Type: text/plain; charset="us-ascii"
Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.17\))
From: Sebastian Moeller <moeller0@gmx.de>
In-Reply-To: <11C85D70-0D22-437D-9A1C-B1A5E6BE0EEF@cable.comcast.com>
Date: Sat, 20 Mar 2021 17:21:57 +0100
Cc: Jonathan Morton <chromatix99@gmail.com>, "tsvwg@ietf.org" <tsvwg@ietf.org>
Content-Transfer-Encoding: quoted-printable
Message-Id: <D78B4E7A-1191-4D86-B44B-FD871D1CFF23@gmx.de>
References: <MN2PR19MB4045FAC079C74FC262005BF483F10@MN2PR19MB4045.namprd19.prod.outlook.com> <92283815-f81a-ba86-fe63-7925e23e31f6@bobbriscoe.net> <MN2PR19MB404513C22FE4025C31261BC783CC0@MN2PR19MB4045.namprd19.prod.outlook.com> <5d8f0031-1aee-9e41-7860-04a46a89607e@bobbriscoe.net> <MN2PR19MB4045305CA7D5673C554BCBA383919@MN2PR19MB4045.namprd19.prod.outlook.com> <ee0c9cd2-608c-ef69-ef84-892cd4f17204@bobbriscoe.net> <MN2PR19MB404522F073A03BA2F866604E83909@MN2PR19MB4045.namprd19.prod.outlook.com> <83559d3f-6004-118a-cde2-ec999fc8c483@bobbriscoe.net> <DE5B87E4-DD60-435E-80AD-01C09F13D173@gmail.com> <375666b8-1123-a635-1cd6-eb496835369a@bobbriscoe.net> <D8EA6E7B-738F-424A-88F2-EFEE3D053C02@gmx.de> <9165ED30-4A09-4B14-99AD-74690DC4AB04@cable.comcast.com> <AA407F19-492D-44FB-9B86-B40BD365F884@gmail.com> <11C85D70-0D22-437D-9A1C-B1A5E6BE0EEF@cable.comcast.com>
To: "Livingood, Jason" <Jason_Livingood=40comcast.com@dmarc.ietf.org>
X-Mailer: Apple Mail (2.3445.104.17)
X-Provags-ID: V03:K1:mwckWEkVHRcUDyNv8NSzMoar5A4PKDO2wmOrit6OCDvwsiUKOhD fAu3t2QxTn0QdhU9xpGh9awsPI2NZrD0D+DHhsJDHgfLJPXN0kBH/gWF0f7jS0t9EPUQ88w 6/MSA6Vm4AXmv1Y5Nc8OvtqffiIyFpHICxNr02vns/FkTs1swVAkZsU5RrZUcLZi/zzxl0C 4aTfxOZ6HCrQYpP6D+Wig==
X-UI-Out-Filterresults: notjunk:1;V03:K0:wvtV4bztk2Y=:M9FilL6Tgh2hs3zgCAuJ9t CHF6/XDCebCRVKujEehm22E9FtnmJqEDsTTqA8/bCyOjp4nf9jAcNXJ1frw6Nwce4xCoE9F5w Ol6c9zPeyTBTc4kjlLjCvClsX8VLWZ7ZUNCp9Hr4SKvumNXiLLo1nBpDDWI35ei7Ci0cqnexT 7K+v+H6V7lmO6NywZsnlqPq8i1gLwJk2DK7nHFC5B3Pcq4Ut8a2548WtomrODmfB6NP790/4j k9ezKPDSivprr8X+QCzjiA2Lpc5lFMpEjEq1QkVmGmXM/AwtQCd6hevOWs0HuI7FL1NdqlApR bFF1ZcZdh54i9URRr9CQmZW1qfm95r99i+gF7rXLe8XMrnMDL9n7y9rJmTgEMyYIzhkANb7Nq 9NX45pI9tGNWR8tAakzDGI8a+IMF1YjEJs9elCisHl7nDY6v96xPP8cVOnZdHzjFozKKwrnS0 Myyw6KFOKJJkahGcMg0K+oUIh4nov/5EWXfuZd0sipWi9rrAA1UZr+nSvyGQYGeTFwkwFU2Hr CJeO/4bRnj310ms56Floo8naLZkVYosuxvlp/rrXxHnwI8IxksUaYACewmAUqfugqhq3RhuZK mFhzu24pgd5RLD7MPa+Iq+8xYoiXiHwS68xYva10IY2mHVTVpopjBC1SkoJ+UfosdlzUyPIcd XSUFZDRsWSudghZQCRZ/n8SbW5RWW0xc1zxzWnOTJkZf2mFd69814ktWIknY8HacV5GqxkdS0 sfdShAXYciaEFIDwEKIUkzSnJQjWTwtLRCyFpCD0fZeTpuqEumaZoFJbT4l0aHgnVWydZ6bSF 54ifC1ai+szbDlNOu9+gEVoCHKekOLPL2jDPUVPVCOZIHXao7xXYlX2vxSFhRVbw8v3JsEqbO msVLwcpa/3ib6swNyFPg==
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/fifNmw70QCOSGq3FJhbvUQdXm2k>
Subject: Re: [tsvwg] L4S drafts: Next Steps
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 20 Mar 2021 16:22:10 -0000
Hi Jason, > On Mar 20, 2021, at 16:08, Livingood, Jason <Jason_Livingood=40comcast.com@dmarc.ietf.org> wrote: > >> The lab studies have shown > > IMO the challenge with lab studies is that there are a lot of variables that are artificial and/or the test environment or test traffic does not fully reflect reality (production). [SM] Nobody hindered team L4S to actually vary those parameters. > 10 or 15 years ago I would have been very focused on extensive QA testing and an elaborate lab test environment. These days its more how to do controlled testing directly in the production network, with a controlled/minimized blast radius in case of problems, easy/quick rollback, rapid code/config iteration. [SM] Controlled testing over real networks is actually possible already, without the IETF's blessing, as long as one makes sure the potential fall-out is restricted to voluntarily participating nodes. To claim there is nothing between tests in the lab and "release the kraken" onto the whole internet, does not strike my as aterribly nuanced nor realistic position? > >> far from a promising system that might be ready for a field trial, one that shows worrying failure modes that primarily affect innocent bystanders. >> What we're asking for is a system that at least behaves reasonably under lab conditions, chosen to represent realistic challenge scenarios likely to occur in the real world. Only then can we have any confidence that L4S will not cause problems anywhere and everywhere that it is deployed. > > Only one way to find out - test it in a real production experiment with appropriate risk controls. [SM] Like a guarding DSCP that makes sure the fall-out is restricted mainly to willingly cooperaring parties? Such common-sense safeguard have been summarily rejected by team L4S... In other words there will be no risk controls, let alone appropriate ones. I come to this conclusion as extrapolation of L4S lab test trajectory. Why do you assume the approach towards safety and functionality engineering is going to change? > The status quo seems to suggest years more debate without (IMO) sufficient data. [SM] So all I need t do to get an incomplete draft to RFC status is to drag my feet? Surely that can not be your serious position? > An alternative is a controlled production experiment, appropriately risk-managed, between willing participants. [SM] +1, but that is not what is under discussion here. We are talking about "release the kraken" based on theoretical considerations, that L4S will work and there will be no incentive to exploit its known failure modes. Engineering by "hope and prayers"... > I see no downside to allowing that to occur via experimental RFC. We're setting the bar at the proposed standard or standard level, which I think is incorrect. I would say instead enable the experiment to accelerate the learning & improvement & drive data-driven decisions. [SM] Again, for a "a controlled production experiment" no buy in of the IETF is required, it never has. So why pretend otherwise? Sebastian P.S.: I missed the last meeting, so if team L4S actually presented data that answers all my questions, I am willing to eat my hat, so did they? > > Jason >
- [tsvwg] L4S drafts: Next Steps Black, David
- Re: [tsvwg] L4S drafts: Next Steps Bob Briscoe
- Re: [tsvwg] L4S drafts: Next Steps Black, David
- Re: [tsvwg] L4S drafts: Next Steps Jonathan Morton
- Re: [tsvwg] L4S drafts: Next Steps Sebastian Moeller
- Re: [tsvwg] L4S drafts: Next Steps Wesley Eddy
- Re: [tsvwg] L4S drafts: Next Steps Ingemar Johansson S
- Re: [tsvwg] L4S drafts: Next Steps Bob Briscoe
- Re: [tsvwg] L4S drafts: Next Steps Black, David
- Re: [tsvwg] L4S drafts: Next Steps Bob Briscoe
- Re: [tsvwg] L4S drafts: Next Steps Black, David
- Re: [tsvwg] L4S drafts: Next Steps Bob Briscoe
- Re: [tsvwg] L4S drafts: Next Steps Jonathan Morton
- Re: [tsvwg] L4S drafts: Next Steps Bob Briscoe
- Re: [tsvwg] L4S drafts: Next Steps Jonathan Morton
- Re: [tsvwg] L4S drafts: Next Steps Black, David
- Re: [tsvwg] L4S drafts: Next Steps Bob Briscoe
- Re: [tsvwg] L4S drafts: Next Steps Black, David
- Re: [tsvwg] L4S drafts: Next Steps Gorry Fairhurst
- Re: [tsvwg] L4S drafts: Next Steps Greg White
- Re: [tsvwg] L4S drafts: Next Steps Gorry Fairhurst
- Re: [tsvwg] L4S drafts: Next Steps Sebastian Moeller
- Re: [tsvwg] L4S drafts: Next Steps Livingood, Jason
- Re: [tsvwg] L4S drafts: Next Steps Jonathan Morton
- Re: [tsvwg] L4S drafts: Next Steps Livingood, Jason
- Re: [tsvwg] L4S drafts: Next Steps Gorry Fairhurst
- Re: [tsvwg] L4S drafts: Next Steps Jonathan Morton
- Re: [tsvwg] L4S drafts: Next Steps Sebastian Moeller
- Re: [tsvwg] L4S drafts: Next Steps Sebastian Moeller
- Re: [tsvwg] L4S drafts: Next Steps Pete Heist
- Re: [tsvwg] L4S drafts: Next Steps Sebastian Moeller
- Re: [tsvwg] L4S drafts: Next Steps Sebastian Moeller