Re: [tsvwg] L4S drafts: Next Steps
"Livingood, Jason" <Jason_Livingood@comcast.com> Sat, 20 March 2021 15:08 UTC
Return-Path: <Jason_Livingood@comcast.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 17ADA3A24A6 for <tsvwg@ietfa.amsl.com>; Sat, 20 Mar 2021 08:08:11 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=comcast.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Co4pxZiCU_EU for <tsvwg@ietfa.amsl.com>; Sat, 20 Mar 2021 08:08:09 -0700 (PDT)
Received: from mx0b-00143702.pphosted.com (mx0b-00143702.pphosted.com [148.163.141.77]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 69B2E3A24A3 for <tsvwg@ietf.org>; Sat, 20 Mar 2021 08:08:09 -0700 (PDT)
Received: from pps.filterd (m0184891.ppops.net [127.0.0.1]) by mx0b-00143702.pphosted.com (8.16.0.43/8.16.0.43) with SMTP id 12KF61Pr018260; Sat, 20 Mar 2021 11:08:08 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcast.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : content-id : content-transfer-encoding : mime-version; s=20190412; bh=vT0KaaR1pgGj2NZL6YIwHhvJnEBR1S0VQcxPybTpaT8=; b=QvZVpVetiWYQCncn8NOtvxNrfIHf7OGPxCNhDx6VOKhLJ2mJzwSfT/HM6U8uX1l0DyjO Mb4NNVERX/kvsGCYzXDtwq1U4AHryPOTnaAA92yeKSUTjQRD312PBh84FfJlW+B/29tm Zlsu1soDVqzwmvF0BRV7njW7JoXgfc3jCv6ue9yMhFj3Pg3mFk7lIRdI2yzFNQTd0tH9 7civdw4vZ6ffhsi7Qok5xmGn1o1u5JViUHf4UYGAthXIzeYz0n9B1+h98k4PlCGHlck2 HGQJDPoApF87muSe7/g/OOtcvYbB0FItunkKiUU5njUBq2zlBepUgSfF7aR6+MX2NJ1U sw==
Received: from pacdcex49.cable.comcast.com (dlppfpt-wc-1p.slb.comcast.com [96.99.226.136]) by mx0b-00143702.pphosted.com with ESMTP id 37ddtesak1-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Sat, 20 Mar 2021 11:08:07 -0400
Received: from PACDCEX49.cable.comcast.com (24.40.2.148) by PACDCEX49.cable.comcast.com (24.40.2.148) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Sat, 20 Mar 2021 11:08:06 -0400
Received: from PACDCEXEDGE01.cable.comcast.com (76.96.78.71) by PACDCEX49.cable.comcast.com (24.40.2.148) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Sat, 20 Mar 2021 11:08:06 -0400
Received: from NAM11-BN8-obe.outbound.protection.outlook.com (104.47.58.172) by webmail.comcast.com (76.96.78.71) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Sat, 20 Mar 2021 11:08:10 -0400
Received: from MN2PR11MB4287.namprd11.prod.outlook.com (2603:10b6:208:189::17) by MN2PR11MB4744.namprd11.prod.outlook.com (2603:10b6:208:263::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3955.18; Sat, 20 Mar 2021 15:08:03 +0000
Received: from MN2PR11MB4287.namprd11.prod.outlook.com ([fe80::c80d:3887:55ee:e89a]) by MN2PR11MB4287.namprd11.prod.outlook.com ([fe80::c80d:3887:55ee:e89a%5]) with mapi id 15.20.3955.024; Sat, 20 Mar 2021 15:08:03 +0000
From: "Livingood, Jason" <Jason_Livingood@comcast.com>
To: Jonathan Morton <chromatix99@gmail.com>
CC: "tsvwg@ietf.org" <tsvwg@ietf.org>
Thread-Topic: [tsvwg] L4S drafts: Next Steps
Thread-Index: AQHXHQ5nOiF94A8NykWzL7jhClAwsqqMrq8AgABHSoD//8J/gA==
Date: Sat, 20 Mar 2021 15:08:02 +0000
Message-ID: <11C85D70-0D22-437D-9A1C-B1A5E6BE0EEF@cable.comcast.com>
References: <MN2PR19MB4045FAC079C74FC262005BF483F10@MN2PR19MB4045.namprd19.prod.outlook.com> <92283815-f81a-ba86-fe63-7925e23e31f6@bobbriscoe.net> <MN2PR19MB404513C22FE4025C31261BC783CC0@MN2PR19MB4045.namprd19.prod.outlook.com> <5d8f0031-1aee-9e41-7860-04a46a89607e@bobbriscoe.net> <MN2PR19MB4045305CA7D5673C554BCBA383919@MN2PR19MB4045.namprd19.prod.outlook.com> <ee0c9cd2-608c-ef69-ef84-892cd4f17204@bobbriscoe.net> <MN2PR19MB404522F073A03BA2F866604E83909@MN2PR19MB4045.namprd19.prod.outlook.com> <83559d3f-6004-118a-cde2-ec999fc8c483@bobbriscoe.net> <DE5B87E4-DD60-435E-80AD-01C09F13D173@gmail.com> <375666b8-1123-a635-1cd6-eb496835369a@bobbriscoe.net> <D8EA6E7B-738F-424A-88F2-EFEE3D053C02@gmx.de> <9165ED30-4A09-4B14-99AD-74690DC4AB04@cable.comcast.com> <AA407F19-492D-44FB-9B86-B40BD365F884@gmail.com>
In-Reply-To: <AA407F19-492D-44FB-9B86-B40BD365F884@gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/16.46.21021202
authentication-results: gmail.com; dkim=none (message not signed) header.d=none;gmail.com; dmarc=none action=none header.from=cable.comcast.com;
x-originating-ip: [2601:41:200:d70:606d:b21b:4065:65a7]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 0522fd2b-595e-46cd-183b-08d8ebb1f577
x-ms-traffictypediagnostic: MN2PR11MB4744:
x-microsoft-antispam-prvs: <MN2PR11MB4744AA1068E17D8C1768C8EEC7679@MN2PR11MB4744.namprd11.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: FtilD/GuAlsPA9L9OK5vOOVgsIFWtDEXEGSPrCzX2wp2uBVX0MPuJ0sBHXzc2vrzjJAys2wUzxutNWAJFxKLHLg6jVE2q7uqEpwBYKodMyNyUOEJYQOwUeblDre87pYv+8rrHxygO44ioiYNpZIJniDQ/NZrSdNTADy9BgiPI2M2g8sGMXNBaAs4xFDais/vpXnY49ajX3bPBqgM6jBwcBm5NdcOvp7VtqRj+GvWRukR6addjW5pLW9gsvLH0V4TiGtwOZmB1oJNx+eORFpF/jb2X0gY1jdX2LC8BX4cxlzI4yFai4rz0GPVpPDR/5ui3Iv7bo/BFNg2fWg4VSYebGit3eXc12fM5/0P6KtHgd9Hf7t5LtfvkWBeSqcLuTrAo6ucq1q/Ax3DrLgRl3N894w9+iclqZ0Ly6d2WfxUH+zy37VKYGhPhqJ9d6JFu5+97ru2zSV/DtRr4ooS4B2Q0xk5HY2bxHnmrw2oAPLNLw0DioqFTECpFiQ+yDBkacvV5aEAxDzeGPwSbvz+XKNWFJojMMwh+1KcvG4hjQ9yG+B8+HvKY5Ra5ZwkcWpKq9vl13nGK4Rr2fab5F3FpcLfXGn3EunLhwI+JQUiccQ911JWbFruU+NV+yR2OTVaH334TSh9njKK7hFzhzyCmA4KrQSobbiRmyI28jqqbdxBFu/rt2fp2vpkB4YKUPtGXGIq
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:MN2PR11MB4287.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(346002)(396003)(376002)(39860400002)(136003)(6916009)(71200400001)(2906002)(83380400001)(478600001)(8936002)(6506007)(5660300002)(86362001)(8676002)(2616005)(6486002)(66556008)(38100700001)(4326008)(66446008)(66476007)(64756008)(66946007)(76116006)(6512007)(316002)(33656002)(186003)(45980500001); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata: CIlhT5SdWz7U5URsD8SlOntAgj5/s9++x4KX5RdDlTzobK1UxLpk6n1aP4t//KeHuXdiOVlK09VBB7jc1QW8xef1Qqo+0Cbsl+j3rJT8Lw9/g5XSN/frTwGfYmwGLAOrq9VShDiqsQH6agUKQwYiUpByCl9x7ANEdZT9ovdifp3ryDDgnbRAYbb+KJm/hW2f6Jw4rGas2A3Lewav7nU2EpFCY3OrcME2RYviAgRk5C5dNYLu3Mj4Ic1pdASnzhf5JtsXAOjqQol0KZ1L9WOcaUhWm+obDIFTKAmeGIqGBzJ+rFLHJdvSFJCCOF7HOHyHhkP8/F3trcpP7d78WJYgM2Zslf2PeFclkw8OrOORNXsssK0H8ge7RLjKdh4GRkBn1a+b716vHD4HPyt/GgSsjMcuL0rdRlL4ogIj1uqcJrUedASLXNRSUKyWGqAE0FeLDTiJIX0yo+CffQ/2Y+A83cml8NHlSDcs+j8KpQZtE67nT70uhh57Eil7D6XsCMx454zQmfrgIfjuZqVxNDbCbbW+CZwbcGI4p7n50kmUPQtc6G8YPwLEA3XEPEqbFYZmVB2j9ixVt/3wb2tnzQyfF8VxD5aE/RUPZKqRcpEXW3VSn+Ia0cc0D06gMi3c93QeP0VsY1XJC4DzaUxVL+NTg/3QuG2bs2vv0PmJvX4+OTrAiMxPNbhJXXe8zY3xZbH7yhtmcvI9+44mncUE0RPzQfKZNQYwQQe5pUU1xAzuMNsru0kx57tjYFq19/HNCfkL4TL0Qb6JGhPWtD6ywLdIuzF3kfgI2bwms0/UKVVzul8X+903NTYIAJvvjGD7MgBglPrkmtRub1VQOPYFfCSwARXepZM3LdSGbVf4teGzq4MscYH3nd3hsUlr6gph5PofZo/9NfwmABqbUZ7QAVpEQzNW198xkkYCUk/da2B84N3buzGEsVkoiAS5h9eIGO2Gd+Buq2vmYTvR3d0d++c69OuakX1g6iuoEW53Pb9BoL3+5iWd41PcU3GJhhwCmb1ch/sRQWzthbOr8f4s+7p16eu9G8TrYEfk6duLvCheeZiBkOCqzuRfh05nLK/UNnioxJyLwJX6trt9I0medu2sEYcJXZ4/cuyk8hveGmehQiUcbdygd8zAM1QQL1RJ8lOHDs/nZ0qw2GERMMxh9+HuIAWuds0FsplY1xrACbXfdpLOWvUP4beMpx8yl52j+A6hhCfT4VJN1ZA79HQWeq56v8icpw28YgN9nWjuGglV9aiN5E51PalCOoPSrw+KGj1d5STAEuMiTcWYkVBBPO/JY8epUmj3NrubEwwgua2h58DzGO0CP0hnhSiSrB5M+qyRFpWVSsOaFcwJTa8W08aJtdh1mj24Kke++j8Rrmvvfd7i5ptuKkx305blpLNluxKg
x-ms-exchange-transport-forked: True
arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Ui1+IbdtKfuQRnkJmP8BqYxvlYoJZDeXiX0zMKJD9Y/m7nPSHX96Mjlwa/6T6XzGmmFeZqCNK6jzh07mdj59z5p4/LnVtDJiuQJ0xmajYJ3BXE1wBR1Dhixu6u9Zn7Qd+toC8ZeEWHgnYdskJe8IfzibgXmMJ1726Wx7VztJxEsIXtIGJfftimX3qag5ZCoEshpWUf1MtfgvRdeGXEwRe6TRhZAJoIqbiAX/766VUUxZdoaF5Ztgo1BwFp9N5kPkB1payo8sGk9klgEWi7s6rAgmlGwpYI/WtD8dUz778xPONqQbP9tBTzPuq6mOtknKNhN0IGCTHGRfuuCdvAOEiw==
arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1cxGhTpf3Soa9cER0rWP89m7pmptv0/9LStTVgqpJmk=; b=eDYVfv9SG2rc1871HKhJrO/ntElg5rbLqT5pvLdemSzjMBhNmyBKToYOg7DVVnmwCBu4A+QL6B+sHaEpxiyYs86xCJxJ6JxOHmMMrzxi1IUmOxyp7dfekFBrOHwqNJQ2KO/7Z+GTKefcNO/HDK/QD1VRcgQ85JeqSDQsj931M+j0u+G594zfaULOhq33ddSqyJ5tyvoOOofICqAsZI+j6BsR41b7NfKzG8rTzcW5JtIzEorOuUb69CE7oXdm7w38HkmrfQ0nagdB+3Ql2WVfYLNviElLcMsqq6NeHhRoi0hJmqX+RpUW1nBcHUujJEdfC1T4iWuo1drRLZxSbKr7Tg==
arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cable.comcast.com; dmarc=pass action=none header.from=cable.comcast.com; dkim=pass header.d=cable.comcast.com; arc=none
x-ms-exchange-crosstenant-authas: Internal
x-ms-exchange-crosstenant-authsource: MN2PR11MB4287.namprd11.prod.outlook.com
x-ms-exchange-crosstenant-network-message-id: 0522fd2b-595e-46cd-183b-08d8ebb1f577
x-ms-exchange-crosstenant-originalarrivaltime: 20 Mar 2021 15:08:03.1727 (UTC)
x-ms-exchange-crosstenant-fromentityheader: Hosted
x-ms-exchange-crosstenant-id: 906aefe9-76a7-4f65-b82d-5ec20775d5aa
x-ms-exchange-crosstenant-mailboxtype: HOSTED
x-ms-exchange-crosstenant-userprincipalname: n2AhVTFPpCH0PKzNVRfOgb2Q5/Fpr/77U3F1h/S0MHvagyGCbp2HqGwpj6u7gt8FQd6e7qK22dUvYO4hgVyjw2cARiBMbZAX4uSeWz3o+0w=
x-ms-exchange-transport-crosstenantheadersstamped: MN2PR11MB4744
x-originatororg: cable.comcast.com
Content-Type: text/plain; charset="utf-8"
Content-ID: <58E62219BD857643A6FF67B08EE4AB15@namprd11.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-CFilter-Loop: Forward AAETWZ
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.369, 18.0.761 definitions=2021-03-20_07:2021-03-19, 2021-03-20 signatures=0
X-Proofpoint-Spam-Reason: safe
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/O57lOOfCr8H3n2yKNkOjRxxa4H0>
Subject: Re: [tsvwg] L4S drafts: Next Steps
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 20 Mar 2021 15:08:11 -0000
> The lab studies have shown IMO the challenge with lab studies is that there are a lot of variables that are artificial and/or the test environment or test traffic does not fully reflect reality (production). 10 or 15 years ago I would have been very focused on extensive QA testing and an elaborate lab test environment. These days its more how to do controlled testing directly in the production network, with a controlled/minimized blast radius in case of problems, easy/quick rollback, rapid code/config iteration. > far from a promising system that might be ready for a field trial, one that shows worrying failure modes that primarily affect innocent bystanders. > What we're asking for is a system that at least behaves reasonably under lab conditions, chosen to represent realistic challenge scenarios likely to occur in the real world. Only then can we have any confidence that L4S will not cause problems anywhere and everywhere that it is deployed. Only one way to find out - test it in a real production experiment with appropriate risk controls. The status quo seems to suggest years more debate without (IMO) sufficient data. An alternative is a controlled production experiment, appropriately risk-managed, between willing participants. I see no downside to allowing that to occur via experimental RFC. We're setting the bar at the proposed standard or standard level, which I think is incorrect. I would say instead enable the experiment to accelerate the learning & improvement & drive data-driven decisions. Jason
- [tsvwg] L4S drafts: Next Steps Black, David
- Re: [tsvwg] L4S drafts: Next Steps Bob Briscoe
- Re: [tsvwg] L4S drafts: Next Steps Black, David
- Re: [tsvwg] L4S drafts: Next Steps Jonathan Morton
- Re: [tsvwg] L4S drafts: Next Steps Sebastian Moeller
- Re: [tsvwg] L4S drafts: Next Steps Wesley Eddy
- Re: [tsvwg] L4S drafts: Next Steps Ingemar Johansson S
- Re: [tsvwg] L4S drafts: Next Steps Bob Briscoe
- Re: [tsvwg] L4S drafts: Next Steps Black, David
- Re: [tsvwg] L4S drafts: Next Steps Bob Briscoe
- Re: [tsvwg] L4S drafts: Next Steps Black, David
- Re: [tsvwg] L4S drafts: Next Steps Bob Briscoe
- Re: [tsvwg] L4S drafts: Next Steps Jonathan Morton
- Re: [tsvwg] L4S drafts: Next Steps Bob Briscoe
- Re: [tsvwg] L4S drafts: Next Steps Jonathan Morton
- Re: [tsvwg] L4S drafts: Next Steps Black, David
- Re: [tsvwg] L4S drafts: Next Steps Bob Briscoe
- Re: [tsvwg] L4S drafts: Next Steps Black, David
- Re: [tsvwg] L4S drafts: Next Steps Gorry Fairhurst
- Re: [tsvwg] L4S drafts: Next Steps Greg White
- Re: [tsvwg] L4S drafts: Next Steps Gorry Fairhurst
- Re: [tsvwg] L4S drafts: Next Steps Sebastian Moeller
- Re: [tsvwg] L4S drafts: Next Steps Livingood, Jason
- Re: [tsvwg] L4S drafts: Next Steps Jonathan Morton
- Re: [tsvwg] L4S drafts: Next Steps Livingood, Jason
- Re: [tsvwg] L4S drafts: Next Steps Gorry Fairhurst
- Re: [tsvwg] L4S drafts: Next Steps Jonathan Morton
- Re: [tsvwg] L4S drafts: Next Steps Sebastian Moeller
- Re: [tsvwg] L4S drafts: Next Steps Sebastian Moeller
- Re: [tsvwg] L4S drafts: Next Steps Pete Heist
- Re: [tsvwg] L4S drafts: Next Steps Sebastian Moeller
- Re: [tsvwg] L4S drafts: Next Steps Sebastian Moeller