Re: [tsvwg] path forward on L4S issue #16

Ingemar Johansson S <ingemar.s.johansson@ericsson.com> Wed, 17 June 2020 14:08 UTC

Return-Path: <ingemar.s.johansson@ericsson.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 552E33A0857 for <tsvwg@ietfa.amsl.com>; Wed, 17 Jun 2020 07:08:47 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.102
X-Spam-Level:
X-Spam-Status: No, score=-2.102 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3wM1c6ONlMxc for <tsvwg@ietfa.amsl.com>; Wed, 17 Jun 2020 07:08:45 -0700 (PDT)
Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-eopbgr80079.outbound.protection.outlook.com [40.107.8.79]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9B3223A0848 for <tsvwg@ietf.org>; Wed, 17 Jun 2020 07:08:44 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=RfYNNTxP8SAGmkY2kgdFRnqg8LgQa3JxShP1VwNWwq5snt2PBH/I0fFJ/MgZN2XilDVe+PQNlBcXbNLQPyVUifFigdTi9tqwrjEQnPtP7OgKtrYU/XskX7oZoBDvhFt8Z9aHvG5LTWM5NouXOCjRYgDVDh/C/4LoXGWPxvVkX0ZEK4u9OLDj0XDMZFuiEgxrrkXzNJTFlki05Jv73M8JKud2hwRXS5/m8YmSkdIunVvdPbo/HUxpBFD/5LPzdR4wZK/aSp+R6n3YbD9vOQN8Absmb28CyoRyh0h5MbfukfuOXwmklE7QdF6ozajM09jiEIBR/O7w5CT0noHgKgUeeA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9IVhktTMho5sT2Y6A2AuHw0l4iOw+IG12YeoVF91Kmw=; b=UCixQaCywUgxEJqTefZO3wiOpgOw1iaue6/lnLjfge0raDQq/bZ3s/97P00ylCo4r8OQBaL0XwOIflmMEQk9Youc6U+v6Kx1xiAZ8yh8TTmgUt5U7xSphj9Zsy5wLL9/4+uu0naYZLSFVFsGLBKv0X2ZmyiPUZRRhbrZ9ectgE4AdQKbOvSBD/li9vsxOt5xKjIzapJVpiC5EtUd8kTvJKVX9ltUdyzeRlwRdK4xkAo0J9woDfR2rVdRXxqh+igaq47Rzw+IUuTYbCva5rI/0kVQ2v+ga3Mh99024mvC2bZ+NlZwW/zF4SSguKpydG2AV9lGaIJI4L1hwbnFfrf2Jg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9IVhktTMho5sT2Y6A2AuHw0l4iOw+IG12YeoVF91Kmw=; b=PtiaKiZMYNfYw7N9crJQJMbCKspisV3HJiz/LCdySH5z+6UmqO3XRnx5ugjTM3/Bln7/9GEZBamwHNSv/1PDMeRGQkG9euHVI00q1q7rTkrhs6ApaaLZ2NzckdhMg0FbvEcnEBNWMZOx4MfyTQupDDvtkP51ZnBuGalmwljzNbk=
Received: from HE1PR0701MB2876.eurprd07.prod.outlook.com (2603:10a6:3:56::8) by HE1PR07MB3276.eurprd07.prod.outlook.com (2603:10a6:7:32::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3109.13; Wed, 17 Jun 2020 14:08:41 +0000
Received: from HE1PR0701MB2876.eurprd07.prod.outlook.com ([fe80::f411:8f72:4035:41d1]) by HE1PR0701MB2876.eurprd07.prod.outlook.com ([fe80::f411:8f72:4035:41d1%8]) with mapi id 15.20.3109.018; Wed, 17 Jun 2020 14:08:41 +0000
From: Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
To: Sebastian Moeller <moeller0@gmx.de>, Ingemar Johansson S <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org>
CC: "Holland, Jake" <jholland@akamai.com>, Jonathan Morton <chromatix99@gmail.com>, "tsvwg@ietf.org" <tsvwg@ietf.org>, Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
Thread-Topic: [tsvwg] path forward on L4S issue #16
Thread-Index: AQHWPkYZyJNg6cgsQkOoRWoF9Fsxh6jQUFNQgAAFjoCAAAT/IIAABjQAgAAXTICAACKkgIAAFF2AgACvbJCAABzFAIAAByHAgABOV4CAAA2VUIAILGgAgALBbRCAAAzsAIAACf3Q
Date: Wed, 17 Jun 2020 14:08:41 +0000
Message-ID: <HE1PR0701MB28767BC5D3B2A14B51DA03E5C29A0@HE1PR0701MB2876.eurprd07.prod.outlook.com>
References: <HE1PR0701MB2876AA3CBBA215B9FB895B0AC2820@HE1PR0701MB2876.eurprd07.prod.outlook.com> <3637517F-63A0-4862-9885-AB5EA7E6C273@gmail.com> <VI1PR0701MB2877E21B7F406C3DFCFF08BCC2820@VI1PR0701MB2877.eurprd07.prod.outlook.com> <92525827-39B6-4E88-B453-660F8FE22523@gmx.de> <VI1PR0701MB287768D465C37DC46A459C12C2820@VI1PR0701MB2877.eurprd07.prod.outlook.com> <57D7632A-594E-47BC-B6B0-5FBC22AAFE37@gmail.com> <DF67B660-DE2B-4EB8-AD77-5FECF27D1BAC@gmx.de> <HE1PR0701MB287679D1842F15FCDAC6223EC2820@HE1PR0701MB2876.eurprd07.prod.outlook.com> <7EEF7075-396F-4565-89C6-674CBB1E6CB8@gmx.de> <HE1PR0701MB28767A1E570A705EBC65EFC4C2830@HE1PR0701MB2876.eurprd07.prod.outlook.com> <5ADEBD56-1A2C-4C34-9132-E50A4A7A4A42@gmx.de> <HE1PR0701MB287695F2245A480A43DB5F9BC2830@HE1PR0701MB2876.eurprd07.prod.outlook.com> <EEB9B5D1-5F06-4BA6-A078-BE9C26D0EAD6@gmail.com> <HE1PR0701MB2876726FC67BD2850B5D39FAC2830@HE1PR0701MB2876.eurprd07.prod.outlook.com> <26EA4BBF-6A6D-41FE-8C37-45568A475CA0@akamai.com> <HE1PR0701MB287625771753F579227D90E7C29A0@HE1PR0701MB2876.eurprd07.prod.outlook.com> <34CFFA7A-EBF1-4D4D-A289-A2AAE5ADDB0F@gmx.de>
In-Reply-To: <34CFFA7A-EBF1-4D4D-A289-A2AAE5ADDB0F@gmx.de>
Accept-Language: sv-SE, en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
authentication-results: gmx.de; dkim=none (message not signed) header.d=none;gmx.de; dmarc=none action=none header.from=ericsson.com;
x-originating-ip: [192.176.1.83]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: de705dcc-d4c4-459f-57d3-08d812c7f0af
x-ms-traffictypediagnostic: HE1PR07MB3276:
x-ms-exchange-transport-forked: True
x-microsoft-antispam-prvs: <HE1PR07MB3276FAFB9E168DF92092233AC29A0@HE1PR07MB3276.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:1751;
x-forefront-prvs: 04371797A5
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: ak1+4w0YECglHPRBcjr0WygT9pJ3B8sI8Qejmd/PS+yIdHaSLyrOxNlYalsz0gk9XjnTutLL3Dfe5oFWCBb2yoc2kTzI2+n/3wxKmw3O82x1PLXqIgHQ73HHzLhg/13pm3yNiPRPUIw4pRAgMvZcbowQjEJbj0zVJrthX0PQA3YryoVtKZe6/FyGPIqpITj+7y/qcwXmflC7Kz1DQ5riWF1A3a0R/lGYUvLlFQpRBTWs4fc5Ga+yG5ZyprQj8FU/Bh7EzU0pa/oiY3wO+WBt80c2lQ1P622WQs4SnwhogVa4/OyAyozh7prBHWJ4GLKc4y2pP1MYT6j0bwmtcxJo6jBHKgs30lt+LxnVeXZ0vrg2pfSeuAOzf3s326BZvT09TEOfVaeEM1obPPe0ya8L2A==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:HE1PR0701MB2876.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(4636009)(136003)(346002)(396003)(39860400002)(376002)(366004)(33656002)(54906003)(5660300002)(7696005)(110136005)(99936003)(966005)(26005)(316002)(86362001)(107886003)(2906002)(76116006)(8936002)(66616009)(66556008)(478600001)(83380400001)(4326008)(45080400002)(66946007)(64756008)(71200400001)(66446008)(66476007)(9686003)(8676002)(6506007)(52536014)(53546011)(66574015)(55016002)(186003); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata: 8KeglOqtLXjfiGiTO5OATwbRdaRdG6rPl3Ri1HNZrM0jtg7fMKb0Seg20K+Gu1GynaMorqwJzu35WTBRZBG1yBQWBYZbOD6rKWIx3ZhjAxduepdHmnMCD7LHYlW3C3TumTHFziE0/ad4I9QViBVvEu+oVloIR7fXD6AMtbukg5YSF+UclRBWvYubzAFxZNX+JaVAjWqxBGDL3D/cU13k+T6vwwRnmiNqPGVsQqE3h06N9BxaXKBjyxv6qy3rWDCPKL0BOlaa9gPUNOTyP3j6fQHJrUoWA8M6hWB+4rOqQMCcwwqCBORadXvXSoDHzxxvXv5JhEdquiSF5VWoUqhC1tpyO+FqEgr1sYQLW1z9o5yABQT6XhOrnhOkucIHz++g7w1CoKJtuD8x8U9NgantGLYkZ5VOnCPo6QtTcgJDrs0khtMgkpasTBmGebddwPRk4hI5zLC5GFV2mStpBmlAyff4a1TSCq+Tg6nBRFUOH7g=
Content-Type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg="SHA1"; boundary="----=_NextPart_000_0093_01D644C1.90BC3A40"
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-Network-Message-Id: de705dcc-d4c4-459f-57d3-08d812c7f0af
X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Jun 2020 14:08:41.6841 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: DWm0MqbSbKYucVM5xkQOocHkGlJBuRxfma2c5fokbLCnF918IrFBig/AoTX5H2ReT4HzZPTjp99eqR8iMcLOYT/VUpJrx1fu52YSGYBh4KrSj4NRGYUzo13k7CSuVx7W
X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR07MB3276
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/tOSjzx2udHUR_7DYpkk0lwn7ARQ>
Subject: Re: [tsvwg] path forward on L4S issue #16
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Jun 2020 14:08:48 -0000

Hi
Sebastian 
Please see inline
/Ingemar

> -----Original Message-----
> From: Sebastian Moeller <moeller0@gmx.de>
> Sent: den 17 juni 2020 15:27
> To: Ingemar Johansson S
> <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org>
> Cc: Holland, Jake <jholland@akamai.com>; Jonathan Morton
> <chromatix99@gmail.com>; Ingemar Johansson S
> <ingemar.s.johansson@ericsson.com>; tsvwg@ietf.org
> Subject: Re: [tsvwg] path forward on L4S issue #16
> 
> Hi Ingemar,
> 
> more below in-line.
> 
> > On Jun 17, 2020, at 15:20, Ingemar Johansson S
> <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org> wrote:
> >
> > Hi Jake
> >
> > And thanks for the input.
> > Given all the input sofar my impression is that It is difficult to say how
> serious issue 16 really is.
> > Surely there is a possibility that L4S flows can get an potentially unfair
> advantage over a congested node that is  RFC3168 capable (and ECN
> enabled). The question is here when things are deemed as unfair and when
> starvation is a fact, opinions differ.
> > Another question is to how large extent there will be legacy RFC3168 ECN
> capable (and ECN enabled ) bottlenecks that will "never" be updated or
> replaced. This question is currently difficult to answer.
> >
> > Yet another aspect is how successful it will be to implement RFC3168
> bottleneck detection e.g. in TCP Prague, I am quite confident that these will
> not always be successful.
> 
> 	[SM] +1
> 
> 
> > But then, given the current deployment situation and possibility to
> > update nodes in the networks (OpenWrt routers appear to support
> > automatic updates)
> 
> 	[SM] Please accept my apology for not being clear on that topic in the
> past. Stock OpenWrt does not offer automatic updates, not even notification
> of update availability at all. There are some vendors, like Evenroute and
> Turris, that base their own products on top of OpenWrt that do offer
> automatic updates and as far as I can tell also notifications. But I have no
> reliable numbers on the prevalence of either stock OpenWrt or update-
> enabled versions in the field. I also add that a tiny bit of research should allow
> to confirm this.

[IJ] Sounds like a contradiction here to me. I was asking for a list of off the shelf routers with OpenWrt support, all these seem to support automatic updates of course limited by some EOL constraints. To me this seems like what the average John or Jane Smith would consider to buy. On top of this we have the few enthusiastic do-it-yourself people who implement OpenWrt in Raspberry PI but that is of lesser interest because a) they are very few and b) they are in the forefront and are thus likely to upgrade pretty fast. 

> 
> > I am not convinced that these need to be 100% bulletproof either.
> 
> 	[SM] 100% is not achievable, but what we currently have is an effort
> just designed to get past the objections int the WG instead of actually trying
> to tackle the issue for real.
> 
> >
> > /Ingemar
> >
> >> -----Original Message-----
> >> From: Holland, Jake <jholland@akamai.com>
> >> Sent: den 15 juni 2020 20:36
> >> To: Ingemar Johansson S
> >> <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org>; Jonathan
> Morton
> >> <chromatix99@gmail.com>
> >> Cc: Ingemar Johansson S <ingemar.s.johansson@ericsson.com>;
> >> tsvwg@ietf.org
> >> Subject: Re: [tsvwg] path forward on L4S issue #16
> >>
> >> Hi Ingemar,
> >>
> >> I posted some summary numbers from some observations I made here:
> >> https://protect2.fireeye.com/v1/url?k=d34bc422-8deb7e4c-d34b84b9-
> 8660
> >> 38973a15-6559e7e079a7505b&q=1&e=7a17ee77-c385-4248-836a-
> 193e64d78d5c&
> >>
> u=https%3A%2F%2Fmailarchive.ietf.org%2Farch%2Fmsg%2Ftsvwg%2F2tbRH
> phJ8
> >> K_CE6is9n7iQy-
> >> VAZM/
> >>
> >> I didn't say anything about France or Norway, but the numbers I have
> >> seen were roughly in line with the numbers Jonathan gave.
> >>
> >> The "growing" claim also looks tentatively well-supported, because
> >> I've seen
> >> 2 new ASNs since then with a high count of CE-marking paths.
> >>
> >> HTH.
> >>
> >> Best regards,
> >> Jake
> >>
> >> On 6/10/20, 6:59 AM, "Ingemar Johansson S"
> >> <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org> wrote:
> >>
> >> Hi
> >>
> >> Do you have any public sources that confirm the numbers you quote
> >> below ?. I tried to look up data on this but it surely is not easy.
> >> Which foras are the vendors that manufacture CPEs active in (if any) ?.
> >>
> >> As regards to endpoints implementing RFC3168, do you refer to servers
> >> and clients or something else?. My interpretation is servers and
> >> clients and I don't believe that they are central  to this
> >> discussion, or do I miss something ?. I understand that traffic
> >> shaping on outgoing interfaces can be applied in a Linux host but
> >> don't see why they become a problem especially as there are qdiscs that
> support dualQ.
> >>
> >> /Ingemar
> >>
> >> PS. I am not yet trying to convince anybody, I am just trying to find
> >> the answers.
> >>
> >>
> >>> -----Original Message-----
> >>> From: Jonathan Morton <chromatix99@gmail.com>
> >>> Sent: den 10 juni 2020 14:58
> >>> To: Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
> >>> Cc: Sebastian Moeller <moeller0@gmx.de>; tsvwg@ietf.org
> >>> Subject: Re: [tsvwg] path forward on L4S issue #16
> >>>
> >>>> On 10 Jun, 2020, at 11:35 am, Ingemar Johansson S
> >>> <ingemar.s.johansson@ericsson.com> wrote:
> >>>>
> >>>> 1) How widely are  RFC3168 ECN capable AQMs deployed _and_
> enabled
> >> ?
> >>>
> >>> Enough for the effects to be visible on about 0.1-1.0% of current
> >>> Internet traffic - and rising steadily.  That's some combination of
> >>> endpoints
> >> negotiating
> >>> ECN support, and middleboxes implementing an AQM, but not
> >>> necessarily both on the same path.  Deployment of ECN-enabled AQM is
> >>> very high across a small number of forward-thinking ISPs, including
> >>> a very large one
> >> in
> >>> France and a major one in Norway.
> >>>
> >>> Basically every endpoint out there today implements RFC-3168 ECN,
> >>> and every Linux endpoint runs an ECN-enabled AQM by default on each
> >>> Ethernet interface.  If Linux and/or Microsoft had decided to switch
> >>> it on by
> >> default a
> >>> decade ago, rather than hiding it behind a non-default configuration
> >>> flag,
> >> we
> >>> would not be having this conversation, because the deployment
> >>> numbers would be too big and obvious to ignore.  It's been a long,
> >>> slow
> >> chicken-and-
> >>> egg situation which the major consumer ISPs have essentially refused
> >>> to
> >> help
> >>> resolve.
> >>>
> >>> But now there are commercial, off-the-shelf CPE products which
> >>> anyone can buy and install, and which implement the sort of
> >>> bufferbloat mitigation measures that most ISPs have not.  I've found
> >>> at least one of those on the physical retail shelf, here in Finland.
> >>> I don't have sales numbers, but
> >> they
> >>> must account for most of the deployment on ISPs that haven't
> >>> deployed it themselves.
> >>>
> >>>> 2) If they are deployed _and_ enabled, can/will they be updated ?
> >>>
> >>> Some can and will.  But some is baked in hardware so would be
> >>> difficult to update, and some is managed by people/vendors who do
> >>> not know or care about L4S, so would tend to keep using the old
> >>> system which is RFC- compliant today.  When was the last time your
> >>> CPE devices got a firmware update?  So L4S has to be able to cope
> >>> with the existence of such deployments in at least the medium term.
> >>>
> >>> Frankly, if you believe that tunnels are an intractable problem,
> >>> then this
> >> is
> >>> just as bad.  So please finally drop this argument; you're not
> >>> convincing anyone who matters.
> >>>
> >>> - Jonathan Morton
> >>
> >