Re: [tsvwg] ECN encapsulation draft - proposed resolution

"De Schepper, Koen (Nokia - BE/Antwerp)" <koen.de_schepper@nokia-bell-labs.com> Mon, 14 June 2021 16:04 UTC

Return-Path: <koen.de_schepper@nokia-bell-labs.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8874A3A2928 for <tsvwg@ietfa.amsl.com>; Mon, 14 Jun 2021 09:04:39 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.599
X-Spam-Level:
X-Spam-Status: No, score=-2.599 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.698, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id BX7UppFPbslT for <tsvwg@ietfa.amsl.com>; Mon, 14 Jun 2021 09:04:34 -0700 (PDT)
Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-eopbgr150098.outbound.protection.outlook.com [40.107.15.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 69BE83A2922 for <tsvwg@ietf.org>; Mon, 14 Jun 2021 09:04:34 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Kqa0zx13eeyGpt+151PD/s0c2+Oc00DCm434hNT9hVh/Q/ja9Pa76mqwtJsDdSGkm7hSfTdDu9QhDhnhQkQPDVRPfg1/k4H/l6jMY/dolMc1OCuUE0UodICExFLkbo0R2HZvny08cr6SPQhYo0T4VVju4jUQXlaKmYmM52h+4lkBYrQpiCZWvk+MUamT/BFsfCNuvxXiqS+c+yWCXc9rFYRko/xdHR+8XqIj9t0VMI4if6e5jtfZzTmIbyfi4aq3eOi91B7H6Y9IF/bSzROZJ2mH8a9LAcH9cnoEUnMwONKoZcux+mK+BHAHe93WdaUCtIptfaPFQtCXqynsZeVX5w==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=vbaPXpNpyZTMzWqZmpMTsBA/YPraA6pZbo6qf2LbWo8=; b=DbQUNZzq+WcY6t6lX2o+TI3xJleVwjejZp+70U02pSCHDz7j56peRhlPI1wT1SAvNLgEutk/Mt+jx+WFQTQBxBNizlk2oEQCmnUdIXj2Mdby909pC7gNksiU30txGrNxspnfqnku49WfHQ5XyKuQwDLp8xYrJtYMUWVpFQH9obxXeMDz0haho3XXvopFRn203xMS+eQTXl9JYKp0TJU2ZJwzRPXSM+Dp94CP+FT1tjxXhNR1fTBLrIIX1gA8Hpc21aGR1r6fMKJ/dRbLf/F1eqxf3sJQ+plTSCXrwbivzvNGEFgbAf2x1O6JOVvyGeQk2CMbbDE30nqcBFVyZzWTEw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nokia-bell-labs.com; dmarc=pass action=none header.from=nokia-bell-labs.com; dkim=pass header.d=nokia-bell-labs.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector1-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=vbaPXpNpyZTMzWqZmpMTsBA/YPraA6pZbo6qf2LbWo8=; b=tubYEKSy0VUjliuRbCuPGvKa8z+qvbfHIfxlpXHbynwjKTLN+yHgl9RY2juuODsTUmqiKWRZ8CtPF7VesCcNcTvlcajOWwAczbthsDg8wqNaidAhC+aX+L8e9/zR5DoIQidsYm6KG4C5zeql//0Nv8U87UOi8vpfLEkZGSEVGYI=
Received: from AM9PR07MB7313.eurprd07.prod.outlook.com (2603:10a6:20b:2c6::19) by AM0PR07MB4017.eurprd07.prod.outlook.com (2603:10a6:208:44::28) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4242.14; Mon, 14 Jun 2021 16:04:31 +0000
Received: from AM9PR07MB7313.eurprd07.prod.outlook.com ([fe80::d85a:c159:4d35:21b2]) by AM9PR07MB7313.eurprd07.prod.outlook.com ([fe80::d85a:c159:4d35:21b2%8]) with mapi id 15.20.4242.015; Mon, 14 Jun 2021 16:04:31 +0000
From: "De Schepper, Koen (Nokia - BE/Antwerp)" <koen.de_schepper@nokia-bell-labs.com>
To: Jonathan Morton <chromatix99@gmail.com>
CC: Bob Briscoe <ietf@bobbriscoe.net>, "tsvwg@ietf.org" <tsvwg@ietf.org>, Markku Kojo <kojo@cs.helsinki.fi>
Thread-Topic: [tsvwg] ECN encapsulation draft - proposed resolution
Thread-Index: AddOnb5B4hPq8TIqQMeaLOUn3OP2OQB/ZnoAADX2kQAAAZDhsAG8/UEAAHx9tgAACEA9gACv6mXAAAmyboAAOj9EoAANYkAAAAN8j2AAA+F8gAACI7xgAAPvDYAAAp1roA==
Date: Mon, 14 Jun 2021 16:04:31 +0000
Message-ID: <AM9PR07MB7313521881989F3299582ED4B9319@AM9PR07MB7313.eurprd07.prod.outlook.com>
References: <MN2PR19MB40454BC50161943BC33AAAD783289@MN2PR19MB4045.namprd19.prod.outlook.com> <43e89761-d168-1eca-20ce-86aa574bd17a@bobbriscoe.net> <de8d355d-08b6-34fb-a6cc-56755c9a11ee@bobbriscoe.net> <MN2PR19MB4045DB9D2C45066AEB0762DB83259@MN2PR19MB4045.namprd19.prod.outlook.com> <alpine.DEB.2.21.2106021717300.4214@hp8x-60.cs.helsinki.fi> <290e1624-fa1e-21d7-95fb-90e284c27dd8@bobbriscoe.net> <C7509065-526C-4712-B6CD-E919910E280E@gmail.com> <AM9PR07MB7313E7797F850B210EC3A799B9369@AM9PR07MB7313.eurprd07.prod.outlook.com> <3009F41B-1D79-4B2D-BC16-8F2049EA4976@gmail.com> <AM9PR07MB731372180EBF5C815A684F3CB9359@AM9PR07MB7313.eurprd07.prod.outlook.com> <51F33C7C-3323-4ADA-98BB-16A83F763FCE@gmail.com> <AM9PR07MB7313DC2C4F922A90E2E602BFB9349@AM9PR07MB7313.eurprd07.prod.outlook.com> <272C3C12-C788-4080-9B57-C3E2DD7BC5B4@gmail.com> <AM9PR07MB7313406CE46E1A167A473443B9349@AM9PR07MB7313.eurprd07.prod.outlook.com> <9B8D5034-E580-4613-8DC2-6845F20FA9EA@gmail.com>
In-Reply-To: <9B8D5034-E580-4613-8DC2-6845F20FA9EA@gmail.com>
Accept-Language: nl-BE, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: gmail.com; dkim=none (message not signed) header.d=none;gmail.com; dmarc=none action=none header.from=nokia-bell-labs.com;
x-originating-ip: [2a02:1810:1e00:cb00:210b:63c2:20dd:546d]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 13b77e5e-7de5-448a-9ea3-08d92f4e186e
x-ms-traffictypediagnostic: AM0PR07MB4017:
x-microsoft-antispam-prvs: <AM0PR07MB40175FE515E2108F5D63DA67B9319@AM0PR07MB4017.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: C4vPbhlUgDGTBrEeOviqy741ImCEwtvhQ7kLB8ajlHa2jOZY+gUHlB5rX7x546G1m2ejdEsKhM6DM6fFkeNrCbOFgfJZJxPb5TaOZW22Rns1gR9zEdE0aRUbW/buxOVIFFTdbLKY5dj00XT0kEm92TQhjDH78ANKTofaQAjOXvXi8J0Ldlv7LWxzFwSVHgzUFu0MvlKkZdiiRJrRFDwN5QYiFR4Eye526X4uX07oSQPicUHNQm9e2cLle0jgkVeVQyn/3OVVADagoA0CQqK4D+6+n2YqQOu0CoY9K0WOZlATMtCyHR2MpiSC7GUaKE/FaGcCd58kmGYhDNPsqKGpsKKuZ8+UYz29YBklf/IRunzo2RlpCLucVtVhGA7GtZzlBIfj1JPOkRhUuNXFEPNHoWagRvcfe3/fExoUnHCGEBh1MzXeBH9xlR5B8tv0lBaOB5W9iJxCfQA+toQwSEvG/0c13D6xTdITIt18Ko+6Rr+PzqSFDh+4tt950EA0XUbO4D1PnNaZUfxpp4hNDMFHu5WjslzxyObb9pFcjMWlz26yo+9jy3ww8Dyv5ZeMiiYEc5K0lOToyxcrNh0KsgjHHIC2+RMnCZW2wOYQEzwphD0=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM9PR07MB7313.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(346002)(396003)(136003)(366004)(376002)(39860400002)(316002)(76116006)(64756008)(66446008)(66946007)(66476007)(66556008)(6506007)(478600001)(52536014)(53546011)(9686003)(83380400001)(38100700002)(6916009)(33656002)(7696005)(8676002)(5660300002)(8936002)(4326008)(71200400001)(186003)(86362001)(122000001)(54906003)(2906002)(55016002); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: G8BOIUHWFf5m6qTV87eFBR/9JYP2rtkkQKZGmky2sWIkfN6qOvXex4bsjk/bE8ng9sxOuaEfp+vHZh6y/tKyiWX6ZgZLlbwGxt/UoZwZ2+y9j9NJCNn1f5JQe0CKYu23R3IsrTDIGcUF2nDIEtj3ibOIf9d3qj6PCDwHBSPVYpOONlPaFZAus39VeYe3/CyEquusE6TG8eAS2rpXmcGtsrI0VSTAm4vzPBvHcxdJEWDlJkqYw7BVFAGIqOSnC7/y4719J5MTnaMibI5/jshZAJY9gAoRov84bw9THDMUcOMb1Icdp2BO2CPolFoXbBAuJ+O75sNBsQc1wqubRcgZHATE957UwlL1QSH5fOwE2NqrCJRoPIINhLF0qFz++3zj20vLO8Yyyp5kqFCnxXsFB//ajeztNjoYqrnCKX9dQoXiWUgK82Kwdv5VR5fFuUvYxt22IKHNs0MkCn8ilmtLtHUQ8HK/QqUUwP+fTLErRlC2HEQvJpuTnBHAmUh4GjO7DTxqi5yTp5QiZ6h0F+Tlv1ywVSH4yzUXr7az+cUNLbUBWUYHlnXchN67zlMDbf0jFKur/iHUpIt74xc6MW8FdhYKBgmnAugYc8hZz2cvJ2ozAMbdbdUU8PXeoIcH/mUBjZ6I1f69mp4zAx/3TLCJKUo6KyMm7m4hE0oPBaDWtignqLqLg+/qNwdAnPmF4DxwTOeaA+ss09OpFKH+0jF9LWz2T9iLqUT+nbYKYmN5pI57GQGQClx0e52L1ANFCITQNFHQETgtBJbe5r2KvaCYgVZffjqA6URlOqDzDDZ2tJ+2aKYDe7FQkulrrZA0pKCAWBNW79A/XFfGIpPMEnJtc4Eqih7YJEuRJi4Xht/61BU4gyPmfV3WKKIxqhr30lPeK8x4MJeWIFdSTZaWMUvvk+nZ0cf99Wd8opDkilzKJAwpOog/8VTGNuuMKk3X3sf3KLE9FVJIBC665A6AOp6+xzJMhAGTDlfORf+cig9qedmBGpcOISUbMOq2gx2AjK7/EvSxNxkfpLoqOeB45VgR0CQ975EXcBX/ltRhM5QCU5J0QbuUDy6BPSkRmlcRCp/P68BWx2nVHL/3JnM0tGTDEwPO69UruQcpAlQujeojt6Fm9qDXK899fI2+52dfWQ8hLicV2V7LHPUO64u0INy3KxOEPJ53tM1j6nlkAY2482QH1pqWVOu8NCDaAPK5cKMMLUoG8M2jeaZtJXwcvRzUNse9owAaxLv89XzsW7TPlepiCHioQCxDO+oZnN9KwGqSmzVpOgYQVgnG0+dsBwOJtMvnE4+OgV5CPSmb5ugsxr1d9dxSmbTeNnX/gTdqE/gI/DsYeTBHTefeL8k6Ur9KlxTmW/s+39b9dJiKp5ZDaAJYUCKv0wzJ5bsP6GHIky39
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: nokia-bell-labs.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM9PR07MB7313.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 13b77e5e-7de5-448a-9ea3-08d92f4e186e
X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Jun 2021 16:04:31.2915 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: DHzLR7VXVeCblG+WORnS1K84Cu1MWKebj32QU4P5i54F0dhOHFMVoh3bzRc5K8nspD1y35MPtd1QlG2Y49GDlfUyrHD6OP7kFNvV/1i2YOx825fbEY50cdKDEovhVe0Y
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR07MB4017
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/EP6J0RuVCWfNF7IC6-vEsrL04Ng>
Subject: Re: [tsvwg] ECN encapsulation draft - proposed resolution
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 14 Jun 2021 16:04:40 -0000

>> Which is what I did in a previous post, using Dimensional Analysis. 
Dimensional analysis is what you can use to check the validity of equations and further derivations from them. I didn't see any equation in your explanation. 

But I understand your point about the interval being constant for Classic CCs. The Congestion Controls determine if a "packet/byte probability per RTT" or an "RTT intervals between mark/drops" is used:
- DCTCP-like CCs use the marked byte (or packet) ratio per RTT (or other time interval), but marks are expected during every RTT (or other time interval)
- Classic CCs trigger reduction on occurrence of any number of bytes/packets dropped/marked per RTT (whether it is a packet of only 1 byte that is marked in that RTT or all packets and bytes marked in that RTT, the result is the same), and need a number of RTTs to recover from the reduction. If the flow is split in small packets and those are marked with the same random prob, they get smaller RTT intervals and a lower rate.

There were recommendations for AQMs to marking packet based on their size, to overcome this unfairness, but this is not often applied I understood. Probably better is to solve this again in the end system: by only triggering a congestion event if 1MSS of data is marked. This solves both cases: So it needs to collect at least 1500 bytes of marked packets  which come from either a series of 32 marks in a row (a large 1500b outer packet was marked and all 32 46b inner packets too) or it was NOT encapsulated in a tunnel, and an AQM is used that marks the small packets directly or it was encapsulated and a decapsulation works as a normal AQM and marks the packets with a probability (and in both cases marks 32 times more packets). Assuming the small packets are separately ACKed the 32 factor can be "undone" in the sender by only triggering after 1500 bytes were ACKed CE.

For scalable CCs this isn't needed, as the proportion of marked bytes and total bytes per interval is used. And for Classic it would only be needed if the TCP/QUIC sender is sending small packets (not if they are split in tunnels in the NW, assuming they keep the proportional factor.

I think this could be a simple way out of this otherwise already broken and complex mix of strategies...??

Koen.


-----Original Message-----
From: Jonathan Morton <chromatix99@gmail.com> 
Sent: Friday, June 11, 2021 2:13 PM
To: De Schepper, Koen (Nokia - BE/Antwerp) <koen.de_schepper@nokia-bell-labs.com>
Cc: Bob Briscoe <ietf@bobbriscoe.net>; tsvwg@ietf.org; Markku Kojo <kojo@cs.helsinki.fi>
Subject: Re: [tsvwg] ECN encapsulation draft - proposed resolution

> On 11 Jun, 2021, at 1:39 pm, De Schepper, Koen (Nokia - BE/Antwerp) <koen.de_schepper@nokia-bell-labs.com> wrote:
> 
>>> Let me turn that around and ask you what would happen if 3% of the ATM cells were *lost*.
> 
> So you are still limit your thinking in terms of CE == DROP, which I thought was accepted not to be the most optimal and useful way forward... We can and MUST use ECN in a much better way if you want ECN to get really deployed AND used...

Funnily enough, nearly all current ECN deployment is using conventional TCP congestion control (RFC-5681, RFC-8312), a time-domain marking strategy (RFC-8289) and the RFC-3168 reassembly rules, and it seems to work pretty well.  Since that is what's currently standardised in published RFCs, don't knock it until you've actually tried it.

>>> Stop thinking in terms of "probability per packet", and start thinking in bytes or seconds instead.  Everyone else is.
>>> There are two currently known AQM designs which implement this approach:
> 
> I think you are missing the point here: It is not the AQM that determines the marks. It is the end-system congestion control.

I agree, that is the correct way around to analyse the system.  Which is what I did in a previous post, using Dimensional Analysis.  That is precisely what I've been trying to get you to read and understand.

What I found, in brief, was that DCTCP has a steady state that is dimensioned in marks per second, while Reno and CUBIC have steady states dimensioned in byte-seconds per mark.  None of them are directly sensitive to packet or byte marking probability - that is just an emergent property of empirical measurement on an inappropriate assumed basis.

> If that uses the packet probability it will DRIVE the AQM to whatever it needs to converge. It is a closed loop, and the end system determines the rate/probability.

You're right that the AQM is effectively driven to the state needed to control the actual transport.  Which is why the AQM in my PPPoA example would never be driven to a 3% cell-marking probability except under extreme circumstances.  Instead, it would select a probability that resulted in a reasonable number of marks per second, or if you prefer, a reasonably large number of bytes between marks.  Codel simply operates directly in the time domain, neatly bypassing a few awkward steps on the way.

> We only can hope the AQM is responsive enough to quickly set that rate or probability. This is where CoDel clearly fails, so not a good example to use. We need to learn from our mistakes and forget "rules from the past" that are not useful...

I'll accept the Codel is not perfect.  However, it's the first AQM that matches with the problem domain well enough to deploy successfully with universal defaults, which I think accounts for its popularity.  If you continue to claim that it "fails", you're going to have to back that up with empirical data.

 - Jonathan Morton