Re: [tsvwg] ECN encapsulation draft - proposed resolution

"De Schepper, Koen (Nokia - BE/Antwerp)" <koen.de_schepper@nokia-bell-labs.com> Thu, 10 June 2021 23:43 UTC

Return-Path: <koen.de_schepper@nokia-bell-labs.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 008093A1F3F for <tsvwg@ietfa.amsl.com>; Thu, 10 Jun 2021 16:43:44 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.599
X-Spam-Level:
X-Spam-Status: No, score=-2.599 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.698, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id HzcvBbP_iapD for <tsvwg@ietfa.amsl.com>; Thu, 10 Jun 2021 16:43:38 -0700 (PDT)
Received: from EUR02-AM5-obe.outbound.protection.outlook.com (mail-eopbgr00126.outbound.protection.outlook.com [40.107.0.126]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 975B03A1F3E for <tsvwg@ietf.org>; Thu, 10 Jun 2021 16:43:38 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=EDdTwMLd032SVrN8EVvIsNHZbvwkqx21k8qucrvVoS1NeP3VCuJGCuE0Zbl7TSVXtTjBk+XJdW8XQbvaLOe6H3YLB/Ai+MKP5OCfSTqB4ZBwbiZDXaiJ1BetUaeF3SSHxb+79TtL33BQK3Oe18gKxheOikquM4OvkjeUGxZBH0F1MsrLac7gii0AJFG+fYfBlF9wjq55gRSEU0PQyv8vI6LB38Iq3J2kZJnPsTd54PtHfRL0MLqqsAEXbDxC3Ml3WxEzQB0nxMxVPSU+iORIA+F4cTQKBdV2B0gEE6AnJrHSMkEfFwwrlJ2Ab2eGnuPq/wRmVgtXrIjFWzvVgqpsFw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=3HrikOfxAIpynZ4K/7iukd3Rc3U37J3aqVYEDcCRl1A=; b=Q4RO8TsIBrxYfoh0FaaKfZ5R28rko8hqg5vEAYNMTNF05xwV/ZRAxbQW106TC9H8cP0x8IzlJ23O+/aTugJ981DlQBhiw2PYVxlOdofBvc8NMpI1WvpqM/RH3gQ9LeMhnrBF+0jn8QSKL+nfBuUtgc8MAGEQSrOoGzb1e6De2cOT4fmfoyeOrPwy2M/Fr11oLN8sNHRe4lfFo1n43r+k1O3lVdzjNlPCG5/U4p0QZxmEikqalP8lsjvsZFOc07lfkXryjLPkMk4KQ2FJqgx7kuIoLQqqMJarr9HiEMI4nCy69pxWYH9ok5lVwGTy5zsiSOz+Jqq59Sqw+B2IaedpDg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nokia-bell-labs.com; dmarc=pass action=none header.from=nokia-bell-labs.com; dkim=pass header.d=nokia-bell-labs.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector1-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=3HrikOfxAIpynZ4K/7iukd3Rc3U37J3aqVYEDcCRl1A=; b=K3baJYZMtv3H9+MgD/dsGt2njfPMFIPAlBHdtioM1sK8pKzNjVX2o9BGB0WZ+fxuLqYEV6pPWv9HX6cbHK5hrqnXshsRGYaoRFkGy/+eFbY+QSOmY8FUO3Fdq0BL8q8Hm8Do+0Ur8ULN9ddC+UtaH5r6/FKbnI+jdb/CGNdulQo=
Received: from AM9PR07MB7313.eurprd07.prod.outlook.com (2603:10a6:20b:2c6::19) by AM0PR07MB5539.eurprd07.prod.outlook.com (2603:10a6:208:103::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4219.17; Thu, 10 Jun 2021 23:43:33 +0000
Received: from AM9PR07MB7313.eurprd07.prod.outlook.com ([fe80::d85a:c159:4d35:21b2]) by AM9PR07MB7313.eurprd07.prod.outlook.com ([fe80::d85a:c159:4d35:21b2%8]) with mapi id 15.20.4242.012; Thu, 10 Jun 2021 23:43:33 +0000
From: "De Schepper, Koen (Nokia - BE/Antwerp)" <koen.de_schepper@nokia-bell-labs.com>
To: "De Schepper, Koen (Nokia - BE/Antwerp)" <koen.de_schepper@nokia-bell-labs.com>, Jonathan Morton <chromatix99@gmail.com>, Bob Briscoe <ietf@bobbriscoe.net>
CC: "tsvwg@ietf.org" <tsvwg@ietf.org>, Markku Kojo <kojo@cs.helsinki.fi>
Thread-Topic: [tsvwg] ECN encapsulation draft - proposed resolution
Thread-Index: AddOnb5B4hPq8TIqQMeaLOUn3OP2OQB/ZnoAADX2kQAAAZDhsAG8/UEAAHx9tgAACEA9gACv6mXAACnyxFA=
Date: Thu, 10 Jun 2021 23:43:33 +0000
Message-ID: <AM9PR07MB7313C96F04928452EA57859DB9359@AM9PR07MB7313.eurprd07.prod.outlook.com>
References: <MN2PR19MB40454BC50161943BC33AAAD783289@MN2PR19MB4045.namprd19.prod.outlook.com> <43e89761-d168-1eca-20ce-86aa574bd17a@bobbriscoe.net> <de8d355d-08b6-34fb-a6cc-56755c9a11ee@bobbriscoe.net> <MN2PR19MB4045DB9D2C45066AEB0762DB83259@MN2PR19MB4045.namprd19.prod.outlook.com> <alpine.DEB.2.21.2106021717300.4214@hp8x-60.cs.helsinki.fi> <290e1624-fa1e-21d7-95fb-90e284c27dd8@bobbriscoe.net> <C7509065-526C-4712-B6CD-E919910E280E@gmail.com> <AM9PR07MB7313E7797F850B210EC3A799B9369@AM9PR07MB7313.eurprd07.prod.outlook.com>
In-Reply-To: <AM9PR07MB7313E7797F850B210EC3A799B9369@AM9PR07MB7313.eurprd07.prod.outlook.com>
Accept-Language: nl-BE, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: nokia-bell-labs.com; dkim=none (message not signed) header.d=none;nokia-bell-labs.com; dmarc=none action=none header.from=nokia-bell-labs.com;
x-originating-ip: [2a02:1810:1e00:cb00:6c54:726e:5266:66c0]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 9635265c-f959-42bf-9786-08d92c698f38
x-ms-traffictypediagnostic: AM0PR07MB5539:
x-ms-exchange-transport-forked: True
x-microsoft-antispam-prvs: <AM0PR07MB55399137E7F8B4D7F861F0EAB9359@AM0PR07MB5539.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: H/nCI/DJjTYD0VU1DHnWmWeihlXHyXOp+/6QsA03s9ZSqQyBP4DCgdSnyz4wfUMIvgpwkvd5FnVpKX7GozNvWd1WrrQR3SQRmM80ZcIG7f4uNX8zhoJRBKRSwg64x+aGpgBF9sORfhjw9Veore1cxfOYXD0Yea2c34LL8bjIzGh5A8+CuYNMWtC7IYZyJSd+uYkO21jY3E7P8qlRuC0vfMDONN0xobATDtcPUQODemAlRaDMiy3KHXezD1XVyUrBoboVfptdTbzvJ/coW/x9tbToMHKODu7UTrRd2Mr6UqyOa+OJ/fEXhhvDS0DHYDgjhXWUaRuY6GZAo8JCYNrJ9aGNBf/SkY58cnJ9F3kl0JLKZZ83kf/IqFnKnjWzn5WPE5S+nQ5o2HE0TK2gXUIPnPxblhUYZns+aXph/Ljpfc6cS9+2SjwCRR9FV2M+wZIe+STIY0PzdZ4Q0zF5oRWJIWGUIcGMsGgnZz6YWQFFgjb67oeIz5EC5a2Ooqg00Y0V6eR8suJlH9fb3FjyTI9LSJfN/jz11hC5JGwR3fdnmdTQfIli86IJUeIMyZfQQeQHPRO/RPR5xTf9ZlQ5FxI6cV1Exf4YWGj9p707NycD//U=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM9PR07MB7313.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(376002)(136003)(346002)(396003)(39860400002)(366004)(54906003)(122000001)(38100700002)(7696005)(110136005)(8676002)(76116006)(4326008)(9686003)(66446008)(5660300002)(64756008)(66946007)(71200400001)(66556008)(66476007)(52536014)(478600001)(6506007)(55016002)(86362001)(186003)(83380400001)(33656002)(316002)(2906002)(53546011)(8936002); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: 3eATO9LRfPTk97oL1qI7uVzwKKaVLMP7wgaZHlDw3VMNWMI1YlVAQjiH5P4Yh7gUdPU98aSodk2E+2fqHhWdzMQiVh0ktlttRHEExYYwCICyKalelXUPijNMVvszxec/sJHP8QEWjo5RmdncJGh4YPJOr0wB8CaUTDdZ3n5Rk6pXcnaRtC4ZRjKVXzGMOvAfdDvMoBP3E2RQ199DFeQ+wZxo/a5WA+Suf0XxEhiHHJsoyX0Oy/e3Hv7Ace9eS8drwmSzYpXVMDK3KeCng98XImC7S9BPfjEQ7+Pin1hf1bNVQUtk5hUYNVc6R5ieKJnZ6EvTad+F/LsoeToWF/PbX7VoM81P4a/PgIAN3pDR7pJTDF0NkMdcq6spZJXcVYK8cAdJbApWpMNf2uxfVorJ1InUrzh6jU3c0ZLETKuvdFjlbzp/1ePxpD1m3Y1TZSy+C4Teg+NBXU32B1CychDuZWnz14OZWvl4SFz8GDt59mP77xvZv1lHKFzF6QOE2EZV59zaMyld4NjqorqKUr1+j5QlruVlGkFaAuIPZr3ntYSgPM+PBCeG5WuTiQ1eGKWtGovdNDy12DpZZVYvrwg8jOHFkpLELzb4PzsV9VEFf1XOnageyojdv3jfjB7BOS0krDfFPmdUGe5jD1DxB67XQM+wAz7pr3GlQAWSYlE0jMQqRdabLjPJ9I+vfElk7keXb7F3F002erKafXnpZqk6jSQP3N0t2PoH6w8HQvQQhscF5mQnal7+Z0uNZ1M3GyXo/gpthwVyuSH7JTpQbT94JQgs4IC3sQkgTEzpJipySgLISqdp2ynaBn2bsw+ifmhJDkWMMEj4eOmSRMSn5S9wapXf8jQYPhI91dV/Lzmomu+wwX9UhnqCu5n1Vn4E49tuTgXtPfqWs/Wj1HPu0TWxLlDk0JMs8rE5xrPJ6zz5ATymM4qLFdlfR/RGOTa/eW6qDPp+e8Pbc4tKo3Qzu1xrwiCEvE1up4swmDomgfo3DUPiH6tx/ozmFulr1FRAr18OQyXS0rL/v0EcrDOEd/U8BokXlTz6lMJ6MLP9M2l0AchRPwL8TMl9OzLcqN1mDua7hE9bkPEy1CD9aJUwEcdPR90LX5LvM4E6VjQ4rrun602wWf5sykNwMH9cKKf+nh4TCdQDq0kR5WSk2YaHIcP89o2gAdIKZQ0u7QCKgckTg08EHQaloaosQLX+09S75mLGoGOEHKGzkfC0TrwHSwhqiafJGXBVKCLpm6OxvMi31/ldbQ74D3z94m90ue1RsxQ5Pu/5O7UqvPxdj3mFQ6aBN7Yg9xyjlJHTIcNOaqhB3kyXs8Q7Anz7oPqxvd0cu3qYQ4ipDwsoowaZvaADOOATmZ/jWO3W1fW37PtUPBYnqRgBxZuejjQ6WApEdHl8fva/
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: nokia-bell-labs.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM9PR07MB7313.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 9635265c-f959-42bf-9786-08d92c698f38
X-MS-Exchange-CrossTenant-originalarrivaltime: 10 Jun 2021 23:43:33.4499 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: aCxcSJLa6/dKRaIU2gqz9i942NxlNb9sN5ogdMkCwAgAsqG7vgeXCV6Z8VFWuawRrJJRsqQ4IfahlDNDGBVf/4+PywIBeSVZ5p7TXCoYy2hYjY/sjy2n2Wxd/87bMWXi
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR07MB5539
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/s_Sdx2EY0ikW5vUmffeDAfEwasw>
Subject: Re: [tsvwg] ECN encapsulation draft - proposed resolution
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 10 Jun 2021 23:43:44 -0000

To clarify the second algorithm, "full packet size" could have 2 meanings: the size of the inner packet or the max packet size, independent of this packet's size.
This results in 3 algorithms:
- only mark if the first byte of the inner (reassembled) packet is marked (ignore marks on any other bytes/segments)
- apply a random probability on the inner packet based on the ratio of marked bytes in the inner packet and the inner packet size
- apply a random probability on the inner packet based on the ratio of marked bytes in the inner packet and the maximum inner packet size

Thinking further on this, it seems that the first 2 algorithms keeps both packet and byte probability, only if there is a strong correlation between the sizes of the inner and outer packets. If there is no correlation, these first two algorithms will carry the outer packet probability to the inner packets independent from their sizes, and the third algorithm will mark the inner depending on their size (gives more marking/dropping probability to larger packets).

If there is a strong correlation of packet sizes and the AQM marks with a byte probability, the second algorithm, will square the byte based probabilities. If the AQM marked with packet probability the tunnel decapsulation will mark with inner packet size dependent probability.

Assuming there is usually a large correlation between packet sizes and that AQMs that apply byte based probabilities are not often used, the first 2 are probably recommended? The third is quite tricky as you need to know exactly what is going on to avoid giving short packets an advantage.

Also taking into account why AQMs in routers would mark byte based or packet based is usually dependent on their capacity limit (being packets or bytes for buffer sizes and packets/second or bits/second for rates). If there is a packet size correlation in the tunnel, then it is logical to pass that through to the original senders, but if there isn't, it is logical to also spread the rate or buffer limit over all flows independent of their sizes (as they don't matter and are reshuffled by the tunnel anyway).

Koen.

-----Original Message-----
From: tsvwg <tsvwg-bounces@ietf.org> On Behalf Of De Schepper, Koen (Nokia - BE/Antwerp)
Sent: Wednesday, June 9, 2021 6:08 PM
To: Jonathan Morton <chromatix99@gmail.com>; Bob Briscoe <ietf@bobbriscoe.net>
Cc: tsvwg@ietf.org; Markku Kojo <kojo@cs.helsinki.fi>
Subject: Re: [tsvwg] ECN encapsulation draft - proposed resolution

Not having followed the full discussion/history, for me preserving the probability of marks is important (whether on bytes or packets), and as marking/dropping is usually applied in the network according to a probability in a closed control loop, it is probably the best way forward. Even if marking is applied by time distance and/or number of bytes or a count algorithm, it will converge to the "right" probability. This means any reassembly that preserves the average probability is good enough. Due to multiple bottlenecks and RTT dependencies, marking/dropping probability to rate/throughput is not an exact science anyway (though we should try to approach this as much as possible in a reasonable way).

So for me following simple algorithms would be ok to use:
- only mark if the first (even partial) segment of the reassembled packet is marked (ignore marks on any other segments)
- apply a random probability on the packet based on the ratio of marked bytes in the packet and full packet size

I believe both algorithms keep both byte and packet probability equal. It might not fulfil the immediate requirement, but since an AQM applying a low probability is not an immediate action anyway, it is not so important. An immediate AQM like the step threshold is marking with a high marking probability (100%) a series of packets, which is then also immediately carried forward during decapsulation by both algorithms.

Koen.


-----Original Message-----
From: tsvwg <tsvwg-bounces@ietf.org> On Behalf Of Jonathan Morton
Sent: Sunday, June 6, 2021 5:02 AM
To: Bob Briscoe <ietf@bobbriscoe.net>
Cc: tsvwg@ietf.org; Markku Kojo <kojo@cs.helsinki.fi>
Subject: Re: [tsvwg] ECN encapsulation draft - proposed resolution

> On 6 Jun, 2021, at 2:06 am, Bob Briscoe <ietf@bobbriscoe.net> wrote:
> 
> Before we do, can we make sure we're all on the same page regarding some basics that I believe are /facts/ about preserving markings when PDU boundaries change. Do you agree with the following table that I asked about earlier:
> 
>                   | marked    marked
>                   | PDUs      bytes
> -------------------+------------------
> preserving prop'n  |  ==        ==
> preserving number  |  !=        ==
> 
> 
> IOW, do you agree that the three that are tagged as '==' are equivalent ways of expressing the same thing, but different from the one tagged '!=' ?

This question just tells me that you are still focusing on the wrong metrics.  The number and/or proportion of marked bytes is IRRELEVANT.  What matters are the number of bytes and/or time interval BETWEEN marks.

I explained this in more detail in my previous post.

 - Jonathan Morton