Re: [tsvwg] Further thoughts on maturity of multipath

Markus.Amend@telekom.de Thu, 09 March 2023 18:45 UTC

Return-Path: <Markus.Amend@telekom.de>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BB50FC1522D7 for <tsvwg@ietfa.amsl.com>; Thu, 9 Mar 2023 10:45:50 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.095
X-Spam-Level:
X-Spam-Status: No, score=-2.095 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=telekom.de
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id EuBxKJbxsKew for <tsvwg@ietfa.amsl.com>; Thu, 9 Mar 2023 10:45:46 -0800 (PST)
Received: from mailout11.telekom.de (mailout11.telekom.de [194.25.225.207]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7C06FC1522CB for <tsvwg@ietf.org>; Thu, 9 Mar 2023 10:45:43 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telekom.de; i=@telekom.de; q=dns/txt; s=dtag1; t=1678387545; x=1709923545; h=from:to:subject:date:message-id:references:in-reply-to: mime-version; bh=zxokL/sCmpOwQtEcDNPe8VtW/9ImZeSa2jZ6d3/MfzI=; b=nv5BAnKdPFrJ+bLeeB3za2c3z15PLAv9uwMEVrnxIPHhqiM72JhpWjAm PkoFNOjkPBqr+sF8J20WOOl2jaFUNVENdGdQB8xY4y6UNbQCfDT1vHknk 8uZeqFXY9o5nvDssykJVZ0RSkS7FDTLtLegHNbfATItSZrBPig6HCR7HF e+56XYwbzjlRskBmc8PbkslmsEezJAQbHxyrrHQocX0brFalTB5Ca3miG ljpiAmtKyzGUbdbEYLzKzU15p9UcXlYIUEpBZr4Foot/uGhvraesvnP+O DE8liXoA+UPRJEoWT9NNy6TLeafZW9uUGB3ofqLB5K6CHUkd/JD0jOQZ2 w==;
Received: from qde9xy.de.t-internal.com ([10.171.254.32]) by MAILOUT11.dmznet.de.t-internal.com with ESMTP/TLS/ECDHE-RSA-AES128-GCM-SHA256; 09 Mar 2023 19:45:41 +0100
IronPort-SDR: uYgv+m3YrtaBdtAaMpJE+cikJm3LFtJ5e3SisDybFmZ+pj6S7AaUtz4WePngX51VIyj7u86w5w sQBan3XxvlW+/tj6g6nEB5bdi6DE1YNPs=
X-IronPort-AV: E=Sophos;i="5.98,247,1673910000"; d="scan'208,217";a="664370421"
X-MGA-submission: MDGthj90wY2ZKxakeL/H3Mu8nOKCwSbqlAp4X9W4aIN/vnW2L6nwALY0dSrHoK+9rk2uLAWjm6RtoOq9c2CFOqEAwRJpYCIjUxlsIiVHXbQM+hYQnmg2OStcXlROqcviudWDx5gnMLwd1CCWpfD2uy3FM87f1ncjTHbpaPcnSthynQ==
Received: from he104281.emea1.cds.t-internal.com ([10.169.119.195]) by QDE9Y1.de.t-internal.com with ESMTP/TLS/ECDHE-RSA-AES128-GCM-SHA256; 09 Mar 2023 19:45:24 +0100
Received: from HE104281.emea1.cds.t-internal.com (10.169.119.195) by HE104281.emea1.cds.t-internal.com (10.169.119.195) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1118.25; Thu, 9 Mar 2023 19:44:41 +0100
Received: from HE102779.emea1.cds.t-internal.com (10.171.40.45) by HE104281.emea1.cds.t-internal.com (10.169.119.195) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1118.25 via Frontend Transport; Thu, 9 Mar 2023 19:44:41 +0100
Received: from DEU01-FR2-obe.outbound.protection.outlook.com (104.47.11.175) by O365mail10.telekom.de (172.30.0.242) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1118.25; Thu, 9 Mar 2023 19:44:41 +0100
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=T3YIGOWIkIGeYEolHwvtsxpG3J0OLSNJoP6jFMLWAKkwudtcPKhigDZbb4m/n8svOklOO4vZBQyploRhzScIyYWcRIdH+Zoaeo3O/XyR/iGDtbMMq3jUO486Jt6636tV7YIQU0nm6kqliNGoXSX7CFsu1cs22PcMkMHacmgSYLp+KBkPMmHOIRvyjvL4FAhlVUfBbi60XH+oWp75BQURpAIUlQmd15EaAsdwGcaIQqwR+a7IMDWV60FQn/Xk6434Mo0NY24OWXTijbhF5MElZE3O3/fgUyK4/ie8AXPBsaa4ZBDC809+5T7XcM8LkqqoxAhcM/w23y1d8xsnHt/e6A==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=zxokL/sCmpOwQtEcDNPe8VtW/9ImZeSa2jZ6d3/MfzI=; b=cVZzSpEPt85fDafTbajHU/dBO06mBSZnNCDy825l840zny5vG7xd+PPdvM3ew8VTi//wy7L/JXl71QZUB+nfRQnIS4Hhhu1yaoWsT3X7RZU4axRgMZggnU7eJlYT5dwKYmeUNB9p4Q9oB9+hjptG2kvRjDUjbwug0ML/2dOO9j+5SZfsVAR8qNms5YXLv2Ucp2+Ynj7g5ppvqi1zBLwA4/ozZ57OZjP5DlntZy1WYrDAgDbpiaT3EMftiewWyNZB/l5E5IwngHW3pCmRdE/gLR+Hqj1SOph9QxQ9ajHzJc0R3GSuMnLPLWqWa8qVY5CJZf3Tet0SCfy2jsV8cAD3VQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=telekom.de; dmarc=pass action=none header.from=telekom.de; dkim=pass header.d=telekom.de; arc=none
Received: from BE1P281MB1652.DEUP281.PROD.OUTLOOK.COM (2603:10a6:b10:1f::6) by FR2P281MB2670.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:64::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6178.19; Thu, 9 Mar 2023 18:44:38 +0000
Received: from BE1P281MB1652.DEUP281.PROD.OUTLOOK.COM ([fe80::8fe9:c9:3452:52e2]) by BE1P281MB1652.DEUP281.PROD.OUTLOOK.COM ([fe80::8fe9:c9:3452:52e2%8]) with mapi id 15.20.6178.019; Thu, 9 Mar 2023 18:44:38 +0000
From: Markus.Amend@telekom.de
To: martin.h.duke@gmail.com, tsvwg@ietf.org
Thread-Topic: [tsvwg] Further thoughts on maturity of multipath
Thread-Index: AQHY9PFt2vJ6rgUSrEmia6HheJ8Wyq45o+kQgLncyhA=
Date: Thu, 09 Mar 2023 18:44:38 +0000
Message-ID: <BE1P281MB16520F2DDA94B414B6CBAEE9FAB59@BE1P281MB1652.DEUP281.PROD.OUTLOOK.COM>
References: <CAM4esxSZa1T2_17=j9r463R2AekOMNBsUn8uRTVjK8h0oqN6aw@mail.gmail.com> <FR3P281MB1663518668326DFB9272D1B1FA009@FR3P281MB1663.DEUP281.PROD.OUTLOOK.COM>
In-Reply-To: <FR3P281MB1663518668326DFB9272D1B1FA009@FR3P281MB1663.DEUP281.PROD.OUTLOOK.COM>
Accept-Language: de-DE, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=telekom.de;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: BE1P281MB1652:EE_|FR2P281MB2670:EE_
x-ms-office365-filtering-correlation-id: 51574e6a-e16b-47b3-b874-08db20ce5660
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 6wCqJt8IB279UBu1lUPd5R1D1dYQ7RBqxbcDNTWLmv1ayWin0oF+tf0FZ9639W3keDgCNERaFmG5GhdMaDPJXC+6G61wB71A3P0ba8bXLYDT8nRvrNUEcBlYEBPXh7GT6BOwIN46YuxUC3/ibtZQUMCBkHeFox2Zizdi0CgaS7Ejbv5f+4nDov/Suca8q/vc3pmBUCpI9riwANINbV8x065bNTWCnZ13/jZR/VI3JW6N131JvZrmXZ9FGC9icd2uh4qHYGegsydsaM5VC/Sgz1KN9BCmoyOcJ2ETAHXO9Tqr5MMj5tyQBt4OBT4jT+L83jBT6HuJMjwXnWhvwZ6liC0Dk0dXkxGFzUKpH52l8FyTNR8nxzzUNqxVlMzCtFcluZwHLcuu5+fU6yhh3YxSK1siedvAhxoeUh0ge1+UxhkfT9V0v0PsE4cMBH0uifiovxwz8CSZvqF38782daozxBYnDAicKtv0iPnowshadwN3osETx5jFXq/sQ3f7CDUUaOLUe4ISI74hiTIaAB9bNG6gDEohl0qpDAPL7aIga+qYjU57GfkJFPYEYkZ9DTRyXFbUzOgZT4Rg7kRBI91dAGFWzvCFSWxlML6m6xWFcZznD4WIY7EgqyyP2x8TVUkV/OD2SC1ANXdpye1RsR8c0WE6jUloToSdJ4fDKONBOMiILXrgmHR6pqasEeMHG1LZ
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BE1P281MB1652.DEUP281.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230025)(4636009)(396003)(39860400002)(366004)(346002)(136003)(376002)(451199018)(33656002)(83380400001)(66574015)(82960400001)(26005)(53546011)(186003)(6506007)(71200400001)(7696005)(41300700001)(66556008)(66476007)(8676002)(64756008)(86362001)(76116006)(2906002)(66946007)(52536014)(66446008)(8936002)(5660300002)(9686003)(38070700005)(38100700002)(316002)(110136005)(55016003)(478600001)(122000001); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: h5yd8fmM28wi5NGZIsC2BphhlVEqOzuO3P6qQCjAJN5+51L3DfJTN3OEKZf3oeQRMCxF5wc7YgoPhkkKmmvZxNu+rQrvTDMUEB3hFN72mTvissL/jL2d5YilfVjIykb3hpYaoxGwpWOtbRbLry/bynYyIcm3qBVFqbZON7nAjU9X5k8eA/fasqj2iavfM3PxxqHL86vAUJOtTa14SQ06yxGYwN/03HcWQJKZFZzHiPc5xof5+Db3ldU4N+F8APQJa8vTC3c1fzB2516Dy4EXUUvO5PONyq8p282JQLsQx7AA+gqKAcC0Z5mGe4544K5Glh+DV60jWSKYAAxpyJUqRYTKBgp/uhfosIKjuYlNKEl7dyArQy5ndndpHQOkAp2Ew7yBu3jFtMHqJGN9yomrzC54h098OdwiHJ3m7W3sZy/ExHpa/qyE0+no/MpWXPswvJKEd8TeJx9ZNeyd2akwcskFl6SzJSXTPRjXyqXoOdSzapD1HGE6SmWjRvhfd3h2NkSVAl19mdK7BV8HsjLOqa3w59q08KMnhcwBz7wCVuW+APD+itHNN+TJwASKRSvFSXWG62j2SjCNDgVRSDTJJTvGgr88WhJkrMP9j0kSBDJ4CC0orJ1dqrIoBjB99G9HSPlQt78VWuw0zOFbQaHrDHJAq6crMQzxNMV+y1VdalYYKwLC2PwF97F0p1tkTiM6PZqFHqmEa3raIt5+PA2S4QVbO0V3TLbddYehX7wdTKB72ToibSnHdD0e0rie40THgIkxmdHo4N2bpr6HirKCv5CV2IpqVa+eFQ8n//2zF5kKdmuTFJlScYeGEl1+P8orwxgiEgNBeVI5m0fjDnLHeuV+e9WOrgkK+qRo1gVtPUA6CuppnmrAjJ5f7Tj+6ZDUrJjVFDT3+mVwDzyD7NWhsRF35kZZpI7NrIB06X6hkybM9lRsCf3VW0c1PODYgSoTLrK9mUg+natOlwsB90nyKOV+53HYHo5cTQ7nemZDp2xbgK/6etW8K8Dl0MRxgbzhnunvuXDPSksuqdlUFh4VsFtK9eu+IFDprnHgAjTuqXAGoTMpEvLKow2x/k+X/XtHtE8cbAsmxZDOt4rq5afa7xdB13z4D5+Ckb7sNl+L/KGp9RNj9thXkoiaKCxb4YiT/2dxvayS2fQ0pl3dOFTqjl1nbYOtkj9rG4ZgVpOnKi7D0wh3XIgaP2b8293eiMtmOI0llIN5UNshk+VildGlF61Jy8bTUhBFXp0k92n2h31RZn9v5mht9SgqYEvtJPEK4vAbaIEYnLs2MguQwsiHjja2Inapn/bLWeI35XNmxE6kCVL2iOfVhJtRszJ/QPPmCywWHz1GAGv/WW/pOuHmnUTW9eni/dQxvio1/m3oEJIED63l15onw8+9taPabL4S2zyedkkiXJ0veuxbT9Lj0oSqU66jzoP91msGM7ytPzVLDjdkdrsbTnr3k1LPaQZ7OwMkSz6FaQ5347+XCtdInPzk+qpRRyUeWN8rx04ojzIEJeqdhdIxbSE8BgC4iwZq9vTROypK+utsOnV9H8ytWj43KXVl/XYkDb1tplJbwZ6MNA3joaF3a+tpBbw2QfrE
Content-Type: multipart/alternative; boundary="_000_BE1P281MB16520F2DDA94B414B6CBAEE9FAB59BE1P281MB1652DEUP_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BE1P281MB1652.DEUP281.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-Network-Message-Id: 51574e6a-e16b-47b3-b874-08db20ce5660
X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Mar 2023 18:44:38.6962 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bde4dffc-4b60-4cf6-8b04-a5eeb25f5c4f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: F4IJZqM2mL541CBojdjipJXNLIMzBZX9HxZEdvKxgFr++pjC4EiXnynbqlHkKcaIjJvnWrZuimu/riyM/6Yg/w==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: FR2P281MB2670
X-OriginatorOrg: telekom.de
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/yK0P2XuAEABfW_SeHfmDLNBjLhk>
Subject: Re: [tsvwg] Further thoughts on maturity of multipath
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 09 Mar 2023 18:45:50 -0000

Hi Martin, all,

With the MP-DCCP draft-07 a version is now available which includes the latest reviews from Simone and IANA. So I now come to the discussion from the last IETF to change to "Proposed Standard". We, the authors, have below attached a text with the new section 3.9 to the "Step 4b" proposed by you for this. I am looking forward to the discussion.

--------------------------------------------------------------------------

### 3.9 Path usage strategies
MP-DCCP can be configured to realise one of several strategies for path usage, via selecting one DCCP subflow of the multiple DCCP subflows within a MP-DCCP connection for data transmission. This can be a dynamic process further facilitated by the means of DCCP and MP-DCCP defined options such as path preference using MP-PRIO, adding or removing DCCP subflows using MP_REMOVEADDR, MP_ADDADDR or DCCP-Close/DCCP-Reset and also path metrics such as packet-loss-rate, CWND or RTT provided by the Congestion Control Algorithm.
Selecting an appropriate method can allow MP-DCCP to realise different path utilization strategies that make MP-DCCP suitable for end-to-end implementation over the Internet or in controlled environments such as Hybrid Access or 5G ATSSS.
#### 3.9.1 Path mobility
The path mobility strategy provides the use of a single path with a seamless handover function to continue the connection when the currently used path is deemed unsuitable for service delivery.
Some of the DCCP subflows of a MP-DCCP connection might become inactive due to either the occurrence of certain error conditions (e.g., DCCP timeout, packet loss threshold, RTT threshold, closed/removed) or adjustments from the MP-DCCP user.
When there is outbound data to send and the primary path becomes inactive (e.g., due to failures) or de-prioritized, the MP-DCCP endpoint SHOULD try to send the data through an alternate path with a different source or destination address (depending on the point of failure), if one exists. This process SHOULD respect the path prio configured by MP_PRIO or if not available pick the most divergent source-destination pair from the original used source-destination pair.
Note: Rules for picking the most appropriate source-destination pair are an implementation decision and are not specified within this document.
Path mobility is supported in the current Linux reference implementation [https://multipath-dccp.org/].
#### 3.9.2 Concurrent path usage
This method could be used to support a concurrent path utilization strategy, which allows multiple path resources to be aggregated for higher throughput.
Compared to the path mobility strategy, the selection of DCCP flows is a per-packet decision and part of the multipath scheduling process which is out of scope of this specification.
Concurrent path usage over the Internet can have implications. The choice of (coupled) congestion control, scheduler, and possible reordering function has performance and fairness consequences. Since this needs further investigation, it is recommended that concurrent path usage over the Internet SHOULD NOT be used.
Concurrent path usage is also supported in the current Linux reference implementation [https://multipath-dccp.org/].

--------------------------------------------------------------------------


Br

Markus

From: tsvwg <tsvwg-bounces@ietf.org> On Behalf Of Amend, Markus
Sent: Freitag, 11. November 2022 15:22
To: martin.h.duke@gmail.com; tsvwg@ietf.org
Subject: Re: [tsvwg] Further thoughts on maturity of multipath

Hi Martin,


Thank you for your thoughts on the items we raised during the IETF 115 TSVWG meeting.


We believe that 4b is a feasible step. We are currently working on a draft version -07 that includes the final comments from Simone and IANA. Our plan is then to provide text for a concurrent path usage section on the mailing list.


Br

Markus

From: tsvwg <tsvwg-bounces@ietf.org<mailto:tsvwg-bounces@ietf.org>> On Behalf Of Martin Duke
Sent: Donnerstag, 10. November 2022 11:44
To: tsvwg <tsvwg@ietf.org<mailto:tsvwg@ietf.org>>
Subject: [tsvwg] Further thoughts on maturity of multipath

I reflected a bit more on the appropriate maturity level of MP-DCCP and MP-QUIC, and the result is perhaps a bit more nuanced than what I said at the mic.

1. After the presentations at IETF 115, I feel somewhat better about the maturity of MP-DCCP. That said, I have no strong opinion as to whether this has cleared the bar for standards track, and would be interested in the overall consensus of the WG.

2. As I stated at the mic, for all MP protocols I am concerned about a Proposed Standard that includes concurrent bulk delivery when we don't really know how to fairly apply congestion control or schedule data streams across multiple paths. Indeed, one reason I encouraged both the MP-DCCP and MP-QUIC work is to provide a good experimental platform for the research community to explore these questions.

3. However, that statement glosses over an important point. There are a variety of use cases that are *not* concurrent delivery. Failover and "hot standby" are sometimes supported by existing standards, but sometimes not (for example, QUIC supports client address changes but not server).

4. Stepping back from the question of how to spell this in documents, what I would like is for the non-concurrent cases to be standards track (assuming they are otherwise mature enough) while implementers are warned away from the concurrent use case unless they "know what they are doing".

4a. One way to do this would be to have a PS document that does not include concurrency while a smaller experimental extension covers concurrency.

4b. Another would be a PS document with a section concurrency that says, in some way, implementers SHOULD NOT do this unless they know what they are doing, perhaps outlining how this can be dangerous if you don't understand your traffic, etc.

5. I am not the responsible AD for QUIC, but I believe a similar framework is appropriate for MP-QUIC.

I'm happy to hear the community's thoughts on this.