Re: [tsvwg] MP-DCCP for UDP multipath transport

Markus.Amend@telekom.de Mon, 16 November 2020 16:21 UTC

Return-Path: <Markus.Amend@telekom.de>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 377413A126B for <tsvwg@ietfa.amsl.com>; Mon, 16 Nov 2020 08:21:16 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.096
X-Spam-Level:
X-Spam-Status: No, score=-2.096 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=telekom.de
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id rThitG2TMpeP for <tsvwg@ietfa.amsl.com>; Mon, 16 Nov 2020 08:21:13 -0800 (PST)
Received: from mailout41.telekom.de (mailout41.telekom.de [194.25.225.151]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 22D183A126A for <tsvwg@ietf.org>; Mon, 16 Nov 2020 08:21:12 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telekom.de; i=@telekom.de; q=dns/txt; s=dtag1; t=1605543673; x=1637079673; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=plMTTJfp49HzpR77oAmjA9DFYNm6/I/vHEwPQBUERkQ=; b=3dspZkcBmXum8h6P+We0b8yVta/Vc2SqJBKIC7FteUbkdbEIjUSgtCAd VVeMvK89MgZ/Sb4EGBVdxAX9T/on/2sGjJXbYWZCRRHsFv+S8Or2USzob 8Fs80YifOM/qebcPq0pZOzjwpri4psioJG4n9IfXjSkPf5vzHttCr6WVV NBdYuiWDxR+QfYM/4GnwkkSkBXpXX6p7a3iMS/RZ2lb+Tn5weTRPC50o6 e+HbLOLio4zz/SzynRSiyB85O2Fu/k6aPDBJZNA5nBDO6IgO+rs/Kwn00 qOU4Wiq8srMmJfrTrXfT+HslPpdYr3u52cj9wY+xM+XIbEGjjCx3NOf/t w==;
IronPort-SDR: 3E7Ib/pZgC0TfgKTEPzExoUKXncP4YWO2OCHTa6swgtRHUJhVX+NLKXK6TBw2YdAR5byRzRleD qcC/5oROjRGQ==
Received: from qdefcs.de.t-internal.com ([10.171.254.41]) by MAILOUT41.dmznet.de.t-internal.com with ESMTP/TLS/ECDHE-RSA-AES128-GCM-SHA256; 16 Nov 2020 17:21:02 +0100
IronPort-SDR: VNYvn6ImqWHvTTTwX/OXAey5baOpRcVbSu57pvwyhpzF/sIc85Y6Tg9frrLAOVORFiFq74URc5 nR1sAf7OOHpc5hBQ+az89DMPJGsPa9pwg=
X-IronPort-AV: E=Sophos;i="5.77,483,1596492000"; d="scan'208";a="234717823"
X-MGA-submission: MDHR5pjs7wvpfMj6RopcLCzBoE3QeClQeDOW3rwiFOzdrG0x9YqzaosuSjS9B/KvxPCH4JJixcPR8sy+xKa8RbKYE4CFgbU/Y8MXFMj8S9mbqFYpEnOrFYCF6W7eykWvo3QWZyb75y2PKQWnjRFlGZEDTz4SPLBgAO1z+Q4cNLeN0A==
Received: from he105715.emea1.cds.t-internal.com ([10.169.118.51]) by QDEFCV.de.t-internal.com with ESMTP/TLS/ECDHE-RSA-AES128-SHA256; 16 Nov 2020 17:21:02 +0100
Received: from HE105709.EMEA1.cds.t-internal.com (10.169.118.41) by HE105715.emea1.cds.t-internal.com (10.169.118.51) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 16 Nov 2020 17:21:02 +0100
Received: from HE104160.emea1.cds.t-internal.com (10.171.40.36) by HE105709.EMEA1.cds.t-internal.com (10.169.118.41) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Mon, 16 Nov 2020 17:21:02 +0100
Received: from GER01-LEJ-obe.outbound.protection.outlook.de (51.5.80.19) by O365mail03.telekom.de (172.30.0.232) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 16 Nov 2020 17:20:59 +0100
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Yqv+vdVIcETsJq8TxdoWGWsLczJYU+LfxhbLYlnFWKnR6XLC4LzPOu1ivB9gMtLpKdLKMA30LZbwbprzl20sFV2hevz3qlFvSdD7grCTuWz0mm4iKRVrDkWPHjWG+0ALXqcu0UQXFFDfwfC77G6OQFtssZgMuTYTyechrQWgnTobLqQd9jYvBDk5emcfWUN+NQgwlnT5yFj7QJG083sMHQ1KV9KhFJYfrpQEImCfG7SjNioNopHjQjPuxwdFi6lTaGD6M7C2sbPVgRmD15RslxwjxZAwuDzHEL+5DlP0RBS2exuXkF+A0mckC+uGFozYahBs8oh3RKdOwuzCnDZPmA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=plMTTJfp49HzpR77oAmjA9DFYNm6/I/vHEwPQBUERkQ=; b=Pnv3XmEvhMqADzWshMvxDGpgx6eDCKesJfYt+SIb/aBzoTMahuSAym+XAPaBu2vZXtvoh9qbjBE8iUo8iHSADlymHuQ4Ibl+J9KXFqebirq+wBLnV6lfT1vG+zq7Q96e6hEg5lzCYiJAKxjroKrYd8h6HMKNAyPtf7dqxn59zuZx3g/9TwD6KHTL1Gls/Pmc/O07mHq2tPndqTUyyPEsXjWotxa7FlIqDYm/pNMFyB3QAEzvZKvGBLQYkTdZWH6yvc1sletFiYnkJOxUaPJl2gIFsqmflA9s4bYZGPIYKJmndKbggC5FSwzulWC8nIRWOtk8yGYONv0nCu1Kp6NQuA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=telekom.de; dmarc=pass action=none header.from=telekom.de; dkim=pass header.d=telekom.de; arc=none
Received: from LEJPR01MB0635.DEUPRD01.PROD.OUTLOOK.DE (2a01:4180:c012:b::12) by LEJPR01MB1194.DEUPRD01.PROD.OUTLOOK.DE (2a01:4180:c012:e::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3589.15; Mon, 16 Nov 2020 16:21:00 +0000
Received: from LEJPR01MB0635.DEUPRD01.PROD.OUTLOOK.DE ([fe80::cd90:d2c4:eccf:600a]) by LEJPR01MB0635.DEUPRD01.PROD.OUTLOOK.DE ([fe80::cd90:d2c4:eccf:600a%5]) with mapi id 15.20.3589.016; Mon, 16 Nov 2020 16:21:00 +0000
From: Markus.Amend@telekom.de
To: Michael.Tuexen@lurchi.franken.de
CC: tsvwg@ietf.org
Thread-Topic: [tsvwg] MP-DCCP for UDP multipath transport
Thread-Index: Ada8DeH/jCNzX5niRS6nrhURdCOYhAAGEAMAAABXSlAAArO+AAAADcwA
Date: Mon, 16 Nov 2020 16:21:00 +0000
Message-ID: <LEJPR01MB0635CD33108AA9A2788F86C0FAE30@LEJPR01MB0635.DEUPRD01.PROD.OUTLOOK.DE>
References: <LEJPR01MB063580A9B12A42F0E0559D6EFAE30@LEJPR01MB0635.DEUPRD01.PROD.OUTLOOK.DE> <15689BF2-25AE-471B-9032-F18A57B1F104@lurchi.franken.de> <LEJPR01MB06353DC16E0AD228268A4D4CFAE30@LEJPR01MB0635.DEUPRD01.PROD.OUTLOOK.DE> <4297770B-8932-4126-BB23-82DAF459835E@lurchi.franken.de>
In-Reply-To: <4297770B-8932-4126-BB23-82DAF459835E@lurchi.franken.de>
Accept-Language: de-DE, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: lurchi.franken.de; dkim=none (message not signed) header.d=none;lurchi.franken.de; dmarc=none action=none header.from=telekom.de;
x-originating-ip: [212.201.104.11]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 49b7c834-9bef-428b-2a28-08d88a4b9b67
x-ms-traffictypediagnostic: LEJPR01MB1194:
x-microsoft-antispam-prvs: <LEJPR01MB1194082D5FCCF5DAA8049381FAE30@LEJPR01MB1194.DEUPRD01.PROD.OUTLOOK.DE>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 4iRI6pqypD+39XXfP0vBSFiZH7sG6Zr3Pb/5qr/PyNu6sj+R0Nia8HH3x8sQ93Zv32IAA6aejhcVVHyZ45FuXhJtwFyxC7Lv03S+MI1rp0oLR6g/dAVfx/ihnjMvm+fnqQxatWz815kiRZSvbcHCGam2vZAnYL/XgRgJbeV4Hd6FD1IMGYfLNpwr/PcOCy+Bt6mfMqqJpAern1Dl48Qx/Qd8ak/WT8D4r15yRRR9UtRUH9H/aHFDJZxVm5h85fOmYMsrRzD1dIvUyob9fLi6o7D061hMb8tNEZA9ZB04PJsqXJsRaL2QBjl1KoPG3qARVePOcf5wBkxXL8z4/qmmiGbU0xUaWvHUuaqB4UetpH0=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:LEJPR01MB0635.DEUPRD01.PROD.OUTLOOK.DE; PTR:; CAT:NONE; SFS:(366004)(396003)(39860400002)(136003)(376002)(346002)(71200400001)(33656002)(186003)(66476007)(66556008)(66446008)(64756008)(66946007)(8936002)(76116006)(7696005)(55016002)(8676002)(966005)(9686003)(83380400001)(66574015)(5660300002)(316002)(2906002)(6916009)(4326008)(86362001)(53546011)(478600001)(26005); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata: fkebYU4NvE6Xg3pvfnfrOF+tiYe4iKvuaNpjUn4LURzc+cW+gj7NXvfZZTF7PtBiY+oLgKVDUsy3/1Oqf+lHvEICrVwckYW9FzDVobTTvHuZnPEXJmQZoFMhj/s9GnwbOM4naCS7ziGMV+w0+xQf6iwdXyUs6JyFECZr76F1Ve7rbHCeRqGb07PW4Wwmaz4mCSrugpBhNYtXkQ+LHSllW/mt2sqDmHQnlxp2G5SnDgthO3/fKSCgynLreu7yTEwEg99thacSj/WDEFBy2vVba8Ugxd3Htednosv+YhJ2xUKpWsoXnGFF1BzhhHGZ7/E98OdzmtE+1KeIsAY9Ig3kcCqfP5bmBNpqzPK+2NjBjEkj+YAmLHReffjAdE8E+a5VE79rofRP9EvtV0wU93S/SjUtsvGiSgZBsP6Afh732a4nRovxLZGFiODn4ZhEqzb95sQc2tw2EyArqQkkyYl5vEZ9vkYCMIbOFrr5VHYf/F0rgLn6ANBNsc9BQkGNBhPLB542G3gAxVZMAIN4LrX5HyRM5DEBWTtij96MLaFt+PARhfxutv6ZZpIEn+gAhTXJjet8g0jsQ+K3/lQZlPMcIAoJQiskAByjiv5LHEvJ4F6O1tzJaZHaUvurBWOQ/fBypqNsOu4zXtCxx8kDIvwZrQ==
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: LEJPR01MB0635.DEUPRD01.PROD.OUTLOOK.DE
X-MS-Exchange-CrossTenant-Network-Message-Id: 49b7c834-9bef-428b-2a28-08d88a4b9b67
X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Nov 2020 16:21:00.6515 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bde4dffc-4b60-4cf6-8b04-a5eeb25f5c4f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: Dv7gPrykbaMFw03PdiSiDuU/Reg3byui0XhqWwXZVUAVgQJDKmQhQM/UyxgWB1EGyJenL41g/WUQpV/uLiHkUg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: LEJPR01MB1194
X-TM-SNTS-SMTP: 7A31ACEAFA6592A46911A55D546229A577782F28C8CCAD133BBDBA3CC22A64DC2000:8
X-OriginatorOrg: telekom.de
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/uAqcDHZzUMf6nV9VFzmNA2fU8PA>
Subject: Re: [tsvwg] MP-DCCP for UDP multipath transport
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 16 Nov 2020 16:21:16 -0000

> -----Original Message-----
> From: Michael Tuexen <Michael.Tuexen@lurchi.franken.de>
> Sent: Montag, 16. November 2020 17:06
> To: Amend, Markus <Markus.Amend@telekom.de>
> Cc: tsvwg@ietf.org
> Subject: Re: [tsvwg] MP-DCCP for UDP multipath transport
> 
> > On 16. Nov 2020, at 16:43, Markus.Amend@telekom.de wrote:
> >
> > Hi Michael,
> >
> > inline
> >
> >> -----Original Message-----
> >> From: Michael Tuexen <Michael.Tuexen@lurchi.franken.de>
> >> Sent: Montag, 16. November 2020 15:38
> >> To: Amend, Markus <Markus.Amend@telekom.de>
> >> Subject: Re: [tsvwg] MP-DCCP for UDP multipath transport
> >>
> >>> On 16. Nov 2020, at 13:52, Markus.Amend@telekom.de wrote:
> >>>
> >>> Dear all,
> >>>
> >>> as the TSVWG chairs suggested in the IETF 109 session, I continue the
> discussion
> >> on the mailinglist.
> >> Hi Markus,
> >>
> >> I have two questions:
> >>
> >> 1. You stated that you are using CCID2. This means that you are adding to
> >> handling of UDP
> >>   packets a congestion control. How does this interact with a congestion
> control
> >> provided by
> >>   the application?
> >
> > Yes, and moreover we also implemented BBRv1 into the DCCP CCID framework.
> The interaction between CCs is given and first results were published a while ago
> in https://arxiv.org/pdf/1907.04567.pdf based on NADA as application CC. More
> recent results are part of our presentation at ICCRG on Friday, discussing a
> broader mix of CCs. Probably there is a trend not to use packet loss based CC for
> the tunnel.
> >
> > Two points here:
> > 1. Nested CC is a broader topic beyond MP-DCCP and also valid e.g. for
> MASQUE. Maybe something which should be independently investigated in
> ICCRG?
> I agree that this is not specific to the scenario you describe, but a broader issue.
> > 2. Solving efficiently out-of-order aggregated multipath packet delivery is
> equally important and often overlooked in favor of CC in CC.
> >
> >>
> >> 2. Considering that you are fine with a tunneling protocol that provides a
> >> congestion control,
> >>   what are the benefits of using DCCP instead of using SCTP with UDP
> >> encapsulation? You can
> >>   use PR-SCTP with the "don't retransmit" policy and could also let the
> reordering
> >> done by
> >>   SCTP. Your failover scenario should be supported by all SCTP
> implementations.
> >> The
> >>   load-sharing would require some standardisation effort.
> >>
> >
> > Excellent this question :-) I fully agree with you, that SCTP can provide similar
> mechanisms. Some years ago we developed, in parallel to our MP-DCCP
> prototype, a SCTP based prototype leveraging PR-, PF- and CMT-SCTP. The
> results looked very promising and we proposed this to 3GPP ATSSS
> (ftp://3gpp.org/Email_Discussions/SA2/Archive/2018-10/Draft%2023793-
> 070_rm.doc, 6.1.7.4), but it was rejected.
> >
> > After that we gave up the SCTP development in favor of DCCP for several
> reasons:
> > -  bad/no Linux support for CMT-SCTP at this time
> Compared to MP-DCCP support, I don't think there is much of a difference. I
> guess it would be implemented
> in Linux, if the corresponding specification could be finished (Linux recently got
> support for UDP encapsulation.). However, that is blocked up to now in TSVWG.
> Since I'm not following 3GPP:
> Is availability on Linux a requirement for 3GPP?

No, but it was a requirement for our DT internal prototype environment. With a Linux reference implementation of (MP-)DCCP it was much simpler for us to move forward and implement it for example in an Android device.
Please don't forget, that was a decision we took in 2017.

However, -just being proactively here - we currently should not end up with the question:  Should we move forward exclusively with MP-DCCP or a SCTP based approach. Both has from my view value and MP-DCCP is first of all only a multipath extension for DCCP. Using encapsulation on top makes it capable of transporting any traffic. It's the same as with SCTP, QUIC and TCP.

> > -  No real unreliable delivery is given. Even PR-SCTP requires a reliable
> "FORWARD-TSN" to become unreliable.
> How does that impact the user experience? User messages can be delivered as
> soon as possible to the application.

Please correct me if I'm wrong, but as long as the FORWARD TSN has not be received, head of line blocking occurs, right?

> > -  UDP encapsulation overhead
> True. It is an 8 byte overhead.
> 
> Best regards
> Michael
> >
> >> Best regards
> >> Michael
> >>
> >>>
> >>> For all who were not able to attend, the presented slides are available
> >> u==[=[nderhttps://datatracker.ietf.org/meeting/109/materials/slides-109-
> tsvwg-
> >> sessa-61-dccp-extensions-for-multipath-operation-00, with a main focus on
> the
> >> prototype implementation. This prototype leverages MP-DCCP between a
> >> mobile handset and a public aggregation point, for giving multipath/multi-
> access
> >> benefit to at least UDP traffic - complementing MPTCP - when communicating
> >> with the Internet. Due to the MP-DCCP encapsulation framework, support is
> not
> >> restricted to UDP and it’s even possible to provide the multipath service to IP
> or
> >> Ethernet traffic. Packet based scheduling, as well as flow based scheduling is in
> >> scope of the prototype/drafts and explained together with results as part of
> the
> >> above mentioned presentation.
> >>>
> >>> Seamless handover for reliability and path/access aggregation for high
> speeds
> >> are supported by design, fitting for example excellently into the 3GPP ATSSS
> >> scope, leveraging:
> >>> https://tools.ietf.org/html/draft-amend-tsvwg-multipath-dccp-03
> >>> https://tools.ietf.org/html/draft-amend-tsvwg-multipath-framework-
> mpdccp-
> >> 01
> >>> https://tools.ietf.org/html/draft-amend-tsvwg-dccp-udp-header-
> conversion-
> >> 01
> >>>
> >>>
> >>> and general scheduling and re-ordering concepts from
> >>> https://tools.ietf.org/html/draft-amend-iccrg-multipath-reordering-01
> >>> https://tools.ietf.org/html/draft-bonaventure-iccrg-schedulers-01
> >>>
> >>> Especially for 3GPP ATSSS purposes, this very dedicated and simple MP-DCCP
> >> framework provides an alternative over the currently discussed MP-QUIC
> >> (+DATAGRAM + MASQUE), which is from an IETF perspective much broader in
> >> scope and not dedicated to ATSSS purposes.
> >>>
> >>> However MP-DCCP is not limited to ATSSS and can be applied end-to-end
> with
> >> or without encapsulation.
> >>>
> >>> So I encourage you to read through the drafts, give feedback and discuss the
> >> potential roadmap towards WG adoption.
> >>>
> >>> Br
> >>>
> >>> Markus
> >