Re: [multipathtcp] MPTCP Schedulers

<philip.eardley@bt.com> Mon, 18 February 2019 09:52 UTC

Return-Path: <philip.eardley@bt.com>
X-Original-To: multipathtcp@ietfa.amsl.com
Delivered-To: multipathtcp@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3FFA0130EEF for <multipathtcp@ietfa.amsl.com>; Mon, 18 Feb 2019 01:52:15 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.6
X-Spam-Level:
X-Spam-Status: No, score=-2.6 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=btgroupcloud.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6ZhYVdi-QWoB for <multipathtcp@ietfa.amsl.com>; Mon, 18 Feb 2019 01:52:11 -0800 (PST)
Received: from smtpe1.intersmtp.com (smtpe1.intersmtp.com [62.239.224.235]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id EA50D130EEC for <multipathtcp@ietf.org>; Mon, 18 Feb 2019 01:52:10 -0800 (PST)
Received: from tpw09926dag15g.domain1.systemhost.net (10.9.212.31) by RDW083A011ED67.bt.com (10.187.98.37) with Microsoft SMTP Server (TLS) id 14.3.408.0; Mon, 18 Feb 2019 09:54:50 +0000
Received: from tpw09926dag04h.domain1.systemhost.net (10.9.202.31) by tpw09926dag15g.domain1.systemhost.net (10.9.212.31) with Microsoft SMTP Server (TLS) id 15.0.1395.4; Mon, 18 Feb 2019 09:52:02 +0000
Received: from RDW083A011ED67.bt.com (10.187.98.37) by tpw09926dag04h.domain1.systemhost.net (10.9.202.31) with Microsoft SMTP Server (TLS) id 15.0.1395.4 via Frontend Transport; Mon, 18 Feb 2019 09:52:02 +0000
Received: from GBR01-LO2-obe.outbound.protection.outlook.com (104.47.21.55) by smtpe1.intersmtp.com (62.239.224.235) with Microsoft SMTP Server (TLS) id 14.3.408.0; Mon, 18 Feb 2019 09:54:40 +0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=BTGroupCloud.onmicrosoft.com; s=selector1-bt-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=IsEL4R589PvbFZlyNescGfiK8Hk9JBIO4Qm29jTNwgI=; b=H2UgiEbg0nk5urnJGpQql6IYfnrowij0v4+/8s1SLkTaVCUHok0WjcpFn0BqNwBdc6WREM6Zxez/8c+1NTjqhkup65+UfZxZyKB+oofza1FPcdr29e025/qIEOoImAyFQ43bLwy8rcS3c4VWeot80dsXBVGfKEYw/bXUxZdKiiU=
Received: from LO2P123MB1792.GBRP123.PROD.OUTLOOK.COM (20.176.157.78) by LO2P123MB1823.GBRP123.PROD.OUTLOOK.COM (20.176.154.146) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1622.16; Mon, 18 Feb 2019 09:51:54 +0000
Received: from LO2P123MB1792.GBRP123.PROD.OUTLOOK.COM ([fe80::a8da:6298:83f7:7a34]) by LO2P123MB1792.GBRP123.PROD.OUTLOOK.COM ([fe80::a8da:6298:83f7:7a34%4]) with mapi id 15.20.1622.018; Mon, 18 Feb 2019 09:51:54 +0000
From: philip.eardley@bt.com
To: alexander@froemmgen.de, olivier.bonaventure@uclouvain.be, cpaasch=40apple.com@dmarc.ietf.org, vladimir.olteanu@cs.pub.ro
CC: multipathtcp@ietf.org
Thread-Topic: [multipathtcp] MPTCP Schedulers
Thread-Index: AQHUxTUuV1Kqm9vTUkK2iSG5t8AveKXhKC0AgAKh7oCAACYIAIABUlAw
Date: Mon, 18 Feb 2019 09:51:54 +0000
Message-ID: <LO2P123MB17926F324140C813F236CA48EB630@LO2P123MB1792.GBRP123.PROD.OUTLOOK.COM>
References: <a939bc37-16ed-9d8a-15d7-16dfec630290@cs.pub.ro> <20190215180722.GR1880@MacBook-Pro-19.local> <41d2eef4-67e8-62a5-5d05-b6248d2293e5@uclouvain.be> <1MKd92-1gcaMb0Y7I-00Kxa3@mrelayeu.kundenserver.de>
In-Reply-To: <1MKd92-1gcaMb0Y7I-00Kxa3@mrelayeu.kundenserver.de>
Accept-Language: en-GB, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=philip.eardley@bt.com;
x-originating-ip: [193.113.37.9]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 1a2f66ad-93db-4060-2caf-08d69586b6ba
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600110)(711020)(4605104)(2017052603328)(7153060)(7193020); SRVR:LO2P123MB1823;
x-ms-traffictypediagnostic: LO2P123MB1823:
x-ms-exchange-purlcount: 4
x-antispam-2: 1
x-microsoft-exchange-diagnostics: 1;LO2P123MB1823;23:n5MANiSc5zSKAdOMuQ/JM9KOR+0Od/HLoDIcqgmq1ARsB5wyF/xDy4jsUe6P6oMnuPq117ZTHrTomZ3z/GBugFOndhjkF+6c2SQ8ft77b3Dze4dHeaqzsGFPCB+86pw5Afu68D2poAWhWqmWS8WDP5q/o0qDl/esQmUiYjxo/AwAAuX+Y1eqTv7ovZniSeIHVwRsYOHWobm/jgrwD6OyfdQ/LY5Qa/Mbhvc4cr8P1l5Ewe2JGDn+8GJMtXYs7B4ar116E20dEz/VTc1R3LROixd5ctKNvASmTvFhJ09JOyifMHqB4EUy/Ug1fsEGlspAIblZdwCi4daOpB57jQrTZEoObLPITRc6HI+nOYwRT/QF5/5sAz1y9kGsAkbE4Mw+Bv0Uz2eJAUTCMRaZos0cKZpJaBaGNYFiRLKihuU4+VeqmVvZWt/05RlpHobTjaakIb7iDFeCJyRnPU3FeAPK4BuiqsOtxj4OJ04XM124+5Yeo/ytirkO+FnQITPTRsFmlNKoEvpLlePch4QsGcTx0pFw2wMGq9mvi45Qgbkm89meu3DnIZ5Pr95krcGagWi4gwYUHb8hN3UpZoPEBefzdx19FgQ21aLfbSPafEp70G2WxhFnxUi3gVYPvA56nwCQW+jbjWezhmb5M9wYtG7t4eFyLpCdqdFee8iCJvo+oWbsl9ZErVA6s209ajnEBygAYvDRYE34dz+4dJFtsxjhhCViLX/k4iwHnroFlJm3p1Er6VGBbmT70zNJyzyv/q6AUyFpGLz/beonf7M8kr0MBDO3t93lGgmO4Z8hu7jjienGMvuft9xVjZQFVYDmzpz1Kt+RB+wnuH0qhtEfXbpIp5AJHmQCoZtHDaS299iOhnqjhjfpmEQ1sm9+oyLWiPXxKa+XNNd2CPNk7yyuSsQsoBieBV3MQ/jNxvaWH+PUsWZrx4LKPZw5g/WqqM3eIcYanmKIe4HbmC+rjcUhR1Yz6ykR71OPsti9yEHNs9Km8IdmeMklwxyCynnslWDKHSM3HsHGCS9+/G4adyauskq8Y4VOymUFqs/d9uTmARKX1TQ2CUk+lfEJM1q5WuU4fQw5ZFoT0AGw4Q8faGOL88CgaSDfHUUdr3RyVwyD/u2Lv1moOryQ4DaCQR7IYAwUaCewN9eJev209+8B/uCJL2m88ILCAwc5DCcXKJVQpmlOdDzvL6N30VuybINQtcfS7CyIZ/bDfT36PSEisJrN+b4wlQpOsRqsFpu9cAAH/J+Z+jiRfa8yXhXjZ8K8deGgOYrwKlD4Zf/X+9j9mkdQQvk7cXHQKi0cx4vqTNFT/Pxrc+dQBaR2+1nwDSMNN+XN9rMvSoCXBWghsUr1Lejii0XBdhUfLfApYTw9NSDsEcn3B53xiPz/Sjc232FQcc7y9X/9
x-microsoft-antispam-prvs: <LO2P123MB1823C58CD467E584F12E9C68EB630@LO2P123MB1823.GBRP123.PROD.OUTLOOK.COM>
x-forefront-prvs: 09525C61DB
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(346002)(366004)(39860400002)(396003)(136003)(376002)(189003)(199004)(6306002)(102836004)(53936002)(11346002)(33656002)(14454004)(8676002)(2906002)(8936002)(110136005)(478600001)(25786009)(316002)(54896002)(4326008)(81156014)(6506007)(186003)(53546011)(446003)(236005)(81166006)(9686003)(256004)(7696005)(14444005)(7736002)(53376002)(71200400001)(74316002)(476003)(19625735003)(486006)(55016002)(66574012)(105586002)(97736004)(68736007)(66066001)(76176011)(106356001)(966005)(5660300002)(6116002)(99286004)(790700001)(229853002)(86362001)(3846002)(6436002)(606006)(93886005)(71190400001)(26005)(6246003); DIR:OUT; SFP:1101; SCL:1; SRVR:LO2P123MB1823; H:LO2P123MB1792.GBRP123.PROD.OUTLOOK.COM; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: bt.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: LdO/Mdo0/i+eLw8qXC1Oi9zLEWD9gs6s9QIGQokHntwzRTKMv6PUgVg7eiDYnMPD2Y+SfE8S54CE2CTY0IArEpFnaTItqaf7c49UTwQrCwm8S09JSatLeJ0LwEhXquNHDrw+sBY2ZiBko4QmA5O97qSHRL7+41AiihlkaziI2D+7KH8XkHZKqr9dvZnUbAxAhFwM3Ty0hFItwOcRfcRHT6k7hHMh1HB0fxL6WbUHAr8qHkWd/FLZPYr6fk/zEjxHhgdI9Y3iC0xZ8kFULNJpQvMOubDMA9P6r1+cEwG8bpS1b2c9Cub7qXTkZaYROZF3weWUKNKgrhA0+3V620ZQXIeFWb+DCObXjAWKzTTzpoQ+OzzYvZCqvEZRUdikfoP3onEWokCyjnc7EBQ1gX+Xr0/AExpzjPQzD1ITqBGay4w=
Content-Type: multipart/alternative; boundary="_000_LO2P123MB17926F324140C813F236CA48EB630LO2P123MB1792GBRP_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 1a2f66ad-93db-4060-2caf-08d69586b6ba
X-MS-Exchange-CrossTenant-originalarrivaltime: 18 Feb 2019 09:51:54.2053 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: a7f35688-9c00-4d5e-ba41-29f146377ab0
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-Transport-CrossTenantHeadersStamped: LO2P123MB1823
X-OriginatorOrg: bt.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/multipathtcp/epT-XCCBzsKwxD3J1cNOcHCgQ0I>
Subject: Re: [multipathtcp] MPTCP Schedulers
X-BeenThere: multipathtcp@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Multi-path extensions for TCP <multipathtcp.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/multipathtcp>, <mailto:multipathtcp-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/multipathtcp/>
List-Post: <mailto:multipathtcp@ietf.org>
List-Help: <mailto:multipathtcp-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/multipathtcp>, <mailto:multipathtcp-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 18 Feb 2019 09:52:15 -0000

A couple of things personally I’d be interested in hearing about

-          If there are differences for the schedulers deployed for end host deployments of MPTCP and the proxy deployments

-          Scheduling algorithms that prefer one interface for policy reasons (eg cost) ie the choice of interface is not primarily down to performance differences between the interfaces (but presumably kicks in at some point when it’s decided that the primary is down (how to decide that?) or that there isnt enough bandwidth on the primary interface (how to decide that?)
phil

From: multipathtcp [mailto:multipathtcp-bounces@ietf.org] On Behalf Of Alexander Frömmgen
Sent: 17 February 2019 12:36
To: Olivier Bonaventure <olivier.bonaventure@uclouvain.be>; Christoph Paasch <cpaasch=40apple.com@dmarc.ietf.org>; Vladimir Olteanu <vladimir.olteanu@cs.pub.ro>
Cc: multipathtcp@ietf.org
Subject: Re: [multipathtcp] MPTCP Schedulers

Hello,

some remarks and questions inline.

> Do you think it would be worthwhile to standardize the MPTCP schedulers? I
> think an informational or best practice RFC would be useful.

What level of scheduler standardization do you consider? While an informal description of the scheduler behavior should be feasible, I have the feeling that a detailed specification of the scheduler behavior is not possible, e.g., i) details of todays scheduler behaviors emerged from the dependencies to the Linux Kernel (round trip time is calculation, packet queues), and ii) intuitive descriptions, such as "redundant“, are very imprecise (prefer old or new packets for heterogenous subflow environments?). [0]

> I agree, but this control could be provided by defining an MPTCP option
> that enables a client to request the utilisation of a specific scheduler
> by a remote server.

> 1. agree on a small list of schedulers that should be supported by MPTCP
> implementations. The literature contains a variety of schedulers, we'd
> need to select some of them

1.1 How to select the concrete schedulers? Given that there is a variety of proposed schedulers, as of today, the Linux implementation contains only three of them. Does this imply that there was no need for further schedulers outside of academia so far?
1.2 How should we deal with the concrete parameters of these schedulers and scheduler Evolution?

> If we can define a small list of identifiers for 1, then we can use the
> same technique as the one described in recent work by Hoang Tran Viet

Sounds great. Can you elaborate a bit the concrete usecase? Why is the eBPF flexibility required?

> B. an API that enables an application to interact with the MPTCP stack

It might worth to start with the high level  "goals" and the target audience of such an API.. For application developers, for example, the choice of the concrete scheduler might be inappropriate. The Apple API [2], for example, is on a much higher abstraction level than explicitly selecting the scheduler.

A high level API to specify the preferences [3], e.g., the required throughput, might enable scheduler innovations to optimize for these preferences and speed up the MPTCP adoption by simplifying the application developers life.

Obviously, the high level API might be implemented on top of a lower level API. In this case, the goal for the lower level API should be to enable the implementation of the high level API on top.

Best,

Alexander

[0] http://progmp.net/froemmgen-middleware2017.pdf
[1] http://tuprints.ulb.tu-darmstadt.de/7709/13/Dissertation_Froemmgen.pdf Section 2.2<http://tuprints.ulb.tu-darmstadt.de/7709/13/Dissertation_Froemmgen.pdf%20Section%202.2>
[2] https://developer.apple.com/documentation/foundation/nsurlsessionmultipathservicetype
[3] https://github.com/AlexanderFroemmgen/draft-ietf-mptcp-api-for-preference-awareness/blob/master/output.txt