Re: [Fwd: New Liaison Statement, "LS on need for Multi-Path QUIC for ATSSS"]

Olivier Bonaventure <Olivier.Bonaventure@uclouvain.be> Fri, 03 April 2020 09:09 UTC

Return-Path: <olivier.bonaventure@uclouvain.be>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id AB5483A154E for <quic@ietfa.amsl.com>; Fri, 3 Apr 2020 02:09:12 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, MSGID_FROM_MTA_HEADER=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=uclouvain.be
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id LJinZ_2hhMNO for <quic@ietfa.amsl.com>; Fri, 3 Apr 2020 02:09:10 -0700 (PDT)
Received: from EUR04-DB3-obe.outbound.protection.outlook.com (mail-eopbgr60110.outbound.protection.outlook.com [40.107.6.110]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7FEEF3A154A for <quic@ietf.org>; Fri, 3 Apr 2020 02:09:09 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=HBgvad6N8UStBMtZbA6v36PxLipazsaprsHXf8532HQkv2TxDZHMjGNrnKr3Pc52HY7RrQH95qbmR5TfSZzQSG+WM2PwOx7+fom+yK3AU1ZMQVyhiQGAc9/qFXmAc7ST1bFbgwc8Qod8joe76Gx1GuRK76AMuKW7Kr7mVHbq8nXKVSlwqFyPlnRvBkKLVwupVXCd0xdH6H/8mHvLege4Y7p/WcbjXvyXHeoNM/1vncfxBu+WhTQ727GcXmVfCMYMfzPLNklRYQ2ooiyEVji+3ottgui+B4v40OsWNfMMMknW3KHq1tOtayPFQqpYqs4K4SUTGC/d9txgfykWib6Dbw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qpv1dYW1tUcmMfAVQCUHC0yATUIpTi6zjR5a8HI/wWo=; b=cnnk6mx1EtgCffpjvoNTNgBjsfdrQHdfRnnfPQCskLJ9B5fJBbRABA9rg6E3yWb/KXEH4KZAYZ6N4FnYc8YrKkQdoxBnkU0+hkpPk15KnO6aJvino9UvnnuBH9CngcXRmOsw7tMtYzTRos1wVDHEOiMhuOCC4oaGzLhRm9XED6jdSWDnPmnD9fq6wR78otG4O6rDP8dVTs3vj0wKQWQHYrPP4VtvEpyNGmO3RbJBFvP/jcVwf3RH7+ENHOQajNK7wz8TuyM6AD8htvs6fmlGVjYW6CnPGf04/SFentEWqaWmcc7mMYvpsK1ZHO5ew7f/Ju6s+/47XvLnGUp6/6r4fw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uclouvain.be; dmarc=pass action=none header.from=uclouvain.be; dkim=pass header.d=uclouvain.be; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uclouvain.be; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qpv1dYW1tUcmMfAVQCUHC0yATUIpTi6zjR5a8HI/wWo=; b=qojuR4baWuLtBYDr+tBGCbEpkk+fRCHfOspm+pMZAe8HzY+hDqdP1Wn6hysYfJSfT75FQQUxunWmI/nyWFoLqSh+EKZvgK09qyaFswm9mDZQL9MBRzVejyNQBbwBhbBU+elpRIekF/onS9M+f8CWVpy355SLGJ+Q17mZv/uRpgE=
Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=olivier.bonaventure@uclouvain.be;
Received: from AM5PR03MB2882.eurprd03.prod.outlook.com (2603:10a6:206:18::24) by AM5PR03MB2916.eurprd03.prod.outlook.com (2603:10a6:206:1a::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2878.16; Fri, 3 Apr 2020 09:09:08 +0000
Received: from AM5PR03MB2882.eurprd03.prod.outlook.com ([fe80::7479:6d4:80f1:9ef1]) by AM5PR03MB2882.eurprd03.prod.outlook.com ([fe80::7479:6d4:80f1:9ef1%3]) with mapi id 15.20.2856.019; Fri, 3 Apr 2020 09:09:08 +0000
Reply-To: Olivier.Bonaventure@uclouvain.be
Subject: Re: [Fwd: New Liaison Statement, "LS on need for Multi-Path QUIC for ATSSS"]
To: Gorry Fairhurst <gorry@erg.abdn.ac.uk>, Lars Eggert <lars@eggert.org>, Ted Hardie <ted.ietf@gmail.com>
Cc: IETF QUIC WG <quic@ietf.org>, Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com>, Martin Thomson <mt@lowentropy.net>
References: <CA+9kkMBcsuJGy5A7cVuooCycfskGLDPnng6O7iN_5t9KWm21DQ@mail.gmail.com> <09D76C30-BB5D-43E5-8F93-661A6C7C105D@eggert.org> <85eefd12-1e10-df7f-d66e-3d0e317b1f00@uclouvain.be> <76ddd8dd-e70d-94e1-3982-d2cb1e176618@erg.abdn.ac.uk>
From: Olivier Bonaventure <Olivier.Bonaventure@uclouvain.be>
Message-ID: <7e52ea36-24fb-e8d3-dad7-232295d3ceb6@uclouvain.be>
Date: Fri, 03 Apr 2020 11:09:06 +0200
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0) Gecko/20100101 Thunderbird/68.6.0
In-Reply-To: <76ddd8dd-e70d-94e1-3982-d2cb1e176618@erg.abdn.ac.uk>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Language: fr-classic
Content-Transfer-Encoding: 8bit
X-ClientProxiedBy: AM0PR06CA0067.eurprd06.prod.outlook.com (2603:10a6:208:aa::44) To AM5PR03MB2882.eurprd03.prod.outlook.com (2603:10a6:206:18::24)
MIME-Version: 1.0
X-MS-Exchange-MessageSentRepresentingType: 1
Received: from mbpobo.local (2a02:2788:484:b4f:9c48:ebf0:8f7:5dba) by AM0PR06CA0067.eurprd06.prod.outlook.com (2603:10a6:208:aa::44) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2878.16 via Frontend Transport; Fri, 3 Apr 2020 09:09:06 +0000
X-Originating-IP: [2a02:2788:484:b4f:9c48:ebf0:8f7:5dba]
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-Correlation-Id: 6d9c660e-6158-4caf-edac-08d7d7aea9c4
X-MS-TrafficTypeDiagnostic: AM5PR03MB2916:
X-Microsoft-Antispam-PRVS: <AM5PR03MB2916E0ACE6B0A83AC776285086C70@AM5PR03MB2916.eurprd03.prod.outlook.com>
X-MS-Oob-TLC-OOBClassifiers: OLM:10000;
X-Forefront-PRVS: 0362BF9FDB
X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM5PR03MB2882.eurprd03.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(10019020)(4636009)(366004)(376002)(346002)(396003)(39860400002)(136003)(52116002)(66476007)(6486002)(66946007)(186003)(478600001)(31696002)(16526019)(6512007)(81156014)(8676002)(81166006)(5660300002)(54906003)(8936002)(86362001)(2906002)(2616005)(6506007)(66556008)(966005)(316002)(3450700001)(4326008)(110136005)(31686004)(786003)(36756003); DIR:OUT; SFP:1102;
Received-SPF: None (protection.outlook.com: uclouvain.be does not designate permitted sender hosts)
X-MS-Exchange-SenderADCheck: 1
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: 5oWVZkydwhkwwTGNlpei435LZegArHwo5P4OH3ja6Womd7AHTaAPHgAtlaF03f0XTtX7VMQJZRl8wtoWPcC16mi0fVQ/8s1e5IiBlfAXebWdyCRN6/2I6AzCWZgVpn/E1ZiGKmE/3PZ8HayiGCh3wK+bYyCcjCZrOoVxymIoo/Ld4deQ/fOta2CGbr1tzbfvfCQ3q7UMlk0nT/e+R2jahs37x8UzJ+Xms+Jx5Wkh82Omu+oSWrazbUZnzuqM1DONTNCIW7+EAD3bbjvzXJ2UeJAGCubWt3OZb54OBBOg2sQkdVYAQg+4j9PeBRSuN4/1rZP29IosuUhM3IzAwZ3KWByZy/NP8cIq24l9RbjmyusPVfXdFcImpcDEaUE1YK+qR3I9gl7ebtTNo3HnulgexwRNeQYU2jGRbPQ3x7XnDZwSgDAcIxW5vwk5suqebXVN0TvbriilNFXkdrO9TYH+OwFSdO2g8fpQqecVV1+V7lW74V+yeiQ7OcnAgjEmzVTsemE4G4L2Fxyd6LmcXoUsdg==
X-MS-Exchange-AntiSpam-MessageData: okz2b+XNAOacWUmkHWXE6fkZeJHzt7KQF7UV7Q6EoLWmLwMxemit0ZifYumlJuN+YJsO/Fa0rQa09VESc40hdDOOP552qO/2zAbWqNsh2guazChtKgXluS3N8gKwayBufP2y07CWq9bwgbfnEmNk+oJg0nXfqDpC7y6r40EX9IRVO55GiqcWMv1bEglxMWSCeX6wtaqwKu8OGlycle23ww==
X-OriginatorOrg: uclouvain.be
X-MS-Exchange-CrossTenant-Network-Message-Id: 6d9c660e-6158-4caf-edac-08d7d7aea9c4
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 03 Apr 2020 09:09:07.9535 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 7ab090d4-fa2e-4ecf-bc7c-4127b4d582ec
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: eZbeEWMA3qwpoWLmAFSWjm1AGNUKYnojfwcP768bGpuZsxxAWza3YzZU7KmD8XiGrgDP/m6oGALCoQ0KPnFaxEU0tfTQxXFVkWG43Mcb+arg7s6qIuoJJuuf+lcKMOx6
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM5PR03MB2916
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/SjYZpJlcrft_Et2kxbfUO3CWxhM>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 03 Apr 2020 09:09:13 -0000

Gorry,
>>>
>>> what we have done with MPTCP is build a system that is reasonably 
>>> good at pooling the capacity of multiple paths for one connection, 
>>> *if* these paths have reasonably similar characteristics, esp. RTT.
>> >
>>> With paths with dissimilar RTTs, we can still pool the capacity, but 
>>> only make it available for use to the application at pretty much the 
>>> maximum of the individual RTTs. That’s still somewhat useful if you 
>>> care about bulk throughput. It’s basically useless if you care about 
>>> small-transfer latencies, which the web has been gravitating to for 
>>> years. (Remember that the MPTCP design is ten years old - from a 
>>> different world. Bandwidths have gone up a lot, making capacity 
>>> pooling less urgent, but late cues have not decreased much.)
>>
>> This corresponds to the hybrid access network case that pools bandwidth.
>>
>>> To make multi path useful to today’s mostly latency-sensitive 
>>> applications, we need a path scheduler that can pool (some of) the 
>>> capacity of multiple dissimilar paths at some effective RTT that is 
>>> much lower than the maximum of the individual ones. I am not aware of 
>>> any proposed scheduler - for MPTCP or otherwise - that achieves that.
>>
>> AFAIK, this is exactly what Apple is doing with MPTCP. They call this 
>> the "interactive mode" and the stack dynamically selects the path 
>> (wifi or cellular) having the best performance (rtt, losses) for 
>> interactive applications. See 
>> https://developer.apple.com/videos/play/wwdc2017/707/
>>
>>> Even if we change the argument from pooling latency to increasing 
>>> resilience, I still doubt that increased resilience at the cost of 
>>> much-increased late zu is a worthwhile trade off for many apps.
>>
>> AFAIK, Apple calls that the "handover mode", it is probably less 
>> useful that the interactive one. Maybe Apple engineers who are on this 
>> list can comment and provide more details.
>>
>> I don't think that Apple uses MPTCP to pool bandwidth. They use MPTCP 
>> to improve user experience and mainly latency.
>>
>>
>> Olivier
> 
> When you says "select" do you mean "change to send data using the new 
> path"?

This is a packet scheduler decision. When new data needs to be sent and 
there are two subflows, the scheduler selects the most suitable one. I 
think that Apple uses its WiFi assist monitor to inform the packet 
scheduler of the most suitable path on the client. On paper that 
describes a similar approach is

https://inl.info.ucl.ac.be/publications/tuning-multipath-tcp-interactive-applications-smartphones.html

In MPTCP, it is difficult for the client and the server to easily 
exchange information about the quality of the paths due to middlebox 
interference and a set of heuristics are used. For example, the server 
replies on the subflow chosen by the smartphone to send the request.

With MPQUIC, we can use ping frames to measure the quality of paths and 
react accordingly. In MPTCP, this would require a complex machinery.


> I f so, I think this is close in operation to a "path failover", even if 
> it uses a trigger metric that isn't just a loss of connectivity, but the 
> result of some other path metric - e.g. significantly lower RTT, 
> availanility of PvD information, ... .

Apple's deployment shows that maintaining the two paths is useful 
because there are situations where latency sensite applications can use 
both paths, e.g. during the handover when the connectivity is weak but 
not yet broken.

> In my mind, this is quite 
> different to a proposal for somehow "sharing" traffic/capacity between 
> several paths, which means understanding capacity and the impacts of 
> variability in path characteristics, the impact of traffic on pooled 
> bandwidth, etc.

The same techniques apply in these different cases.
> 
> It still does pose some issues in estimating the capacity on the "new" 
> path, but ... The mechanisms to do this seem to exist within the design 
> expected of QUIC.

QUIC is clearly both cleaner and more powerful than MPTCP for this. You 
can find a detailed discussion on this in Quentin De Coninck's PhD 
thesis which is available from https://www.multipath-quic.org


Olivier