Re: Preparing for discussion on what to do about the multipath extension milestone

Olivier Bonaventure <Olivier.Bonaventure@uclouvain.be> Sun, 04 October 2020 20:54 UTC

Return-Path: <olivier.bonaventure@uclouvain.be>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D05883A09F8 for <quic@ietfa.amsl.com>; Sun, 4 Oct 2020 13:54:30 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.313
X-Spam-Level:
X-Spam-Status: No, score=-2.313 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, MSGID_FROM_MTA_HEADER=0.001, NICE_REPLY_A=-0.213, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=uclouvain.be
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 65cLqt3wysFA for <quic@ietfa.amsl.com>; Sun, 4 Oct 2020 13:54:29 -0700 (PDT)
Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-eopbgr80111.outbound.protection.outlook.com [40.107.8.111]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B584E3A09F5 for <quic@ietf.org>; Sun, 4 Oct 2020 13:54:28 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=fvaG25KAgWHVIQMTa6a32DX6Q2aAYpiPYSWo1HV/MqnmnXsOGauSKE+VutdANJ9UB0fZaUYLxZtoiKu57uv7DRxaVJYQxQby/1/YffAJxDT58ZOjq9TmxNp6V6DkEqtOOpE82JgEH5cVgWZzb8duVwuguH71eloBK6/Ci1XIBFX1eNHhLCbmnExuKqx4ilFhMeO/be7Bl3K1lMJlIyF6kBM21I98x1WSsSBB5cZlm/EjyqWD2CPl05ljP04O9mLcbUqNi3WX9veIKTfUc4Xmkgd/QCBQ1HTf9tUnsRO4f354mkehvUSZECovXHwtIp2vUyZE2sdilpdeEJ2KYn8pKA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=vqv8HATVHDCZNZOXPPdjfNfrZAcAZ3vFSPWNFWbIxmo=; b=IE2qst18GSHhM6DwLAd8Sa7z1NI3PuiCPd1a2pGVTeh2UtqHEwzBR2tvVISpx+Z9lOzhojq9Y+hLrhANN9BqV9mxjU+aDYUFlM7yETlHaEpaQeySkkyH+MO+RZtdB0yS101oXOUgeEWD04a3XjsaTHJzQhJuzBbLprM+1xok/QlPGPsSwy/wiJikcagaxtVUmABqAsrmdWWciHgeYMnI79vBkO13QJEQRBE1eLE7ieJHXpbzBOCdBsl0SZY2gBDS8iCytQeSgBLr3DuFn7X4ylzFcHPtm6l0MBM6ZzbU6+PrCuXN9NZpAebIv4euo2nwr2HjMz5p3UvMKxww1Tvotg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uclouvain.be; dmarc=pass action=none header.from=uclouvain.be; dkim=pass header.d=uclouvain.be; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uclouvain.be; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=vqv8HATVHDCZNZOXPPdjfNfrZAcAZ3vFSPWNFWbIxmo=; b=vrqqTMH1aZ45F7FOyDqmENbEZ2/BJpQGMYsUpfULuNveq585G9Zf1sWLxUt08Xnhyz7kT3F4ueXO2XEtPifA9+pvIpvfzHmHKkeOxdvPRf1O52aMdPeS5zm2Ya7m4Rys0hI+qjVyjnZXPgB1LbZO4IQGchM3oQ/WxhUasRgDvFM=
Authentication-Results: gmail.com; dkim=none (message not signed) header.d=none;gmail.com; dmarc=none action=none header.from=uclouvain.be;
Received: from AM7PR03MB6642.eurprd03.prod.outlook.com (2603:10a6:20b:1bf::6) by AM7PR03MB6642.eurprd03.prod.outlook.com (2603:10a6:20b:1bf::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3433.37; Sun, 4 Oct 2020 20:54:26 +0000
Received: from AM7PR03MB6642.eurprd03.prod.outlook.com ([fe80::1cd6:a808:56a3:e868]) by AM7PR03MB6642.eurprd03.prod.outlook.com ([fe80::1cd6:a808:56a3:e868%6]) with mapi id 15.20.3433.043; Sun, 4 Oct 2020 20:54:25 +0000
Subject: Re: Preparing for discussion on what to do about the multipath extension milestone
To: Lucas Pardue <lucaspardue.24.7@gmail.com>
Cc: Matt Joras <matt.joras@gmail.com>, QUIC WG <quic@ietf.org>, Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com>
References: <F0A5E38D-4117-4729-BFF8-72D97CAA9908@eggert.org> <CAKKJt-e=+XLZhNWqaG9YSLTRqyQRvDc-dagUSkFwHOByFwZ++Q@mail.gmail.com> <78651438-2fce-ba67-4f44-4228bbc79a75@uclouvain.be> <CADdTf+hOACZ1x=d8SV-aX0f3vc+_fyqTziRqi5gi+nJgppaz8A@mail.gmail.com> <1ada66fc-61b1-c541-8a25-afbc7c978940@uclouvain.be> <CALGR9oZzi=Ucf54xZxcy4Qfc3Q6JWuxjv5jxwR41JaEUHkcXZw@mail.gmail.com> <1e9119a6-ef0a-ebe1-8925-e0ff0d6ce9aa@uclouvain.be> <CALGR9oaSXtzi8eTdm03CQ4jt2-O1iENzD1D-8aCwn-osrjbyPQ@mail.gmail.com> <142e8430-1afa-a0f9-7089-26b1be9af79f@uclouvain.be> <CALGR9oahmGZo5HhnAX4Ke=4q=7ZT6t4TfusbF8xOdkfU9yCXGw@mail.gmail.com> <b1c5919e-43a3-449d-3b8f-a73b0558aff9@uclouvain.be> <CALGR9oao-riThu9QB2+c0kG6ODKKyzQccJnGDWAxFFFVn6816g@mail.gmail.com> <b43ad577-1ad2-e80b-06b0-6a6af9a92ed9@uclouvain.be> <CALGR9oZsqQJ5Kf15O9wL=MRma4bvbNfY=6K6xr3=MuCiJLveJw@mail.gmail.com>
From: Olivier Bonaventure <Olivier.Bonaventure@uclouvain.be>
Message-ID: <5cb34cf9-39c9-a7de-e472-12ebc4e774ff@uclouvain.be>
Date: Sun, 04 Oct 2020 22:54:24 +0200
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0
In-Reply-To: <CALGR9oZsqQJ5Kf15O9wL=MRma4bvbNfY=6K6xr3=MuCiJLveJw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Language: en-US
Content-Transfer-Encoding: 7bit
X-Originating-IP: [2a02:2788:484:585:f154:f32b:1845:e0ec]
X-ClientProxiedBy: AM4PR0101CA0062.eurprd01.prod.exchangelabs.com (2603:10a6:200:41::30) To AM7PR03MB6642.eurprd03.prod.outlook.com (2603:10a6:20b:1bf::6)
MIME-Version: 1.0
X-MS-Exchange-MessageSentRepresentingType: 1
Received: from [IPv6:2a02:2788:484:585:f154:f32b:1845:e0ec] (2a02:2788:484:585:f154:f32b:1845:e0ec) by AM4PR0101CA0062.eurprd01.prod.exchangelabs.com (2603:10a6:200:41::30) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3433.36 via Frontend Transport; Sun, 4 Oct 2020 20:54:25 +0000
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-Correlation-Id: 2438152d-6447-488e-f845-08d868a7adcd
X-MS-TrafficTypeDiagnostic: AM7PR03MB6642:
X-Microsoft-Antispam-PRVS: <AM7PR03MB6642F1CA6A2200A3006D77AA860F0@AM7PR03MB6642.eurprd03.prod.outlook.com>
X-MS-Oob-TLC-OOBClassifiers: OLM:10000;
X-MS-Exchange-SenderADCheck: 1
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: C0L8R9o89VRS6rd+oiuum+wy0ZphATtp+TlWm7YVBMqQyzY8vPMg/xYwUZzs1YHRax+EmaKuzUxCbaL0i80keBUPqE77afX4/hSzBUiwg+CSBi7QOUCVNtWp+e4UyTNuHTc+8Ocdg6vYN2slTEilSdJMX8IKv6fDToVJWfdLD2VWHgQ/uBY9UP1vI0pGpRwxpUCNYNl0Y2Zc7r/PJk9QcKhWepnfZByozWAOG8ket6xVcgWKtoh5/CaCsuNqmIJIxpuyd7rNdsGp2+ZHKVvuNBAEpHId0b6nPGJXCSuW41UpjtJHDp40fDW3CJkpbqjeFlRKl+PSKJZ9PGOzZJLNgJiilxSmPMEZU7RWDE/u+BXFBHzKP8KpyqaHcGGd9n7gxtO8zmiKnwJg9LHeW68sWTk1QZ/7vxHsF1Xk7YAYoXjGlu9EylCL/anttCFshz+rUUn80RceDaUhzZTMMzeUAQ==
X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM7PR03MB6642.eurprd03.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(136003)(396003)(376002)(366004)(39860400002)(346002)(316002)(786003)(2906002)(8936002)(66556008)(5660300002)(4326008)(86362001)(966005)(36756003)(6486002)(31696002)(8676002)(54906003)(186003)(16526019)(66946007)(83080400001)(2616005)(478600001)(52116002)(31686004)(6916009)(66476007)(83380400001)(66574015)(43740500002); DIR:OUT; SFP:1102;
X-MS-Exchange-AntiSpam-MessageData: O55EN9niLs6NBO5y/XootmXea2jPyvtQRq7d1WRt5D9xX/OoPmqV7mWTFBPxDMM+mVe3fnas28oxE5EKuBYD9UYhl3WfzcrPlh6syOvnr7QSepIzOWqnPB5RAdcFKQt/c3XBxB/qBNCuJBv7FLjtAWGFP+UpYO70tXC2ATMbnSflLbRxI7kOxIA+m8XINo/i0VIE5h+kZTkKkBLryk/r5r7ZYEY4bdUdUm4p7KMFibDhcoLiI1So9itVawIXQbkWt0Ytiq3DxffwQEllBeo8LU4vxj/yi9GYLNYRGEtYPBKlr/R8aD5iCt6ZF4R2qppZPPXXURbrIhK7Rs6um8eGruJZorJKLiE0pvi9MRiElBt5E0ycY+b88K6JeLCPNMEQVIman90aDzOEd0zAX629PIJPu6mbjDbubfk63OZTkJGCk9fpcYDiqM6oFKYgm1MULLYrDBInxtEH47gcE5B93QDGDAdDJNokyypvIsE8EVOcUVZrCGL1ekRz5ggaj29i/1R1DC6lKwraA/N53bs6LSRu3KRKeOHXLiyavnfUnEEoxgAHXIhdq3PtwNCGzXtPWEGd3ejgWQf7lO5gIUe9gW3ILQR/3SJNj3+bWb0HXC/bwgVl6jCtzgxaoi3alm3EYym9S8omPtGgjwfyuTb6g6tejndpJMH8jtu8LuUODOE3GpfYz+mwLFsII3bEacus8aZIBYHHiwmqu+e/hRrVzQ==
X-OriginatorOrg: uclouvain.be
X-MS-Exchange-CrossTenant-Network-Message-Id: 2438152d-6447-488e-f845-08d868a7adcd
X-MS-Exchange-CrossTenant-AuthSource: AM7PR03MB6642.eurprd03.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 04 Oct 2020 20:54:25.8714 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 7ab090d4-fa2e-4ecf-bc7c-4127b4d582ec
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: DdTFz9XhPO88lG9kr9qba42ThkEQf0rcJJrGtakl+/YNJGoKvc3twQQ7zs8f3slhQ9sN3QGkzLY5QinJx3P/I0vdE5qD7uDjYd3ZPYTJt57lovXbjvGmiTE7Lhy/2zka
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM7PR03MB6642
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/dpZSzLoEeeU-Qes20RRM3azQLy0>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 04 Oct 2020 20:54:31 -0000

Lucas,
> 
>     In a single-path QUIC implementation, the implementation sends the next
>     frames according to the congestion control scheme. When the congestion
>     window is open, new frames can be sent. The QUIC protocol does striclty
>     not mandate how different frames from different streams will be sent.
>     Robin's measurements show that different implementations use very
>     different strategies. The same will be true for multipath, expect that
>     there will be one congestion controller per path. Each of these
>     congestion controllers will open opportunities to transmit frames and
>     the QUIC implementation will send frames when any of the underlying
>     congestion window is open. This can be further optimised depending on
>     the policies that are function of the considered use case.
> 
> 
> Right. But the opportunities to send STREAM frames are driven by flow 
> control not just congestion. There are some strict mandates there. 
> Approaches such as binding a stream to a uniflow could cause starvation 
> of the related-path due to flow control even when congestion window is 
> open. 

I would suggest to start by not binding a stream to a specific uniflow. 
This might be added later if useful.

> Flow control is driven by applications putting data into the 
> transport, and consuming from it. I suspect HTTP/2 over MPTCP does not 
> have this problem, mainly because TCP's flow control trumps. But maybe 
> I'm wrong.

MPTCP provides the same bytestream as TCP and does not expose anything 
special AFAIK to HTTP/2

> Some implementations like quiche decouple the transport library from 
> UDP. Applications hoping for MP-QUIC with such implementations will have 
> to accommodate some of the complexity, the transport cannot do it all.

Path management (i.e. deciding when to create uniflows) is something 
that MPQUIC applications could do. The Linux MPTCP implementation 
initially included this feature as a set of kernel modules. It involved 
to libraries that interact with the kernel using netlink, see

https://inl.info.ucl.ac.be/publications/smapp-towards-smart-multipath-tcp-enabled-applications.html

> I do agree that we don't have to solve all of these things upfront and 
> in one document. But I think there is a risk of defining mechanisms and 
> ignoring some pathological cases. As a parallel, QUIC provides 
> congestion control mechanisms and does not mandate any algorithms but it 
> has taken care to suggest one that is going to be safe to deploy on the 
> Internet.

This is a reasonable approach

> Lucas
> 
> [1] https://mailarchive.ietf.org/arch/msg/quic/OlwAHMyK2mAuRCRuCP-Lpyb7ntA/
> [2] https://github.com/quicwg/base-drafts/issues/3332


Olivier