Re: Use of multiple paths [was: Re: [Fwd: New Liaison Statement, "LS on need for Multi-Path QUIC for ATSSS"]]

Magnus Westerlund <magnus.westerlund@ericsson.com> Tue, 07 April 2020 07:48 UTC

Return-Path: <magnus.westerlund@ericsson.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1C0CA3A1877 for <quic@ietfa.amsl.com>; Tue, 7 Apr 2020 00:48:55 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.268
X-Spam-Level:
X-Spam-Status: No, score=-2.268 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.168, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jF_qCjAxWjOZ for <quic@ietfa.amsl.com>; Tue, 7 Apr 2020 00:48:52 -0700 (PDT)
Received: from EUR05-VI1-obe.outbound.protection.outlook.com (mail-vi1eur05on2061b.outbound.protection.outlook.com [IPv6:2a01:111:f400:7d00::61b]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 83D4D3A1875 for <quic@ietf.org>; Tue, 7 Apr 2020 00:48:51 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=oXZMpPOUH9/XB0NckntLYxFOIoQZx16Sf3RJkOOyo452MnEZ8WpqXPgfNiY3hHESKx3fjThSVFPrzIZmY+hVciDV6GzArJMZF+xE9RIjRWW/jfrBo61YuUr02kGlSxMmcu21x2VYRBfYHW+20iotrfOZcPsWfXZu9rzxOVFLwlKU4KAF6ry4XUfJUtdzpZlJSNMMdxbmgZzrxSOMKDbWI2olXh8/bFY4AL877fLRUaV84UxTQou1LLah9dkmQqPYdQndP1oQDNcQOjRyIvgCE2foJnlarW7vDU23rM9RywJbJsHIPcyeyjCHUzJdhaYnsgoPJbJ8WAKcwH69e/aSAw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=c9cJHmwJXcZ7oG9rlPYbmGAHLNAoHE0snz9CnG4JdNo=; b=mFjIXBF4bjdGGdzMEazYxCx62n5thWeV0DHx77UN4fhjp7TdbkhV9s3a9D2QLllHC7hTzWmICnfJ1yy4mg8AE5TdQrsOIhSnwXNEBDN8Vmg3WRRVJ88THlhP3eBYj2h0eT41NrmJWx5FQ7KOyS/pvJDR4g+2knHBHZmToCK04QXXGxj0UbMf5ZZshXEmBVtMfYQ+GgtsT65snMgm6cXc1rXsJ3XNJoeC7EGGNRU1F5zjtTbOMGlMpKaR9XLX1XqQzg8Q0jVwiXB2e7W9h8U0mG3D/Cl6065FMOcpeLskeA3wum3T3KVzAlZ4VfpM3dLX5DYRcl+jMmmpv8GlpBbtIQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=c9cJHmwJXcZ7oG9rlPYbmGAHLNAoHE0snz9CnG4JdNo=; b=Rf+yG04a+l5Uq9FBkf6Z0btHlZECTxaq/Xbyu7nqv2c5wnTuJ4mMul1jigwM/yVTvqE0IvqxkRurUrYrnY+2QxzZCIdwYC01FU1+o7qUOYKWM4OQmhthZNiJmDuhcHng7WnTBZ3v9iWqslfHSncNdW9emmclKDXtnhngu62dmZg=
Received: from HE1PR0702MB3772.eurprd07.prod.outlook.com (52.133.7.14) by HE1PR0702MB3610.eurprd07.prod.outlook.com (10.167.124.27) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2878.13; Tue, 7 Apr 2020 07:48:48 +0000
Received: from HE1PR0702MB3772.eurprd07.prod.outlook.com ([fe80::ec28:2c21:6d78:917a]) by HE1PR0702MB3772.eurprd07.prod.outlook.com ([fe80::ec28:2c21:6d78:917a%2]) with mapi id 15.20.2900.012; Tue, 7 Apr 2020 07:48:48 +0000
From: Magnus Westerlund <magnus.westerlund@ericsson.com>
To: "spencerdawkins.ietf@gmail.com" <spencerdawkins.ietf@gmail.com>
CC: Mirja Kuehlewind <mirja.kuehlewind@ericsson.com>, "ted.ietf@gmail.com" <ted.ietf@gmail.com>, "lucaspardue.24.7@gmail.com" <lucaspardue.24.7@gmail.com>, "lars@eggert.org" <lars@eggert.org>, "fenix@fb.com" <fenix@fb.com>, "quic@ietf.org" <quic@ietf.org>, "mt@lowentropy.net" <mt@lowentropy.net>, "Olivier.Bonaventure@uclouvain.be" <Olivier.Bonaventure@uclouvain.be>
Subject: Re: Use of multiple paths [was: Re: [Fwd: New Liaison Statement, "LS on need for Multi-Path QUIC for ATSSS"]]
Thread-Topic: Use of multiple paths [was: Re: [Fwd: New Liaison Statement, "LS on need for Multi-Path QUIC for ATSSS"]]
Thread-Index: AQHWCb9S1+bTW3c/Fkmo5bSbbOBgxqhncZmAgAAR+gCAABvKgP//sDKAgAS/GICAAKEQgIAAnrqA
Date: Tue, 07 Apr 2020 07:48:48 +0000
Message-ID: <02975081ad545b65391bc0da6eebe59c85b7f798.camel@ericsson.com>
References: <C48DFF7F-1B67-42E2-8A82-1A04E097AD46@ericsson.com> <b9f29f18-ec1b-3c3d-48de-e52d420d66c4@uclouvain.be> <CALGR9oaNSqPMRNwt27J=cRfCS3paLoVPcGORyoZUKBQwuM+4tA@mail.gmail.com> <2387458e-f2fd-2de9-ee68-4cee8ebbe9ed@uclouvain.be> <F2392732-FC09-46D0-99DF-EED238C68C77@fb.com> <b9982c48f7d9fd07542ec2504f1a9fbe67956a62.camel@ericsson.com> <CAKKJt-csFnU=Poiu6gEYkqsawfKeRiOu_ssn4LjxXmFFHHu2GA@mail.gmail.com>
In-Reply-To: <CAKKJt-csFnU=Poiu6gEYkqsawfKeRiOu_ssn4LjxXmFFHHu2GA@mail.gmail.com>
Accept-Language: sv-SE, en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-mailer: Evolution 3.28.5-0ubuntu0.18.04.1
authentication-results: spf=none (sender IP is ) smtp.mailfrom=magnus.westerlund@ericsson.com;
x-originating-ip: [158.174.118.23]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: b49c70bd-8bb1-49a8-1d84-08d7dac81b6e
x-ms-traffictypediagnostic: HE1PR0702MB3610:|HE1PR0702MB3610:
x-ms-exchange-transport-forked: True
x-microsoft-antispam-prvs: <HE1PR0702MB36106EEB3A868D2F38A930BC95C30@HE1PR0702MB3610.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:6790;
x-forefront-prvs: 036614DD9C
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:HE1PR0702MB3772.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(10009020)(4636009)(136003)(376002)(346002)(396003)(366004)(39860400002)(478600001)(81166006)(71200400001)(26005)(81156014)(2906002)(6916009)(36756003)(5660300002)(8936002)(8676002)(6512007)(53546011)(6506007)(66476007)(66616009)(316002)(44832011)(966005)(86362001)(54906003)(6486002)(2616005)(66946007)(76116006)(64756008)(4326008)(99936003)(186003)(66556008)(66446008)(99106002); DIR:OUT; SFP:1101;
received-spf: None (protection.outlook.com: ericsson.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 46ydiGREBTlEG1MI7OFFLoaP0mHc/sjyUIGrYnWwsQe+qzNeX2XN8mhJ3lZCsEYkkLb343Xl7Q88iQ1Lf7OXPb0qbIRu6SoFzr8a9sfXiqmHdattI6DRqd8DSy2xvMSVAzpcJjxNu/Zdp3ajabX9PUJBeigq/jV2bhJ1CPkPEX4TX6/GFpxCxtIxS6SOHKn2NwEIyJ7nTHqGsUS5YHekNKXRcmSw/5kqIlY3UlngjnQMjkkaBh8wBlWiZqpm4gUVvC+fuqY8CgFF4+Pr26zKEuy1UAxbSayraIBZQZhVoqkpcDrTM4KF0pPJEZ+mTUjqA1PXe/yB65Wt1juItWgMcu7R9qUWMClT+96IhDNFFnr7+bxnw0efRFuEM4OKUhgAklWNalNbypPK9JdJ2FZYUqhoO3ilsgTaHVXW3Inz2p/PFAxt5vQ77BTUU97GPxh1ppcWfI2ARnwJBmaR4cmLMza0M+b/IB/+pZZccpL7xF4ba/n6iTIPe61PUdeJ0TUrKAUKvyu00mQrMf8ZGLs39z/RnXleYBFJ7JKpCQkRZ8OWggsY79AasqTrYEXBN5sZ
x-ms-exchange-antispam-messagedata: cpZIHupAk4aZMjZ/yWQrbh8B5yiEfNKy0vY5TquToicaN2YtW7ow4HZoQvHPhUdwLXRyFOHr1gzjBhKDYGlvyAMxRc3FkAbf4levDVrHgI1e6r3Y1VOEPmqrjgGT8JXD9Jk7T79IbCZARtRGpS+thg==
Content-Type: multipart/signed; micalg="sha-256"; protocol="application/x-pkcs7-signature"; boundary="=-vuuYAsEqO+0tLI/yrEgw"
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-Network-Message-Id: b49c70bd-8bb1-49a8-1d84-08d7dac81b6e
X-MS-Exchange-CrossTenant-originalarrivaltime: 07 Apr 2020 07:48:48.3301 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: Li1SZMZtcs/smCgV+TUcgwiBaF51UPEjgIIK3C59zGWoMvrQDS1qbnkKwwKpVcyxb9jqmFvHaNgB6BhyW9ALKhsLPpDqagUqgxtUx0+6La8=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR0702MB3610
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/Wnr_QDgIMP8gC8X7nS8m30V2rjs>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 07 Apr 2020 07:48:55 -0000

Thanks,

So I was groping after something more complex. So basically the definition of
reliable multi-stream usage of QUIC that has an ALPN to identify that there it
is up to the application to interpret how the streams are used. A sort of "TCP
socket" for QUIC? Which might also imply some basic constraints on the API
between the application and the QUIC stack? 

Magnus

On Mon, 2020-04-06 at 17:20 -0500, Spencer Dawkins at IETF wrote:
> For what it's worth, 
> 
> On Mon, Apr 6, 2020 at 7:44 AM Magnus Westerlund <
> magnus.westerlund@ericsson.com> wrote:
> > Hi Roberto,
> > 
> > Do you have a reference or can you expand on what functionalities you
> > actually
> > expect from a session layer? 
> 
> From https://www.ietf.org/jabber/logs/masque/2020-03-24.htmll (extracted,
> please feel free to correct me if I'm misrepresenting anyone):
> 
> [23:48:45] <carrickdb@jabber.hot-chilli.net> Can someone explain why you
> couldn't you have QUIC over QUIC? The payload would be the packet the proxy
> forwards.
> [23:48:46] <sftcd> could be, fine question though
> [23:48:47] <hta> jonathan: I don't regard drop-from-queue as congestion
> control.
> [23:48:55] <keithmoore> Magnus: but I also think that we're inevitably going
> to have something like this, whether we want it or not, including the
> potential for each app to negotiate its own relationship with an external
> proxy.   so we might as well try to understand the hazards.
> [23:49:00] <ekr@jabber.org> carrick: you can have quic over quic. It's just
> not specified yet
> [23:49:02] <achernya> There's no specification for anything-over-QUIC over
> than h3
> [23:49:10] <achernya> *other than, rather
> [23:49:15] <Ted.h> @Martin I dropped Matt a note to ask for a citation; will
> forward to you if he has one that can be referenced.
> [23:49:18] <carrickdb@jabber.hot-chilli.net> I see, thanks
> [23:49:25] <Martin Thomson> Ted.h: appreciate it, thanks
> [23:49:30] <spencerdawkins> That's the problem - there's not a generalized
> upper interface for QUIC.  
> 
>  and, in https://www.ietf.org/jabber/logs/webtrans/2020-03-27.html 
> (extracted, and please feel free to correct me ...
> 
> [22:35:32] <Martin Thomson> I also support adoption.  The requirements parts
> are mostly solid.  I have concerns about the composition of transports in the
> overview piece.
> [22:35:45] <ekr@jabber.org> I also support adoption of this draft.
> [22:36:38] <kaduk@jabber.org/barnowl> schmansport sessions?
> [22:36:40] <hta> Session transport!
> [22:36:41] <spencerdawkins> Is there an agreed upper interface for QUIC that
> is not HTTP/3?
> [22:36:48] <carrickdb@jabber.hot-chilli.net> +1 on what Mark said
> [22:36:49] <ekr@jabber.org> WebSockets/2
> [22:36:49] <brong> SPLITTERS
> [22:36:54] <carrickdb@jabber.hot-chilli.net> about "transport"
> [22:37:07] <dschinazi@jab.im> Spencer: draft-ietf-quic-transport ?  
> 
> So, ISTM that this question is banging around from venue to venue. Some people
> are assuming draft-ietf-quic-transport will work well enough for protocols
> that aren't HTTP/3, and others are not so sure. 
> 
> Definitely worth talking about, in what I hope is the near future ...
> 
> (It's also worth mentioning that 
> https://tools.ietf.org/html/draft-pardue-quic-siduck-00 appears in at least
> one of those jabber logs)
> 
> Best,
> 
> Spencer
> 
> > Cheers
> > 
> > Magnus
> > 
> > On Fri, 2020-04-03 at 19:15 +0000, Roberto Peon wrote:
> > > QUIC is currently missing a session layer other than H3.
> > > 
> > > I'm pretty unhappy about the idea of other protocols right now, since I
> > > believe moving forward without a generic session layer is a mistake we'll
> > all
> > > pay for in the future ( again).
> > > 
> > > -=R
> > > 
> > > On 4/3/20, 10:01 AM, "QUIC on behalf of Olivier Bonaventure" <
> > > quic-bounces@ietf.org on behalf of Olivier.Bonaventure@uclouvain.be>
> > wrote:
> > > 
> > >     Hello Lucas,
> > >     
> > >     > I'll acknowledge that HTTP/3 isn't the only use of QUIC, but it is
> > a 
> > >     > comprehensive use of the transport features that has deployment 
> > >     > experience. 
> > >     
> > >     I agree that HTTP/3 has been the main use case for QUIC and that it
> > has 
> > >     influenced some parts of its design. However, I personally consider
> > QUIC 
> > >     as the generic transport protocol that will support a broad set of 
> > >     applications that will probably have different requirements than
> > HTTP/3.
> > >     
> > >     QUIC has a very clean and extensible design and architecture. It
> > opens 
> > >     new ways to think about the transport layer without all the problems 
> > >     that TCP has faced since roughly the last two decades.
> > >     
> > >     > So looking at MPQUIC thorough the lens of HTTP/3, streams 
> > >     > may not be truly independent because of their reliance on other
> > streams 
> > >     > such control or QPACK. 
> > >     
> > >     Agreed, but there are applications that will use independant streams.
> > A 
> > >     simple example is a standard file transfert and many existing 
> > >     applications that rely on a single bytestream. A TLS VPN that uses
> > QUIC 
> > >     instead of TLS/TCP could map each transported TCP connection over a 
> > >     different QUIC stream.
> > >     
> > >     > Furthermore, even if we model the streams as 
> > >     > independent HTTP requests, the reality is that there is often a
> > higher 
> > >     > layer that wants to put them back together and there the ordering
> > can 
> > >     > matter. These are elements of the puzzle for prioritizing
> > multiplexing 
> > >     > of streams.
> > >     > 
> > >     > Getting scheduling of HTTP streams right is really hard. With HTTP/2
> > > and 
> > >     > TCP today we see several server implementations that just don't do
> > it 
> > >     > very well and may never get around to fixing it. We've also seen
> > issues 
> > >     > in how servers adapt their scheduling to client reprioritization 
> > >     > signals. That seems quite relevant to this use case which requires
> > a 
> > >     > server to select an appropriate path based on client conditions.
> > >     > 
> > >     > The experience, to me, is a sign that people would struggle to build
> > an 
> > >     > HTTP/3 implementation (particularly server-side response
> > scheduling) 
> > >     > that achieves the theoretical goals of MPQUIC. Is it something that
> > can 
> > >     > be tested and shown to demonstrably outperform HTTP/3 plus
> > connection 
> > >     > migration in a statistically significant fashion? Maybe there are
> > case 
> > >     > studies of  HTTP/2 implementations that have tried adapting to
> > MPTCP, 
> > >     > which could inform an analysis for HTTP/3?
> > >     
> > >     In MPTCP, we were less ambitious than in HTTP/2 or HTTP/3 concerning
> > the 
> > >     packet schedulers. We considered that each host is independant and
> > that 
> > >     it uses its own packet scheduler. In contrast with HTTP/2, we did not 
> > >     define ways to prioritise one path over the other by exchanging 
> > >     information in the protocol (except the backup bit, but this disables
> > a 
> > >     path). In practice, what we observe is that the application selects
> > the 
> > >     packet scheduler that it needs locally. On Apple smartphones, this is 
> > >     the choice between the Handover and the Interactive modes for
> > example. 
> > >     This is not as powerful as negotiating packet schedulers over the
> > MPTCP 
> > >     connection, but seems a reasonable tradeoff from an engineering 
> > >     viewpoint based on deployment experience.
> > >     
> > >     
> > >     Olivier
> > >     
> > >     
> > > 
-- 
Cheers

Magnus Westerlund 


----------------------------------------------------------------------
Networks, Ericsson Research
----------------------------------------------------------------------
Ericsson AB                 | Phone  +46 10 7148287
Torshamnsgatan 23           | Mobile +46 73 0949079
SE-164 80 Stockholm, Sweden | mailto: magnus.westerlund@ericsson.com
----------------------------------------------------------------------