Re: [PANRG] About Keith and Michael's proposal on sidecar protocols in PANRG today

Michael Welzl <michawe@ifi.uio.no> Thu, 24 March 2022 22:50 UTC

Return-Path: <michawe@ifi.uio.no>
X-Original-To: panrg@ietfa.amsl.com
Delivered-To: panrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 937503A0D6F for <panrg@ietfa.amsl.com>; Thu, 24 Mar 2022 15:50:33 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.909
X-Spam-Level:
X-Spam-Status: No, score=-1.909 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=unavailable autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id fUaDr1YZS2d1 for <panrg@ietfa.amsl.com>; Thu, 24 Mar 2022 15:50:31 -0700 (PDT)
Received: from mail-out04.uio.no (mail-out04.uio.no [IPv6:2001:700:100:8210::76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id F143B3A0D77 for <panrg@irtf.org>; Thu, 24 Mar 2022 15:50:30 -0700 (PDT)
Received: from mail-mx03.uio.no ([129.240.10.15]) by mail-out04.uio.no with esmtps (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from <michawe@ifi.uio.no>) id 1nXWHa-003HC8-Mj; Thu, 24 Mar 2022 23:50:18 +0100
Received: from dhcp-9a5b.meeting.ietf.org ([31.133.154.91]) by mail-mx03.uio.no with esmtpsa (TLS1.2:ECDHE-RSA-AES256-GCM-SHA384:256) user michawe (Exim 4.94.2) (envelope-from <michawe@ifi.uio.no>) id 1nXWHY-000Eg6-W4; Thu, 24 Mar 2022 23:50:18 +0100
From: Michael Welzl <michawe@ifi.uio.no>
Message-Id: <CBACE661-9BE9-4B93-BA27-6F237C4F0D63@ifi.uio.no>
Content-Type: multipart/alternative; boundary="Apple-Mail=_D2DCF5BC-AAB9-43FF-93A4-33A2BA283636"
Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.7\))
Date: Thu, 24 Mar 2022 23:50:14 +0100
In-Reply-To: <CAL0D2oQgdLon5jYvRrcyRtQoNQmp66jcwOZ1OCa9rdPweuJC=Q@mail.gmail.com>
Cc: "Holland, Jake" <jholland=40akamai.com@dmarc.ietf.org>, Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com>, "panrg@irtf.org" <panrg@irtf.org>
To: Nicolas Kuhn <nicolas.kuhn.ietf@gmail.com>
References: <CAKKJt-c2K1B6mBeKuBmf+E+m+3ZPyTMRk-oZ23ZOP2hZHSkpPQ@mail.gmail.com> <8F38CA66-7AA6-4DCF-88A6-30D0E38C80DF@akamai.com> <51875E18-6905-474F-A384-580F9F3E72FD@ifi.uio.no> <CAL0D2oQgdLon5jYvRrcyRtQoNQmp66jcwOZ1OCa9rdPweuJC=Q@mail.gmail.com>
X-Mailer: Apple Mail (2.3608.120.23.2.7)
X-UiO-SPF-Received: Received-SPF: neutral (mail-mx03.uio.no: 31.133.154.91 is neither permitted nor denied by domain of ifi.uio.no) client-ip=31.133.154.91; envelope-from=michawe@ifi.uio.no; helo=dhcp-9a5b.meeting.ietf.org;
X-UiO-Spam-info: not spam, SpamAssassin (score=-5.0, required=5.0, autolearn=disabled, AWL=0.009, HTML_MESSAGE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, UIO_MAIL_IS_INTERNAL=-5)
X-UiO-Scanned: F466D7B4F05036490D3BB2B2A1D294D14C421DC9
X-UiOonly: C5F92460F5A8F82C15C66C49F1F08657C0C4F9C4
Archived-At: <https://mailarchive.ietf.org/arch/msg/panrg/gmfh4HNszUmuetCdHzZ8QZn33cs>
Subject: Re: [PANRG] About Keith and Michael's proposal on sidecar protocols in PANRG today
X-BeenThere: panrg@irtf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Path Aware Networking \(Proposed\) Research Group discussion list" <panrg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/panrg>, <mailto:panrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/panrg/>
List-Post: <mailto:panrg@irtf.org>
List-Help: <mailto:panrg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/panrg>, <mailto:panrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Thu, 24 Mar 2022 22:50:34 -0000

Hi,

Changing the subject line too, to be more correct; some answers below:


> On Mar 24, 2022, at 6:14 PM, Nicolas Kuhn <nicolas.kuhn.ietf@gmail.com> wrote:
> 
> Hi, 
> 
> On the interactions between a proxy and multi-path protocols, here is a pointer to experiments we had done with PEPSal splitting TCP connections and MP-TCP. 
> https://datatracker.ietf.org/meeting/106/materials/slides-106-mptcp-mptcp-satellite-01 <https://datatracker.ietf.org/meeting/106/materials/slides-106-mptcp-mptcp-satellite-01> 

*** Commercial interlude ***   please use PEP-DNA instead: https://github.com/kr1stj0n/pep-dna <https://github.com/kr1stj0n/pep-dna>   faster, in the kernel, able to relay the handshake (i.e., no need for it to terminate before beginning the next), also open source…    :-)


> The TCP splitting proxy should be aware that the end-to-end protocol is trying to negotiate a multi-path connection otherwise there may be issues. 
> 
> We had also experienced issues related to the receive buffer management (expected to be located at the client only with MPTCP) and MPTCP-level acknowledgement or packets. 

These *may* be relevant, but I would like to caution against translating problems seen with connection-splitting PEPs in these scenarios 1:1 into the scenarios with the sidecar.

A TCP connection splitter helps to easily explain the idea of separating congestion control, but the comparison fits only to a certain degree - there are some fundamental differences. For one, a TCP connection splitting PEP has to guarantee reliability, retransmit packets, etc., as it breaks TCP’s reliability semantics. That’s different in the use case that I showed, which it’s more minimalist (or “less intrusive”, for a better sounding phrase  :-)   hmmm… perhaps even better: "minimally invasive”, as in surgery?).


> Moreover, with QUIC the multipath extension negotiation would hardly be seen by a proxy, right ? 

Yes, that’s right. The SC proxy might not know that multipath is even in use… does it need to know about it though?


> As you said, Michael, the devil is in the details and this opens the room for very interesting research IMHO.
> 
> Thanks for sharing this work,

Thanks for these kind words!

Cheers,
Michael



> 
> Nico
> 
> On Thu, Mar 24, 2022 at 3:18 PM Michael Welzl <michawe@ifi.uio.no <mailto:michawe@ifi.uio.no>> wrote:
> Hi,
> 
> A separate email to keep the thread alive, since Spencer wanted to discuss multipath:
> 
> 1) how could it support MP:  I didn’t have it on the slides, but “you can split traffic for me on the path, I can handle some HOL blocking delay on this connection” could be another type of use case for this protocol…
> 
> 2) How would it interact with multipath:  Say, a SC proxy just starts ACKing back towards the source (consider a case with no NAT, or the SC proxy sitting before it, or ACKs being piggybacked: then the NAT is also less of a problem). The path changes => the SC disappears; no more ACKs, no more performance improvement. Or, there is SC proxy 2, which all of a sudden begins ACKing - supported in the same way. Perhaps a setup round-trip is wasted before these ACKs on a new path could become useful…
> 
> Multiple SCs on multiple paths…. well they would ACK each, e.g. feeding into the congestion control as per-path information. SC ACKs from only one path out of multiple in a MP connection - at least in case of MPTCP, this would refer to the “connection” it sees (how to identify that is another open issue … but let’s keep it simple and say “piggyback on the connection that it sees” - so it would be specific to only one path, perhaps...
> 
> Surely not all cases are so easy  :)
> 
> Cheers,
> Michael
> 
> 
>  
>> From: Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com <mailto:spencerdawkins.ietf@gmail.com>>
>> Date: Thu,2022-03-24 at 5:44 AM
>> To: "panrg@irtf.org <mailto:panrg@irtf.org>" <panrg@irtf.org <mailto:panrg@irtf.org>>
>> Subject: [PANRG] About Michael's proposal on sidecar protocols in PANRG today
>>  
>> Dear PANRG,
>>  
>> I liked Michael's proposal, and I suggest that we spend some time thinking about interaction with multiplath, now that all REAL transport protocols support multipath ... 😀
>>  
>> Best,
>>  
>> Spencer
>> _______________________________________________
>> Panrg mailing list
>> Panrg@irtf.org <mailto:Panrg@irtf.org>
>> https://www.irtf.org/mailman/listinfo/panrg <https://www.irtf.org/mailman/listinfo/panrg>
> _______________________________________________
> Panrg mailing list
> Panrg@irtf.org <mailto:Panrg@irtf.org>
> https://www.irtf.org/mailman/listinfo/panrg <https://www.irtf.org/mailman/listinfo/panrg>
> _______________________________________________
> Panrg mailing list
> Panrg@irtf.org
> https://www.irtf.org/mailman/listinfo/panrg