Re: [EToSat] about LOOPS(Localized Optimization of Path Segments) and etosat

Ludovic THOMAS <ludovic.thomas@woolab.fr> Mon, 11 February 2019 07:48 UTC

Return-Path: <ludovic.thomas@woolab.fr>
X-Original-To: etosat@ietfa.amsl.com
Delivered-To: etosat@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B9FFA131007 for <etosat@ietfa.amsl.com>; Sun, 10 Feb 2019 23:48:21 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.234
X-Spam-Level:
X-Spam-Status: No, score=-1.234 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001, SPF_SOFTFAIL=0.665, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id yDV9UYBkPHTR for <etosat@ietfa.amsl.com>; Sun, 10 Feb 2019 23:48:18 -0800 (PST)
Received: from smtpextng.isae.fr (smtpextng.isae.fr [192.93.254.80]) by ietfa.amsl.com (Postfix) with ESMTP id 9B21712E04D for <etosat@ietf.org>; Sun, 10 Feb 2019 23:48:16 -0800 (PST)
Received: from smtp-secu-int (smtp-secu-int.isae.fr [10.132.1.48]) by smtpextng.isae.fr (Postfix) with ESMTP id 44B607126B for <etosat@ietf.org>; Mon, 11 Feb 2019 08:48:15 +0100 (CET)
Received: from [10.161.3.54] (port-thomas.isae.fr [10.161.3.54]) by smtp-secu-int (Postfix) with ESMTPSA id 1DEF2206F79 for <etosat@ietf.org>; Mon, 11 Feb 2019 08:48:15 +0100 (CET)
To: etosat@ietf.org
References: <D408889639FC5E4FADB4E00A3E01FA8FA6D64374@nkgeml513-mbs.china.huawei.com> <BL0PR11MB33944EB404AA6A1E8DABBBD490A80@BL0PR11MB3394.namprd11.prod.outlook.com> <BL0PR11MB33940058189CAC345C51C2C090A80@BL0PR11MB3394.namprd11.prod.outlook.com> <D408889639FC5E4FADB4E00A3E01FA8FA6D64D4D@nkgeml513-mbs.china.huawei.com> <205ADE17-7C94-4AF5-B2F3-87613C6E41DE@tzi.org> <BL0PR11MB3394C0EE1249C918BC33448C908D0@BL0PR11MB3394.namprd11.prod.outlook.com> <1ABAA149-B3D7-4944-ACFB-CF8E3AA977E6@tzi.org> <BL0PR11MB3394EABD752B8F15EF20D31A90680@BL0PR11MB3394.namprd11.prod.outlook.com> <6640CB92-B666-4531-B5AC-A8DC9C6D887E@mjmontpetit.com> <00AE6432-8C90-4BF3-825B-C98D03AB5F1A@tzi.org> <F3B0A07CFD358240926B78A680E166FF1EB80036@TW-MBX-P02.cnesnet.ad.cnes.fr>
From: Ludovic THOMAS <ludovic.thomas@woolab.fr>
Message-ID: <2a13aaff-72cd-cb68-8f74-48a49b383823@woolab.fr>
Date: Mon, 11 Feb 2019 08:48:14 +0100
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.2.1
MIME-Version: 1.0
In-Reply-To: <F3B0A07CFD358240926B78A680E166FF1EB80036@TW-MBX-P02.cnesnet.ad.cnes.fr>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Transfer-Encoding: 8bit
Content-Language: en-US
Archived-At: <https://mailarchive.ietf.org/arch/msg/etosat/LGRuxDL2ei0ZKieKohifL1wLq34>
Subject: Re: [EToSat] about LOOPS(Localized Optimization of Path Segments) and etosat
X-BeenThere: etosat@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "The EToSat list is a non-WG mailing list used to discuss performance implications of running encrypted transports such as QUIC over satellite." <etosat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/etosat>, <mailto:etosat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/etosat/>
List-Post: <mailto:etosat@ietf.org>
List-Help: <mailto:etosat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/etosat>, <mailto:etosat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 11 Feb 2019 07:48:22 -0000

Maybe the research should include a topic on the throughput 
initialization, namely the exponential probing of the link capacity 
(shall it be called "slow start" in NewReno, "hystart" in Cubic or 
"binary search" in BBR).

FWIU, deciding to increase the throughput is today a sole decision of 
the transport protocol at the endpoint.
The exponential probing of a link with high RTT is yet long and 
drastically reduces the web browsing performances (page load time, time 
to paint, ...)

With TCP, the gateway PEP was able to generate ACKs, allowing the server 
to only probe the (low RTT) link connecting it to the gateway. With 
QUIC, the decision to increase the throughput is performed only based on 
(encrypted) ACKs generated by the remote client (at a high RTT distance 
in a SATCOM context). LOOPS overlay can't today participate in that 
decision.

To put it in a nutshell, re-transmissions and FECs mechanisms under the 
transport layer are about how to maintain the best (and fair) use of the 
resources even if transmission capacity is suddenly reduced by weather 
conditions. But we may ask how to initially reach this best use in an 
efficient manner, starting from scratch.

FWIU, solutions to improve the slow start without cutting a QUIC 
connection will require cross-layer interactions.
I'm thinking maybe some overlay nodes can participate in the negotiation 
of the transport initial parameters during the handshake, so that 
end-points know they communicate over a high-BDP yet LOOPS-enabled path.

It would raises lot of questions, such as how a QUIC endpoint can trust 
a LOOPS overlay node...

Ludovic

Le 08/02/2019 à 15:26, Kuhn Nicolas a écrit :
> Dear all,
>
> Thanks for putting this up - this indeed could help structure many
> activities related to the management and optimization of tunnels.
> I just wanted to point out that losses due to rain-fade do not happen much
> when ACM is correctly tuned.
>
> That being said, we may have non neglectable Wi-Fi losses for an end user on
> a phone. We can expect important QoE degradations in this context.
> At the moment, the low-hanging fruits are still to be defined, but IMHO
> trying to adapt QUIC recovery to this use-case is important (for QUIC v2?).
>
> I would be happy to further discuss that and want to contribute (with
> presentations and/or drafts).
>
> Cheers,
>
> Nico
>
> -----Message d'origine-----
> De : EToSat <etosat-bounces@ietf.org> De la part de Carsten Bormann
> Envoyé : jeudi 7 février 2019 20:03
> À : Marie-Jose Montpetit <marie@mjmontpetit.com>
> Cc : etosat@ietf.org; Border, John <John.Border@hughes.com>
> Objet : Re: [EToSat] about LOOPS(Localized Optimization of Path Segments)
> and etosat
>
> On Feb 7, 2019, at 19:37, Marie-Jose Montpetit <marie@mjmontpetit.com>
> wrote:
>> I think this work my loop back (yes pun intended) in some of the work we
>> are doing on adding FEC/Network Coding to QUIC which would help the error
>> recovery without waiting for the long retransmission.
> Right, when the transport actually helps with this you can get even better
> results.
> But then, LOOPS can send the FEC just along the problematic sub-paths, so
> the ones without the equivalent of rain-fade are not burdened.
>
>> And of couse the work we are proposing in COIN where we want to add
>> processing on network paths. So stay tuned.
> Exactly, COIN would be one of the ways to get the in-network processing for
> this (for now, this is all about manually set-up nodes).
>
>> And of course when we were doing TCP over Satellite and other fu-over
>> satellite work way back when we touched a lot of the topics Carsten
>> raised: how to design a network that will survive the yes sometimes
>> adverse conditions of high frequency satellite systems (Ka band for those
>> of you who want to know) where the usual random packet loss hypothesis in
>> the Internet meet deep fades, in fact beyond what a typical error recovery
>> can deal with. Hence yes multi-path is a good idea but not sure we can
>> always count on the 2nd path when only a satellite network is available
>> (use satellite diversity using double coverage?).
>>
>> As for the PEPs satellite networks are not the only ones using them. But
>> with the new transports and e-2-e encryption this becomes potentially not
>> feasible. Which is also an issue when you want to add computing in the
>> network hence reliance on “trusted nodes” or even other distributed
>> network concepts (blockchains?).
>>
>> Lots to think about…
> Indeed, pretty much a lifetime of research could go into this… The aim of
> LOOPS is to recast and limit the problem in such a way that we can address a
> good chunk of it with low-hanging fruit that can be deployed promptly.
>
> I’m pretty sure that nwcrg has some of this low-hanging fruit already
> plucked, so that’s why I’m going to ask there to contribute here.
>
> Grüße, Carsten
>
>
>> mjm
>>
>> Marie-Jose Montpetit, Ph.D.
>> mariejo@mit.edu
>> marie@mjmontpetit.com
>> +1-781-526-2661
>> @SocialTVMIT
>>
>>
>>
>>> On Feb 7, 2019, at 12:50 PM, Border, John <John.Border@hughes.com> wrote:
>>>
>>>
>>> You wrote:
>>>
>>> "Traditionally, satellite PEPs have treated the whole satellite section
>>> (uplink, downlink) as a single sub-path (hop) for optimization.  LOOPS
>>> would benefit from an active LOOPS node on the satellite.  Is that
>>> something that is on the table these days?"
>>>
>>> Do you mean on the satellite itself?   There have been a few satellites
>>> built with processing capability on board (mostly for government/military
>>> use) but that is not currently happening for the high speed satellites
>>> being used for Internet over satellite.
>>>
>>> Some of the elements of LOOPS already exist for satellite links but they
>>> need to be beefed up now because transport layer solutions are
>>> disappearing.  One area that concerns me a lot is loss recovery.  While
>>> the error rate on the satellite paths is generally very low most of the
>>> time, but gets higher during link condition fades (e.g. heavy rain).
>>> Satellite technology has come a long way in using adaptive techniques to
>>> compensate for fade but there is always some residual error rate.  And,
>>> from the outside, the mitigation techniques will look like a reduction in
>>> link capacity which ties in to the other LOOPS aspects of dealing with
>>> congestion management.
>>>
>>>
>>> John
>>>
>>>
>>> -----Original Message-----
>>> From: Carsten Bormann <cabo@tzi.org>
>>> Sent: Wednesday, February 06, 2019 4:43 PM
>>> To: etosat@ietf.org
>>> Cc: Marie-Jose Montpetit <marie@mjmontpetit.com>; Border, John
>>> <John.Border@hughes.com>
>>> Subject: Re: about LOOPS(Localized Optimization of Path Segments) and
>>> etosat
>>>
>>> On Jan 3, 2019, at 18:48, Border, John <John.Border@hughes.com> wrote:
>>>> Clearly LOOPS should not focus only on satellite.  But, I think LOOPS
>>>> is directly relevant to ETOSAT.  Techniques like LOOPS are likely to be
>>>> a key part of the solution to the performance over satellite problem.
>>>>
>>>> I will be sending out an email to ETOSAT in the next couple of days to
>>>> try to kickstart discussion overall.
>>> Here is my attempt at kickstarting:
>>>
>>> Traditional approaches at enhancing end-to-end performance by
>>> deploying nodes on the way (performance enhancing proxies, PEPs) have
>>> employed heavy interactions with the end-to-end transport protocols,
>>> usually without their explicit consent.  With end-to-end encryption
>>> going under the transport (QUIC), this approach is no longer useful.
>>> This is the underlying theme of the ETOSAT mailing list, but also an
>>> important motivator for the more general LOOPS approach.  (Please use
>>> the slides previously sent as a reference to node terminology.)
>>>
>>> So what kind of performance enhancement can we do even without
>>> aggressively reaching into transport layers?
>>>
>>> * Active queue management: AQM is certainly a good idea.  A potential
>>> benefit of LOOPS for AQM is that it can run measurements between sub-path
>>> ingress and sub-path egress nodes, as well as between overlay ingress and
>>> overlay egress.  So more data can be made available inside the system of
>>> LOOPS nodes, and this may help in active queue management.
>>>
>>> * Loss recovery.  Packets can be recovered between sub-path ingress and
>>> sub-path egress nodes.  This can be based on local retransmissions and/or
>>> on adding and using FEC.  By cooperation of the sub-path ingress and
>>> egress nodes, the parameters for these (RTO, FEC rate, choice between
>>> retransmission and FEC) can be chosen wisely.  Overlay ingress and egress
>>> nodes can provide additional information, such as end-to-end RTT
>>> estimates, which might also help in choosing these parameters and
>>> avoiding continuing with sub-path retransmission when an end-to-end
>>> retransmission is likely to kick in.  The total load on the network
>>> decreases with replacing end-to-end by subpath retransmissions/FEC.
>>> Tail-loss detection can benefit from mixing multiple end-to-end flows
>>> into one error-controlled subpath flow.
>>>
>>> * Multipathing.  Again, both the overlay ingress/egress nodes and the
>>> sub-path ingress/egress nodes can help with detecting multiple paths and
>>> using them in the best possible way.
>>>
>>> Challenges, and potential mitigations by employing advances in end-to-end
>>> transports, include:
>>>
>>> * Reflecting congestion information up from the sub-paths to the
>>> end-to-end paths.  Sub-path ingress/egress nodes may employ additional
>>> congestion indicators such as sojourn time to sort loss events into
>>> congestion or non-congestion losses.
>>>
>>> * Reordering may reduce end-to-end transport performance.  RACK may help
>>> us here, as may cwnd undo on spurious retransmission detection in current
>>> TCPs.  Or we could use resequencing in egress nodes, but this is
>>> generally not a favored approach.
>>>
>>> * MTU.
>>>
>>> Traditionally, satellite PEPs have treated the whole satellite section
>>> (uplink, downlink) as a single sub-path (hop) for optimization.  LOOPS
>>> would benefit from an active LOOPS node on the satellite.  Is that
>>> something that is on the table these days?
>>>
>>> What we could design here includes:
>>>
>>> * Sub-path “transport-layer style“ protocols, for retransmission and FEC.
>>> This includes designing/selecting good FEC schemes for sub-path usage, as
>>> well as some basic encapsulation formats.
>>> * Formats for making measurement information available between the nodes.
>>> * Formats for making control information available between ingress and
>>> egress nodes.
>>>
>>> Grüße, Carsten
>> _______________________________________________
>> EToSat mailing list
>> EToSat@ietf.org
>> https://www.ietf.org/mailman/listinfo/etosat
> _______________________________________________
> EToSat mailing list
> EToSat@ietf.org
> https://www.ietf.org/mailman/listinfo/etosat