Re: [EToSat] about LOOPS(Localized Optimization of Path Segments) and etosat

Marie-Jose Montpetit <marie@mjmontpetit.com> Thu, 07 February 2019 18:37 UTC

Return-Path: <marie@mjmontpetit.com>
X-Original-To: etosat@ietfa.amsl.com
Delivered-To: etosat@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A6154130DC0 for <etosat@ietfa.amsl.com>; Thu, 7 Feb 2019 10:37:50 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 0.001
X-Spam-Level:
X-Spam-Status: No, score=0.001 tagged_above=-999 required=5 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=mjmontpetit-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id x5kDGlRctbF1 for <etosat@ietfa.amsl.com>; Thu, 7 Feb 2019 10:37:47 -0800 (PST)
Received: from mail-qt1-x831.google.com (mail-qt1-x831.google.com [IPv6:2607:f8b0:4864:20::831]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 738F712F1A5 for <etosat@ietf.org>; Thu, 7 Feb 2019 10:37:47 -0800 (PST)
Received: by mail-qt1-x831.google.com with SMTP id j36so1019234qta.7 for <etosat@ietf.org>; Thu, 07 Feb 2019 10:37:47 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mjmontpetit-com.20150623.gappssmtp.com; s=20150623; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=ZxTqS11O2D24cXUaKu+4stNCm6gqAe0sJN5hKXsCto0=; b=Nxxtd9WSrH0H4CLd6tPnC7gA7f9cc6dlet5+SS/VvUzlxsNUfzDOhv8RS1B6IKFda/ e/pumTjA/lCHeGKBEQo2frnSJsdeftsIDPDs1An6RVMzAmHccDgAkO6sF5oP9GXK9fZY +CVTiRIHXMd6UQZdH9bQEFnQl79nOYvJuKI/fBfNXdCnfkRIvSwWiZURDNyJWumJjKbQ ou9jvQoPtu2b9rmXNpXWLacnIg4c5c1TEjoctcx2pV+nzVAdoYW8RDcNy0Z0ANfFUyYm l6nKzYZsieWqx1LAestTtf+mop+mRhfelyIIa8a6E7IMSMkAAau+dAwyxNi1F3e8NwCo RlJw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=ZxTqS11O2D24cXUaKu+4stNCm6gqAe0sJN5hKXsCto0=; b=KDkJwwVTknGD2u73IEJXXmWdnqUacyStC+eaYO8dWPjZZPpB1XCJCmAvUe8wZtVnhI QJQdRw/mOh368zephCh9xF0MAThJKecCyft2CriaBjNMi9VV0s7+gDqz1oe8KL7INvBP PcerbU7Of0TjqUTAxWZveZP0VZUWJftpCA0NF/8J6teWkRgxX1f0xAF7ZXo6QbIcIYz0 jHtPNxn8rrDy8xFggLzkYf9DF78WXNjBV38zQPWYigxN3bPqVEtn2QFZpe8NzHfLu6Se hGW6B+e8VOXhL/O7/t8SesrJfu0bMX8XnrVOuuKTybMiOXVGRHmuihW+tPqNXjIyofdU De9Q==
X-Gm-Message-State: AHQUAuYmeqIbm34ubuNgvVNlsGSmheVyiCbmr/JtkDaj84tYpwN6IjSV 8JNtdAAsJSTN0FEewnezV3uQxw==
X-Google-Smtp-Source: AHgI3IYtJW1H6rq54EvbhePDaAwPSZehDrIZvhK97MS9vQ8kN3S3ITs20TN29fKIUaBMKUz4lW8+iA==
X-Received: by 2002:aed:2151:: with SMTP id 75mr13400071qtc.24.1549564666342; Thu, 07 Feb 2019 10:37:46 -0800 (PST)
Received: from heidi-lamarr.fios-router.home (pool-173-48-150-213.bstnma.fios.verizon.net. [173.48.150.213]) by smtp.gmail.com with ESMTPSA id q53sm11150885qte.22.2019.02.07.10.37.44 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 07 Feb 2019 10:37:45 -0800 (PST)
From: Marie-Jose Montpetit <marie@mjmontpetit.com>
Message-Id: <6640CB92-B666-4531-B5AC-A8DC9C6D887E@mjmontpetit.com>
Content-Type: multipart/alternative; boundary="Apple-Mail=_DB5E6523-2316-497A-904D-9FA2010EBEE6"
Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\))
Date: Thu, 07 Feb 2019 13:37:43 -0500
In-Reply-To: <BL0PR11MB3394EABD752B8F15EF20D31A90680@BL0PR11MB3394.namprd11.prod.outlook.com>
Cc: Carsten Bormann <cabo@tzi.org>, "etosat@ietf.org" <etosat@ietf.org>
To: "Border, John" <John.Border@hughes.com>
References: <D408889639FC5E4FADB4E00A3E01FA8FA6D64374@nkgeml513-mbs.china.huawei.com> <BL0PR11MB33944EB404AA6A1E8DABBBD490A80@BL0PR11MB3394.namprd11.prod.outlook.com> <BL0PR11MB33940058189CAC345C51C2C090A80@BL0PR11MB3394.namprd11.prod.outlook.com> <D408889639FC5E4FADB4E00A3E01FA8FA6D64D4D@nkgeml513-mbs.china.huawei.com> <205ADE17-7C94-4AF5-B2F3-87613C6E41DE@tzi.org> <BL0PR11MB3394C0EE1249C918BC33448C908D0@BL0PR11MB3394.namprd11.prod.outlook.com> <1ABAA149-B3D7-4944-ACFB-CF8E3AA977E6@tzi.org> <BL0PR11MB3394EABD752B8F15EF20D31A90680@BL0PR11MB3394.namprd11.prod.outlook.com>
X-Mailer: Apple Mail (2.3445.9.1)
Archived-At: <https://mailarchive.ietf.org/arch/msg/etosat/q3gvbu2XUy6XViO91wK3fLb4HwQ>
Subject: Re: [EToSat] about LOOPS(Localized Optimization of Path Segments) and etosat
X-BeenThere: etosat@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "The EToSat list is a non-WG mailing list used to discuss performance implications of running encrypted transports such as QUIC over satellite." <etosat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/etosat>, <mailto:etosat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/etosat/>
List-Post: <mailto:etosat@ietf.org>
List-Help: <mailto:etosat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/etosat>, <mailto:etosat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 07 Feb 2019 18:37:51 -0000

I think this work my loop back (yes pun intended) in some of the work we are doing on adding FEC/Network Coding to QUIC which would help the error recovery without waiting for the long retransmission. And of couse the work we are proposing in COIN where we want to add processing on network paths. So stay tuned.

And of course when we were doing TCP over Satellite and other fu-over satellite work way back when we touched a lot of the topics Carsten raised: how to design a network that will survive the yes sometimes adverse conditions of high frequency satellite systems (Ka band for those of you who want to know) where the usual random packet loss hypothesis in the Internet meet deep fades, in fact beyond what a typical error recovery can deal with. Hence yes multi-path is a good idea but not sure we can always count on the 2nd path when only a satellite network is available (use satellite diversity using double coverage?). 

As for the PEPs satellite networks are not the only ones using them. But with the new transports and e-2-e encryption this becomes potentially not feasible. Which is also an issue when you want to add computing in the network hence reliance on “trusted nodes” or even other distributed network concepts (blockchains?). 

Lots to think about…

mjm
 
Marie-Jose Montpetit, Ph.D.
mariejo@mit.edu
marie@mjmontpetit.com
+1-781-526-2661
@SocialTVMIT



> On Feb 7, 2019, at 12:50 PM, Border, John <John.Border@hughes.com> wrote:
> 
>  
> You wrote:
>  
> "Traditionally, satellite PEPs have treated the whole satellite section (uplink, downlink) as a single sub-path (hop) for optimization.  LOOPS would benefit from an active LOOPS node on the satellite.  Is that something that is on the table these days?"
>  
> Do you mean on the satellite itself?   There have been a few satellites built with processing capability on board (mostly for government/military use) but that is not currently happening for the high speed satellites being used for Internet over satellite.  
>  
> Some of the elements of LOOPS already exist for satellite links but they need to be beefed up now because transport layer solutions are disappearing.  One area that concerns me a lot is loss recovery.  While the error rate on the satellite paths is generally very low most of the time, but gets higher during link condition fades (e.g. heavy rain).  Satellite technology has come a long way in using adaptive techniques to compensate for fade but there is always some residual error rate.  And, from the outside, the mitigation techniques will look like a reduction in link capacity which ties in to the other LOOPS aspects of dealing with congestion management. 
>  
>  
> John
>  
>  
> -----Original Message-----
> From: Carsten Bormann <cabo@tzi.org <mailto:cabo@tzi.org>> 
> Sent: Wednesday, February 06, 2019 4:43 PM
> To: etosat@ietf.org <mailto:etosat@ietf.org>
> Cc: Marie-Jose Montpetit <marie@mjmontpetit.com <mailto:marie@mjmontpetit.com>>; Border, John <John.Border@hughes.com <mailto:John.Border@hughes.com>>
> Subject: Re: about LOOPS(Localized Optimization of Path Segments) and etosat
>  
> On Jan 3, 2019, at 18:48, Border, John <John.Border@hughes.com <mailto:John.Border@hughes.com>> wrote:
> > 
> > Clearly LOOPS should not focus only on satellite.  But, I think LOOPS is directly relevant to ETOSAT.  Techniques like LOOPS are likely to be a key part of the solution to the performance over satellite problem.
> > 
> > I will be sending out an email to ETOSAT in the next couple of days to try to kickstart discussion overall.
>  
> Here is my attempt at kickstarting:
>  
> Traditional approaches at enhancing end-to-end performance by deploying nodes on the way (performance enhancing proxies, PEPs) have employed heavy interactions with the end-to-end transport protocols, usually without their explicit consent.  With end-to-end encryption going under the transport (QUIC), this approach is no longer useful.  This is the underlying theme of the ETOSAT mailing list, but also an important motivator for the more general LOOPS approach.  (Please use the slides previously sent as a reference to node terminology.)
>  
> So what kind of performance enhancement can we do even without aggressively reaching into transport layers?
>  
> * Active queue management: AQM is certainly a good idea.  A potential benefit of LOOPS for AQM is that it can run measurements between sub-path ingress and sub-path egress nodes, as well as between overlay ingress and overlay egress.  So more data can be made available inside the system of LOOPS nodes, and this may help in active queue management.
>  
> * Loss recovery.  Packets can be recovered between sub-path ingress and sub-path egress nodes.  This can be based on local retransmissions and/or on adding and using FEC.  By cooperation of the sub-path ingress and egress nodes, the parameters for these (RTO, FEC rate, choice between retransmission and FEC) can be chosen wisely.  Overlay ingress and egress nodes can provide additional information, such as end-to-end RTT estimates, which might also help in choosing these parameters and avoiding continuing with sub-path retransmission when an end-to-end retransmission is likely to kick in.  The total load on the network decreases with replacing end-to-end by subpath retransmissions/FEC.  Tail-loss detection can benefit from mixing multiple end-to-end flows into one error-controlled subpath flow.
>  
> * Multipathing.  Again, both the overlay ingress/egress nodes and the sub-path ingress/egress nodes can help with detecting multiple paths and using them in the best possible way.
>  
> Challenges, and potential mitigations by employing advances in end-to-end transports, include:
>  
> * Reflecting congestion information up from the sub-paths to the end-to-end paths.  Sub-path ingress/egress nodes may employ additional congestion indicators such as sojourn time to sort loss events into congestion or non-congestion losses.
>  
> * Reordering may reduce end-to-end transport performance.  RACK may help us here, as may cwnd undo on spurious retransmission detection in current TCPs.  Or we could use resequencing in egress nodes, but this is generally not a favored approach.
>  
> * MTU.
>  
> Traditionally, satellite PEPs have treated the whole satellite section (uplink, downlink) as a single sub-path (hop) for optimization.  LOOPS would benefit from an active LOOPS node on the satellite.  Is that something that is on the table these days?
>  
> What we could design here includes:
>  
> * Sub-path “transport-layer style“ protocols, for retransmission and FEC.  This includes designing/selecting good FEC schemes for sub-path usage, as well as some basic encapsulation formats.
> * Formats for making measurement information available between the nodes.
> * Formats for making control information available between ingress and egress nodes.
>  
> Grüße, Carsten