Re: [EToSat] Interop runner with satellite links

Nicolas Kuhn <nicolas.kuhn.ietf@gmail.com> Sat, 26 February 2022 06:24 UTC

Return-Path: <nicolas.kuhn.ietf@gmail.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5EAD53A081F; Fri, 25 Feb 2022 22:24:41 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.207
X-Spam-Level:
X-Spam-Status: No, score=-0.207 tagged_above=-999 required=5 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id hw6ZTrIDw8Re; Fri, 25 Feb 2022 22:24:36 -0800 (PST)
Received: from mail-qt1-x835.google.com (mail-qt1-x835.google.com [IPv6:2607:f8b0:4864:20::835]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id CC2F63A080B; Fri, 25 Feb 2022 22:24:35 -0800 (PST)
Received: by mail-qt1-x835.google.com with SMTP id v3so4493794qta.11; Fri, 25 Feb 2022 22:24:35 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=M4yiIBRnqwmyv2zPc/9jaI38jhZl95CdhvP775wauTo=; b=TBidphvSKBG2sza1FFfs4uwA9e+GbdeHsEZXwxxlHyUE9ecoLUoMgz/QDtDYgCF8Fi IO8AAkfWlVd3XIwJ4AeY/zJnfFZW3JEK/vOluv1bnKKsCyH0FhIonkuOAH77svsLkOzv iBiT+vwYckcQ7YNVTJAgl2rgkMxFhG+5Cr2XHaSiSPeTPBGNMDfkrgeb6ChugNkUAHKn Nt+tne0ei4KQFtPw6KnG4JUpim4p/ZxRbGW+s1t4iiEv3geuocWjXogtrxk4EaUUq5mn AsYKTpk6zwrcudxy+/RX3qfUyIY3lveZ8l5vEqtRORnOv3ErCIFm4BBzjQn6x0ksUaoV 28vQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=M4yiIBRnqwmyv2zPc/9jaI38jhZl95CdhvP775wauTo=; b=hESrjeIMj3LoOhqUFkE2jgE++85nt6UKZFY8N8zaW9YCHe3Uv220ZBWmBSmhe8tJoC gymqwGuOIA7cvyB9SAVQxQqiH4CSGOnux5pPz843wbLQBOhPiXOduYWZI8DHVUvLyqMX KgUL2UT2/935pbq8Pvg+49nI1zxJkyyw7AODRsO4RIhLMsnfkeZRmmVW3eKicgOGO9+f /lssTLNF4uGyMXiNcDtTk0B0aK2E8H6HwhncdeyFHkeLTwYcxJfj/NzbxCKatk+WsLp4 Nsq+ViKl5qozAFe7h2Xa8+S02DTG+kCP1tuU663laHynxcd2aX/jSx+cNzXdwiWHbhXy 8DtQ==
X-Gm-Message-State: AOAM533sKpFlN25nBAUTtj9TiReN4kXuyWjB28IDmbOLurk/+TJgNhGz 4R1HlbStTnh691I717MZPoyiYwRrngRjrpkNWJ8=
X-Google-Smtp-Source: ABdhPJzcKEaIBEtDmuMaWrEiZEMQX6F0hIpnR6VQ1K5sDyiONfRR3c2Kv5hHFarRrSBw/AmOjuL9dmBkRYdNIYb/Ycc=
X-Received: by 2002:ac8:5c45:0:b0:2dd:baf7:d4fb with SMTP id j5-20020ac85c45000000b002ddbaf7d4fbmr10003101qtj.323.1645856674305; Fri, 25 Feb 2022 22:24:34 -0800 (PST)
MIME-Version: 1.0
References: <2572762.KRHqeOQrTU@7b74a564-70da-4baa-82f8-b74434554dd0> <2321206.ElGaqSPkdT@7b74a564-70da-4baa-82f8-b74434554dd0> <BL1PR11MB53038951CA6E71DC10A7F6E5CE3A9@BL1PR11MB5303.namprd11.prod.outlook.com> <1f27c94e-e9ca-e93e-f158-b696fc2e82a8@huitema.net>
In-Reply-To: <1f27c94e-e9ca-e93e-f158-b696fc2e82a8@huitema.net>
From: Nicolas Kuhn <nicolas.kuhn.ietf@gmail.com>
Date: Sat, 26 Feb 2022 07:24:22 +0100
Message-ID: <CAL0D2oR8+5OB_0qpzHX6VwpipkEXaDYWZHvbBDMWTvU_CycTMQ@mail.gmail.com>
Subject: Re: [EToSat] Interop runner with satellite links
To: Christian Huitema <huitema@huitema.net>
Cc: "Su, Chi-Jiun" <Chi-Jiun.Su=40hughes.com@dmarc.ietf.org>, Sebastian Endres <basti.endres@fau.de>, "etosat@ietf.org" <etosat@ietf.org>, "quic@ietf.org" <quic@ietf.org>, "joerg.deutschmann@fau.de" <joerg.deutschmann@fau.de>
Content-Type: multipart/alternative; boundary="0000000000006c59b605d8e5ded0"
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/QgurtFGOvlT5zGaALRfIvXiDYjk>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 26 Feb 2022 06:24:42 -0000

On Sat, Feb 26, 2022 at 3:40 AM Christian Huitema <huitema@huitema.net>
wrote:

>
> On 2/21/2022 10:16 AM, Su, Chi-Jiun wrote:
> > Hi Sebastian,
> >
> > Thanks for the great work.
> > Some comments/questions.
> >
> >    *   Sec. IV,D, 5: Interesting to know "picoquic" does speculative
> retransmission. As you argue, this may not always help. Did you confirm
> with the author?
>
> This is indeed supported in picoquic. There are APIs that allows the
> implementation to turn the feature on or off:
> `picoquic_set_preemptive_repeat_policy(quic_context, do_repeat)` is used
> to set the policy per Quic context, i.e., for all new connections;
> `picoquic_set_preemptive_repeat_per_cnx(connection_context, do_repeat)`
> is used to set the policy for a specific connection.
>
> The speculative retransmission happens at the lowest priority, i.e.,
> only happens if there is nothing else to send. It is subject to
> congestion control and rate limiting. The "nothing to send" rule means
> that it will only kick after all data of a stream and the FIN mark have
> been sent. The selection of data for speculative retransmission is based
> on stream level acknowledgements. The code deduces the acknowledged
> parts of a data stream from the packet acknowledgements. It will look at
> data that has been sent, but not yet acknowledged.
>
> As you say, this does not always help. If the packet loss rate is low,
> most of the preemptively repeated packets will be useless. On the other
> hand, when sending a file over a lossy link, the application may wait a
> long time for retransmission of packets lost in the last RTT. If loss
> rate and data rates are high enough, some of these packets will have to
> be repeated twice, or maybe three times. So we have a tradeoff: waste
> bandwidth, or waste time. The API allows the application to consider
> that tradeoff and decide whether it is useful or not.
>
> I would very much like to replace the current implementation of
> preemptive repeat by some version of FEC. FEC in general is a poor fit
> for transmission of big files, because it is always less bandwidth
> efficient than just repeating the packets that are lost. But if the
> application knows that the file transmission is almost complete, because
> there is just one CWIN worth of data left, it could turn own FEC for the
> the duration of the last RTT. It will "waste" a modest number of FEC
> packets, while drastically reducing the impact of packet losses on the
> duration of the file transfer. We could even imagine only sending the
> FEC packets after the FIN mark has been sent, making sure that FEC does
> not increase the duration of transfer if there were no errors.
>
> On the interaction between congestion control and coding, you may be
interested in looking at :
https://datatracker.ietf.org/doc/html/draft-irtf-nwcrg-coding-and-congestion-12

There have been other interesting contributions on the integration of FEC
in QUIC :
- https://datatracker.ietf.org/doc/html/draft-swett-nwcrg-coding-for-quic-04
- https://datatracker.ietf.org/doc/draft-roca-nwcrg-rlc-fec-scheme-for-quic/
-
https://inl.info.ucl.ac.be/publications/quic-fec-bringing-benefits-forward-erasure-correction-quic.html

I think the proposed approach (sending FEC packets when the file
transmission is over) had been experimented and will investigate whether
the results can be shared.


> -- Christian Huitema
>
>
> >    *    The results show loss-based CC does not perform well compared to
> BBR
> >    *   Production software performs well more like picoquic or not ?
> >       *   how big difference is between production vs these
> implementations in the test?
> >    *   Any Time-Offset graphs for EUTELSAT case ?
> >    *   Research overview page: additional column on emulated or real Sat
> link will be helpful
> >
> > Good useful work.
> > thanks.
> > cj
> > ________________________________
> > From: QUIC <quic-bounces@ietf.org> on behalf of Sebastian Endres <
> basti.endres@fau.de>
> > Sent: Friday, February 18, 2022 7:02 AM
> > To: etosat@ietf.org <etosat@ietf.org>; quic@ietf.org <quic@ietf.org>
> > Cc: joerg.deutschmann@fau.de <joerg.deutschmann@fau.de>
> > Subject: Re: [EToSat] Interop runner with satellite links
> >
> > **EXTERNAL EMAIL**
> >
> > Dear all,
> >
> > we've published a pre-print of our paper in which we present the
> QUIC-Interop-runner extended to include satellite scenarios and our
> measurement results using numerous publicly available QUIC implementations:
> >
> >
> https://urldefense.com/v3/__https://arxiv.org/abs/2202.08228__;!!Emaut56SYw!mFvp0jheUG95wMrw7L6ZHr3AUjZZgp63MEXhAZnEYvwEkQITw9uIFauoKkW-JRj-Kg$
> >
> > Best regards,
> >
> > Sebastian
> >
> > On Mittwoch, 29. September 2021 21:38:05 CET Sebastian Endres wrote:
> >> Dear all,
> >>
> >> for my master's thesis we ran measurements of all publicly available
> QUIC implementations over an emulated satellite link. The results are
> available online:
> https://urldefense.com/v3/__https://interop.sedrubal.de/__;!!Emaut56SYw!mFvp0jheUG95wMrw7L6ZHr3AUjZZgp63MEXhAZnEYvwEkQITw9uIFauoKkUlf0EgaQ$
> >>
> >> A click on the results also shows time-offset plots, but are not
> available for every combination.
> >>
> >> In general, the performance of QUIC over high latency (e.g.,
> geostationary satellites) is rather poor, especially if there is packet
> loss.
> >>
> >> Would it make sense to add such tests with challenging link
> characteristics to the official QUIC interop runner?
> >>
> >> Best regards,
> >>
> >> Sebastian
> >>
> >>
> >> _______________________________________________
> >> EToSat mailing list
> >> EToSat@ietf.org
> >>
> https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/etosat__;!!Emaut56SYw!mFvp0jheUG95wMrw7L6ZHr3AUjZZgp63MEXhAZnEYvwEkQITw9uIFauoKkXTZO8rhQ$
> >>
> >
> >
> >
> > _______________________________________________
> > EToSat mailing list
> > EToSat@ietf.org
> > https://www.ietf.org/mailman/listinfo/etosat
>
> _______________________________________________
> EToSat mailing list
> EToSat@ietf.org
> https://www.ietf.org/mailman/listinfo/etosat
>