Re: [EToSat] Interop runner with satellite links
Nicolas Kuhn <nicolas.kuhn.ietf@gmail.com> Sat, 26 February 2022 06:24 UTC
Return-Path: <nicolas.kuhn.ietf@gmail.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5EAD53A081F; Fri, 25 Feb 2022 22:24:41 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.207
X-Spam-Level:
X-Spam-Status: No, score=-0.207 tagged_above=-999 required=5 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id hw6ZTrIDw8Re; Fri, 25 Feb 2022 22:24:36 -0800 (PST)
Received: from mail-qt1-x835.google.com (mail-qt1-x835.google.com [IPv6:2607:f8b0:4864:20::835]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id CC2F63A080B; Fri, 25 Feb 2022 22:24:35 -0800 (PST)
Received: by mail-qt1-x835.google.com with SMTP id v3so4493794qta.11; Fri, 25 Feb 2022 22:24:35 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=M4yiIBRnqwmyv2zPc/9jaI38jhZl95CdhvP775wauTo=; b=TBidphvSKBG2sza1FFfs4uwA9e+GbdeHsEZXwxxlHyUE9ecoLUoMgz/QDtDYgCF8Fi IO8AAkfWlVd3XIwJ4AeY/zJnfFZW3JEK/vOluv1bnKKsCyH0FhIonkuOAH77svsLkOzv iBiT+vwYckcQ7YNVTJAgl2rgkMxFhG+5Cr2XHaSiSPeTPBGNMDfkrgeb6ChugNkUAHKn Nt+tne0ei4KQFtPw6KnG4JUpim4p/ZxRbGW+s1t4iiEv3geuocWjXogtrxk4EaUUq5mn AsYKTpk6zwrcudxy+/RX3qfUyIY3lveZ8l5vEqtRORnOv3ErCIFm4BBzjQn6x0ksUaoV 28vQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=M4yiIBRnqwmyv2zPc/9jaI38jhZl95CdhvP775wauTo=; b=hESrjeIMj3LoOhqUFkE2jgE++85nt6UKZFY8N8zaW9YCHe3Uv220ZBWmBSmhe8tJoC gymqwGuOIA7cvyB9SAVQxQqiH4CSGOnux5pPz843wbLQBOhPiXOduYWZI8DHVUvLyqMX KgUL2UT2/935pbq8Pvg+49nI1zxJkyyw7AODRsO4RIhLMsnfkeZRmmVW3eKicgOGO9+f /lssTLNF4uGyMXiNcDtTk0B0aK2E8H6HwhncdeyFHkeLTwYcxJfj/NzbxCKatk+WsLp4 Nsq+ViKl5qozAFe7h2Xa8+S02DTG+kCP1tuU663laHynxcd2aX/jSx+cNzXdwiWHbhXy 8DtQ==
X-Gm-Message-State: AOAM533sKpFlN25nBAUTtj9TiReN4kXuyWjB28IDmbOLurk/+TJgNhGz 4R1HlbStTnh691I717MZPoyiYwRrngRjrpkNWJ8=
X-Google-Smtp-Source: ABdhPJzcKEaIBEtDmuMaWrEiZEMQX6F0hIpnR6VQ1K5sDyiONfRR3c2Kv5hHFarRrSBw/AmOjuL9dmBkRYdNIYb/Ycc=
X-Received: by 2002:ac8:5c45:0:b0:2dd:baf7:d4fb with SMTP id j5-20020ac85c45000000b002ddbaf7d4fbmr10003101qtj.323.1645856674305; Fri, 25 Feb 2022 22:24:34 -0800 (PST)
MIME-Version: 1.0
References: <2572762.KRHqeOQrTU@7b74a564-70da-4baa-82f8-b74434554dd0> <2321206.ElGaqSPkdT@7b74a564-70da-4baa-82f8-b74434554dd0> <BL1PR11MB53038951CA6E71DC10A7F6E5CE3A9@BL1PR11MB5303.namprd11.prod.outlook.com> <1f27c94e-e9ca-e93e-f158-b696fc2e82a8@huitema.net>
In-Reply-To: <1f27c94e-e9ca-e93e-f158-b696fc2e82a8@huitema.net>
From: Nicolas Kuhn <nicolas.kuhn.ietf@gmail.com>
Date: Sat, 26 Feb 2022 07:24:22 +0100
Message-ID: <CAL0D2oR8+5OB_0qpzHX6VwpipkEXaDYWZHvbBDMWTvU_CycTMQ@mail.gmail.com>
Subject: Re: [EToSat] Interop runner with satellite links
To: Christian Huitema <huitema@huitema.net>
Cc: "Su, Chi-Jiun" <Chi-Jiun.Su=40hughes.com@dmarc.ietf.org>, Sebastian Endres <basti.endres@fau.de>, "etosat@ietf.org" <etosat@ietf.org>, "quic@ietf.org" <quic@ietf.org>, "joerg.deutschmann@fau.de" <joerg.deutschmann@fau.de>
Content-Type: multipart/alternative; boundary="0000000000006c59b605d8e5ded0"
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/QgurtFGOvlT5zGaALRfIvXiDYjk>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 26 Feb 2022 06:24:42 -0000
On Sat, Feb 26, 2022 at 3:40 AM Christian Huitema <huitema@huitema.net> wrote: > > On 2/21/2022 10:16 AM, Su, Chi-Jiun wrote: > > Hi Sebastian, > > > > Thanks for the great work. > > Some comments/questions. > > > > * Sec. IV,D, 5: Interesting to know "picoquic" does speculative > retransmission. As you argue, this may not always help. Did you confirm > with the author? > > This is indeed supported in picoquic. There are APIs that allows the > implementation to turn the feature on or off: > `picoquic_set_preemptive_repeat_policy(quic_context, do_repeat)` is used > to set the policy per Quic context, i.e., for all new connections; > `picoquic_set_preemptive_repeat_per_cnx(connection_context, do_repeat)` > is used to set the policy for a specific connection. > > The speculative retransmission happens at the lowest priority, i.e., > only happens if there is nothing else to send. It is subject to > congestion control and rate limiting. The "nothing to send" rule means > that it will only kick after all data of a stream and the FIN mark have > been sent. The selection of data for speculative retransmission is based > on stream level acknowledgements. The code deduces the acknowledged > parts of a data stream from the packet acknowledgements. It will look at > data that has been sent, but not yet acknowledged. > > As you say, this does not always help. If the packet loss rate is low, > most of the preemptively repeated packets will be useless. On the other > hand, when sending a file over a lossy link, the application may wait a > long time for retransmission of packets lost in the last RTT. If loss > rate and data rates are high enough, some of these packets will have to > be repeated twice, or maybe three times. So we have a tradeoff: waste > bandwidth, or waste time. The API allows the application to consider > that tradeoff and decide whether it is useful or not. > > I would very much like to replace the current implementation of > preemptive repeat by some version of FEC. FEC in general is a poor fit > for transmission of big files, because it is always less bandwidth > efficient than just repeating the packets that are lost. But if the > application knows that the file transmission is almost complete, because > there is just one CWIN worth of data left, it could turn own FEC for the > the duration of the last RTT. It will "waste" a modest number of FEC > packets, while drastically reducing the impact of packet losses on the > duration of the file transfer. We could even imagine only sending the > FEC packets after the FIN mark has been sent, making sure that FEC does > not increase the duration of transfer if there were no errors. > > On the interaction between congestion control and coding, you may be interested in looking at : https://datatracker.ietf.org/doc/html/draft-irtf-nwcrg-coding-and-congestion-12 There have been other interesting contributions on the integration of FEC in QUIC : - https://datatracker.ietf.org/doc/html/draft-swett-nwcrg-coding-for-quic-04 - https://datatracker.ietf.org/doc/draft-roca-nwcrg-rlc-fec-scheme-for-quic/ - https://inl.info.ucl.ac.be/publications/quic-fec-bringing-benefits-forward-erasure-correction-quic.html I think the proposed approach (sending FEC packets when the file transmission is over) had been experimented and will investigate whether the results can be shared. > -- Christian Huitema > > > > * The results show loss-based CC does not perform well compared to > BBR > > * Production software performs well more like picoquic or not ? > > * how big difference is between production vs these > implementations in the test? > > * Any Time-Offset graphs for EUTELSAT case ? > > * Research overview page: additional column on emulated or real Sat > link will be helpful > > > > Good useful work. > > thanks. > > cj > > ________________________________ > > From: QUIC <quic-bounces@ietf.org> on behalf of Sebastian Endres < > basti.endres@fau.de> > > Sent: Friday, February 18, 2022 7:02 AM > > To: etosat@ietf.org <etosat@ietf.org>; quic@ietf.org <quic@ietf.org> > > Cc: joerg.deutschmann@fau.de <joerg.deutschmann@fau.de> > > Subject: Re: [EToSat] Interop runner with satellite links > > > > **EXTERNAL EMAIL** > > > > Dear all, > > > > we've published a pre-print of our paper in which we present the > QUIC-Interop-runner extended to include satellite scenarios and our > measurement results using numerous publicly available QUIC implementations: > > > > > https://urldefense.com/v3/__https://arxiv.org/abs/2202.08228__;!!Emaut56SYw!mFvp0jheUG95wMrw7L6ZHr3AUjZZgp63MEXhAZnEYvwEkQITw9uIFauoKkW-JRj-Kg$ > > > > Best regards, > > > > Sebastian > > > > On Mittwoch, 29. September 2021 21:38:05 CET Sebastian Endres wrote: > >> Dear all, > >> > >> for my master's thesis we ran measurements of all publicly available > QUIC implementations over an emulated satellite link. The results are > available online: > https://urldefense.com/v3/__https://interop.sedrubal.de/__;!!Emaut56SYw!mFvp0jheUG95wMrw7L6ZHr3AUjZZgp63MEXhAZnEYvwEkQITw9uIFauoKkUlf0EgaQ$ > >> > >> A click on the results also shows time-offset plots, but are not > available for every combination. > >> > >> In general, the performance of QUIC over high latency (e.g., > geostationary satellites) is rather poor, especially if there is packet > loss. > >> > >> Would it make sense to add such tests with challenging link > characteristics to the official QUIC interop runner? > >> > >> Best regards, > >> > >> Sebastian > >> > >> > >> _______________________________________________ > >> EToSat mailing list > >> EToSat@ietf.org > >> > https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/etosat__;!!Emaut56SYw!mFvp0jheUG95wMrw7L6ZHr3AUjZZgp63MEXhAZnEYvwEkQITw9uIFauoKkXTZO8rhQ$ > >> > > > > > > > > _______________________________________________ > > EToSat mailing list > > EToSat@ietf.org > > https://www.ietf.org/mailman/listinfo/etosat > > _______________________________________________ > EToSat mailing list > EToSat@ietf.org > https://www.ietf.org/mailman/listinfo/etosat >
- Interop runner with satellite links Sebastian Endres
- Re: Interop runner with satellite links Behcet Sarikaya
- Re: [EToSat] Interop runner with satellite links Su, Chi-Jiun
- Re: [EToSat] Interop runner with satellite links Sebastian Endres
- Re: [EToSat] Interop runner with satellite links Su, Chi-Jiun
- Re: [EToSat] Interop runner with satellite links Joerg Deutschmann
- Re: [EToSat] Interop runner with satellite links Christian Huitema
- Re: [EToSat] Interop runner with satellite links Nicolas Kuhn
- Re: [EToSat] Interop runner with satellite links Christian Huitema
- Re: [EToSat] Interop runner with satellite links Su, Chi-Jiun
- Re: [EToSat] Interop runner with satellite links Su, Chi-Jiun
- Re: [EToSat] Interop runner with satellite links Christian Huitema
- Re: [EToSat] Interop runner with satellite links Su, Chi-Jiun
- Re: [EToSat] Interop runner with satellite links Joerg Deutschmann