Re: [EToSat] [QUIC performance and SATCOM]

Kuhn Nicolas <Nicolas.Kuhn@cnes.fr> Tue, 15 October 2019 06:48 UTC

Return-Path: <Nicolas.Kuhn@cnes.fr>
X-Original-To: etosat@ietfa.amsl.com
Delivered-To: etosat@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B72F212006A for <etosat@ietfa.amsl.com>; Mon, 14 Oct 2019 23:48:03 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level:
X-Spam-Status: No, score=-1.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id G1F1H-t9ldKx for <etosat@ietfa.amsl.com>; Mon, 14 Oct 2019 23:48:01 -0700 (PDT)
Received: from mx2.cnes.fr (mx2.cnes.fr [194.199.174.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A2BA012004E for <etosat@ietf.org>; Mon, 14 Oct 2019 23:48:00 -0700 (PDT)
X-IronPort-AV: E=Sophos;i="5.67,298,1566864000"; d="scan'208";a="30074585"
X-IPAS-Result: A2EWAAD3aqVd/wUBeApMGhoBAQEBAQEBAQEDAQEBAREBAQECAgEBAQGBagIBAQEBCwGCH1kTdBIqCoQbkG+ZQIFfCAkBAQEBAQEBAQEgCwkBAgEBg3tFAheCTyQ3Bg4CDAEBAQQBAQEBAQUCAQECAmmEa0IMhiABAQEBAQIBASERFR8GGwIBBQMNCwICBiACAgIlCxUQAgQBEgiDG4J3DzmtLXWBMhqEHgEDBIYEgQwoAYFkhjaBaoQggRFGgU5+PoJhAQEBAoEmOgoLgncygiwEjHSCeJ1YB4E3boIvhFmFTIhgdIFGcoZchBkDixyNYU2CbYNngU+TJiSBWDMaJ0yCbAlHEIFvF4NQM4ELg1aFP0QwAYEgCI4kAYEiAQE
X-URL-LookUp-ScanningError: 1
From: Kuhn Nicolas <Nicolas.Kuhn@cnes.fr>
To: 'Joerg Deutschmann' <joerg.deutschmann@fau.de>, "etosat@ietf.org" <etosat@ietf.org>, Emmanuel Lochin <emmanuel.lochin@isae-supaero.fr>
Thread-Topic: [EToSat] [QUIC performance and SATCOM]
Thread-Index: AQHVgp78S+iuesXRV0WbvECdyAGNVqdbQuXw
Date: Tue, 15 Oct 2019 06:46:57 +0000
Deferred-Delivery: Tue, 15 Oct 2019 06:47:57 +0000
Message-ID: <F3B0A07CFD358240926B78A680E166FF1ECB4E11@TW-MBX-P03.cnesnet.ad.cnes.fr>
References: <F3B0A07CFD358240926B78A680E166FF176933C4@TW-MBX-P02.cnesnet.ad.cnes.fr> <2f287d44-4a03-372d-533a-bd15ab82e7f3@fau.de> <504dc62e-16c0-b31f-d5de-ea50d907090d@fau.de> <20191010104538.GB47251@tom-desk.erg.abdn.ac.uk> <6c9ece74-dab4-5888-0e7f-886431c2aed4@isae-supaero.fr> <306d5a95-a9af-f065-b357-c6bd332a7aa7@fau.de>
In-Reply-To: <306d5a95-a9af-f065-b357-c6bd332a7aa7@fau.de>
Accept-Language: fr-FR, en-US
Content-Language: fr-FR
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-tm-as-product-ver: SMEX-11.0.0.4255-8.100.1062-24978.005
x-tm-as-result: No--29.692300-0.000000-31
x-tm-as-user-approved-sender: Yes
x-tm-as-user-blocked-sender: No
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
Archived-At: <https://mailarchive.ietf.org/arch/msg/etosat/Sac-j__rhhAEHKoeCbhNKpODZQc>
Subject: Re: [EToSat] [QUIC performance and SATCOM]
X-BeenThere: etosat@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "The EToSat list is a non-WG mailing list used to discuss performance implications of running encrypted transports such as QUIC over satellite." <etosat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/etosat>, <mailto:etosat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/etosat/>
List-Post: <mailto:etosat@ietf.org>
List-Help: <mailto:etosat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/etosat>, <mailto:etosat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 15 Oct 2019 06:48:04 -0000

Dear Joerg,

If you have any issues in using OpenSAND, do not hesitate to let me know. 

If you are interested in integrate satellite links in the ns-3 QUIC benchmarking framework, you may want to look at SNS-3 : http://www.sns3.org/content/home.php 

Kind regards, 

Nicolas

-----Message d'origine-----
De : EToSat <etosat-bounces@ietf.org> De la part de Joerg Deutschmann
Envoyé : lundi 14 octobre 2019 16:52
À : etosat@ietf.org; Emmanuel Lochin <emmanuel.lochin@isae-supaero.fr>
Objet : Re: [EToSat] [QUIC performance and SATCOM]

Dear Emmanuel,

thank you. I've been aware of OpenSAND for some time, but did not try it yet. The paper certainly is interesting.

When using NetEm, our results were worse than using real links or dummynet. The reason may be that we do not have specific NetEm/tbf settings for satellite links. If anybody has, please tell me. With dummynet the results matched the measurements from real satellite links quite well.

Despite the benefits of OpenSAND, I'm afraid that a lot of developers will stick to the emulation tools they are used to. Therefore, I think it would also be interesting to see how satellite links perform with the ns-3 QUIC benchmarking framework [1].

[1] https://github.com/marten-seemann/quic-network-simulator

Best regards,
Joerg




On 10.10.19 13:52, Emmanuel Lochin wrote:
> Dear Joerg, Tom,
> 
> If you attempt to mimic a satellite link with Netem or Dummynet, you 
> might be interested in having a better emulation system such as 
> OpenSAND
> : http://opensand.org/
> If you need to be convinced by the capabilities of OpenSAND, check 
> this paper : "Making Trustable Satellite Experiments: an Application 
> to a VoIP Scenario" available here : 
> http://oatao.univ-toulouse.fr/21907/
> 
> EL
> 
> Le 10/10/2019 à 12:45, Tom Jones a écrit :
>> On Wed, Oct 09, 2019 at 04:55:58PM +0200, Joerg Deutschmann wrote:
>>> Dear all,
>>>
>>> we continued our QUIC over satellite performance measurements with 
>>> different operators and QUIC implementations. Unfortunately, these 
>>> are still only black-box tests. The results were presented at the 
>>> 25th KaConf. The related paper [1] also gives an introduction to 
>>> QUIC, therefore you probably want to skip to section 4 and 5.
>>>
>>> [1]
>>> www7content.cs.fau.de/~deutschmann/KaConf2019/KaConf2019_QUICoverSat
>>> ellite_paper.pdf
>>>
>> Hi,
>>
>> thanks for sharing these results.
>>
>> Could you expand, maybe off list, the problems you had with netem and 
>> Linux?
>>
>> We have network emulation testbeds here using both dummynet on 
>> FreeBSD and netem on Linux and with some work we managed to get 
>> similar network charactaristics out of both. I do wonder if we might 
>> have missed something that you have seen though.
>>
>>
>>> Best regards,
>>> Joerg
>>>
>>>
>>>
>>>
>>> On 15.02.19 16:48, Joerg Deutschmann wrote:
>>>> Dear all,
>>>>
>>>> thanks for the link to this interesting paper. We did some related 
>>>> work, which you might be interested in. It will be presented at the 
>>>> NetSys
>>>> 2019 conference [1]. A version is available at [2].
>>>>
>>>> While your "QUIC and SATCOM" paper provides more details regarding
>>>> HTTP/2 vs. QUIC, we took a broader view. We measured page load 
>>>> times over HTTP(S)/1.1 and HTTP/2, with and without VPNs. 
>>>> Additionally we set up two Quic servers (Chromium QUIC and 
>>>> quic-go). All tests were run with three different satellite 
>>>> internet providers, showing quite some differences...
>>>>
>>>> Best regards,
>>>> Joerg
>>>>
>>>> [1] www.netsys2019.org
>>>> [2] www7content.cs.fau.de/~deutschmann/NetSys2019_preprint.pdf
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On 09.11.18 04:35, Kuhn Nicolas wrote:
>>>>> Dear all,
>>>>>
>>>>> We have recently posted on ArXiv an article on QUIC and its 
>>>>> performance over a GEO SATCOM link.
>>>>>
>>>>> https://arxiv.org/pdf/1810.04970.pdf
>>>>>
>>>>> This paper has been presented at IETF 103 @MAPRG
>>>>> https://datatracker.ietf.org/meeting/103/materials/agenda-103-mapr
>>>>> g-00
>>>>>
>>>>> The code used to run these experiments is available, so do not 
>>>>> hesitate to contact us if you want to reproduce our experiments.
>>>>>
>>>>> Kind regards,
>>>>>
>>>>> Ludovic Thomas (ISAE-SUPAERO), Emmanuel Dubois (CNES), Nicolas 
>>>>> Kuhn (CNES), Emmanuel Lochin (ISAE-SUPAERO)
>>>>>
>>
>>
>>> _______________________________________________
>>> EToSat mailing list
>>> EToSat@ietf.org
>>> https://www.ietf.org/mailman/listinfo/etosat
>>
>