Re: [EToSat] [QUIC performance and SATCOM]

Joerg Deutschmann <joerg.deutschmann@fau.de> Mon, 14 October 2019 14:52 UTC

Return-Path: <joerg.deutschmann@fau.de>
X-Original-To: etosat@ietfa.amsl.com
Delivered-To: etosat@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 650AD120106 for <etosat@ietfa.amsl.com>; Mon, 14 Oct 2019 07:52:12 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.3
X-Spam-Level:
X-Spam-Status: No, score=-4.3 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=fau.de
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YLUFwCEaRnlK for <etosat@ietfa.amsl.com>; Mon, 14 Oct 2019 07:52:09 -0700 (PDT)
Received: from mx-rz-3.rrze.uni-erlangen.de (mx-rz-3.rrze.uni-erlangen.de [IPv6:2001:638:a000:1025::16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 224AE120103 for <etosat@ietf.org>; Mon, 14 Oct 2019 07:52:08 -0700 (PDT)
Received: from mx-rz-smart.rrze.uni-erlangen.de (mx-rz-smart.rrze.uni-erlangen.de [IPv6:2001:638:a000:1025::1e]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (No client certificate requested) by mx-rz-3.rrze.uni-erlangen.de (Postfix) with ESMTPS id 46sM3B1LGbz1yRB; Mon, 14 Oct 2019 16:52:06 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fau.de; s=fau-2013; t=1571064726; bh=rz/68hs1cM9h1a4+nEBAuJ4sw36HePUxEcBSpsXDjs4=; h=Subject:To:References:From:Date:In-Reply-To:From:To:CC:Subject; b=Za5cPGaVjCJ/4hudySmnFaZBbBUaVFNWiLv35hqz1/ytxInDyMxD+WMxjRw7BEJwH TgqLzkAPAOBQEPTNJAXcP+uhGcDIagJZ5wtobzFJknku7485AUcZCh0y58O+iBvUc8 XYXmD4uHYopi6WmygeG4d1M7CcEhU57p1tRpKvjTJpdgU3/UnnmEt+g8bBeDswlbU6 1VATK6FZHN29UEDkCHAIuFk4hs3asJrOOznYTupnBMpt4hRhciqjjLF/15tkunfbrY sRShRub+BPqoEJpSGovfkZ1beV7xkAlo6HbTEg4I+Q79+/wa5Vgp0pTJXjOVBHFMlu LsqLaPeXaNqFg==
X-Virus-Scanned: amavisd-new at boeck2.rrze.uni-erlangen.de (RRZE)
X-RRZE-Flag: Not-Spam
X-RRZE-Submit-IP: 131.188.37.210
Received: from faui7s0.informatik.uni-erlangen.de (faui7s0.informatik.uni-erlangen.de [131.188.37.210]) by mailhub.rrze.uni-erlangen.de (Postfix) with ESMTP id 46sM373Cx7z206W; Mon, 14 Oct 2019 16:52:03 +0200 (CEST)
Received: from [10.20.10.42] (faustaff-010-020-010-042.pool.uni-erlangen.de [10.20.10.42]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by faui7s0.informatik.uni-erlangen.de (Postfix) with ESMTPSA id 5E0D540E43D0; Mon, 14 Oct 2019 16:52:03 +0200 (CEST)
To: etosat@ietf.org, Emmanuel Lochin <emmanuel.lochin@isae-supaero.fr>
References: <F3B0A07CFD358240926B78A680E166FF176933C4@TW-MBX-P02.cnesnet.ad.cnes.fr> <2f287d44-4a03-372d-533a-bd15ab82e7f3@fau.de> <504dc62e-16c0-b31f-d5de-ea50d907090d@fau.de> <20191010104538.GB47251@tom-desk.erg.abdn.ac.uk> <6c9ece74-dab4-5888-0e7f-886431c2aed4@isae-supaero.fr>
From: Joerg Deutschmann <joerg.deutschmann@fau.de>
Message-ID: <306d5a95-a9af-f065-b357-c6bd332a7aa7@fau.de>
Date: Mon, 14 Oct 2019 16:52:00 +0200
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.9.0
MIME-Version: 1.0
In-Reply-To: <6c9ece74-dab4-5888-0e7f-886431c2aed4@isae-supaero.fr>
Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg="sha-256"; boundary="------------ms070504050207010906060907"
Archived-At: <https://mailarchive.ietf.org/arch/msg/etosat/sJN_mvonUhNpISXy6szHBGi07oY>
Subject: Re: [EToSat] [QUIC performance and SATCOM]
X-BeenThere: etosat@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "The EToSat list is a non-WG mailing list used to discuss performance implications of running encrypted transports such as QUIC over satellite." <etosat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/etosat>, <mailto:etosat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/etosat/>
List-Post: <mailto:etosat@ietf.org>
List-Help: <mailto:etosat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/etosat>, <mailto:etosat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 14 Oct 2019 14:52:13 -0000

Dear Emmanuel,

thank you. I've been aware of OpenSAND for some time, but did not try it yet. The paper certainly is interesting.

When using NetEm, our results were worse than using real links or dummynet. The reason may be that we do not have specific NetEm/tbf settings for satellite links. If anybody has, please tell me. With dummynet the results matched the measurements from real satellite links quite well.

Despite the benefits of OpenSAND, I'm afraid that a lot of developers will stick to the emulation tools they are used to. Therefore, I think it would also be interesting to see how satellite links perform with the ns-3 QUIC benchmarking framework [1].

[1] https://github.com/marten-seemann/quic-network-simulator

Best regards,
Joerg




On 10.10.19 13:52, Emmanuel Lochin wrote:
> Dear Joerg, Tom,
> 
> If you attempt to mimic a satellite link with Netem or Dummynet, you 
> might be interested in having a better emulation system such as OpenSAND 
> : http://opensand.org/
> If you need to be convinced by the capabilities of OpenSAND, check this 
> paper : "Making Trustable Satellite Experiments: an Application to a 
> VoIP Scenario" available here : http://oatao.univ-toulouse.fr/21907/
> 
> EL
> 
> Le 10/10/2019 à 12:45, Tom Jones a écrit :
>> On Wed, Oct 09, 2019 at 04:55:58PM +0200, Joerg Deutschmann wrote:
>>> Dear all,
>>>
>>> we continued our QUIC over satellite performance measurements with
>>> different operators and QUIC implementations. Unfortunately, these are
>>> still only black-box tests. The results were presented at the 25th
>>> KaConf. The related paper [1] also gives an introduction to QUIC,
>>> therefore you probably want to skip to section 4 and 5.
>>>
>>> [1] 
>>> www7content.cs.fau.de/~deutschmann/KaConf2019/KaConf2019_QUICoverSatellite_paper.pdf 
>>>
>> Hi,
>>
>> thanks for sharing these results.
>>
>> Could you expand, maybe off list, the problems you had with netem and
>> Linux?
>>
>> We have network emulation testbeds here using both dummynet on FreeBSD
>> and netem on Linux and with some work we managed to get similar network
>> charactaristics out of both. I do wonder if we might have missed 
>> something
>> that you have seen though.
>>
>>
>>> Best regards,
>>> Joerg
>>>
>>>
>>>
>>>
>>> On 15.02.19 16:48, Joerg Deutschmann wrote:
>>>> Dear all,
>>>>
>>>> thanks for the link to this interesting paper. We did some related 
>>>> work,
>>>> which you might be interested in. It will be presented at the NetSys
>>>> 2019 conference [1]. A version is available at [2].
>>>>
>>>> While your "QUIC and SATCOM" paper provides more details regarding
>>>> HTTP/2 vs. QUIC, we took a broader view. We measured page load times
>>>> over HTTP(S)/1.1 and HTTP/2, with and without VPNs. Additionally we set
>>>> up two Quic servers (Chromium QUIC and quic-go). All tests were run 
>>>> with
>>>> three different satellite internet providers, showing quite some
>>>> differences...
>>>>
>>>> Best regards,
>>>> Joerg
>>>>
>>>> [1] www.netsys2019.org
>>>> [2] www7content.cs.fau.de/~deutschmann/NetSys2019_preprint.pdf
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On 09.11.18 04:35, Kuhn Nicolas wrote:
>>>>> Dear all,
>>>>>
>>>>> We have recently posted on ArXiv an article on QUIC and its
>>>>> performance over a GEO SATCOM link.
>>>>>
>>>>> https://arxiv.org/pdf/1810.04970.pdf
>>>>>
>>>>> This paper has been presented at IETF 103 @MAPRG
>>>>> https://datatracker.ietf.org/meeting/103/materials/agenda-103-maprg-00
>>>>>
>>>>> The code used to run these experiments is available, so do not
>>>>> hesitate to contact us if you want to reproduce our experiments.
>>>>>
>>>>> Kind regards,
>>>>>
>>>>> Ludovic Thomas (ISAE-SUPAERO), Emmanuel Dubois (CNES), Nicolas Kuhn
>>>>> (CNES), Emmanuel Lochin (ISAE-SUPAERO)
>>>>>
>>
>>
>>> _______________________________________________
>>> EToSat mailing list
>>> EToSat@ietf.org
>>> https://www.ietf.org/mailman/listinfo/etosat
>>
>