Re: [EToSat] Side-meeting on QUIC over high BDP ?

Joerg Deutschmann <joerg.deutschmann@fau.de> Wed, 09 October 2019 19:51 UTC

Return-Path: <joerg.deutschmann@fau.de>
X-Original-To: etosat@ietfa.amsl.com
Delivered-To: etosat@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8DAAA120B24 for <etosat@ietfa.amsl.com>; Wed, 9 Oct 2019 12:51:35 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.301
X-Spam-Level:
X-Spam-Status: No, score=-4.301 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=fau.de
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id hj2h872tcm0T for <etosat@ietfa.amsl.com>; Wed, 9 Oct 2019 12:51:33 -0700 (PDT)
Received: from mx-rz-2.rrze.uni-erlangen.de (mx-rz-2.rrze.uni-erlangen.de [IPv6:2001:638:a000:1025::15]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DEE971200F7 for <etosat@ietf.org>; Wed, 9 Oct 2019 12:51:32 -0700 (PDT)
Received: from mx-rz-smart.rrze.uni-erlangen.de (mx-rz-smart.rrze.uni-erlangen.de [IPv6:2001:638:a000:1025::1e]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (No client certificate requested) by mx-rz-2.rrze.uni-erlangen.de (Postfix) with ESMTPS id 46pPwy2Bd4zPkr2; Wed, 9 Oct 2019 21:51:30 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fau.de; s=fau-2013; t=1570650690; bh=MO7ow6Qc0NJlEo38sGXHB1kQPxwadyX6wNXSiznPM0A=; h=Subject:To:References:From:Cc:Date:In-Reply-To:From:To:CC: Subject; b=Sw93JP68cYbID28OHVBZ79GM4Quz8lGNXKcuO2mT1HdTp8Rfkrr4lcIn8w1CYzrMZ OO1ihV8fGb7TRmle7Ggjg7rDb3jt1fhAzbO+rcE9lrdcgVUiGwUhG73g0+R9pyxDbU U4lAdMES1Ffrz07mslSIg46GLT7b5G6GfbDeJycq/eJsWSR8geeIP4mYlKd70ZuSWf gGHmmho8SMa42k8A6vQiO/73uSjNdtT2WYkG+i9IgbtBqbAluNlIYs9OefgOT/Ad6W LFN6gFY+IAPQtMmFk8+YwyWE0rt+XX8RE9cKZgOVXE8DJ6Mi4P0pwQZHcTGA6yvwdk wNWn8eqxvG8oQ==
X-Virus-Scanned: amavisd-new at boeck1.rrze.uni-erlangen.de (RRZE)
X-RRZE-Flag: Not-Spam
X-RRZE-Submit-IP: 131.188.37.210
Received: from faui7s0.informatik.uni-erlangen.de (faui7s0.informatik.uni-erlangen.de [131.188.37.210]) by mailhub.rrze.uni-erlangen.de (Postfix) with ESMTP id 46pPwv3vBtzPn9d; Wed, 9 Oct 2019 21:51:27 +0200 (CEST)
Received: from [192.168.178.58] (x5f72297b.dyn.telefonica.de [95.114.41.123]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by faui7s0.informatik.uni-erlangen.de (Postfix) with ESMTPSA id 5D5A04069C37; Wed, 9 Oct 2019 21:51:27 +0200 (CEST)
To: gorry@erg.abdn.ac.uk
References: <F3B0A07CFD358240926B78A680E166FF1ECA0946@TW-MBX-P02.cnesnet.ad.cnes.fr> <5946f6f0-4c75-2ea2-ed88-3c86c2af923f@fau.de> <5D9DF946.8060100@erg.abdn.ac.uk>
From: Joerg Deutschmann <joerg.deutschmann@fau.de>
Cc: etosat@ietf.org
Message-ID: <6f2d5526-396f-4a00-29e6-9d8a2d15dad2@fau.de>
Date: Wed, 09 Oct 2019 21:51:24 +0200
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.8.0
MIME-Version: 1.0
In-Reply-To: <5D9DF946.8060100@erg.abdn.ac.uk>
Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg="sha-256"; boundary="------------ms050303010600000506000600"
Archived-At: <https://mailarchive.ietf.org/arch/msg/etosat/hHp2xDE8VOU49woqjFe6Opgta78>
Subject: Re: [EToSat] Side-meeting on QUIC over high BDP ?
X-BeenThere: etosat@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "The EToSat list is a non-WG mailing list used to discuss performance implications of running encrypted transports such as QUIC over satellite." <etosat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/etosat>, <mailto:etosat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/etosat/>
List-Post: <mailto:etosat@ietf.org>
List-Help: <mailto:etosat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/etosat>, <mailto:etosat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 09 Oct 2019 19:51:36 -0000

Hi,

in our latest measurements [1] we black-box tested different QUIC implementations and different European satellite operators. The QUIC implementations are quicly and ngtcp (both draft-22) and Chromium QUIC (Q046). The operators are Astra, Avanti and Tooway. We also added one testbed setup based on dummynet.

We requested a single 1 Mbyte object and plotted time-sequence diagrams (a) without packet losses and (b) with 1% random packet loss. We decrypted pcap traces (quicly and ngtcp) or used log files (Chromium Q046) to plot offset numbers and see retransmissions. Packet losses have a very negative impact which was already mentioned at previous meetings. There are performance differences among implementations as well as operators. Please refer to [1] for the graphs.

I think testing different implementations and operators is fine, but these black-box tests are somehow unsatisfying because they do not explain *why* there are differences. Especially while the implementations are work in progress. A more detailed analysis would be great, but we currently have very limited time available for the QUIC over satellite topic.

[1] www7content.cs.fau.de/~deutschmann/KaConf2019/KaConf2019_QUICoverSatellite_paper.pdf
(section 4 and 5)

Best regards,
Joerg



On 09.10.19 17:14, Gorry Fairhurst wrote:
> Hi,
> 
> Could you share the topic with us (what version of QUIC; what aspect 
> were you testing) - so we can plan ahead and coordinate.
> 
> Gorry
> 
> On 09/10/2019, 16:07, Joerg Deutschmann wrote:
>> Dear Nicolas,
>>
>> I'd like to join but probably can't make it to Singapore. We have some 
>> limited results which I just sent to this mailing list...
>>
>> Best regards,
>> Joerg
>>
>>
>>
>> On 03.10.19 10:10, Kuhn Nicolas wrote:
>>> Hi,
>>>
>>> We are planning a side-meeting at next IETF on “Performance evaluation
>>> of QUIC in various environments”.
>>>
>>> The main idea is to gather people evaluating QUIC when it comes to
>>> exploit paths with various characteristics – with a slight focus for
>>> high BDP networks.
>>>
>>> Evaluations of QUIC over satellite has been presented in multiple IETF
>>> sessions [1-5], but a dedicated session would enable to gather whoever
>>> is interested in this activity.
>>>
>>> Is anyone interested in presenting experimental results and/or attend
>>> such meeting ?
>>>
>>> Cheers,
>>>
>>> Nico, on the behalf of John, Gorry and Emile
>>>
>>> [1]
>>> https://datatracker.ietf.org/meeting/103/materials/slides-103-maprg-quic-and-satcom-nicolas-kuhn-01 
>>>
>>>
>>>
>>> [2]
>>> https://datatracker.ietf.org/meeting/104/materials/slides-104-maprg-satellite-internet-performance-measurements-jorg-deutschmann-01 
>>>
>>>
>>>
>>> [3]
>>> https://datatracker.ietf.org/meeting/105/materials/slides-105-maprg-measuring-quic-dynamics-over-a-high-delay-path-01 
>>>
>>>
>>>
>>> [4]
>>> https://datatracker.ietf.org/meeting/105/materials/slides-105-panrg-quic-over-satellite-00 
>>>
>>>
>>> [5]
>>> https://datatracker.ietf.org/meeting/105/materials/slides-105-panrg-quic-over-in-sequence-paths-with-different-characteristics-00 
>>>
>>>
>>>
>> _______________________________________________
>> EToSat mailing list
>> EToSat@ietf.org
>> https://www.ietf.org/mailman/listinfo/etosat
>