[EToSat] Performance issue with QUIC on a satellite link with losses

PETROU Matthieu <Matthieu.PETROU@viveris.fr> Wed, 18 August 2021 13:06 UTC

Return-Path: <Matthieu.PETROU@viveris.fr>
X-Original-To: etosat@ietfa.amsl.com
Delivered-To: etosat@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1088F3A1894 for <etosat@ietfa.amsl.com>; Wed, 18 Aug 2021 06:06:49 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.901
X-Spam-Level:
X-Spam-Status: No, score=-1.901 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=viverislicensing.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id CT1MZJKsIrAo for <etosat@ietfa.amsl.com>; Wed, 18 Aug 2021 06:06:44 -0700 (PDT)
Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-eopbgr150105.outbound.protection.outlook.com [40.107.15.105]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 41A933A1891 for <etosat@ietf.org>; Wed, 18 Aug 2021 06:06:43 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=PQffxX9Argifb2S0tQ2Isvv47luGi/B/NGfY6uYm5UacGlGtt2p2YJ5GPlol8phL6QIjGMrQyGufsWvxJt5V+LNGBdlF1mCSACuhSxujc9Db+FB5zXtoNNxSziYHIxVoIJmHSvMuu05LSKnPdcAaPcK97GOnptVkrTcHRpnp4b5aPxIjdMXxK/Jq+2SkxH4kHuhQx2zhKXORrc9YoZuPDW+qVHlPDnvqeUOqgWjGq3pcm3bB2WW70GjscP7+7h9NYft+G+O3fK6QZphQNheyreIGMNtj1rZB/smdxsZRRTOR4dTCr5So3/ZGhhBALSjNjCBrgxw279ZUxuDkk5Ljlg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=pRiCxFGWJd99rPN3lTsQNoHLMIeohEuMJgJdeORpZSk=; b=AQJqpdwNuHrrAZVgBFSPgh/+fxN0IUjmMLkSGMhaUrWKVv3U/GzOpUv88cN9sXRUn3IewzqhIQ4P/ZeHfCdfVVGdVkjbybJCSiHEm2JNAtqDYj4uPr0L/fULDwKxLvFmkyK1OSRTQ6iDrbJl28V17drrpKHBrhN4uG+M7S4xKYYKrcZJYvXDNqaT9RdUIfgPEQYNJu+N8lhI7wgUYfPqRs8ZmDZSE4Rmr+5u+LkF3/3hlByzdbQ8TJSne+5Eq16/5ztQp9b0Nwwy9DHKK4IZrIPwpSy1xKAzakYzGXQvKGx9prH0Et3nNLRyBAL1SLEDsDBtJiOvoTpUe8Ow+AKZvA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=viveris.fr; dmarc=pass action=none header.from=viveris.fr; dkim=pass header.d=viveris.fr; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=viverislicensing.onmicrosoft.com; s=selector2-viverislicensing-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=pRiCxFGWJd99rPN3lTsQNoHLMIeohEuMJgJdeORpZSk=; b=wOp3viekgQQMiQJdctUu0MgAIyiYPNRNCpyRFnU6e8FlCHoV4cuZ/B4SaBctVba9RT/seLI87adINLW18u1AKaQVc/SXelJaPmUNHJpWT6N+UJr4xH/zTSRUc1PGNtIX4prrJoE90nbwuPOmK7sG8BVZjNP6vcZUD/JqhPRqM40=
Received: from VI1PR09MB2640.eurprd09.prod.outlook.com (2603:10a6:803:87::28) by VI1PR0901MB1613.eurprd09.prod.outlook.com (2603:10a6:800:84::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4415.18; Wed, 18 Aug 2021 13:06:40 +0000
Received: from VI1PR09MB2640.eurprd09.prod.outlook.com ([fe80::4cc2:4216:4c1a:8f3c]) by VI1PR09MB2640.eurprd09.prod.outlook.com ([fe80::4cc2:4216:4c1a:8f3c%6]) with mapi id 15.20.4415.024; Wed, 18 Aug 2021 13:06:39 +0000
From: PETROU Matthieu <Matthieu.PETROU@viveris.fr>
To: "etosat@ietf.org" <etosat@ietf.org>
Thread-Topic: Performance issue with QUIC on a satellite link with losses
Thread-Index: AQHXlDGm6u+do5hV7EKkcixA3w6ebg==
Date: Wed, 18 Aug 2021 13:06:39 +0000
Message-ID: <VI1PR09MB2640EF103CEE6C502F94536E9EFF9@VI1PR09MB2640.eurprd09.prod.outlook.com>
Accept-Language: fr-FR, en-US
Content-Language: fr-FR
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: ietf.org; dkim=none (message not signed) header.d=none;ietf.org; dmarc=none action=none header.from=viveris.fr;
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 620be0f1-3a35-485b-4cb2-08d96249049a
x-ms-traffictypediagnostic: VI1PR0901MB1613:
x-microsoft-antispam-prvs: <VI1PR0901MB16131FD4E6C880A93C52D8559EFF9@VI1PR0901MB1613.eurprd09.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:3044;
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 2LLFCh2kGXF0JuTUVd1h0N2YvVmR6PwvGGFH8szQISDbmOjpQLPnRJ5L1/K1UgNdu7fKbDXg8IcCtpR7ESz1Soh01o9+MiOGpPCWTlU7ksYAO+0hVSOSyFGXHrTb9wSuObGljZQXAfKHqssBD3RllQxDzgyiS+OThDgE7u1EvsS2mpAJsPruaEqYCH72OZH5EoV45yPP4c+0HfO4Hih5b31hXZyDS7Slr31ZWQsBp3EMm4kWZr2OQ0jDHaYiRcJQy/O0Mjhbt/8ZXJn4KyYcX3pSDcfUsaNf5xZKdknObhgWQa8tiJRQX3XqCO+EoknFxwVFIKtNZ4aCFmQpDxXkkgJbBXiGSXX8oq11nZdU22FTCNg/WPWc0gcif7PIRlbuq1l0tRdhP5RELtYyOQbU4IyPUZrRFa6yHVaxpzM+X6nGnwA2SiQlnr0DdADqOlDT7EjjEUvsWrjWke4rl2lUajEAS+Rli3qy7TtrG+1UrjYRF0SVhrk6pV9Qd49uoPwiiCQDAuELluSHWeW3gzGRyIuZjFxfurB+bfUBVBpElru8ai5tLo2lsZN6dzOBwBA54N2wr9GldcrgT+SKqLimkNwtYUbXgCk0dP5zJr3D9PGgr1v4uprQ8wvRSNYG2wk2/NTtcbaJiEL0GBSJoiaK9usLGZFlzfiMZTrc6NK0N5kePnt53MsY9O60yFRxFr3BSH6NVMygsmn7Q+cgMZ6yLg==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:VI1PR09MB2640.eurprd09.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(346002)(396003)(376002)(39840400004)(136003)(122000001)(76116006)(478600001)(8936002)(38100700002)(8676002)(6916009)(186003)(38070700005)(66556008)(91956017)(26005)(6506007)(316002)(66946007)(66476007)(64756008)(66446008)(2906002)(5660300002)(86362001)(19627405001)(52536014)(9686003)(83380400001)(33656002)(71200400001)(7696005)(55016002); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?Windows-1252?Q?OPp/afOFlAUG0YuqNDAmpPfYTY+yuboJOXLl42xXVQU4lXRYGLAUc1U2?= =?Windows-1252?Q?VHMAY4prIzLRZ9JUFit9QTmoBURfx7UaAMtHHI3fkqI2CQHm64W5Ired?= =?Windows-1252?Q?owxrhog5wRaWB9N0zKxImgoJsP8GTzKvnwM5VH/6/SclBD8UUjLmxKPv?= =?Windows-1252?Q?UXJcH2a7LF3eIS0ZQWrynEqZcEdqyyrb6Ws5q6zP8dBjmMSMdBa+vfh4?= =?Windows-1252?Q?PWapTw2vFZ8N4Pj+Z7XcZ9cvxHISi2tac9hypX9Hf8ksnvGx8rGXmKsY?= =?Windows-1252?Q?Dwr0sNzq8WimbDMfaBiS8uWzoTJlSvCsnApkEd2COWoxEVJKT3p/wl7Z?= =?Windows-1252?Q?adgFgobu4Cl/BoW1+GJZ/Nslj66U4zEABO13QEiKHUwC036WHnDIoW5j?= =?Windows-1252?Q?H0Sgz17fsZq/hZ6+/vQfezcl1h5OZyftSP78Y1laBRvFi0yjdyFAwYAc?= =?Windows-1252?Q?JaAkL5jAI1IpP9Xa51o7BqDoDbCLVbSD+0AhbgKHgPFZ+p0Nk0jAylzy?= =?Windows-1252?Q?3ScFCHvg1R7hz/+zIpVYfe5ygHehpk4zjIBN1ySWotF3I2ak4PA7nzMT?= =?Windows-1252?Q?uubiaWGBOZe2mxmGQmQVpkPsh5xvSglQQqsEYp6vg7B9uNeoy+nfCpJQ?= =?Windows-1252?Q?Ph8XSgqS+WQkmrvdyMiT2zzKhKKYHJ3gpBf/4rgIO2N8C/Nto/JgJhUr?= =?Windows-1252?Q?bPJRUkMMRUC/YE17eDMSPBB6jFtO51kJRNN21oLzd5LdOmz9y9XWcZMS?= =?Windows-1252?Q?DF/YchdQaerHuNdeOFhWQgmwzVUf3orETEeTUeMBQfmjdgvAWCHXZWN7?= =?Windows-1252?Q?zlOZ91MYUEHzCWL01jvp6MUXou0k23v/8Ho1ZSBN+TBGmulTWA6wvYSF?= =?Windows-1252?Q?npbBQtz1Ia3P2yFPj5ghHTICZs76hVZA4ZJm193l49SUZ2Sp8mgeCc2a?= =?Windows-1252?Q?Q2px0ZNaJNayUFlYRTZLPrjeu8R9OovOAxFl7wKPEd2KKVZblJmfpy8+?= =?Windows-1252?Q?MSTxgMPKfksi46sNFYZ3VL9iR1eqM4fKj2qYsXaKVAvv1ybUdtMfsA0w?= =?Windows-1252?Q?nZa292fCP+MsucM0IIGJKkFjldwGFN3gHrM7pVWgoBPWs+ojaawXFeq4?= =?Windows-1252?Q?cBevV2v2OLBqox2hlEwr5MJSfN27VwFjiuvNgJeNgsnwVci/l1KS3Qi9?= =?Windows-1252?Q?gKbDuPAtzfeLzAaXXIfNvN/h9Uc4O6BiwKO2/Jw+VI38a7BA/Z37Bdqm?= =?Windows-1252?Q?uLOq9WIW15fJQOwKcSSxf7/ZyXtlg2VZqUPUuZs8f6Gt2brCQUq2O9xg?= =?Windows-1252?Q?Zq8A4Xf2gOXS8rLGeChxJmPqvnRTo6+7p+O1Y3TQS7pDpxZeMw5e42DA?= =?Windows-1252?Q?tLo1pvIomSU8UPMQ4MyUNUT3BhmWbyM6O+4=3D?=
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_VI1PR09MB2640EF103CEE6C502F94536E9EFF9VI1PR09MB2640eurp_"
MIME-Version: 1.0
X-OriginatorOrg: viveris.fr
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: VI1PR09MB2640.eurprd09.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 620be0f1-3a35-485b-4cb2-08d96249049a
X-MS-Exchange-CrossTenant-originalarrivaltime: 18 Aug 2021 13:06:39.7222 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 34bab81c-945c-43f1-ad13-592b97e11b40
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: dnIUWtw9rjbG1yfxnKbdkkGnfo3zSld3+XdN7W8QpuCJkRMif2nNIwIdOHOnC63JCb7F4wmCP+HkxXYVnvQhxzVuWt0RUhjJkcy7AOo1aGE=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR0901MB1613
Archived-At: <https://mailarchive.ietf.org/arch/msg/etosat/nzPt18CjSVewPtBCehH743CFIHo>
Subject: [EToSat] Performance issue with QUIC on a satellite link with losses
X-BeenThere: etosat@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "The EToSat list is a non-WG mailing list used to discuss performance implications of running encrypted transports such as QUIC over satellite." <etosat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/etosat>, <mailto:etosat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/etosat/>
List-Post: <mailto:etosat@ietf.org>
List-Help: <mailto:etosat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/etosat>, <mailto:etosat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 18 Aug 2021 13:06:49 -0000

Hello everyone,


I’m currently running some tests to compare the download time of QUIC (picoquic) and TCP (iperf3) on a satellite connection, and I saw some wide differences in the results that I wanted to share with you.


I use OpenSAND to emulate the satellite link. The bandwidth between the server and the client is 12 Mb/s on the forward link, and 3 Mb/s on the return link. The buffer size is fixed on the gateway to a bit more than BDP (1.2 times the BDP). I emulate packet losses with time traces, generated with the modele Gilbert and Elliot, with p = 0.01 and q = 0.167. Overall, there is 2.56% of loss time with an average burst length of 16.70ms and a maximum burst length of 43ms.


For the tests, I download either 20 MB of data with iperf3 and picoquic. Either there is only one flow which downloads 20 MB, or five concurrent flows, with each one of them downloading 20 MB. To be able to compare the concurrent flows, I launch 5 different iperf3 and picoquic threads for each flow (on different ports). Both QUIC and TCP are using CUBIC and have hystart disabled. I’m using iperf 3.7+ (cJSON 1.5.2) and picoquic v0.34f.


Here is the download time medians and the standard deviation of 30 tests in those conditions :

Configuration

Download time median (s)

Standard Deviation (s)

1 TCP flow

91.42

47.48

1 QUIC flow

278.39

172.45

5 TCP flows

163.35

50.16

5 QUIC flows

400.74

127.81


If I remove all link losses, here is the download time medians and the standard deviation of 30 tests :

Configuration

Download time median (s)

Standard Deviation (s)

1 TCP flow

17.84

0.34

1 QUIC flow

18.35

0.20

5 TCP flows

65.29

8.73

5 QUIC flows

74.46

7.61


With those results, it seems that QUIC (picoquic) is way more impacted by losses on a satellite link. However, I don’t really understand why, as both are using CUBIC algorithm and hystart is disabled.


Is there something I’m missing here?

Thanks in advance for your help,
Matthieu