A test suite for QUIC

Maxime Piraux <maxime.piraux@student.uclouvain.be> Fri, 09 March 2018 10:33 UTC

Return-Path: <maxime.piraux@student.uclouvain.be>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 14CCA12AF83 for <quic@ietfa.amsl.com>; Fri, 9 Mar 2018 02:33:57 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.919
X-Spam-Level:
X-Spam-Status: No, score=-1.919 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H4=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=uclouvain.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zVUiQNxz81k3 for <quic@ietfa.amsl.com>; Fri, 9 Mar 2018 02:33:55 -0800 (PST)
Received: from EUR03-VE1-obe.outbound.protection.outlook.com (mail-eopbgr50118.outbound.protection.outlook.com [40.107.5.118]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7213D12426E for <quic@ietf.org>; Fri, 9 Mar 2018 02:33:54 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uclouvain.onmicrosoft.com; s=selector1-student-uclouvain-be; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=ek6ogtueeOdNBR4WYT8TGKlmKV//yuikokc0Ks6tf1Q=; b=TbJ1aFODoR/9eoqnzDA+4JGR2SVag1zxGrutYNsn4srNj6UOHEeOWXn2iL80+5HTpiVlvidSjeOhEJj1ET9aBQMLQDVhic+XDmi5/IaLlqTZCVVENOZBExtg8BHwEQU+PdO+Z5BT55H1gWVVD8UEdXrPbTLXf/1NNWxgQCe0umc=
Received: from VI1PR0301MB2336.eurprd03.prod.outlook.com (10.168.133.138) by VI1PR0301MB2175.eurprd03.prod.outlook.com (10.169.132.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.548.13; Fri, 9 Mar 2018 10:33:51 +0000
Received: from VI1PR0301MB2336.eurprd03.prod.outlook.com ([fe80::ddb2:f6d1:6a31:6a05]) by VI1PR0301MB2336.eurprd03.prod.outlook.com ([fe80::ddb2:f6d1:6a31:6a05%13]) with mapi id 15.20.0548.018; Fri, 9 Mar 2018 10:33:51 +0000
From: Maxime Piraux <maxime.piraux@student.uclouvain.be>
To: "quic@ietf.org" <quic@ietf.org>
CC: Olivier Bonaventure <olivier.bonaventure@uclouvain.be>, Quentin De Coninck <quentin.deconinck@uclouvain.be>
Subject: A test suite for QUIC
Thread-Topic: A test suite for QUIC
Thread-Index: AQHTt5DqeDJR1yKUQ0GDhWcguNp6Zg==
Date: Fri, 9 Mar 2018 10:33:51 +0000
Message-ID: <VI1PR0301MB23363F9B2EA3F54F14B912B4D8DE0@VI1PR0301MB2336.eurprd03.prod.outlook.com>
Accept-Language: fr-FR, en-US
Content-Language: fr-FR
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=maxime.piraux@student.uclouvain.be;
x-originating-ip: [2001:6a8:308f:5:266e:96ff:fe14:144d]
x-ms-publictraffictype: Email
x-microsoft-exchange-diagnostics: 1; VI1PR0301MB2175; 7:9Tm26PUYwrq7MoGAY4OYHjTMWf28BbgJgXQysuoCJrTlI5qkiSc0nHRkV7Y/wXQr8ttmff0qBRjohVDnjvCq6MOVF29q0CBYcDnxgKIX7IRUxbAa8/O6do+QOyeCyAS9GSW1HfvX7X5z7dervAlM8zwi9Zi8HrL6OOVPMTJ8tmyw28lJpanpO3YKaCdvHGb6gkp4KiiHQhx8CUwZxFlnxi9EJ1IZsKoR4HXqnspsVEDtg5VVBV59XGGYOplHT9QX
x-ms-exchange-antispam-srfa-diagnostics: SSOS;
x-ms-office365-filtering-correlation-id: b55e66b8-f821-4d20-bc9e-08d585a94004
x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(5600026)(4604075)(3008032)(2017052603328)(7153060)(7193020); SRVR:VI1PR0301MB2175;
x-ms-traffictypediagnostic: VI1PR0301MB2175:
x-ld-processed: 7ab090d4-fa2e-4ecf-bc7c-4127b4d582ec,ExtAddr
x-microsoft-antispam-prvs: <VI1PR0301MB2175E5E8024069A2A7009050D8DE0@VI1PR0301MB2175.eurprd03.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:;
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(5005006)(8121501046)(3231220)(944501244)(52105095)(3002001)(10201501046)(93006095)(93001095)(6041310)(201703131423095)(201702281529075)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123562045)(20161123560045)(20161123558120)(20161123564045)(6072148)(201708071742011); SRVR:VI1PR0301MB2175; BCL:0; PCL:0; RULEID:; SRVR:VI1PR0301MB2175;
x-forefront-prvs: 0606BBEB39
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(396003)(346002)(39850400004)(39380400002)(366004)(376002)(189003)(55674003)(199004)(5640700003)(81166006)(74316002)(6116002)(6506007)(1730700003)(81156014)(102836004)(478600001)(8936002)(6436002)(4326008)(97736004)(8676002)(786003)(3280700002)(316002)(54906003)(7736002)(9686003)(53936002)(2501003)(6916009)(6606003)(74482002)(55016002)(14454004)(46003)(2900100001)(105586002)(3660700001)(54896002)(25786009)(7696005)(53336002)(6306002)(5250100002)(107886003)(106356001)(86362001)(33656002)(99286004)(68736007)(2906002)(413944005)(5660300001)(966005)(19627405001)(2351001); DIR:OUT; SFP:1102; SCL:1; SRVR:VI1PR0301MB2175; H:VI1PR0301MB2336.eurprd03.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:0; LANG:en;
received-spf: None (protection.outlook.com: student.uclouvain.be does not designate permitted sender hosts)
x-microsoft-antispam-message-info: 8ie9lCZFP11lwajema2Jo1M++WBkl9YbLgVNY/DynK4bdeMbEkliRiB8ETZ79jwpd8hj7yrWB+Hau61zEbStYFUvhEQO4aSyRmgGXwadUmYNbT7WeqB5byHBRNo/bNjJBzPS5sB6VzoJHoSzY6UOXWKAfHxNfZ6uAB3Q5ypgG8Y9Akxi6iaU1DaPjAOMms+47h9dqIOhhhP5a21XMaFJH9xGZ8dcoEZ49tmGE8Ktg3vgi44Cbu1AlYpQEZd6lKEY/uMjlSVglOjfqC7D9hysS2xpfsb++E9rYmnu1pnzk4mFFQmY2JdWg6cBm/Zd9XKY3VPXCN+Iku907qNMi3/TrA==
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/alternative; boundary="_000_VI1PR0301MB23363F9B2EA3F54F14B912B4D8DE0VI1PR0301MB2336_"
MIME-Version: 1.0
X-OriginatorOrg: student.uclouvain.be
X-MS-Exchange-CrossTenant-Network-Message-Id: b55e66b8-f821-4d20-bc9e-08d585a94004
X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Mar 2018 10:33:51.1875 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 7ab090d4-fa2e-4ecf-bc7c-4127b4d582ec
X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR0301MB2175
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/_cgeD-MgRlyImUxMaeYgZbq1KhM>
X-Mailman-Approved-At: Fri, 09 Mar 2018 02:41:51 -0800
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 09 Mar 2018 10:35:42 -0000

Dear all,


I am working at UCLouvain with Quentin De Coninck and Olivier Bonaventure on a test suite for IETF QUIC. I have implemented a minimal client library, based on which I wrote test scenarii. It is currently draft-09 and TLS-1.3-draft-23 compatible. Each scenario is aimed at testing a particular feature of QUIC. A host runs the test suite daily and its results are available at https://quic-tracker.info.ucl.ac.be/. All public test servers as listed in the working group's GitHub wiki are tested currently.

For each test, a result comprising the full decrypted bytes exchanged during the test is included and can be viewed directly on the website. Each packet is dissected a la Wireshark. Some tests only collect metrics about the implementation, others do real testing of the implementation behavior with regard to the specification.

The website is certainly not perfectly user-friendly at the moment, but I hope it will provide you interesting facts about the public implementations.

I have plans to implement a lot more test scenarii in the near future. The source code will be released as indicated in the About page before IETF 101.
I will take part in the IETF 101 Hackathon. This is a good opportunity if you wish to provide me some feedback about my work and what I can improve.
You can of course also contact me by email in the meantime.


Best regards,
Maxime Piraux