[CFRG] Re: Where should test vectors live?

Peter Gutmann <pgut001@cs.auckland.ac.nz> Fri, 20 September 2024 09:06 UTC

Return-Path: <pgut001@cs.auckland.ac.nz>
X-Original-To: cfrg@ietfa.amsl.com
Delivered-To: cfrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B9CAAC14F5F4 for <cfrg@ietfa.amsl.com>; Fri, 20 Sep 2024 02:06:29 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.008
X-Spam-Level:
X-Spam-Status: No, score=-2.008 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=cs.auckland.ac.nz
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id IMrFUJhG4Cka for <cfrg@ietfa.amsl.com>; Fri, 20 Sep 2024 02:06:25 -0700 (PDT)
Received: from AUS01-SY4-obe.outbound.protection.outlook.com (mail-sy4aus01on20727.outbound.protection.outlook.com [IPv6:2a01:111:f403:201e::727]) (using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 69344C14F600 for <cfrg@irtf.org>; Fri, 20 Sep 2024 02:06:25 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=FWedBFpeRVScgQWj1xwYCkS07sPePsmTYypKIdLfn7nHvBgrjLHvaVTemv2BVuPTyo8dYOHTEqPYy/eHaPgdy8g9PwzN/dEIVZZIfv5dLgg5SrHZbCPodcqo16p/pb19HMBAd3mZgMH4roBJfFQbA7KiDIZ9tCiD9Za8L9CniMtKMb2BF+RWP1NS77rUCvBh+rYBOkXiEe4K430MmOI4uVhpajha/UjUQcxPujsRB6uQz/N3JsVIWs/ayBPmX8j1mTLjoii7kBwmCqz97vhRJj4FlrKFUWfyWBS36e6uk+X3BB0WFCmX/3mbJfqJNLMs2eeE0dhSzvNhi2dLgw4WbQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=wsbyyKwMdAR1dDHdhKGLbZEwpXJ3862lIJ/f+BV4WDU=; b=uzuICVrj48ijUxiVXb75yr600zfsBsO/AF8XpXL3JEAWAam4vD/NRSg6Xta/p3gljWRhUyeaAmj1omtW8hRePvCNaxL1hzoLSIRk9L9ed2iPFGKSZDFc+0DqtdCppNUeUEe2BSqbAZ2AZm+ck1zO5vp20xwNApLTQIC8Sdf5prKGtqQ1ZGRaay6Y23ZDvojspJ2RHAz9Ljqvl6/7k5CuVJyMfDuth7CnYRmrSLBMdZU2h+8d/K4mf4JnLEmLCWrU4i73BH5Un+lBMa4MoG2L96hqqUIZ3QNsazyJnEFATcFSxbPvIkCOoujoBS2D4TjEXIYOepDLBeQac0rq1239Pg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cs.auckland.ac.nz; dmarc=pass action=none header.from=cs.auckland.ac.nz; dkim=pass header.d=cs.auckland.ac.nz; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cs.auckland.ac.nz; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=wsbyyKwMdAR1dDHdhKGLbZEwpXJ3862lIJ/f+BV4WDU=; b=p2h9xfrEcLWcWXXhuOfcuBbQ6RKJQZ3jjKnMq3WJkiYseuXvc9ysK9Emt7pWc11RNiW+HmqlbS1RegDForgrxcVN1nTtOA46GdWKhU+HuVN7+P8dtCCVgGXuoAr/UzPYxj0JuTr5GMlPlpuJEy/l+gKggk0Dn4BRnOE82lVst9lN16xCkspr4W1cMI//RxXAcK5wREu0ZkK8CCUXcxE9kwiVkqyzXSzWL/aEKMrA+9MP8L8cKC/DdI1eZi6kWYE8KKcq37XhoWcbLyvUG438Bwncqm3V1PxDISvQfHsIJJHpQS1T+z+IDvIRjxmtSz3u/K1CzsHwdRTzXaFVUiz3nw==
Received: from ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM (2603:10c6:220:229::18) by MEUP300MB0141.AUSP300.PROD.OUTLOOK.COM (2603:10c6:220:21c::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7918.23; Fri, 20 Sep 2024 09:06:21 +0000
Received: from ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM ([fe80::2b6:430a:4d2a:5c52]) by ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM ([fe80::2b6:430a:4d2a:5c52%2]) with mapi id 15.20.7982.018; Fri, 20 Sep 2024 09:06:21 +0000
From: Peter Gutmann <pgut001@cs.auckland.ac.nz>
To: Christopher Patton <cpatton=40cloudflare.com@dmarc.ietf.org>, CFRG <cfrg@irtf.org>
Thread-Topic: [CFRG] Where should test vectors live?
Thread-Index: AQHbCvKQhp1HgSd95EOKD1QGr5mMy7JgYniL
Date: Fri, 20 Sep 2024 09:06:21 +0000
Message-ID: <ME0P300MB07133990518F386077AAFB23EE6C2@ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM>
References: <CAG2Zi20N98cxpgjfRe6gWw1SQEoux+5P3NhLBFUfUHk_udYeFg@mail.gmail.com>
In-Reply-To: <CAG2Zi20N98cxpgjfRe6gWw1SQEoux+5P3NhLBFUfUHk_udYeFg@mail.gmail.com>
Accept-Language: en-NZ, en-US
Content-Language: en-NZ
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=cs.auckland.ac.nz;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: ME0P300MB0713:EE_|MEUP300MB0141:EE_
x-ms-office365-filtering-correlation-id: 825e530f-57f9-4834-b73f-08dcd9537ed7
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;ARA:13230040|1800799024|366016|376014|38070700018;
x-microsoft-antispam-message-info: HjMOa/MnD0Rk9Wrk8HLbw83rIKrVrrjDmMboS9URIgZNLwjlg3Iy2AJGKZn8fbfFldpveNMe2XHrcOZVBjiRKp/UNfP3KRQp3OwCZciJ9RnLRYUkjmYziEPY4iyItvp4VGsZFKERjpAN+onKkIPDKrw3XbRw2LE4kzVsW2C+sHSoAwhsy9q6J+smKzyG6HfUSDkArfEpIV1LF+NHA7/Og1kDArhVy5BU0Yi2gNaYmiEFY/AjJlbQYuA+zOYh4DDbykCqOOR0kn2weusbNcL6lY33N3zgZ5dDBR8l0k1WO1+lTi3kAyMHQDjsl/LOgzFlC9ggF204l9ja9yj8vndpFfVWjjPgdvdTeFEpzibB69tT9RJdcXM4sES3YaOcDEM/Sa7qHYnxnSgzVlNCZ1Hiz4YKP8yXDR4YP7dj3/zBZtVAQGf2onYDnfIDvLd2YpTmPf1ovnCJWu4bueVk85sGG1o0+R+VCBhUWixKfE5XrJF4xkJmPEnZgMJIm8rOpZ8kE4gZQJVN4jHyldVcwN+hoCNDCbQsLOT2z10/HFN9jHeAyCzwNWWHyoe3f5G2v0Q+K/eIRvAsy1gtO1Tr6yPmhpHdhtC/SNTqY0Wl3PuqAV2J+BeHxD3n6NiiOAb5E9FalG5N2K4YcM4OKOgiqvtqzcXzcvfW/2/eeQUlRlf2R5NMuzCL3nxlTHgU0d/v3orLAbadCWA4uNZwGhvC12PLBFMn+By1PhRkbqxVGTk3rySGDdgpLLo1/Dhy8hwTajeONLJUikLodhN5f+GRJrxpQvo/M61VsXhSC3O0iWdzOI0zb4HiKf6p1RrtCGLsWYtY4g6FVNo8ZroI4eHKGX5j0K781v5MKKNDS/NlzEV3cFEyM2fAP1+Y3nSe2E4OL+62yCJ+7K9zAI7DIBEAqWTVlmgcWfhfwqQx3n2is+NyVhyqejyR7LeyuwpYD6AUdbc0xOakxb87XaZ7/R+EqoC4P7iG+opRSybwO/McFTntIGRg8Idf14SqH4QUwjnSbkiUcOcoqPyco9vYUnVS4eUvnmW4y32mMHU+NJ6DGxAvDZTv54ELkJBt9fC9rZJle/wCxTq0HWK7aVZDq0g6FeFz8nuIs+DO711s4DSpX/PEYAppXRpsb0qAZKzBvB/8yMAvuqvWAvuslREYrZQEirec9O0taxFqonmvSLfkjKoaTtsQru0Nsnl0IGZ7arRbUeNxeYlJu+Q6voeRVCTXaEQxNP+iWwM1soj6steCOIWI4PjYlSm/YF6zQzbE1srfmRx7uJpEkzACfeIciLml0t2ix18xMZ9VdSyUAKSdVivAYa2mQkoFhPx1u0SX7CwGWS+Zub3I2UdF6IF0yNapFlozSw==
x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(366016)(376014)(38070700018);DIR:OUT;SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: dXMs0cTQ0eRVi5NFE6sUQTJwtxWN27uAJXY2B9Vt2+pvaThRkRW5JUX0skF22vSkoA/C+plGEYp5Hr8dteJCvRwb+pmrbKSKNqJqsczbFtqbYuEt0C93alzVRJnNg3jQNkM1U19cy+78U8GK6A/pJFU3NI4fGc8Zd6YpCSeShx4phBYJXYQ+ThavGWzhVfNOW5hCblXmSJ4a7lFbiLKOwc3dNt5nHonFyOoWkRieOeeIrMSPrQzCbyUEkDJ1srfQZpfKEHTBz/7VuE8rKyVJBjVvANJUugIXmgCmJVKZhQHAKQhyiRXkcpLdNcKO4vEprrCS4+RrcaKg3rXmZnvZb7GU5gmurLWNz5OmfwNAUhMxYozaHwNhCOaUrjbEz48/NzbRxNR9qgMCelCqc4PcSBwTJWOx8RRdYaECihFlXYMTzatV6jhfF56HSJ+CQ5Dw+L8G8m0JZcFEOmeOK+13le7otT6Nw7DQj0I5tajlCB5cC4z8PAE8MXV+xNx1/mbZdpVbZqt7J6dCFy54ZkYoRanF1xrMqqa5xEYvTRSXXoZ8Sp01syiuSnatOVX4YrsC0Nr2TA+ggET9wIywy1nstpqYZCnztvL1htsW0o/0cQnPbqHrcRn5Km1hITB69n7VWvpbchXisiKroUmQx8ZSdToMepunglu136SFNMSx1Rpi/mOJr/6Tx1pH8241yDk5+naePQzv+yj8uRXZz/viw50AU6ipZei3lNhaw6Hnrpz3SpxqahHECiOLflZFRG7RjweAMS4wNkLLi/PIB30bujl1Dht9Yw5/+MepJASz1pyyC++Dfhm52NU7uYTzFtJtqrTyrGPlobIdyweMq5+MO7b5R1LRXJHIIeUhlJ0jqqdAhnL8joXBH02xHzVNw/zoJztmg17fo0SiD/u5u7FkAf062DG2s9T4Clp2V5lN2VYtXTS4ciX2fW0hwOasEv9gdFp6bJO9Z8J+V8W0uw6GiG8ThqHOR8Nw3J8ehEmhHSUeifRrHv35/TRJDPFDSgyr6N95cazh9tUMmZpYW9qExCdp8zI/cetAvMu4fVm+/yaF1sGBQBi9FZUxGmR9WXdVAPmkds1Wrz7gxlzdkaAIQc2Wvla4pESAPQkW2JFeaRxYs+GmxhJxyfXLQdUWUKWlChlBFFCC3D1bTfrPE++Izn9gs9wpF83KOkoS45dupNahGqnMes6mtdczjr9nXkJt6VH5/MD0/YCATCE8jiym6fVgHD98cNOySbJUTNtc/iqPFxM3dGi0j/6yeyNpXu8qnbRT/p61gEG7DVYyVXEHY0IUqTAmzHQHo+EggB2MkooW0QtHND2HaAZMUraP5+qWp1ZcK+uThPjs+KVB2D/DiE9tyndLEG4iUJ8wDh53N8jvdBP77yzqA4eCGXSd54ROR+C54s+GyE0ydasCZF7UorLD4thLuDPfdh6cUmkh+i95SYrwJ2LefMFl3D6MrX91wLMp6lMxhZZzhXGOZrP2HLJDVKGP0Fl7k+eaFBXP2nCFXOLBq3KBmV/BOSy74M70gXRe7R3EWf7qV9o5HXqG7LpBBj55YxHoMVZslzLpTHVRH2g91P75qhrl8wpKMZyX
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: cs.auckland.ac.nz
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-Network-Message-Id: 825e530f-57f9-4834-b73f-08dcd9537ed7
X-MS-Exchange-CrossTenant-originalarrivaltime: 20 Sep 2024 09:06:21.3203 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: d1b36e95-0d50-42e9-958f-b63fa906beaa
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 9F8exvyUR10E0H/Etz1SFx8JbJvWTyq3zevy0wsM1EJSgBptEEvqulqEIcDTuSVBU/O4pgcdzY/E3+wgOxWuHMIQG5ciw0HPEF7S09etP0A=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MEUP300MB0141
Message-ID-Hash: CFTIRLFN64GINMQWKU27R24ZRVOMV643
X-Message-ID-Hash: CFTIRLFN64GINMQWKU27R24ZRVOMV643
X-MailFrom: pgut001@cs.auckland.ac.nz
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cfrg.irtf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [CFRG] Re: Where should test vectors live?
List-Id: Crypto Forum Research Group <cfrg.irtf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/cfrg/XhHDk0qSmtIT2uWYiQmWULfUM3M>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cfrg>
List-Help: <mailto:cfrg-request@irtf.org?subject=help>
List-Owner: <mailto:cfrg-owner@irtf.org>
List-Post: <mailto:cfrg@irtf.org>
List-Subscribe: <mailto:cfrg-join@irtf.org>
List-Unsubscribe: <mailto:cfrg-leave@irtf.org>

Christopher Patton <cpatton=40cloudflare.com@dmarc.ietf.org> writes:

>How do folks feel about pointing to machine readable test vectors from an RFC
>in lieu of producing human-friendly, but machine-unfriendly in the appendix?
>Suppose for example an RFC had a pointer to a JSON blob somewhere on
>datatracker. Is this feasible/desirable?

For RFC 8894 I just put them on github:

  Samples of SCEP messages are available through the JSCEP project [JSCEP] in
  the src/samples directory.

  [JSCEP] "A Java implementation of the Simple Certificate Enrolment
  Protocol", commit 7410332, January 2020, <https://github.com/jscep/jscep>.

That makes things easy, you can directly download the binaries without having
to faff around with decoding whatever ad-hoc format the RFC has adopted, and
if your code is already on Github can just pull the data directly into your
project.

Peter.