IETF Logo Mail Archive

[CFRG] Re: Where should test vectors live?

Peter Gutmann <pgut001@cs.auckland.ac.nz> Sat, 21 September 2024 07:58 UTC

Return-Path: <pgut001@cs.auckland.ac.nz>
X-Original-To: cfrg@ietfa.amsl.com
Delivered-To: cfrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1ECEBC151981 for <cfrg@ietfa.amsl.com>; Sat, 21 Sep 2024 00:58:46 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.008
X-Spam-Level:
X-Spam-Status: No, score=-2.008 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=cs.auckland.ac.nz
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id SOtDPz7wO0nP for <cfrg@ietfa.amsl.com>; Sat, 21 Sep 2024 00:58:41 -0700 (PDT)
Received: from AUS01-ME3-obe.outbound.protection.outlook.com (mail-me3aus01on20731.outbound.protection.outlook.com [IPv6:2a01:111:f403:201d::731]) (using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BB9F1C1516E9 for <cfrg@irtf.org>; Sat, 21 Sep 2024 00:58:41 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=HDaFJNfTCfquYtir1feTdmm0ZuWVCzfqV0qrSJF8OPuuJtonO+EP46+Vsf0JhblaActybt5yvRlClDR/0lz+xSimKsIzT2sB66S6YSx6OOcvemDBAIxUaPuP/Eg7ri+zXAByklTwuygW5PzQzUTVcJ7mgT5ljwuNzh8aseEHNDgtEdzV7phQNOYTR1AdNjrq0w+vurZbAVZpwoExnc6nWeMbJtp/ZTVf3DHNJnfzmtpLpdLvNMA9RkVLP4ADoKDmeQvNnOW5Jzaq7yXou6T+NOgQtZqKnnQGCtpV0GC3f9vkQZF4/qBmQmJRCwx6ImmNsHYpnwzPULs1cgVxpjM0cg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=4nW+J0vKZQZoH10a97mXqH2RMslr8lf6oG3ANHjTzgg=; b=ippXb78Ng/ChkBnu5d+anU3z2lHeFO+FuSqbqaC0vn6tkPt2NbVyCGAs0ofemP0VOoFKMjU6tEQEP98vdF5W26D06Iiuh2psGyy65OzsOav+Baz4D3oU7wzjKKuugEhqYM/RsRgUMfj76vTBw3K/QxCn6kFvyTCvFvEr2YrqL4H4y5XEC4CmDQ9RQ/XFHENJ6ShsSKcqq83XQm1g2h2RsOfiFYyzmQmHmTsYpvxc0yhSxy8ymZ707YH9eMzAY9tlPyxnSGSXsKzpZrx9Z3Vf6mb8/q+p3RdkyGxqQbKzhhoFtFOUY0U1cifEFxGUBuUrQ7O4Lvg7nc5i+QIKdgWsXA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cs.auckland.ac.nz; dmarc=pass action=none header.from=cs.auckland.ac.nz; dkim=pass header.d=cs.auckland.ac.nz; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cs.auckland.ac.nz; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=4nW+J0vKZQZoH10a97mXqH2RMslr8lf6oG3ANHjTzgg=; b=C/FdgZqjkGyvFLCnIUAopI5mMHQdEcPo+UO+u/odEHKMISTjOI1+aqGfevzyZ+ZKD2fuo5Jv94Vd71eWfXEhOldBx97ovFnlp5Bxh80Wt20Z4tpskC/XpjQ5hGBhlP55d6QpbfxtemhEW5zeuFGE986UTgH+uyX0L0X1M27NA/z8+z+RGSjwkHOqQ24xb7lwsb+fltH7+4CJt7chsnp8MTq/64zY0jEDacfdxPcKs0ecBqd67pijygZUkDa/xisqeeccicnYz+eI2BCWfiaz0QQlrElW4LQ8fgIDr3FLtlKMFwSmZOw52AseUf9k7kd0XRlKUhEsqEepNrulf2cL1w==
Received: from ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM (2603:10c6:220:229::18) by SY8P300MB0502.AUSP300.PROD.OUTLOOK.COM (2603:10c6:10:299::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7982.23; Sat, 21 Sep 2024 07:58:36 +0000
Received: from ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM ([fe80::2b6:430a:4d2a:5c52]) by ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM ([fe80::2b6:430a:4d2a:5c52%2]) with mapi id 15.20.7982.022; Sat, 21 Sep 2024 07:58:36 +0000
From: Peter Gutmann <pgut001@cs.auckland.ac.nz>
To: "Salz, Rich" <rsalz=40akamai.com@dmarc.ietf.org>, Christopher Patton <cpatton=40cloudflare.com@dmarc.ietf.org>, Frank Denis <cfrg=40pureftpd.org@dmarc.ietf.org>
Thread-Topic: [CFRG] Re: Where should test vectors live?
Thread-Index: AQHbCvkQX2vQ2rs8vk2xBZ+HIVb2zrJgfpyAgABxMYCAADFmgIAAwNNL
Date: Sat, 21 Sep 2024 07:58:36 +0000
Message-ID: <ME0P300MB071301B3F2862B401EBCB3D7EE6D2@ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM>
References: <CAG2Zi20N98cxpgjfRe6gWw1SQEoux+5P3NhLBFUfUHk_udYeFg@mail.gmail.com> <CAN8C-_KDTg2ZatR7tf0K9e19Xz24CrMF06_vB8fc0ZioqZ+oeA@mail.gmail.com> <BF349DA5-981E-4B06-83B7-8C6654D7F64B@pureftpd.org> <CAG2Zi21Qq0ENbdXgdkmZ86xcLyHMgExfKqsAy2M9T4PMGYf8FQ@mail.gmail.com> <9A7D78C3-76B4-4D39-B9E4-4C70B61484A7@akamai.com>
In-Reply-To: <9A7D78C3-76B4-4D39-B9E4-4C70B61484A7@akamai.com>
Accept-Language: en-NZ, en-US
Content-Language: en-NZ
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=cs.auckland.ac.nz;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: ME0P300MB0713:EE_|SY8P300MB0502:EE_
x-ms-office365-filtering-correlation-id: 90db8b7e-7310-432c-d358-08dcda13329d
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;ARA:13230040|366016|376014|1800799024|38070700018;
x-microsoft-antispam-message-info: nBcxKMHYjNCN35JY51LEZMTyCZ3bq+pDKyWz3PP1Gd2hosTX/5aknF5vkoHyylbCRBSXKPPC8ihfUCYhPhgz7oF6HcZDuyI7IxSSei1Bhwes0K8GDFcCaQkrJN7Yyi8C/0Ejlkrhx8jXgRGL+BiEmBZD6+3MeQedZ4XmkRStgwqyFSmNWeJbjRJQmRtcVwnlPDUDULmftOLlNSUZiBEZgjmrVCEBKS4M074dzH0Hr9prvxKK+fvxDYlw58XXbM08eECh4h0nviQ7vOPm/nhNV7ct0falVPDpcmr0M4ECOKwfGDlmsf8kKT+pRv3djZlCLujM5x42PjxhadCaof4CbfyXSqJpQwysT1bynUGnBvzyzHGrcbpFzXqXZnWcc4anxmLv6EKWpjJ+18hfV99pn15t4szPcTwxMg2pv2zkRojL+AUKL1sAIDTlE352ZXPfLCErPO0RUR9e/jyexJWn9qv1/cMESa3a+KZIGNL6G8/+O/3vUlogGUI1SzDS42vsRTQGlY5+i/9lvg2zES6TXtrFxQ0g67ONXvQHrkr7Hx2McB1VSecrgK8Co3sKV+jrv8GWXN55F6hWoOxHLdrQAJcD8/r00hHHoFYTIE+ziqWAPQHEyPXncXgn6daBYsEnwElU2B/eRPtjC01csudZk3zmJP8PHTq7mkTkK+g5a3NRlAzBX5+wM+/Ly0K86K7A++MCiFE4bsNHq5kYFq1syT29YIABmz2NXfVAXtnzOHYv3qLPi3/ikDwo+T0etuLruRRl5viDS82H1cTsVhW5qiXMNdZbDqADLNenH883COI+5M5Nd62cq6MCFqPp2qdORmXrdRv9iIBbbt6cJGbnB55SZIyYZhk1AKX1WbZfsgVm2HwdoK4Dp15mqcVT9wEZWJuXIRgMiBeW6mzbzCDrkWjDayp4oxfK5wfvmud9BdYUSe0vLppHy91r2aBwID9rPhoOeeneoEBv9czBk0Ps1mDo5pNSaoRD1FsD3XsGistbhfLYMC2xKVONCeGPSrpC9LNgP7matWr/FrdK6TeFSvOWMy8SNvZOTrpQiUultPTRI9Zr1OxcZn/Q+k16YNjxJKwek7aNiMg0EWmc82S8jglnEvqqN87eIv1fDll1+INAQzmp9wKb2KaoZaOzhpQytZ+kM91/u3Ob1g2oKPbOidZ+bl/iJ0maZBFyHiPk32g3PXqeBJ/wQENopmVaFtUGxYnFHBmLiLAPADvaT9EzSNFrtsb1P8sYKw8pjMuVsNeBtlzaJtnTHU35ZCrE24jswTl6I09d23LjjRwQCAr9X0y9FxEutcx5OtIgGisc3okhlgdfUf/mWZHIOTfIIzisUYsf9q8W84Jtf2sWt7+vijJ1x7fiiSXe9cQzEx0ZHxqlDX6jw7uQrIy5IJUSit7x0WKvEQKZZo2g3LhQvQ+weg==
x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230040)(366016)(376014)(1800799024)(38070700018);DIR:OUT;SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: qba/pNUuVqyMBuQalaC3IlMRoV+XRXatSZdyscbfL56ME066ijNEaoGq2JCwjMUhvBKfJm+j2Y6Wivi+dDRrU1oAyD2eO92sfn0u1Z+V2U/HvZoVt+VbSrsSg9ZvwfwGxO59yPRVq7PJBnUcZqqEEjWJLBt2M9uwjAbSfEYISdVIyKW3nS2OAOMfzfEWLyUkh44S+PUMKqRZczSATvjiAVBzA+oba2p4n7Zn6D8c0pdtu8188tc0P1UedAbMldp93XX0V+8s3qWBtxiTOwr0bVs+7U8zrumgIYcIiiJq2SB5pFY/KjRqrWmjJCKjcp9gZhUSvaqqxl1eqnnOjgNGEibpu2YthKXjAWxDvtOCHfvmVG2PaIxEhXu0pOHmLknPxxnTvzYp3WPGQw2Yi9Ih0BZR1ljkDILjJ+W7WeJ+5pyDtL/MphkcI8+DJwfI5IwzjS9zKFK5VGrFshUreyfczCsxjsYmAn7NhEBrh9VEcaU2F3sht+jt89AbsXpQoRDGHDhwacy/vU0cPUeYd3ZcqdzraddkMcM1/3fuPmGtegyMWf2QvcXzmizLzAe7vLl9NSxLXa14kujJPZvWAqJbQMfARvekgOvWssAsDYyOJZ+nzSUukxrBjWGkWoflG7LtkFL7LDtBvHBiwOVgslPygX6OJQ0F8x9+9Jt1GWToEly3eZOPgWfuHXwWM+CPNJFOAeMO5it93/bW7g1AQ9+fbAb8xeySKIW40nCQTvZ+ep18FfWkOJpMJoGf9Zi+nzOvUXqH6HX5aJDhckigWVL6UsRlu6tT2bHwA4iOMw+JsQN1TUwoO0RUzpA2s7EewKvF9KpzKXE2AB0XoePwRqAlHW7Le9J/2jrmuQQdIF4KfPGArTn7BdjW3NTDPB9fc+StFSnNVMXu4DtGISjA+1tqbLUdaN2HeWILcQOZnQwxhzWnLhOiEoh3xL1O01X0Wm78gcljagBD2/I0KyS6KpqfuiBECsgWARaMOnWw7qywJtqAsmgiMwEAcYvBSIA92BWSZAFw+fXUvinaHwf1x5gRez5dft0ssY2GLrzUMXLes2i+jqHhOVf+uyRYRKKmWCiyBYCNlTwpAangqb7gljIBQHCQRg/dIE5v3ie7hCKBPDYujmIPgAm7AjPHangR4kwygSOgHeXs9I2dreWw+ZatsMJfZQI3OTAQeOVy9ySDT4Tn8g3AqG7WuIYq7PToMZGtD8ygMTzjVVEzfSv5gE2hTI56bSLT24doH8dYUoKw1qsfmJcdKj2blWEY83I1oNsNpqjy9/COd/hUOP59FYqLG8ZC30J54EANvByJGZJznok0MOb6Xtjix3Jphk3OPJPofIohmaAbg/9yMjlTbTClfmmTLPStvGxmZAAwqj5ZlppphBxZ7gtgR6rL2Y0PJdqTVZMACcPYygBn/iYRCAgSoRXdErNdYn+wOJUlhMp423EJy9uTVJwiAOcN3G9DFIRJyX7eNGmF5VD7xj/LEAMX5OU2LO91Z4ERpZQ6tZS3X8XeCBgZbkc8X8rc+HekwshsQjHtN2SOxQs5hWSoLdo/Xv3TOpNITbOuuJ/KyPYKAwBD1gYjKH4ENPizpcCNFtbO
Content-Type: text/plain; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: cs.auckland.ac.nz
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-Network-Message-Id: 90db8b7e-7310-432c-d358-08dcda13329d
X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Sep 2024 07:58:36.7764 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: d1b36e95-0d50-42e9-958f-b63fa906beaa
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: OTyiuck9V/zIAQwyFYBLeYh95allR2sRGl424dD363GeD3th2iffuLVPFv45lKD0hN7iiz6Mm032zeKsCyxTdiGgym6AAZQDlN7zaUTNnrQ=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SY8P300MB0502
Message-ID-Hash: GFIUVUWIGRHUHOI2NVM753RVLEVVJNVW
X-Message-ID-Hash: GFIUVUWIGRHUHOI2NVM753RVLEVVJNVW
X-MailFrom: pgut001@cs.auckland.ac.nz
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cfrg.irtf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: CFRG <cfrg@irtf.org>
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [CFRG] Re: Where should test vectors live?
List-Id: Crypto Forum Research Group <cfrg.irtf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/cfrg/cam3sfJUD7pkoHgEi8PbQ6udLsA>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cfrg>
List-Help: <mailto:cfrg-request@irtf.org?subject=help>
List-Owner: <mailto:cfrg-owner@irtf.org>
List-Post: <mailto:cfrg@irtf.org>
List-Subscribe: <mailto:cfrg-join@irtf.org>
List-Unsubscribe: <mailto:cfrg-leave@irtf.org>

Salz, Rich <rsalz=40akamai.com@dmarc.ietf.org> writes:

>I think having a machine-readable source that is external to the RFC is good,
>but I’d be sad if there RFC were not self-contained.

It depends on how big the test vectors are, if you've got an otherwise 20-page
RFC that's 90 pages long because of the need to carry huge base64-encoded
binary blobs or something then it should be in a separate repository.  An
extreme example of this is ISO 24727, where the testing document is five
thousand six hundred pages long (5,600 pages, not a typo).  No-one has ever
read this, both because it takes a Professor of Neomathematics at Maximegalon
University to figure out what it could cost to buy from ISO and because no-one
in their right mind would ever try and work with a 5,600 page test document.

Peter.

v2.39.1 | Report a Bug | By Email | System Status