Return-Path: X-Original-To: cfrg@ietfa.amsl.com Delivered-To: cfrg@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1ECEBC151981 for ; Sat, 21 Sep 2024 00:58:46 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -2.008 X-Spam-Level: X-Spam-Status: No, score=-2.008 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=cs.auckland.ac.nz Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id SOtDPz7wO0nP for ; Sat, 21 Sep 2024 00:58:41 -0700 (PDT) Received: from AUS01-ME3-obe.outbound.protection.outlook.com (mail-me3aus01on20731.outbound.protection.outlook.com [IPv6:2a01:111:f403:201d::731]) (using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BB9F1C1516E9 for ; Sat, 21 Sep 2024 00:58:41 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=HDaFJNfTCfquYtir1feTdmm0ZuWVCzfqV0qrSJF8OPuuJtonO+EP46+Vsf0JhblaActybt5yvRlClDR/0lz+xSimKsIzT2sB66S6YSx6OOcvemDBAIxUaPuP/Eg7ri+zXAByklTwuygW5PzQzUTVcJ7mgT5ljwuNzh8aseEHNDgtEdzV7phQNOYTR1AdNjrq0w+vurZbAVZpwoExnc6nWeMbJtp/ZTVf3DHNJnfzmtpLpdLvNMA9RkVLP4ADoKDmeQvNnOW5Jzaq7yXou6T+NOgQtZqKnnQGCtpV0GC3f9vkQZF4/qBmQmJRCwx6ImmNsHYpnwzPULs1cgVxpjM0cg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=4nW+J0vKZQZoH10a97mXqH2RMslr8lf6oG3ANHjTzgg=; b=ippXb78Ng/ChkBnu5d+anU3z2lHeFO+FuSqbqaC0vn6tkPt2NbVyCGAs0ofemP0VOoFKMjU6tEQEP98vdF5W26D06Iiuh2psGyy65OzsOav+Baz4D3oU7wzjKKuugEhqYM/RsRgUMfj76vTBw3K/QxCn6kFvyTCvFvEr2YrqL4H4y5XEC4CmDQ9RQ/XFHENJ6ShsSKcqq83XQm1g2h2RsOfiFYyzmQmHmTsYpvxc0yhSxy8ymZ707YH9eMzAY9tlPyxnSGSXsKzpZrx9Z3Vf6mb8/q+p3RdkyGxqQbKzhhoFtFOUY0U1cifEFxGUBuUrQ7O4Lvg7nc5i+QIKdgWsXA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cs.auckland.ac.nz; dmarc=pass action=none header.from=cs.auckland.ac.nz; dkim=pass header.d=cs.auckland.ac.nz; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cs.auckland.ac.nz; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=4nW+J0vKZQZoH10a97mXqH2RMslr8lf6oG3ANHjTzgg=; b=C/FdgZqjkGyvFLCnIUAopI5mMHQdEcPo+UO+u/odEHKMISTjOI1+aqGfevzyZ+ZKD2fuo5Jv94Vd71eWfXEhOldBx97ovFnlp5Bxh80Wt20Z4tpskC/XpjQ5hGBhlP55d6QpbfxtemhEW5zeuFGE986UTgH+uyX0L0X1M27NA/z8+z+RGSjwkHOqQ24xb7lwsb+fltH7+4CJt7chsnp8MTq/64zY0jEDacfdxPcKs0ecBqd67pijygZUkDa/xisqeeccicnYz+eI2BCWfiaz0QQlrElW4LQ8fgIDr3FLtlKMFwSmZOw52AseUf9k7kd0XRlKUhEsqEepNrulf2cL1w== Received: from ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM (2603:10c6:220:229::18) by SY8P300MB0502.AUSP300.PROD.OUTLOOK.COM (2603:10c6:10:299::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7982.23; Sat, 21 Sep 2024 07:58:36 +0000 Received: from ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM ([fe80::2b6:430a:4d2a:5c52]) by ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM ([fe80::2b6:430a:4d2a:5c52%2]) with mapi id 15.20.7982.022; Sat, 21 Sep 2024 07:58:36 +0000 From: Peter Gutmann To: "Salz, Rich" , Christopher Patton , Frank Denis Thread-Topic: [CFRG] Re: Where should test vectors live? Thread-Index: AQHbCvkQX2vQ2rs8vk2xBZ+HIVb2zrJgfpyAgABxMYCAADFmgIAAwNNL Date: Sat, 21 Sep 2024 07:58:36 +0000 Message-ID: References: <9A7D78C3-76B4-4D39-B9E4-4C70B61484A7@akamai.com> In-Reply-To: <9A7D78C3-76B4-4D39-B9E4-4C70B61484A7@akamai.com> Accept-Language: en-NZ, en-US Content-Language: en-NZ X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=cs.auckland.ac.nz; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: ME0P300MB0713:EE_|SY8P300MB0502:EE_ x-ms-office365-filtering-correlation-id: 90db8b7e-7310-432c-d358-08dcda13329d x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0;ARA:13230040|366016|376014|1800799024|38070700018; x-microsoft-antispam-message-info: =?Windows-1252?Q?nBcxKMHYjNCN35JY51LEZMTyCZ3bq+pDKyWz3PP1Gd2hosTX/5aknF5v?= =?Windows-1252?Q?koHyylbCRBSXKPPC8ihfUCYhPhgz7oF6HcZDuyI7IxSSei1Bhwes0K8G?= =?Windows-1252?Q?DFcCaQkrJN7Yyi8C/0Ejlkrhx8jXgRGL+BiEmBZD6+3MeQedZ4XmkRSt?= =?Windows-1252?Q?gwqyFSmNWeJbjRJQmRtcVwnlPDUDULmftOLlNSUZiBEZgjmrVCEBKS4M?= =?Windows-1252?Q?074dzH0Hr9prvxKK+fvxDYlw58XXbM08eECh4h0nviQ7vOPm/nhNV7ct?= =?Windows-1252?Q?0falVPDpcmr0M4ECOKwfGDlmsf8kKT+pRv3djZlCLujM5x42PjxhadCa?= =?Windows-1252?Q?of4CbfyXSqJpQwysT1bynUGnBvzyzHGrcbpFzXqXZnWcc4anxmLv6EKW?= =?Windows-1252?Q?pjJ+18hfV99pn15t4szPcTwxMg2pv2zkRojL+AUKL1sAIDTlE352ZXPf?= =?Windows-1252?Q?LCErPO0RUR9e/jyexJWn9qv1/cMESa3a+KZIGNL6G8/+O/3vUlogGUI1?= =?Windows-1252?Q?SzDS42vsRTQGlY5+i/9lvg2zES6TXtrFxQ0g67ONXvQHrkr7Hx2McB1V?= =?Windows-1252?Q?SecrgK8Co3sKV+jrv8GWXN55F6hWoOxHLdrQAJcD8/r00hHHoFYTIE+z?= =?Windows-1252?Q?iqWAPQHEyPXncXgn6daBYsEnwElU2B/eRPtjC01csudZk3zmJP8PHTq7?= =?Windows-1252?Q?mkTkK+g5a3NRlAzBX5+wM+/Ly0K86K7A++MCiFE4bsNHq5kYFq1syT29?= =?Windows-1252?Q?YIABmz2NXfVAXtnzOHYv3qLPi3/ikDwo+T0etuLruRRl5viDS82H1cTs?= =?Windows-1252?Q?VhW5qiXMNdZbDqADLNenH883COI+5M5Nd62cq6MCFqPp2qdORmXrdRv9?= =?Windows-1252?Q?iIBbbt6cJGbnB55SZIyYZhk1AKX1WbZfsgVm2HwdoK4Dp15mqcVT9wEZ?= =?Windows-1252?Q?WJuXIRgMiBeW6mzbzCDrkWjDayp4oxfK5wfvmud9BdYUSe0vLppHy91r?= =?Windows-1252?Q?2aBwID9rPhoOeeneoEBv9czBk0Ps1mDo5pNSaoRD1FsD3XsGistbhfLY?= =?Windows-1252?Q?MC2xKVONCeGPSrpC9LNgP7matWr/FrdK6TeFSvOWMy8SNvZOTrpQiUul?= =?Windows-1252?Q?tPTRI9Zr1OxcZn/Q+k16YNjxJKwek7aNiMg0EWmc82S8jglnEvqqN87e?= =?Windows-1252?Q?Iv1fDll1+INAQzmp9wKb2KaoZaOzhpQytZ+kM91/u3Ob1g2oKPbOidZ+?= =?Windows-1252?Q?bl/iJ0maZBFyHiPk32g3PXqeBJ/wQENopmVaFtUGxYnFHBmLiLAPADva?= =?Windows-1252?Q?T9EzSNFrtsb1P8sYKw8pjMuVsNeBtlzaJtnTHU35ZCrE24jswTl6I09d?= =?Windows-1252?Q?23LjjRwQCAr9X0y9FxEutcx5OtIgGisc3okhlgdfUf/mWZHIOTfIIzis?= =?Windows-1252?Q?UYsf9q8W84Jtf2sWt7+vijJ1x7fiiSXe9cQzEx0ZHxqlDX6jw7uQrIy5?= =?Windows-1252?Q?IJUSit7x0WKvEQKZZo2g3LhQvQ+weg=3D=3D?= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230040)(366016)(376014)(1800799024)(38070700018);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?Windows-1252?Q?qba/pNUuVqyMBuQalaC3IlMRoV+XRXatSZdyscbfL56ME066ijNEaoGq?= =?Windows-1252?Q?2JCwjMUhvBKfJm+j2Y6Wivi+dDRrU1oAyD2eO92sfn0u1Z+V2U/HvZoV?= =?Windows-1252?Q?t+VbSrsSg9ZvwfwGxO59yPRVq7PJBnUcZqqEEjWJLBt2M9uwjAbSfEYI?= =?Windows-1252?Q?SdVIyKW3nS2OAOMfzfEWLyUkh44S+PUMKqRZczSATvjiAVBzA+oba2p4?= =?Windows-1252?Q?n7Zn6D8c0pdtu8188tc0P1UedAbMldp93XX0V+8s3qWBtxiTOwr0bVs+?= =?Windows-1252?Q?7U8zrumgIYcIiiJq2SB5pFY/KjRqrWmjJCKjcp9gZhUSvaqqxl1eqnnO?= =?Windows-1252?Q?jgNGEibpu2YthKXjAWxDvtOCHfvmVG2PaIxEhXu0pOHmLknPxxnTvzYp?= =?Windows-1252?Q?3WPGQw2Yi9Ih0BZR1ljkDILjJ+W7WeJ+5pyDtL/MphkcI8+DJwfI5Iwz?= =?Windows-1252?Q?jS9zKFK5VGrFshUreyfczCsxjsYmAn7NhEBrh9VEcaU2F3sht+jt89Ab?= =?Windows-1252?Q?sXpQoRDGHDhwacy/vU0cPUeYd3ZcqdzraddkMcM1/3fuPmGtegyMWf2Q?= =?Windows-1252?Q?vcXzmizLzAe7vLl9NSxLXa14kujJPZvWAqJbQMfARvekgOvWssAsDYyO?= =?Windows-1252?Q?JZ+nzSUukxrBjWGkWoflG7LtkFL7LDtBvHBiwOVgslPygX6OJQ0F8x9+?= =?Windows-1252?Q?9Jt1GWToEly3eZOPgWfuHXwWM+CPNJFOAeMO5it93/bW7g1AQ9+fbAb8?= =?Windows-1252?Q?xeySKIW40nCQTvZ+ep18FfWkOJpMJoGf9Zi+nzOvUXqH6HX5aJDhckig?= =?Windows-1252?Q?WVL6UsRlu6tT2bHwA4iOMw+JsQN1TUwoO0RUzpA2s7EewKvF9KpzKXE2?= =?Windows-1252?Q?AB0XoePwRqAlHW7Le9J/2jrmuQQdIF4KfPGArTn7BdjW3NTDPB9fc+St?= =?Windows-1252?Q?FSnNVMXu4DtGISjA+1tqbLUdaN2HeWILcQOZnQwxhzWnLhOiEoh3xL1O?= =?Windows-1252?Q?01X0Wm78gcljagBD2/I0KyS6KpqfuiBECsgWARaMOnWw7qywJtqAsmgi?= =?Windows-1252?Q?MwEAcYvBSIA92BWSZAFw+fXUvinaHwf1x5gRez5dft0ssY2GLrzUMXLe?= =?Windows-1252?Q?s2i+jqHhOVf+uyRYRKKmWCiyBYCNlTwpAangqb7gljIBQHCQRg/dIE5v?= =?Windows-1252?Q?3ie7hCKBPDYujmIPgAm7AjPHangR4kwygSOgHeXs9I2dreWw+ZatsMJf?= =?Windows-1252?Q?ZQI3OTAQeOVy9ySDT4Tn8g3AqG7WuIYq7PToMZGtD8ygMTzjVVEzfSv5?= =?Windows-1252?Q?gE2hTI56bSLT24doH8dYUoKw1qsfmJcdKj2blWEY83I1oNsNpqjy9/CO?= =?Windows-1252?Q?d/hUOP59FYqLG8ZC30J54EANvByJGZJznok0MOb6Xtjix3Jphk3OPJPo?= =?Windows-1252?Q?fIohmaAbg/9yMjlTbTClfmmTLPStvGxmZAAwqj5ZlppphBxZ7gtgR6rL?= =?Windows-1252?Q?2Y0PJdqTVZMACcPYygBn/iYRCAgSoRXdErNdYn+wOJUlhMp423EJy9uT?= =?Windows-1252?Q?VJwiAOcN3G9DFIRJyX7eNGmF5VD7xj/LEAMX5OU2LO91Z4ERpZQ6tZS3?= =?Windows-1252?Q?X8XeCBgZbkc8X8rc+HekwshsQjHtN2SOxQs5hWSoLdo/Xv3TOpNITbOu?= =?Windows-1252?Q?uJ/KyPYKAwBD1gYjKH4ENPizpcCNFtbO?= Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: cs.auckland.ac.nz X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: ME0P300MB0713.AUSP300.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 90db8b7e-7310-432c-d358-08dcda13329d X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Sep 2024 07:58:36.7764 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: d1b36e95-0d50-42e9-958f-b63fa906beaa X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: OTyiuck9V/zIAQwyFYBLeYh95allR2sRGl424dD363GeD3th2iffuLVPFv45lKD0hN7iiz6Mm032zeKsCyxTdiGgym6AAZQDlN7zaUTNnrQ= X-MS-Exchange-Transport-CrossTenantHeadersStamped: SY8P300MB0502 Message-ID-Hash: GFIUVUWIGRHUHOI2NVM753RVLEVVJNVW X-Message-ID-Hash: GFIUVUWIGRHUHOI2NVM753RVLEVVJNVW X-MailFrom: pgut001@cs.auckland.ac.nz X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cfrg.irtf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: CFRG X-Mailman-Version: 3.3.9rc4 Precedence: list Subject: =?utf-8?q?=5BCFRG=5D_Re=3A_Where_should_test_vectors_live=3F?= List-Id: Crypto Forum Research Group Archived-At: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: Salz, Rich writes:=0A= =0A= >I think having a machine-readable source that is external to the RFC is go= od,=0A= >but I=92d be sad if there RFC were not self-contained.=0A= =0A= It depends on how big the test vectors are, if you've got an otherwise 20-p= age=0A= RFC that's 90 pages long because of the need to carry huge base64-encoded= =0A= binary blobs or something then it should be in a separate repository. An= =0A= extreme example of this is ISO 24727, where the testing document is five=0A= thousand six hundred pages long (5,600 pages, not a typo). No-one has ever= =0A= read this, both because it takes a Professor of Neomathematics at Maximegal= on=0A= University to figure out what it could cost to buy from ISO and because no-= one=0A= in their right mind would ever try and work with a 5,600 page test document= .=0A= =0A= Peter.=