[CFRG] Re: Where should test vectors live?
Orie Steele <orie@transmute.industries> Fri, 20 September 2024 01:03 UTC
Return-Path: <orie@transmute.industries>
X-Original-To: cfrg@ietfa.amsl.com
Delivered-To: cfrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A4CD4C1516EB for <cfrg@ietfa.amsl.com>; Thu, 19 Sep 2024 18:03:51 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.105
X-Spam-Level:
X-Spam-Status: No, score=-2.105 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=transmute.industries
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id UWDC-7JX1TMg for <cfrg@ietfa.amsl.com>; Thu, 19 Sep 2024 18:03:47 -0700 (PDT)
Received: from mail-pf1-x42b.google.com (mail-pf1-x42b.google.com [IPv6:2607:f8b0:4864:20::42b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5BA91C15198F for <cfrg@irtf.org>; Thu, 19 Sep 2024 18:03:47 -0700 (PDT)
Received: by mail-pf1-x42b.google.com with SMTP id d2e1a72fcca58-71971d2099cso1141489b3a.2 for <cfrg@irtf.org>; Thu, 19 Sep 2024 18:03:47 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=transmute.industries; s=google; t=1726794226; x=1727399026; darn=irtf.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=7y98cywdxIGMiRrCsYQfdlCHN97VBfvgpfCXtzJPEaI=; b=ZgQgrBDXO/sXQ7N+nsmWgbcEVOPO+TACSYUU5NNlgL/X75O/ls/HPD/iJvjecUNmsM iCX56+RP19wm+CRKKfYRoVdKiFhg4v4cPF6IdZX90V70DPNgYDrgLCw4Lhoqo5IwM5LX 4XfvTlcNpaH/a5m3WrYAvcWks2qc9nQ+qYhrMs66XbpGBa84iccMgOuSGmMjOjjPQVUz 2dXCIU+rDMgGX6ZuLR4E0u2L4J/P5+vGDmgdv1W7mXbZi6cpzyogcjsEPmnU6inANU/b L3ujgmByaG8Zhp7PQdZjjrto9WfeID2ptRS+vLRZ4dLUwmhRdME8HCveoP76rihsNGF8 l5tQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1726794226; x=1727399026; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=7y98cywdxIGMiRrCsYQfdlCHN97VBfvgpfCXtzJPEaI=; b=lOC3xa6H7cSO0lNI4CKfrHV6bqH5mHRRXuF9N/jEsP1OGXAzVHIMQWgTE7KaC6PF3o cTQznQ14V2P2riljhSexQQsnaOEi30OUEa3fublg82RUXnfI8nTB5FkiWKUe4vN6vNon 4nYYt3PVgYB9SvyA3y5+7GTYv64KXHCBWWi0L/GTVeiQq5QxV7DMAmptAbulKtZM5D6b 0gUdjOF4OB3RhPSnUIAWl914+DVaioR9QqWtvND/2/GUkizhK6UU/eDpqyvhpoTRii+2 WrCfW7muxl8E3zBwCYBXvJcPNB/55aixwQW9V7OZbCnKgN7h56ylEiNw4IhattzjnXCa R91A==
X-Gm-Message-State: AOJu0YzN6raI27CUtGd9xBARxXFzO6c0QaQm3ju6BZkMShKwaPzuIi2F ca25NJv6dmFbVqfx0538JrD3+nlhLk8rmMQxVjTXriEOJsKhPGU7vhdhico8bP6WT26nTWmvMOP zZuSAAVvy9EdG5KitgvbN3TlP850+Wtuy/ZIO3zhWpGc6KhkM
X-Google-Smtp-Source: AGHT+IGEtizDj7WPuuzM88os+IuxDrLWCB+g7jcHkuI/qqygdMBtbsg+BzXeZKng+Zy8/B0/co+GspjvalzLvDXFncA=
X-Received: by 2002:a05:6a00:1408:b0:717:e01d:312f with SMTP id d2e1a72fcca58-7199ca05aa0mr1544163b3a.27.1726794226347; Thu, 19 Sep 2024 18:03:46 -0700 (PDT)
MIME-Version: 1.0
References: <CAG2Zi20N98cxpgjfRe6gWw1SQEoux+5P3NhLBFUfUHk_udYeFg@mail.gmail.com>
In-Reply-To: <CAG2Zi20N98cxpgjfRe6gWw1SQEoux+5P3NhLBFUfUHk_udYeFg@mail.gmail.com>
From: Orie Steele <orie@transmute.industries>
Date: Thu, 19 Sep 2024 20:03:34 -0500
Message-ID: <CAN8C-_KDTg2ZatR7tf0K9e19Xz24CrMF06_vB8fc0ZioqZ+oeA@mail.gmail.com>
To: Christopher Patton <cpatton=40cloudflare.com@dmarc.ietf.org>
Content-Type: multipart/alternative; boundary="000000000000764b740622829c6a"
Message-ID-Hash: CRLGIXIJ2OR4VVXY4RIB6L7DDWCMT7NE
X-Message-ID-Hash: CRLGIXIJ2OR4VVXY4RIB6L7DDWCMT7NE
X-MailFrom: orie@transmute.industries
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cfrg.irtf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: CFRG <cfrg@irtf.org>
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [CFRG] Re: Where should test vectors live?
List-Id: Crypto Forum Research Group <cfrg.irtf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/cfrg/in7ldlH7dZs5AwlYgWXhEjG2UQo>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cfrg>
List-Help: <mailto:cfrg-request@irtf.org?subject=help>
List-Owner: <mailto:cfrg-owner@irtf.org>
List-Post: <mailto:cfrg@irtf.org>
List-Subscribe: <mailto:cfrg-join@irtf.org>
List-Unsubscribe: <mailto:cfrg-leave@irtf.org>
I like the idea of hosting machine readable test vectors. The COSE WG has a collection of files under the working group GitHub organization. The is also https://www.iana.org/assignments/yang-parameters/yang-parameters.xhtml And... https://www.iana.org/assignments/xml-registry/schema/location-type.xsd So perhaps there is some possibility of hosting test vectors with IANA. I would want to ensure that the references made in RFCs are not changed after publication. You could consider publishing the hash of the files along with the references in an appendix. Hosting the files in a version control system and referencing them that way seems like the least effort. OS On Thu, Sep 19, 2024, 7:17 PM Christopher Patton <cpatton= 40cloudflare.com@dmarc.ietf.org> wrote: > Hi CFRG, > > It occurred to me today that our drafts often have human-friendly test > vectors that look something like this: > https://datatracker.ietf.org/doc/html/rfc9180#appendix-A.1.1 > > These aren't super convenient for a machine. In theory you could write a > script that downloads https://www.rfc-editor.org/rfc/rfc9180.txt and > write a parser to pull out the test vectors, but does anyone really do > this? Luckily for RFC 9180 we have a JSON version to work with instead: > > https://raw.githubusercontent.com/cfrg/draft-irtf-cfrg-hpke/refs/heads/master/test-vectors.json > > How do folks feel about pointing to machine readable test vectors from an > RFC in lieu of producing human-friendly, but machine-unfriendly in the > appendix? Suppose for example an RFC had a pointer to a JSON blob somewhere > on datatracker. Is this feasible/desirable? > > Thanks, > Chris P. > > _______________________________________________ > CFRG mailing list -- cfrg@irtf.org > To unsubscribe send an email to cfrg-leave@irtf.org >
- [CFRG] Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? D. J. Bernstein
- [CFRG] Re: Where should test vectors live? Orie Steele
- [CFRG] Re: Where should test vectors live? Watson Ladd
- [CFRG] Re: Where should test vectors live? Richard Barnes
- [CFRG] Re: Where should test vectors live? Orie Steele
- [CFRG] Re: Where should test vectors live? Björn Haase
- [CFRG] Re: Where should test vectors live? Carsten Bormann
- [CFRG] Re: Where should test vectors live? Carsten Bormann
- [CFRG] Re: Where should test vectors live? Björn Haase
- [CFRG] Re: Where should test vectors live? Carsten Bormann
- [CFRG] Re: Where should test vectors live? Peter Gutmann
- [CFRG] Re: Where should test vectors live? Frank Denis
- [CFRG] Re: Where should test vectors live? Frank Denis
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? Sofia Celi
- [CFRG] Re: Where should test vectors live? Colin Perkins
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? Carsten Bormann
- [CFRG] Re: Where should test vectors live? // Sug… Björn Haase
- [CFRG] Re: Where should test vectors live? Colin Perkins
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? Salz, Rich
- [CFRG] Re: Where should test vectors live? Jean Mahoney
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? John Mattsson
- [CFRG] Re: Where should test vectors live? Peter Gutmann
- [CFRG] Re: Where should test vectors live? Björn Haase
- [CFRG] Re: Where should test vectors live? D. J. Bernstein
- [CFRG] Re: Where should test vectors live? Bellebaum, Thomas
- [CFRG] Re: Where should test vectors live? Scott Fluhrer (sfluhrer)
- [CFRG] Re: Where should test vectors live? Phillip Hallam-Baker