[CFRG] Re: Where should test vectors live?
Jean Mahoney <jmahoney@amsl.com> Fri, 20 September 2024 21:55 UTC
Return-Path: <jmahoney@amsl.com>
X-Original-To: cfrg@ietfa.amsl.com
Delivered-To: cfrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 96995C1D4CD8 for <cfrg@ietfa.amsl.com>; Fri, 20 Sep 2024 14:55:45 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.907
X-Spam-Level:
X-Spam-Status: No, score=-1.907 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7RgVHd-NbOkw for <cfrg@ietfa.amsl.com>; Fri, 20 Sep 2024 14:55:41 -0700 (PDT)
Received: from c8a.amsl.com (c8a.amsl.com [4.31.198.40]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 72C03C14CE3B for <cfrg@irtf.org>; Fri, 20 Sep 2024 14:55:41 -0700 (PDT)
Received: from localhost (localhost [127.0.0.1]) by c8a.amsl.com (Postfix) with ESMTP id 64A8F424CD0E; Fri, 20 Sep 2024 14:55:41 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
Received: from c8a.amsl.com ([127.0.0.1]) by localhost (c8a.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3imLi3tCcVZg; Fri, 20 Sep 2024 14:55:41 -0700 (PDT)
Received: from [192.168.1.203] (unknown [47.186.48.51]) by c8a.amsl.com (Postfix) with ESMTPSA id 17234424CD0D; Fri, 20 Sep 2024 14:55:41 -0700 (PDT)
Message-ID: <a913e321-5746-46bb-a1ee-059fd5818877@amsl.com>
Date: Fri, 20 Sep 2024 16:55:39 -0500
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
To: Colin Perkins <csp@csperkins.org>, Christopher Patton <cpatton@cloudflare.com>
References: <CAG2Zi20N98cxpgjfRe6gWw1SQEoux+5P3NhLBFUfUHk_udYeFg@mail.gmail.com> <AFC838DA-68C1-476C-8823-C3BF1E38CE39@csperkins.org> <CAG2Zi23hBZjJ==G0sRwyN+w9bH3ww=G3=MC3eHY+cExqd6X57Q@mail.gmail.com> <967BBF38-8C46-4ADC-BE41-47CAE7B7A235@csperkins.org>
Content-Language: en-US
From: Jean Mahoney <jmahoney@amsl.com>
In-Reply-To: <967BBF38-8C46-4ADC-BE41-47CAE7B7A235@csperkins.org>
Content-Type: text/plain; charset="UTF-8"; format="flowed"
Content-Transfer-Encoding: 8bit
Message-ID-Hash: RJAAT2GGGOTL4WKPDQOWL564Y3BCN4KS
X-Message-ID-Hash: RJAAT2GGGOTL4WKPDQOWL564Y3BCN4KS
X-MailFrom: jmahoney@amsl.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cfrg.irtf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: CFRG <cfrg@irtf.org>, RFC Editor <rfc-editor@rfc-editor.org>
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [CFRG] Re: Where should test vectors live?
List-Id: Crypto Forum Research Group <cfrg.irtf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/cfrg/sWa_WkzOW5IPvQ71Hmz21HsBNVY>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cfrg>
List-Help: <mailto:cfrg-request@irtf.org?subject=help>
List-Owner: <mailto:cfrg-owner@irtf.org>
List-Post: <mailto:cfrg@irtf.org>
List-Subscribe: <mailto:cfrg-join@irtf.org>
List-Unsubscribe: <mailto:cfrg-leave@irtf.org>
Hi Colin, On 9/20/24 2:00 PM, Colin Perkins wrote: > Hi, > > For links from RFCs to GitHub, I’ve copied the RFC Editor to get a > definitive ruling. My feeling is that we wouldn’t want links to personal > GitHub pages, but it might make sense to link to GitHub repos owned by > the research group since they’re perhaps more likely to be long-term > stable. Presumably the github links would be informative rather than > normative? [JM] Yes, GitHub repos may be referenced informatively. Please see <https://www.rfc-editor.org/styleguide/part2/#ref_repo> If you choose to include test vectors within a document, we recommend that they be labeled <sourcecode type="test-vectors"> (or if you are writing in kramdown-rfc: ~~~ test-vectors). This label can help a reader extract the content. More info on sourcecode types may be found here: <https://www.rfc-editor.org/rpc/wiki/doku.php?id=sourcecode-types> For an example of an RFC that includes test vectors in the document and also provides an informative GitHub reference, please see https://www.rfc-editor.org/rfc/rfc9605#appendix-C Best regards, RFC Editor/jm > > For the additional resources, look at > https://datatracker.ietf.org/doc/draft-ietf-lamps-csr-attestation/ > <https://datatracker.ietf.org/doc/draft-ietf-lamps-csr-attestation/> or > https://datatracker.ietf.org/doc/draft-irtf-cfrg-aegis-aead/ > <https://datatracker.ietf.org/doc/draft-irtf-cfrg-aegis-aead/> for > examples (in the Document section). The datatracker lets you, where I > think “you” is the relevant RG/WG chair, specify the following for each > draft: faq, github_org, github_repo, github_username, gitlab_repo, > gitlab_username, jabber_log, jabber_room, mailing_list, > mailing_list_archive, related_implementations, repo, slack, tracker, > webpage, wiki, yc_entry, yc_impact, zulip (each can occur multiple times). > > Cheers, > Colin > > > > On 20 Sep 2024, at 18:28, Christopher Patton wrote: > > Colin, > > What would be the contents of the "Additional resources" field? > Would it just be a link to GitHub? Ideally the RFC itself would tell > you where to get test vectors: do you think it's inappropriate for > the RFC itself to link to GitHub? > > Chris P. > > On Fri, Sep 20, 2024 at 10:03 AM Colin Perkins <csp@csperkins.org > <mailto:csp@csperkins.org>> wrote: > > Hi, > > The datatracker has an “Additional resources” field for each > draft, that can be used to cross-reference to GitHub repos, etc. > > Colin > > > On 20 Sep 2024, at 1:17, Christopher Patton wrote: > > Hi CFRG, > > It occurred to me today that our drafts often have > human-friendly test vectors that look something like this: > https://datatracker.ietf.org/doc/html/rfc9180#appendix-A.1.1 > <https://datatracker.ietf.org/doc/html/rfc9180#appendix-A.1.1> > > These aren't super convenient for a machine. In theory you > could write a script that downloads > https://www.rfc-editor.org/rfc/rfc9180.txt > <https://www.rfc-editor.org/rfc/rfc9180.txt> and write a > parser to pull out the test vectors, but does anyone really > do this? Luckily for RFC 9180 we have a JSON version to work > with instead: > https://raw.githubusercontent.com/cfrg/draft-irtf-cfrg-hpke/refs/heads/master/test-vectors.json <https://raw.githubusercontent.com/cfrg/draft-irtf-cfrg-hpke/refs/heads/master/test-vectors.json> > > How do folks feel about pointing to machine readable test > vectors from an RFC in lieu of producing human-friendly, but > machine-unfriendly in the appendix? Suppose for example an > RFC had a pointer to a JSON blob somewhere on datatracker. > Is this feasible/desirable? > > Thanks, > Chris P. > > _______________________________________________ > CFRG mailing list -- cfrg@irtf.org <mailto:cfrg@irtf.org> > To unsubscribe send an email to cfrg-leave@irtf.org > <mailto:cfrg-leave@irtf.org> >
- [CFRG] Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? D. J. Bernstein
- [CFRG] Re: Where should test vectors live? Orie Steele
- [CFRG] Re: Where should test vectors live? Watson Ladd
- [CFRG] Re: Where should test vectors live? Richard Barnes
- [CFRG] Re: Where should test vectors live? Orie Steele
- [CFRG] Re: Where should test vectors live? Björn Haase
- [CFRG] Re: Where should test vectors live? Carsten Bormann
- [CFRG] Re: Where should test vectors live? Carsten Bormann
- [CFRG] Re: Where should test vectors live? Björn Haase
- [CFRG] Re: Where should test vectors live? Carsten Bormann
- [CFRG] Re: Where should test vectors live? Peter Gutmann
- [CFRG] Re: Where should test vectors live? Frank Denis
- [CFRG] Re: Where should test vectors live? Frank Denis
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? Sofia Celi
- [CFRG] Re: Where should test vectors live? Colin Perkins
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? Carsten Bormann
- [CFRG] Re: Where should test vectors live? // Sug… Björn Haase
- [CFRG] Re: Where should test vectors live? Colin Perkins
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? Salz, Rich
- [CFRG] Re: Where should test vectors live? Jean Mahoney
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? John Mattsson
- [CFRG] Re: Where should test vectors live? Peter Gutmann
- [CFRG] Re: Where should test vectors live? Björn Haase
- [CFRG] Re: Where should test vectors live? D. J. Bernstein
- [CFRG] Re: Where should test vectors live? Bellebaum, Thomas
- [CFRG] Re: Where should test vectors live? Scott Fluhrer (sfluhrer)
- [CFRG] Re: Where should test vectors live? Phillip Hallam-Baker