[CFRG] Re: Where should test vectors live?

Jean Mahoney <jmahoney@amsl.com> Fri, 20 September 2024 21:55 UTC

Return-Path: <jmahoney@amsl.com>
X-Original-To: cfrg@ietfa.amsl.com
Delivered-To: cfrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 96995C1D4CD8 for <cfrg@ietfa.amsl.com>; Fri, 20 Sep 2024 14:55:45 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.907
X-Spam-Level:
X-Spam-Status: No, score=-1.907 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7RgVHd-NbOkw for <cfrg@ietfa.amsl.com>; Fri, 20 Sep 2024 14:55:41 -0700 (PDT)
Received: from c8a.amsl.com (c8a.amsl.com [4.31.198.40]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 72C03C14CE3B for <cfrg@irtf.org>; Fri, 20 Sep 2024 14:55:41 -0700 (PDT)
Received: from localhost (localhost [127.0.0.1]) by c8a.amsl.com (Postfix) with ESMTP id 64A8F424CD0E; Fri, 20 Sep 2024 14:55:41 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
Received: from c8a.amsl.com ([127.0.0.1]) by localhost (c8a.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3imLi3tCcVZg; Fri, 20 Sep 2024 14:55:41 -0700 (PDT)
Received: from [192.168.1.203] (unknown [47.186.48.51]) by c8a.amsl.com (Postfix) with ESMTPSA id 17234424CD0D; Fri, 20 Sep 2024 14:55:41 -0700 (PDT)
Message-ID: <a913e321-5746-46bb-a1ee-059fd5818877@amsl.com>
Date: Fri, 20 Sep 2024 16:55:39 -0500
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
To: Colin Perkins <csp@csperkins.org>, Christopher Patton <cpatton@cloudflare.com>
References: <CAG2Zi20N98cxpgjfRe6gWw1SQEoux+5P3NhLBFUfUHk_udYeFg@mail.gmail.com> <AFC838DA-68C1-476C-8823-C3BF1E38CE39@csperkins.org> <CAG2Zi23hBZjJ==G0sRwyN+w9bH3ww=G3=MC3eHY+cExqd6X57Q@mail.gmail.com> <967BBF38-8C46-4ADC-BE41-47CAE7B7A235@csperkins.org>
Content-Language: en-US
From: Jean Mahoney <jmahoney@amsl.com>
In-Reply-To: <967BBF38-8C46-4ADC-BE41-47CAE7B7A235@csperkins.org>
Content-Type: text/plain; charset="UTF-8"; format="flowed"
Content-Transfer-Encoding: 8bit
Message-ID-Hash: RJAAT2GGGOTL4WKPDQOWL564Y3BCN4KS
X-Message-ID-Hash: RJAAT2GGGOTL4WKPDQOWL564Y3BCN4KS
X-MailFrom: jmahoney@amsl.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cfrg.irtf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: CFRG <cfrg@irtf.org>, RFC Editor <rfc-editor@rfc-editor.org>
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [CFRG] Re: Where should test vectors live?
List-Id: Crypto Forum Research Group <cfrg.irtf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/cfrg/sWa_WkzOW5IPvQ71Hmz21HsBNVY>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cfrg>
List-Help: <mailto:cfrg-request@irtf.org?subject=help>
List-Owner: <mailto:cfrg-owner@irtf.org>
List-Post: <mailto:cfrg@irtf.org>
List-Subscribe: <mailto:cfrg-join@irtf.org>
List-Unsubscribe: <mailto:cfrg-leave@irtf.org>

Hi Colin,

On 9/20/24 2:00 PM, Colin Perkins wrote:
> Hi,
> 
> For links from RFCs to GitHub, I’ve copied the RFC Editor to get a 
> definitive ruling. My feeling is that we wouldn’t want links to personal 
> GitHub pages, but it might make sense to link to GitHub repos owned by 
> the research group since they’re perhaps more likely to be long-term 
> stable. Presumably the github links would be informative rather than 
> normative?

[JM] Yes, GitHub repos may be referenced informatively. Please see
<https://www.rfc-editor.org/styleguide/part2/#ref_repo>

If you choose to include test vectors within a document, we recommend 
that they be labeled <sourcecode type="test-vectors"> (or if you are 
writing in kramdown-rfc: ~~~ test-vectors). This label can help a reader 
extract the content. More info on sourcecode types may be found here:
<https://www.rfc-editor.org/rpc/wiki/doku.php?id=sourcecode-types>

For an example of an RFC that includes test vectors in the document and 
also provides an informative GitHub reference, please see 
https://www.rfc-editor.org/rfc/rfc9605#appendix-C

Best regards,
RFC Editor/jm

> 
> For the additional resources, look at 
> https://datatracker.ietf.org/doc/draft-ietf-lamps-csr-attestation/ 
> <https://datatracker.ietf.org/doc/draft-ietf-lamps-csr-attestation/> or 
> https://datatracker.ietf.org/doc/draft-irtf-cfrg-aegis-aead/ 
> <https://datatracker.ietf.org/doc/draft-irtf-cfrg-aegis-aead/> for 
> examples (in the Document section). The datatracker lets you, where I 
> think “you” is the relevant RG/WG chair, specify the following for each 
> draft: faq, github_org, github_repo, github_username, gitlab_repo, 
> gitlab_username, jabber_log, jabber_room, mailing_list, 
> mailing_list_archive, related_implementations, repo, slack, tracker, 
> webpage, wiki, yc_entry, yc_impact, zulip (each can occur multiple times).
> 
> Cheers,
> Colin
> 
> 
> 
> On 20 Sep 2024, at 18:28, Christopher Patton wrote:
> 
>     Colin,
> 
>     What would be the contents of the "Additional resources" field?
>     Would it just be a link to GitHub? Ideally the RFC itself would tell
>     you where to get test vectors: do you think it's inappropriate for
>     the RFC itself to link to GitHub?
> 
>     Chris P.
> 
>     On Fri, Sep 20, 2024 at 10:03 AM Colin Perkins <csp@csperkins.org
>     <mailto:csp@csperkins.org>> wrote:
> 
>         Hi,
> 
>         The datatracker has an “Additional resources” field for each
>         draft, that can be used to cross-reference to GitHub repos, etc.
> 
>         Colin
> 
> 
>         On 20 Sep 2024, at 1:17, Christopher Patton wrote:
> 
>             Hi CFRG,
> 
>             It occurred to me today that our drafts often have
>             human-friendly test vectors that look something like this:
>             https://datatracker.ietf.org/doc/html/rfc9180#appendix-A.1.1
>             <https://datatracker.ietf.org/doc/html/rfc9180#appendix-A.1.1>
> 
>             These aren't super convenient for a machine. In theory you
>             could write a script that downloads
>             https://www.rfc-editor.org/rfc/rfc9180.txt
>             <https://www.rfc-editor.org/rfc/rfc9180.txt> and write a
>             parser to pull out the test vectors, but does anyone really
>             do this? Luckily for RFC 9180 we have a JSON version to work
>             with instead:
>             https://raw.githubusercontent.com/cfrg/draft-irtf-cfrg-hpke/refs/heads/master/test-vectors.json <https://raw.githubusercontent.com/cfrg/draft-irtf-cfrg-hpke/refs/heads/master/test-vectors.json>
> 
>             How do folks feel about pointing to machine readable test
>             vectors from an RFC in lieu of producing human-friendly, but
>             machine-unfriendly in the appendix? Suppose for example an
>             RFC had a pointer to a JSON blob somewhere on datatracker.
>             Is this feasible/desirable?
> 
>             Thanks,
>             Chris P.
> 
>             _______________________________________________
>             CFRG mailing list -- cfrg@irtf.org <mailto:cfrg@irtf.org>
>             To unsubscribe send an email to cfrg-leave@irtf.org
>             <mailto:cfrg-leave@irtf.org>
>