[CFRG] Re: Where should test vectors live?

Orie Steele <orie@transmute.industries> Fri, 20 September 2024 01:03 UTC

Return-Path: <orie@transmute.industries>
X-Original-To: cfrg@ietfa.amsl.com
Delivered-To: cfrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A4CD4C1516EB for <cfrg@ietfa.amsl.com>; Thu, 19 Sep 2024 18:03:51 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.105
X-Spam-Level:
X-Spam-Status: No, score=-2.105 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=transmute.industries
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id UWDC-7JX1TMg for <cfrg@ietfa.amsl.com>; Thu, 19 Sep 2024 18:03:47 -0700 (PDT)
Received: from mail-pf1-x42b.google.com (mail-pf1-x42b.google.com [IPv6:2607:f8b0:4864:20::42b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5BA91C15198F for <cfrg@irtf.org>; Thu, 19 Sep 2024 18:03:47 -0700 (PDT)
Received: by mail-pf1-x42b.google.com with SMTP id d2e1a72fcca58-71971d2099cso1141489b3a.2 for <cfrg@irtf.org>; Thu, 19 Sep 2024 18:03:47 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=transmute.industries; s=google; t=1726794226; x=1727399026; darn=irtf.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=7y98cywdxIGMiRrCsYQfdlCHN97VBfvgpfCXtzJPEaI=; b=ZgQgrBDXO/sXQ7N+nsmWgbcEVOPO+TACSYUU5NNlgL/X75O/ls/HPD/iJvjecUNmsM iCX56+RP19wm+CRKKfYRoVdKiFhg4v4cPF6IdZX90V70DPNgYDrgLCw4Lhoqo5IwM5LX 4XfvTlcNpaH/a5m3WrYAvcWks2qc9nQ+qYhrMs66XbpGBa84iccMgOuSGmMjOjjPQVUz 2dXCIU+rDMgGX6ZuLR4E0u2L4J/P5+vGDmgdv1W7mXbZi6cpzyogcjsEPmnU6inANU/b L3ujgmByaG8Zhp7PQdZjjrto9WfeID2ptRS+vLRZ4dLUwmhRdME8HCveoP76rihsNGF8 l5tQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1726794226; x=1727399026; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=7y98cywdxIGMiRrCsYQfdlCHN97VBfvgpfCXtzJPEaI=; b=lOC3xa6H7cSO0lNI4CKfrHV6bqH5mHRRXuF9N/jEsP1OGXAzVHIMQWgTE7KaC6PF3o cTQznQ14V2P2riljhSexQQsnaOEi30OUEa3fublg82RUXnfI8nTB5FkiWKUe4vN6vNon 4nYYt3PVgYB9SvyA3y5+7GTYv64KXHCBWWi0L/GTVeiQq5QxV7DMAmptAbulKtZM5D6b 0gUdjOF4OB3RhPSnUIAWl914+DVaioR9QqWtvND/2/GUkizhK6UU/eDpqyvhpoTRii+2 WrCfW7muxl8E3zBwCYBXvJcPNB/55aixwQW9V7OZbCnKgN7h56ylEiNw4IhattzjnXCa R91A==
X-Gm-Message-State: AOJu0YzN6raI27CUtGd9xBARxXFzO6c0QaQm3ju6BZkMShKwaPzuIi2F ca25NJv6dmFbVqfx0538JrD3+nlhLk8rmMQxVjTXriEOJsKhPGU7vhdhico8bP6WT26nTWmvMOP zZuSAAVvy9EdG5KitgvbN3TlP850+Wtuy/ZIO3zhWpGc6KhkM
X-Google-Smtp-Source: AGHT+IGEtizDj7WPuuzM88os+IuxDrLWCB+g7jcHkuI/qqygdMBtbsg+BzXeZKng+Zy8/B0/co+GspjvalzLvDXFncA=
X-Received: by 2002:a05:6a00:1408:b0:717:e01d:312f with SMTP id d2e1a72fcca58-7199ca05aa0mr1544163b3a.27.1726794226347; Thu, 19 Sep 2024 18:03:46 -0700 (PDT)
MIME-Version: 1.0
References: <CAG2Zi20N98cxpgjfRe6gWw1SQEoux+5P3NhLBFUfUHk_udYeFg@mail.gmail.com>
In-Reply-To: <CAG2Zi20N98cxpgjfRe6gWw1SQEoux+5P3NhLBFUfUHk_udYeFg@mail.gmail.com>
From: Orie Steele <orie@transmute.industries>
Date: Thu, 19 Sep 2024 20:03:34 -0500
Message-ID: <CAN8C-_KDTg2ZatR7tf0K9e19Xz24CrMF06_vB8fc0ZioqZ+oeA@mail.gmail.com>
To: Christopher Patton <cpatton=40cloudflare.com@dmarc.ietf.org>
Content-Type: multipart/alternative; boundary="000000000000764b740622829c6a"
Message-ID-Hash: CRLGIXIJ2OR4VVXY4RIB6L7DDWCMT7NE
X-Message-ID-Hash: CRLGIXIJ2OR4VVXY4RIB6L7DDWCMT7NE
X-MailFrom: orie@transmute.industries
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cfrg.irtf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: CFRG <cfrg@irtf.org>
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [CFRG] Re: Where should test vectors live?
List-Id: Crypto Forum Research Group <cfrg.irtf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/cfrg/in7ldlH7dZs5AwlYgWXhEjG2UQo>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cfrg>
List-Help: <mailto:cfrg-request@irtf.org?subject=help>
List-Owner: <mailto:cfrg-owner@irtf.org>
List-Post: <mailto:cfrg@irtf.org>
List-Subscribe: <mailto:cfrg-join@irtf.org>
List-Unsubscribe: <mailto:cfrg-leave@irtf.org>

I like the idea of hosting machine readable test vectors.

The COSE WG has a collection of files under the working group GitHub
organization.

The is also
https://www.iana.org/assignments/yang-parameters/yang-parameters.xhtml

And...
https://www.iana.org/assignments/xml-registry/schema/location-type.xsd

So perhaps there is some possibility of hosting test vectors with IANA.

I would want to ensure that the references made in RFCs are not changed
after publication.

You could consider publishing the hash of the files along with the
references in an appendix.

Hosting the files in a version control system and referencing them that way
seems like the least effort.

OS


On Thu, Sep 19, 2024, 7:17 PM Christopher Patton <cpatton=
40cloudflare.com@dmarc.ietf.org> wrote:

> Hi CFRG,
>
> It occurred to me today that our drafts often have human-friendly test
> vectors that look something like this:
> https://datatracker.ietf.org/doc/html/rfc9180#appendix-A.1.1
>
> These aren't super convenient for a machine. In theory you could write a
> script that downloads https://www.rfc-editor.org/rfc/rfc9180.txt and
> write a parser to pull out the test vectors, but does anyone really do
> this? Luckily for RFC 9180 we have a JSON version to work with instead:
>
> https://raw.githubusercontent.com/cfrg/draft-irtf-cfrg-hpke/refs/heads/master/test-vectors.json
>
> How do folks feel about pointing to machine readable test vectors from an
> RFC in lieu of producing human-friendly, but machine-unfriendly in the
> appendix? Suppose for example an RFC had a pointer to a JSON blob somewhere
> on datatracker. Is this feasible/desirable?
>
> Thanks,
> Chris P.
>
> _______________________________________________
> CFRG mailing list -- cfrg@irtf.org
> To unsubscribe send an email to cfrg-leave@irtf.org
>