[CFRG] Re: Where should test vectors live?

Christopher Patton <cpatton@cloudflare.com> Fri, 20 September 2024 17:29 UTC

Return-Path: <cpatton@cloudflare.com>
X-Original-To: cfrg@ietfa.amsl.com
Delivered-To: cfrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id DBF01C14F60D for <cfrg@ietfa.amsl.com>; Fri, 20 Sep 2024 10:29:07 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.105
X-Spam-Level:
X-Spam-Status: No, score=-2.105 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=cloudflare.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id pIjYqbU_AiDV for <cfrg@ietfa.amsl.com>; Fri, 20 Sep 2024 10:29:03 -0700 (PDT)
Received: from mail-qt1-x836.google.com (mail-qt1-x836.google.com [IPv6:2607:f8b0:4864:20::836]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B348FC14F600 for <cfrg@irtf.org>; Fri, 20 Sep 2024 10:29:03 -0700 (PDT)
Received: by mail-qt1-x836.google.com with SMTP id d75a77b69052e-4584a719ff5so16316111cf.0 for <cfrg@irtf.org>; Fri, 20 Sep 2024 10:29:03 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cloudflare.com; s=google09082023; t=1726853342; x=1727458142; darn=irtf.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=e8i55rdkDUiYxA6k1Qgaq/CVoFLuLeK9aih9BOCo0lo=; b=NsJYrm7yFQmyYXb8lhCEZGxHZpqA9D05TDu4SZiTvuCa5idD+m0XQjtO05LheRYreT +gkxwd5bgwBv/kSorhEGK1Neds8oZh1ON+tiR+2pRTtj2mApyS9dJYcddOeJ2WbCJETF xlVFG9ONX0hTr+2qNNsVEpBeZKVFgxzPyedMH7VsauZZrFpphJIW4qmWXHADxmcriwrr 4LNbGj2ivALmEUXFLhQ94NFYFZYdETdM/Gn8dMxJ2U7nCHpEZ7bQfPA0P1ZjVoKwuN6T IdKBxaAFanzYoJJwiYZfA/WDdqXUj1ITmXTWdaKlZ6mG/LkzjLjTqO7/pwirxIrymqTR q6GQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1726853342; x=1727458142; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=e8i55rdkDUiYxA6k1Qgaq/CVoFLuLeK9aih9BOCo0lo=; b=LzO3HjZSlT1KIugMbc7L/efmGCCXm8aFq7eQdTTp+Iwy1ZgC/z6Q8FNzwT48eoGVj8 pWuxrGC6fPqY1UIJg4BBZ0fx76a3/QChBR/JuYC1jlATQplVgh2GzMp83ZRvCdK5Vcj9 vBh8KGFJQyduFha6Dh0Bp8GBbxkQgxGH4SQMV3NlK4klnt0X5cyQsuUjaMsVC/Va2LBM sPcw58foifq0WknzZCKUzhabXuuiakJsAXGxZGd27rL16BmpAARm6A3G4PMUkxNCsmoB RiPszOKuokmnuKACKOhM2boeuOR/CrJAar4LO/bk9HmAAXygrqjIm/+qpOKWiFqLeibt fCzQ==
X-Gm-Message-State: AOJu0YzWWFGX11i5Yro5ro/EzSRZ9n9pOP+f9JrYkCmCNY6HdRVwGUfC Q0rzqWZhK8P+Gbo9FnItTpZuxDSC7pS87CsudrCQH7DZrVMMRzYA6HmMmMI/Id7Uoke3MPz5bwo vpnXdIwD30+igyHjL9dmtubOU4OLA6FPhXkXTKH82uUUV3FxziZA=
X-Google-Smtp-Source: AGHT+IE25zRqd9xmPWZe7RJwdNFdiuUuBREL04knBmxBHfxq3GV6E/eQbgsLyV/cYM5Y8Caw5sBAyO63FCHif/GZxcY=
X-Received: by 2002:a05:622a:190c:b0:458:4ff5:84ce with SMTP id d75a77b69052e-45b2291dc14mr46583751cf.49.1726853342437; Fri, 20 Sep 2024 10:29:02 -0700 (PDT)
MIME-Version: 1.0
References: <CAG2Zi20N98cxpgjfRe6gWw1SQEoux+5P3NhLBFUfUHk_udYeFg@mail.gmail.com> <AFC838DA-68C1-476C-8823-C3BF1E38CE39@csperkins.org>
In-Reply-To: <AFC838DA-68C1-476C-8823-C3BF1E38CE39@csperkins.org>
From: Christopher Patton <cpatton@cloudflare.com>
Date: Fri, 20 Sep 2024 10:28:50 -0700
Message-ID: <CAG2Zi23hBZjJ==G0sRwyN+w9bH3ww=G3=MC3eHY+cExqd6X57Q@mail.gmail.com>
To: Colin Perkins <csp@csperkins.org>
Content-Type: multipart/alternative; boundary="0000000000000e44db062290604d"
Message-ID-Hash: YCUP7CPBJM3RNXJNO63TGEJERGRMEMFA
X-Message-ID-Hash: YCUP7CPBJM3RNXJNO63TGEJERGRMEMFA
X-MailFrom: cpatton@cloudflare.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cfrg.irtf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: CFRG <cfrg@irtf.org>
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [CFRG] Re: Where should test vectors live?
List-Id: Crypto Forum Research Group <cfrg.irtf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/cfrg/vfro_aZh0zzU78IGQIElI_D9Kzc>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cfrg>
List-Help: <mailto:cfrg-request@irtf.org?subject=help>
List-Owner: <mailto:cfrg-owner@irtf.org>
List-Post: <mailto:cfrg@irtf.org>
List-Subscribe: <mailto:cfrg-join@irtf.org>
List-Unsubscribe: <mailto:cfrg-leave@irtf.org>

Colin,

What would be the contents of the "Additional resources" field? Would it
just be a link to GitHub? Ideally the RFC itself would tell you where to
get test vectors: do you think it's inappropriate for the RFC itself to
link to GitHub?

Chris P.

On Fri, Sep 20, 2024 at 10:03 AM Colin Perkins <csp@csperkins.org> wrote:

> Hi,
>
> The datatracker has an “Additional resources” field for each draft, that
> can be used to cross-reference to GitHub repos, etc.
>
> Colin
>
> On 20 Sep 2024, at 1:17, Christopher Patton wrote:
>
> Hi CFRG,
>
> It occurred to me today that our drafts often have human-friendly test
> vectors that look something like this:
> https://datatracker.ietf.org/doc/html/rfc9180#appendix-A.1.1
>
> These aren't super convenient for a machine. In theory you could write a
> script that downloads https://www.rfc-editor.org/rfc/rfc9180.txt and
> write a parser to pull out the test vectors, but does anyone really do
> this? Luckily for RFC 9180 we have a JSON version to work with instead:
>
> https://raw.githubusercontent.com/cfrg/draft-irtf-cfrg-hpke/refs/heads/master/test-vectors.json
>
> How do folks feel about pointing to machine readable test vectors from an
> RFC in lieu of producing human-friendly, but machine-unfriendly in the
> appendix? Suppose for example an RFC had a pointer to a JSON blob somewhere
> on datatracker. Is this feasible/desirable?
>
> Thanks,
> Chris P.
>
> _______________________________________________
> CFRG mailing list -- cfrg@irtf.org
> To unsubscribe send an email to cfrg-leave@irtf.org
>
>