[CFRG] Re: Where should test vectors live?
Orie Steele <orie@transmute.industries> Fri, 20 September 2024 01:17 UTC
Return-Path: <orie@transmute.industries>
X-Original-To: cfrg@ietfa.amsl.com
Delivered-To: cfrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A8A8CC1519A8 for <cfrg@ietfa.amsl.com>; Thu, 19 Sep 2024 18:17:10 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.105
X-Spam-Level:
X-Spam-Status: No, score=-2.105 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=transmute.industries
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id idsH3D9lbor9 for <cfrg@ietfa.amsl.com>; Thu, 19 Sep 2024 18:17:06 -0700 (PDT)
Received: from mail-pf1-x42b.google.com (mail-pf1-x42b.google.com [IPv6:2607:f8b0:4864:20::42b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B81C8C151998 for <cfrg@irtf.org>; Thu, 19 Sep 2024 18:17:01 -0700 (PDT)
Received: by mail-pf1-x42b.google.com with SMTP id d2e1a72fcca58-71798661a52so1217600b3a.0 for <cfrg@irtf.org>; Thu, 19 Sep 2024 18:17:01 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=transmute.industries; s=google; t=1726795021; x=1727399821; darn=irtf.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=WWCDR36ZrowkFFUXefWdJ3Tvw+Ubjbjgeacw3EnRTDE=; b=L4/ZXmIl6irQeqtPDLb96/9EEYmJNOUIvIgWoqLTo5w59iwMXOYiFC6ENYy6tVhCEd dDwtf/QliK5tSoredVhuQYNLEGKkkNTd16SNL7IrphIzN/y+6vOPJVNMD+jFZc7FAoYY ayuQ5oGABTMw1Ph++YHN0RxlkPXZKbjUOk+7VuocCatXuP27uSXjnPbrmpbPSwcBt5TK MHYPM3D6pxCJy+OO5SOoJVP0HoTdS+DZOwNPyJFvcER2JtGosC9y8BYBAD9lw3rYweuo gWGKYeAjuypKz/27bP67wrD/5K3dKjSD2iL9PiJNZOigx+WE7/67C2IgzQ2pgVSfOBUQ 422A==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1726795021; x=1727399821; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=WWCDR36ZrowkFFUXefWdJ3Tvw+Ubjbjgeacw3EnRTDE=; b=jhySJGW7z8fp0Sc4gmGW4BpLJZ96/3bYwxOAG4YuQNCI2B8rkA2dT7ah9R8esa+KcW P8feAZu6n3jLlhLqlMfV8R2X75Z9KLj8bVxTckg9OQXSa49MbzLbytnfiFttDajWCs9s 9p+ko3mHeQXkMKgkzb2p0xHotb1+7QwkxZXXRGAZCqTFGwTgKnFGE7VGbClsQ4Qgf1p3 gYDJ1Ak+0cBYlk8h8P9QDYaCpvCJ6zhDXl7v4zluiVMhxPkE6yuCwKdcmWLR+8crCL58 Z6xonsxgR1W9jXEM6m39q2nVnEBfPmotwR3sTJ3IynmC4sIzVLg++7lg3QOLJiJ+a3Rb 6qhQ==
X-Forwarded-Encrypted: i=1; AJvYcCWaT3gsbjXyy1cOc1oljGzlM9J3oe2Idn4TBYeb8YkVaDUdqtPJ5xgdAf8PR6ihBBckOptO@irtf.org
X-Gm-Message-State: AOJu0YyGZ9EQxw2JkXF6s6VaOGnNETwPj0JC4O0c7lhdT0DWJ5q6oVWa DiZYDw48gKE/753ElAokIbdbvVMjP3N6Leo5Wj7e59BoGKnSA5LpD3YyOfptA1nkByMEyAnKmtg 7+dpi/DpF+7uopq2T93nKE0uJUpUj8s5rsm03Og==
X-Google-Smtp-Source: AGHT+IH6ePiuHla/Av9ZuLJuK6qvfmjH+JCuyjDGkR0F/yNrpiYUfN1FbyTEQLzhMXAA27Quuxdq7/VKigq5MLoooSU=
X-Received: by 2002:a05:6a00:23c8:b0:706:aa39:d5c1 with SMTP id d2e1a72fcca58-7199b0cff9bmr1843237b3a.8.1726795020947; Thu, 19 Sep 2024 18:17:00 -0700 (PDT)
MIME-Version: 1.0
References: <CAG2Zi20N98cxpgjfRe6gWw1SQEoux+5P3NhLBFUfUHk_udYeFg@mail.gmail.com> <CACsn0cmLjjyxcKsiHio-Vu-8jo80FQ=aFtoO3GD69jC5kUig9A@mail.gmail.com> <CAL02cgSwxmkfaE23ivfZQFe9DPBLE8wiQoQjin0HNKfo611YOA@mail.gmail.com>
In-Reply-To: <CAL02cgSwxmkfaE23ivfZQFe9DPBLE8wiQoQjin0HNKfo611YOA@mail.gmail.com>
From: Orie Steele <orie@transmute.industries>
Date: Thu, 19 Sep 2024 20:16:49 -0500
Message-ID: <CAN8C-_+Um4i5rZJx1wdiALV-xKpaOKsonRv-9M9g+Xmt-ExVkw@mail.gmail.com>
To: Richard Barnes <rlb@ipv.sx>
Content-Type: multipart/alternative; boundary="000000000000d2ed76062282cb9c"
Message-ID-Hash: HACHYYSVK2GB65WFCSXEERNL2BUHVJ2I
X-Message-ID-Hash: HACHYYSVK2GB65WFCSXEERNL2BUHVJ2I
X-MailFrom: orie@transmute.industries
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-cfrg.irtf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: Christopher Patton <cpatton=40cloudflare.com@dmarc.ietf.org>, CFRG <cfrg@irtf.org>
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [CFRG] Re: Where should test vectors live?
List-Id: Crypto Forum Research Group <cfrg.irtf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/cfrg/iu-gipLb5iLOKKFspRaFqXgMMq8>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cfrg>
List-Help: <mailto:cfrg-request@irtf.org?subject=help>
List-Owner: <mailto:cfrg-owner@irtf.org>
List-Post: <mailto:cfrg@irtf.org>
List-Subscribe: <mailto:cfrg-join@irtf.org>
List-Unsubscribe: <mailto:cfrg-leave@irtf.org>
Richard beat me to it, but here is another link for including source code in XML RFCs. https://authors.ietf.org/rfcxml-vocabulary I suspect developers would probably prefer direct links to files over parsing content out of XML or HTML, but that's always an option. OS On Thu, Sep 19, 2024, 8:14 PM Richard Barnes <rlb@ipv.sx> wrote: > FWIW, RFC 6716 contains the source code of a reference implementation, and > instructions for how to extract and build the code from the RFC: > > https://datatracker.ietf.org/doc/html/rfc6716#appendix-A.1 > > You could do a similar thing with test vectors. > > On Thu, Sep 19, 2024 at 9:10 PM Watson Ladd <watsonbladd@gmail.com> wrote: > >> >> >> On Thu, Sep 19, 2024, 5:18 PM Christopher Patton <cpatton= >> 40cloudflare.com@dmarc.ietf.org> wrote: >> >>> Hi CFRG, >>> >>> It occurred to me today that our drafts often have human-friendly test >>> vectors that look something like this: >>> https://datatracker.ietf.org/doc/html/rfc9180#appendix-A.1.1 >>> >>> These aren't super convenient for a machine. In theory you could write a >>> script that downloads https://www.rfc-editor.org/rfc/rfc9180.txt and >>> write a parser to pull out the test vectors, but does anyone really do >>> this? Luckily for RFC 9180 we have a JSON version to work with instead: >>> >>> https://raw.githubusercontent.com/cfrg/draft-irtf-cfrg-hpke/refs/heads/master/test-vectors.json >>> >>> How do folks feel about pointing to machine readable test vectors from >>> an RFC in lieu of producing human-friendly, but machine-unfriendly in the >>> appendix? Suppose for example an RFC had a pointer to a JSON blob somewhere >>> on datatracker. Is this feasible/desirable? >>> >> >> Why not in ignored elements (not sure how to do)in the XML source? This >> might take some tools team input. >> >>> >>> Thanks, >>> Chris P. >>> >>> _______________________________________________ >>> CFRG mailing list -- cfrg@irtf.org >>> To unsubscribe send an email to cfrg-leave@irtf.org >>> >> _______________________________________________ >> CFRG mailing list -- cfrg@irtf.org >> To unsubscribe send an email to cfrg-leave@irtf.org >> > _______________________________________________ > CFRG mailing list -- cfrg@irtf.org > To unsubscribe send an email to cfrg-leave@irtf.org >
- [CFRG] Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? D. J. Bernstein
- [CFRG] Re: Where should test vectors live? Orie Steele
- [CFRG] Re: Where should test vectors live? Watson Ladd
- [CFRG] Re: Where should test vectors live? Richard Barnes
- [CFRG] Re: Where should test vectors live? Orie Steele
- [CFRG] Re: Where should test vectors live? Björn Haase
- [CFRG] Re: Where should test vectors live? Carsten Bormann
- [CFRG] Re: Where should test vectors live? Carsten Bormann
- [CFRG] Re: Where should test vectors live? Björn Haase
- [CFRG] Re: Where should test vectors live? Carsten Bormann
- [CFRG] Re: Where should test vectors live? Peter Gutmann
- [CFRG] Re: Where should test vectors live? Frank Denis
- [CFRG] Re: Where should test vectors live? Frank Denis
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? Sofia Celi
- [CFRG] Re: Where should test vectors live? Colin Perkins
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? Carsten Bormann
- [CFRG] Re: Where should test vectors live? // Sug… Björn Haase
- [CFRG] Re: Where should test vectors live? Colin Perkins
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? Salz, Rich
- [CFRG] Re: Where should test vectors live? Jean Mahoney
- [CFRG] Re: Where should test vectors live? Christopher Patton
- [CFRG] Re: Where should test vectors live? John Mattsson
- [CFRG] Re: Where should test vectors live? Peter Gutmann
- [CFRG] Re: Where should test vectors live? Björn Haase
- [CFRG] Re: Where should test vectors live? D. J. Bernstein
- [CFRG] Re: Where should test vectors live? Bellebaum, Thomas
- [CFRG] Re: Where should test vectors live? Scott Fluhrer (sfluhrer)
- [CFRG] Re: Where should test vectors live? Phillip Hallam-Baker