Re: [Edm] Tracking (and distinguishing) formal analysis

Martin Thomson <mt@lowentropy.net> Wed, 15 March 2023 11:24 UTC

Return-Path: <mt@lowentropy.net>
X-Original-To: edm@ietfa.amsl.com
Delivered-To: edm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BB8F7C151544 for <edm@ietfa.amsl.com>; Wed, 15 Mar 2023 04:24:50 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.095
X-Spam-Level:
X-Spam-Status: No, score=-7.095 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=lowentropy.net header.b="Gz5NXKgM"; dkim=pass (2048-bit key) header.d=messagingengine.com header.b="lq8LnIdy"
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id vJqHVgtk4yMy for <edm@ietfa.amsl.com>; Wed, 15 Mar 2023 04:24:45 -0700 (PDT)
Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B6F12C15152D for <edm@iab.org>; Wed, 15 Mar 2023 04:24:45 -0700 (PDT)
Received: from compute6.internal (compute6.nyi.internal [10.202.2.47]) by mailout.nyi.internal (Postfix) with ESMTP id 942DC5C0191 for <edm@iab.org>; Wed, 15 Mar 2023 07:24:42 -0400 (EDT)
Received: from imap41 ([10.202.2.91]) by compute6.internal (MEProxy); Wed, 15 Mar 2023 07:24:42 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lowentropy.net; h=cc:content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm3; t=1678879482; x=1678965882; bh=6F kjkisfZVTPn/bn++u6ekoOPMttT28DCAroBV5HCAY=; b=Gz5NXKgMw08PWfNknk 5t8SW9tebrVfuQXBJOxw1ZVtdXzSw0wW9WtpfWJm1AwTHtjWhltAEZRktyCX6sTh X6f7IALIlZ0F0zPXIhNXNA4CegKJfAuFGNDXU6FmsswiNAuIpQxWadgFVi9m9E0g 7ZKkXFkOPZo7h1uDh0OSOeHl9ZEBQat1AngXgpT1CstSbWikgjiC+EEc+GlRDDdP ICG+xJonqVbnqbHmX1G5IDFmHkOOXPt0tfmVPlxbJ+pNrHzbQIr7JGR8gms4XCYM /tRkt2EnCniePaLTrhWnj83ITM3OwjSzoBZwtTRIm/7LXYbaEpQcoFI/sp0RHN+y 8EVQ==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1678879482; x=1678965882; bh=6FkjkisfZVTPn /bn++u6ekoOPMttT28DCAroBV5HCAY=; b=lq8LnIdy+j7yw2EIqeJw125D61mPr JKeMkDArLGAL2355gFcMQqH1Cei5ZbdrI4xz7xL5C3dk+6PXDlDar9pyWiuJOqQe 9Ow3PFvHhLqormir/YnCDJ1mQzfcMaOWS3o8xqr87RGSxailwdkDzMPgT0IXqP+v hBv6/2avviPo4uXm2RCnthn9Mu0iPfeWIlmiBx9RQSZVkTsbg0yKR3egqbd2nFQM 8B1RnUfUS+dXtmdoGXj7KzSKY0rtuXpk6tOnbRnUa4QF8bukysr/lxMmQqgOjBOE LRwHH8WPX2DjUltOvtORg/vjL4lL8RiiLKyJ5XW2e5Lt3oslc3ZdwsXSg==
X-ME-Sender: <xms:-qoRZM9cYHwAB1gu2X8ZvgUJGuXzbpUEwV0PUjKiZtOTGQJE01O9HQ> <xme:-qoRZEuaM-Ge4I4F8Vw0zcrznYH5kQc9MGWjeouIyVG5rgiLGbE-ivv80MwwIYOKW VQZ4vmwo26pSPruh0Y>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvhedrvddvkedgvdejucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfgjfhffhffvufgtsehttd ertderredtnecuhfhrohhmpedfofgrrhhtihhnucfvhhhomhhsohhnfdcuoehmtheslhho figvnhhtrhhophihrdhnvghtqeenucggtffrrghtthgvrhhnpefhhfeljeffuefhfeehie euuedtudeljeevkeegkedvheefiefgtefhvefffeelgeenucffohhmrghinhepghhithhh uhgsrdgtohhmpdhivghtfhdrohhrghdpihgrsgdrohhrghenucevlhhushhtvghrufhiii gvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehmtheslhhofigvnhhtrhhophihrdhn vght
X-ME-Proxy: <xmx:-qoRZCBsHH5V5i8tqo5TDLdts7n73phlPUlV-RyKxws7eGxgj9QFfA> <xmx:-qoRZMc1ou1IGaZf3ZKGc4I94E1qpgu_aJa-18Hq3AEZBtouTIkCug> <xmx:-qoRZBN0GUwxWKPbU9Y1fqvF8mlX4p7bH_gk5IcQNH_Qrw0zgf93XQ> <xmx:-qoRZHbyS2laRTGOLUPVd3sO5zvo3A81UWaKc5QUCkKOsZX4PqgVmQ>
Feedback-ID: ic129442d:Fastmail
Received: by mailuser.nyi.internal (Postfix, from userid 501) id 5F6DE234007E; Wed, 15 Mar 2023 07:24:42 -0400 (EDT)
X-Mailer: MessagingEngine.com Webmail Interface
User-Agent: Cyrus-JMAP/3.9.0-alpha0-221-gec32977366-fm-20230306.001-gec329773
Mime-Version: 1.0
Message-Id: <a7471db3-efe8-421a-b9fa-9acc4824ab67@betaapp.fastmail.com>
In-Reply-To: <E190D24B-81E3-45F4-A2C6-06E21473C16B@heapingbits.net>
References: <E190D24B-81E3-45F4-A2C6-06E21473C16B@heapingbits.net>
Date: Wed, 15 Mar 2023 22:24:22 +1100
From: Martin Thomson <mt@lowentropy.net>
To: edm@iab.org
Content-Type: text/plain
Archived-At: <https://mailarchive.ietf.org/arch/msg/edm/GS4sv6d9bf-OrzIeyM95CVzw98w>
Subject: Re: [Edm] Tracking (and distinguishing) formal analysis
X-BeenThere: edm@iab.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: "Evolvability, Deployability, & Maintainability \(Proposed\) Program" <edm.iab.org>
List-Unsubscribe: <https://www.iab.org/mailman/options/edm>, <mailto:edm-request@iab.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/edm/>
List-Post: <mailto:edm@iab.org>
List-Help: <mailto:edm-request@iab.org?subject=help>
List-Subscribe: <https://www.iab.org/mailman/listinfo/edm>, <mailto:edm-request@iab.org?subject=subscribe>
X-List-Received-Date: Wed, 15 Mar 2023 11:24:50 -0000

I tend to think that the draft should be citing work like what you reference.

Still, having references to implementations, analyses, or other relevant material, can still be valuable to collect the way you describe.  I think that this could help.  Given that this is a bag of tagged URLs, the bar for adding new types should be pretty low.

On that thought, I'd be OK with "explanatory blog posting" meeting the bar, as well, if you like.  We've had a ton of really good ones published over time for IETF work.  Sometimes they are the best way to get introductory-level background on the work.  Add those too.

(Tracking clicks might only offer the most vague approximation of "value".  Discussion might be a better indicator. Though in this case, the number of people qualified to read and contribute to that work is very much limited.)

On Wed, Mar 15, 2023, at 22:04, Christopher Wood wrote:
> Hi folks,
>
> One of the helpful contributions of this group was changes to the 
> datatracker that help track implementations of specifications (under 
> "additional resources"). I've used this for a couple of specifications 
> [0], and I hope others find them useful [1].
>
> Implementations are not the only artifact that help with the 
> development of specifications, though. Artifacts produced through 
> formal analysis, such as executable models using tools like ProVerif or 
> Tamarin and even pen-and-paper analyses, both change as the 
> specification changes. As we develop specifications, new analyses 
> appear over time, including after the final RFC is published.
>
> Given that these artifacts have similar churn as implementations, and 
> complement specifications in a similar way as well, I'm wondering if we 
> ought to extend the available tags in the datatracker to keep track of 
> these things. As a strawman proposal, what do folks think about adding 
> a "related_analyses" tag (similar to the "related_implementations" tag) 
> to the set of available tags in the datatracker? We might use it like 
> so:
>
>     related_analyses https://github.com/cloudflare/ohttp-analysis 
> (Tamarin model of Oblivious HTTP)
>    
> Additionally, I'm wondering if we could also add a way to "flag" 
> different resources so that they are easier to identify. Not everyone 
> might know what a "Tamarin model" is. So for example, perhaps we could 
> have colored label that says "analysis" (or something) next to the 
> rendered item in the datatracker.
>
> Good idea? Bad idea? I'm curious to hear your thoughts. If interested, 
> maybe we could discuss this in 116?
>
> Best,
> Chris
>
> [0] https://datatracker.ietf.org/doc/draft-ietf-ohai-ohttp/ as one 
> example
> [1] I don't know how useful these are to others. Do we have a way to 
> determine how many times these links are clicked?
> -- 
> Edm mailing list
> Edm@iab.org
> https://www.iab.org/mailman/listinfo/edm