IETF Logo Mail Archive

Re: [Edm] Implementation status listings and conformance tests

John Levine <johnl@taugh.com> Sat, 05 February 2022 03:43 UTC

Return-Path: <johnl@iecc.com>
X-Original-To: edm@ietfa.amsl.com
Delivered-To: edm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 929653A307E for <edm@ietfa.amsl.com>; Fri, 4 Feb 2022 19:43:31 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.85
X-Spam-Level:
X-Spam-Status: No, score=-1.85 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.25, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=iecc.com header.b=RVgtYKiU; dkim=pass (2048-bit key) header.d=taugh.com header.b=wjfymiT3
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id yGCjBVXSflyL for <edm@ietfa.amsl.com>; Fri, 4 Feb 2022 19:43:26 -0800 (PST)
Received: from gal.iecc.com (gal.iecc.com [IPv6:2001:470:1f07:1126:0:43:6f73:7461]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 86B613A307B for <edm@iab.org>; Fri, 4 Feb 2022 19:43:26 -0800 (PST)
Received: (qmail 60926 invoked from network); 5 Feb 2022 03:43:23 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=iecc.com; h=date:message-id:from:to:cc:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:cleverness; s=edfa.61fdf25b.k2202; bh=y8sAtokqwMR+4IW32xf4GieWctWro1cTWtFJ+q/dW/o=; b=RVgtYKiURkLmDLK8/ky7bQrRvBaevR7lCjR41xeiknXL5icyEfG37hn4fSq98imt6g2C1+IVpvaOjPj5zCKNX3aQnt+hhK4izNCjorGnIp54N4BpnWKsxRG9BMJ9+gVdOe5bXqXALh+l4alqJ8pr92inIxgZGsp7auGQjMKI356PKH9DucwxdP19HpkHrPgJfgmmda1mcce/1HbjtgSI9WMl+lh0Z+LjPwYJz+Ag+4CqO1l8y+mw+9vMiwfB2OEkaVY0bE+cw3GEOylA+tmeNv41J8XAKQbUBjUR1im40eOT57NebifzUCN6SktHwXRQxm3odGTDZuw2/LAEdXwlAQ==
DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=taugh.com; h=date:message-id:from:to:cc:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:cleverness; s=edfa.61fdf25b.k2202; bh=y8sAtokqwMR+4IW32xf4GieWctWro1cTWtFJ+q/dW/o=; b=wjfymiT3ad9ZrQJfCQzqAm8zpWBSfkOLVc/BPl6NdsVxqIfEBYzpBBBlFRPg3vr78xniXxT8ihW3/fwFWHA08beq4B3h51bFpBq2caGEgUgagcUbmRQk6fjoZVPPz6aS10uTvPXKcJO2FFwrZ62tpe6Lz+i/lHBxUE0vNYAeA/HJd2ruouFZcliqQEmezqmpFZhIlbkoC4MWF6V5OxDiTbu1Eg9pSQ+BX2nosC4B3achuLjMbVoNWui9MKLx2tnpEF8S5Eop4uKtxj/PmTyvp1/jEAt2xgZm5l79Hv8kO4/zmM2cyDcQzMK96HVelnAHbmP02Mg5daVgFlmime0lOQ==
Received: from ary.qy ([IPv6:2001:470:1f07:1126::78:696d:6170]) by imap.iecc.com ([IPv6:2001:470:1f07:1126::78:696d:6170]) with ESMTPS (TLS1.2 ECDHE-RSA AES-256-GCM AEAD) via TCP6; 05 Feb 2022 03:43:23 -0000
Received: by ary.qy (Postfix, from userid 501) id E81813657481; Fri, 4 Feb 2022 22:43:22 -0500 (EST)
Date: Fri, 04 Feb 2022 22:43:22 -0500
Message-Id: <20220205034322.E81813657481@ary.qy>
From: John Levine <johnl@taugh.com>
To: edm@iab.org
Cc: tpauly@apple.com
In-Reply-To: <4EF9A682-4A27-4B95-9AD2-28A4393E843E@apple.com>
Organization: Taughannock Networks
X-Headerized: yes
Cleverness: minimal
Mime-Version: 1.0
Content-type: text/plain; charset="utf-8"
Content-transfer-encoding: 8bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/edm/W_uKWJvgKa43gLATfDQK3UcILBk>
Subject: Re: [Edm] Implementation status listings and conformance tests
X-BeenThere: edm@iab.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Evolvability, Deployability, & Maintainability \(Proposed\) Program" <edm.iab.org>
List-Unsubscribe: <https://www.iab.org/mailman/options/edm>, <mailto:edm-request@iab.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/edm/>
List-Post: <mailto:edm@iab.org>
List-Help: <mailto:edm-request@iab.org?subject=help>
List-Subscribe: <https://www.iab.org/mailman/listinfo/edm>, <mailto:edm-request@iab.org?subject=subscribe>
X-List-Received-Date: Sat, 05 Feb 2022 03:43:32 -0000

It appears that Tommy Pauly  <tpauly@apple.com> said:
>Hi Paul,
>
>Thanks for sharing this. I think this is a useful caution against delving into managing conformance, or even trying to strictly define what guarantees come with implementation status / interoperability.
>
>Perhaps there should be some standard written disclaimer text we can recommend for any pages that discuss implementation status to provide this warning?

I think the advice is to do what we did with the mail server EAI tests,
say these packages passed these tests without trying to say therefore
they conform to X.

In case there were places where formal conformance had little relationship to usability.
In particular, there were POP and IMAP servers that passed very few of the formal EAI
tests but even so were quite usable with EAI mail.

R's,
John

v2.23.0 | Report a Bug | By Email