[TLS] Re: Improving the quality of the discussion on the TLS email list
Filippo Valsorda <filippo@ml.filippo.io> Fri, 31 July 2026 17:54 UTC
Return-Path: <filippo@ml.filippo.io>
X-Original-To: tls@mail2.ietf.org
Delivered-To: tls@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id EFDCA121CBCF7 for <tls@mail2.ietf.org>; Fri, 31 Jul 2026 10:54:32 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1785520472; bh=8APNUlk86AA9UGRuqVtXxswRLE3XtDWkrjiVcu3Vr4c=; h=Date:From:To:Cc:In-Reply-To:References:Subject; b=LI3RFZEBCzyNbXmGeB/+OP/xUWrIsgPgxvD8PGe0BvzbgoWgmTlpNbBMLfrlwmS/E Oz/uYSX62gixnwr6w8B9u9arcCvKN7yhT9X1Vv0r97bGN34TFd9ZsvecfyB11SgI5w CqIonEPjvBE0OqzJ9rK+bl4h3GTxsxdYEWbDoKdI=
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -2.698
X-Spam-Level:
X-Spam-Status: No, score=-2.698 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_VALIDITY_CERTIFIED_BLOCKED=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=filippo.io header.b="TDLL3BAn"; dkim=pass (2048-bit key) header.d=messagingengine.com header.b="JQUAoqQk"
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0Vuwm9dvvnB7 for <tls@mail2.ietf.org>; Fri, 31 Jul 2026 10:54:31 -0700 (PDT)
Received: from fout-b2-smtp.messagingengine.com (fout-b2-smtp.messagingengine.com [202.12.124.145]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id D06AC121CBCEE for <tls@ietf.org>; Fri, 31 Jul 2026 10:54:31 -0700 (PDT)
Received: from phl-compute-09.internal (phl-compute-09.internal [10.202.2.49]) by mailfout.stl.internal (Postfix) with ESMTP id 715601D0019B; Fri, 31 Jul 2026 13:54:25 -0400 (EDT)
Received: from phl-imap-09 ([10.202.2.99]) by phl-compute-09.internal (MEProxy); Fri, 31 Jul 2026 13:54:25 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=filippo.io; h=cc :cc:content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm1; t=1785520465; x=1785606865; bh=z3m8tWr34a iFIEACgfMMEUampAuWebSA5aJ+25REk6A=; b=TDLL3BAn8d65A7exC5OMl8VeAs K5eZd7faDnXT0/Fumf1HjQWOcddEyW2oDzqD+qlHzDZJebvzXKss7bIdz1x/7rgL khLX4SCxnuoa+SJz8pzpodYPBm3q6HvvSKcJykTkoFgfH408SF3UO8Qc5YP6QTDG rcfP+oXB+R1IaN0KNwQcFCpYjWhJyNEabaiplHyEjjxPU7fNAxflCDtQNeOpN6WA jXfBMq1fb1ZBhtHHsGr5urb+aYl7Yu8aPikJgnihRF2NOde9lqd/CiwPuabLeJa/ oXU82FUanTh0PH+HWlrQ2CcmGPHuwtAxLJ7WsXw7ImpQTbE7u9wzsOZnCM8w==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t= 1785520465; x=1785606865; bh=z3m8tWr34aiFIEACgfMMEUampAuWebSA5aJ +25REk6A=; b=JQUAoqQkdJwk8isLb/h1qyZJB96E246oUzaHq6oOKydWk1lqKEg FX7nqJ44l5g1zTu6RtHcbAqq+44mcIuOfI52ZCqSAcCD+j7uLHQDKFcgw1UP9l7b u45COXiBhls4HyuWQOG/iCN+5F7IZA6B4NH0ruIjhyH5S0nyfR+rX5yNBM0PQTOD HOsVw1cHz40BsQZYhlMLU00NnDstua0JIC/buU4J5SATjDFl++Xrn3/C0MkJ+e8W 12AaMilMy/6juG9MBRHeugv1kKObaC3yTe/VTkkBK43OoKOFrDr/o5PyCW1DiopZ 6y8PrKBddPOVykw3pCC6kiGq/MUxS1iLDhw==
X-ME-Sender: <xms:UeFsahQs0FywXn1JeKEpWob3jvlcjt8EGMxERY5Ox6bHuMh4D6rFyg> <xme:UeFsalmQO2JLb4HFaF9A6Nzh9-c7LAWDLLHWE2DLpE3TwKdNHA2wS82I-U_52jCx8 8FP65b1kuyaZuA8_eC9Hx_pz7N4KoZMOqGJ-oCd1OOWJnVWGG9jxLM>
X-ME-Proxy-Cause: dmFkZTGHfb5P7bjSmg9dIvHBCUtcImLgMZT96aEiwWEvXVkyP1kR2PTL5J5kSf04I20eyn YdQNbrzddwvIAkX9lGTZDKzz4tgC3VMSgRVUPpazJuDuIAoWYtPc94+lSQF/HQuvRoq6Y1 88p+c1EsGeetclZYtC0eWEEz64SclYESVlyNuXQKLWSYaTCC9HW3g2oA0QUHWlHxwfAsgX t50rsC7Aru4Egd21q+3KdgfVZOhiQr4u8noYnbqPK497arUjuowGSq2buU9dc7JBHwLj9t pWIWQPeSWa4zmlZHL1Yj6nBVF48YE7N3skMuQYCik7DLRdB8xoWxu4h9Ll+w7CHhfdb1N2 BvL8cK21BTzJOAb+Z3cLJ0iZlVZRL21ghN/LVP5OmNH1cc/LeKGyGfdz2JBQMDXeRHAWF5 /95C2/wOzrNncsqtrfqd6ZOYzKzPzfdSwnss1tUhrCxyt0B0ODg3IxiPeKhVCYElobV1NF hCp16IZuBfG8qTkqlEo5CMMIwOcubpOjBzftE23eqytaqZ64axUgGn8EzBxp8Mov2m3tJr +QbEFBvuzPQxpyRzfd07pe6sd9PBPwGntYXob3wrZA1qK/gWW3oCJJ3Nfjj5TZnfBQeh9g i+IhhVIJnIxLxuM3YsIVaWDyhSL0pHuyIvK2Z56VHqqokWGkahIH5P/3UhlQ
X-ME-Proxy: <xmx:UeFsaokvDjg7JnNEkqz_cJwnT1fKd0mQ0cTA3Ru23MvtJknsH-1yjQ> <xmx:UeFsasI-o9qXl-_O3Y02T9bBhk5BjjPVIx30lyBnV6we2xsAFoJhEA> <xmx:UeFsaly3ULSpenRZUAjtfhI2WmjHtrzkUs_IbFkl0X2KdX7fjZA_FQ> <xmx:UeFsasuxvM2L1wM3KCmk7a_RicKrWMA2NEOdG8bOztlBJZgKKG2X1g> <xmx:UeFsauXZDl-3agROTfeSsOiw0iKUYYUllFY0t3wyt4hCI6zRqLyb6cp4>
Feedback-ID: i2e91459c:Fastmail
Received: by mailuser.phl.internal (Postfix, from userid 501) id 036253020073; Fri, 31 Jul 2026 13:54:24 -0400 (EDT)
X-Mailer: MessagingEngine.com Webmail Interface
MIME-Version: 1.0
Date: Fri, 31 Jul 2026 19:53:54 +0200
From: Filippo Valsorda <filippo@ml.filippo.io>
To: Orr Dunkelman <orrd@cs.haifa.ac.il>
Message-Id: <f5cb425b-6fd4-48f2-aec0-5272e9ff30fe@app.fastmail.com>
In-Reply-To: <CAA+_yBYWP_3MOcTM8FH8wjiif_L_WLOPVHKnp8nVmGJzFiCCpQ@mail.gmail.com>
References: <CAEzBKQ4fymnSeo8tgqMLOfKopvMGk4xnDq=SQJKf-RBL4-uh6g@mail.gmail.com> <CAEEbLAbhZUpempA9Rvjhm1qrLfBWXa_2ntdfpO20cqDu0h5fbQ@mail.gmail.com> <CAEzBKQ6NOzQc66T+SEdSvLa2gxjtO77DYUUWuTfr99zV_a-Ofg@mail.gmail.com> <c8a74833-35cd-44a0-8992-e5463a82aa8f@dennis-jackson.uk> <F95592F7-6E60-4835-B21C-B5B1954084F7@kenkubota.de> <b3321e23-5f9b-4f8a-8bd9-d2cca2800d67@lear.ch> <amypaHNTh0Ya7XF+@ein.win.tue.nl> <538b6162-6cbb-4051-9810-601b29f880fe@app.fastmail.com> <CAA+_yBYWP_3MOcTM8FH8wjiif_L_WLOPVHKnp8nVmGJzFiCCpQ@mail.gmail.com>
Content-Type: multipart/alternative; boundary="d50ce96a8025f29edddfdc1c8337085cc1faa8bf"
Message-ID-Hash: QKWU5Y4B3KCAJOUUZRLIUABKEGY7R2EZ
X-Message-ID-Hash: QKWU5Y4B3KCAJOUUZRLIUABKEGY7R2EZ
X-MailFrom: filippo@ml.filippo.io
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-tls.ietf.org-0; header-match-tls.ietf.org-1; header-match-tls.ietf.org-2; header-match-tls.ietf.org-3; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: tls@ietf.org
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [TLS] Re: Improving the quality of the discussion on the TLS email list
List-Id: "This is the mailing list for the Transport Layer Security working group of the IETF." <tls.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/tls/6Y4oDbqc8oKaU4muPy4aobCWBEA>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tls>
List-Help: <mailto:tls-request@ietf.org?subject=help>
List-Owner: <mailto:tls-owner@ietf.org>
List-Post: <mailto:tls@ietf.org>
List-Subscribe: <mailto:tls-join@ietf.org>
List-Unsubscribe: <mailto:tls-leave@ietf.org>
Hi Orr,
Emphasis added:
> Then, have you tried tallying support by “pre-existing WG participants or people with demonstrated expertise” *using your own methodology*? Did you land at a result significantly different from “roughly 7/10”?
I have high confidence that Tanja, or you if you want to help, can give it a useful try.
2026-07-31 19:10 GMT+02:00 Orr Dunkelman <orrd@cs.haifa.ac.il>:
> As the ADs did not publicly release the criteria relevant to what is considered "prior involvement" (would participation in one discussion before the ML-KEM sufficient to be considered in this set of voices?) nor what are the "experienced people" they deemed to be worthy of being heard (i.e., newcomers who are experienced), it is a bit impossible to make the statistics you have asked Tanja to make. Actually, even putting aside mailing issues, moderation problems, and assuming that indeed all the votes were indeed public, no one but the ADs can make these statistics. This is exactly what reasonable people asked for in this mailing list (including people from academia, industry and government) - to get these criteria publicly available. Hence, contacting IESG, IAB, the UN, or even the local fire brigade, is useless until the ADs supply this information.
>
> Furthermore, during the discussion I've pointed out that one of the co-designers of MLKEM found the idea of standardizing only MLKEM to be premature. I am sure that when assigning weights to participants, one of the guys inventing the thing (and especially as this particular individual has years of experience in industry, so this is not just a theoretical computer scientist with no understanding of the real world), should probably get a somewhat higher weight than even people who participated in past TLS discussions. As the ADs did not report counting this specific individual's "vote" (that says that the entire idea is bad) it is unclear whether it was taken into account. Actually, I hope to ask all the relevant co-designers when I meet them in future conferences [relevant by my own personal secret criteria].
>
> Cheers,
>
>
>
> On Fri, Jul 31, 2026 at 5:36 PM Filippo Valsorda <filippo@ml.filippo.io> wrote:
>> __
>> Excellent, sounds like you land at the same result as the chairs when tallying support by all participants. That’s promising!
>>
>> Then, have you tried tallying support by “pre-existing WG participants or people with demonstrated expertise” using your own methodology? Did you land at a result significantly different from “roughly 7/10”?
>>
>> Assuming you’re not looking a priori for something to object to, if you come to the same conclusion using your own methodology, I don’t see what good demanding an itemized list would do.
>>
>> If you do come to a significantly different result, you can share your methodology in your appeal, and let the ADs, IESG, or IAB assess it.
>>
>> 2026-07-31 15:55 GMT+02:00 Tanja Lange <tanja@hyperelliptic.org>:
>>> Dear Eliot, dear all,
>>> I can tally the emails on list, which were about even in favor and against.
>>> The chairs announced that by some process of discarding or weighing some votes
>>> they reach 70% in favor. To quote this verbatim
>>> "However, if we look at pre-existing WG
>>> participants or people with demonstrated expertise, roughly 7/10 WG
>>> participants favor advancing the document, which shows rough consensus
>>> to move the document forward."
>>> The requests I've seen, starting right after the chairs announced their
>>> decision that there was consensus in favor of the document, are asking for
>>> which input was discarded or counted higher or lower. I cannot do the
>>> "homework" of checking this because I don't know the mechanism used.
>>>
>>> Additionally, the email asking for responses was sent with
>>> Reply-To: Joseph Salowey <joe@salowey.net>
>>> so that replies would go to Joe's address and to the list only if the sender
>>> chooses to reply to all (or edits the header manually), so there might be some
>>> emails that didn't go to the list and which therefore I cannot count when doing
>>> my homework.
>>>
>>> Finally, there are reports of messages not appearing on list despite the
>>> sender responding with the release code. We have seen some messages containing
>>> release codes appear on list (I hadn't seen that in any previous discussion).
>>> My understanding is that the chairs see those, and maybe that's where the
>>> chairs saw additional support, but I cannot count these in my homework.
>>>
>>> Hence, I would like to support the request for transparency of how the 7/10
>>> (quoted above) was reached.
>>>
>>> All the best
>>> Tanja
>>>
>>> On Fri, Jul 31, 2026 at 01:02:26PM +0200, Eliot Lear wrote:
>>> > Hi,
>>> >
>>> > On 31.07.2026 12:37, Ken Kubota wrote:
>>> >
>>> > There have been repeated requests [1, 2] that the working group chairs release the participant chart/list/table publicly that supports the 70 % claim ("7/10 WG participants favor advancing the document" [3]).
>>> >
>>> > Unnecessary. All the information used by the chairs is publicly available on
>>> > this list. Do your own homework. Stop making work for others.
>>> >
>>> >
>>>
>>>
>>>
>>>
>>>
>>>
>>> > _______________________________________________
>>> > TLS mailing list -- tls@ietf.org
>>> > To unsubscribe send an email to tls-leave@ietf.org
>>>
>>> _______________________________________________
>>> TLS mailing list -- tls@ietf.org
>>> To unsubscribe send an email to tls-leave@ietf.org
>>>
>>
>> _______________________________________________
>> TLS mailing list -- tls@ietf.org
>> To unsubscribe send an email to tls-leave@ietf.org
- [TLS] Improving the quality of the discussion on … Paul Romer
- [TLS] Re: Improving the quality of the discussion… Sophie Schmieg
- [TLS] Follow up on "Improving the quality of the … Paul Romer
- [TLS] Re: Follow up on "Improving the quality of … Filippo Valsorda
- [TLS] Re: Improving the quality of the discussion… Paul Romer
- [TLS] Re: Improving the quality of the discussion… mark
- [TLS] Re: Improving the quality of the discussion… Paul Romer
- [TLS] Re: Improving the quality of the discussion… Dennis Jackson
- [TLS] Re: Improving the quality of the discussion… Sophie Schmieg
- [TLS] Re: Improving the quality of the discussion… Ken Kubota
- [TLS] Re: Improving the quality of the discussion… Eliot Lear
- [TLS] Re: Improving the quality of the discussion… Tanja Lange
- [TLS] Re: Improving the quality of the discussion… Dennis Jackson
- [TLS] Re: Improving the quality of the discussion… Filippo Valsorda
- [TLS] Re: Improving the quality of the discussion… Orr Dunkelman
- [TLS] Re: Improving the quality of the discussion… Filippo Valsorda
- [TLS] Re: Improving the quality of the discussion… Andrew Lee
- [TLS] Re: Improving the quality of the discussion… Salz, Rich
- [TLS] Re: Improving the quality of the discussion… Ken Kubota
- [TLS] Re: Improving the quality of the discussion… Salz, Rich
- [TLS] Request to the Working Group Chairs (accord… Ken Kubota
- [TLS] Re: Request to the Working Group Chairs (ac… Deb Cooley
- [TLS] Re: Request to the Working Group Chairs (ac… Ken Kubota
- [TLS] Re: Request to the Working Group Chairs (ac… Joseph Salowey
- [TLS] Re: Improving the quality of the discussion… Joseph Salowey
- [TLS] Re: Improving the quality of the discussion… Nadim Kobeissi
- [TLS] Re: Improving the quality of the discussion… Nico Williams