Re: Dealing with LLMs in IETF discussions draft

Orie <orie@or13.io> Fri, 31 July 2026 11:32 UTC

Return-Path: <orie@or13.io>
X-Original-To: ietf@mail2.ietf.org
Delivered-To: ietf@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 929481218E074 for <ietf@mail2.ietf.org>; Fri, 31 Jul 2026 04:32:10 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1785497530; bh=xopZXgp9dRUtGEUMTvXE8xTENgtGXj2uQc7lnsiykmA=; h=References:In-Reply-To:From:Date:Subject:To:Cc; b=y9tetc21JSwNP996t84Ttl9nS4COr/yRywGCIfcyMQ3EArPpGjUTCn5Vcjk5Q4y9Q 93k3qVuCr5McbDpFsUeDas9kju0Wz/V1VceQOJ5j6Xyy++xnC8FSr5X4r5vw07WIo+ eCh9tRKNeu636y/TT1uPVXkMk7u3Hdsrp+tRVCVY=
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=or13.io
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id frU3auVG3q_W for <ietf@mail2.ietf.org>; Fri, 31 Jul 2026 04:32:09 -0700 (PDT)
Received: from mail-pg1-x532.google.com (mail-pg1-x532.google.com [IPv6:2607:f8b0:4864:20::532]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id 9013A1218E068 for <ietf@ietf.org>; Fri, 31 Jul 2026 04:32:09 -0700 (PDT)
Received: by mail-pg1-x532.google.com with SMTP id 41be03b00d2f7-c999f162c9aso557457a12.3 for <ietf@ietf.org>; Fri, 31 Jul 2026 04:32:09 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; t=1785497528; cv=none; d=google.com; s=arc-20260327; b=J15uS+iQfBUH9dVFHDwqMQcAcBF1/tEkVPZXmZ63g7PJpsLKv6Q65RBQsi0rInQfHg 0HWci8j7VyA6ybYpRU/UxWXk/SzIc7BNIoXcfLDgFq+fEzxipNa+bfcc68gr4C3Uqziq hOQUBLnp1m1JOFZHh/l5tFGOTnX8grx5KJxFreAP0r3uknMa+xn/GpUash6qpZ2rwV65 xV9AZH/3xEeg77FYckhfuyEULM0lzRPQ0LC3aeizT8Rf6WswEqz6HNHWvAmPAn/gku/e bxvSIWINyA4zU/i4kET2/iKGcsN0zcHuVGpGES59URQskQNBQhsEj8/fHcxrE/x9QRR+ C1HQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=zXMGJmnoJtU+giKkZoMQHRTlJ17k+3r+s0Q8hWLQYCQ=; fh=jD5L10VIzsT8wvcp7fG59eTn1Ry8SJkWQugoP6q4OaE=; b=TZvkJdhVgYRzpAmnkrcykUxEOk49qlzo53kQLb6VEViTAM5qnGPLDUOE58vZkIStwz 9zAcODj/I+ECGWvvcTOQw3jEsAX6QM/34NU3PI0UTTMkPB8JyzA7xklvox0SUjwzkupI d0BqyBsaUDVrbWN1HrT4P+Iecc8UIHNFI8H/jaXuJJhY0I1zhWflrpHkPSOiMsI/mC2T FWYdC0+FMYUqAaQ9egW9K1oBRsWvwr3QqBzeqhA6GZ2KjGe5r3/3+ISr/5wBDWQXTJly 9vLnhh8zW12jSxhi01hnB6RBNjeT4GC6Eyu6yFYW7vlSu17t3KeKUpMbEDC4e/t32zZY rJFw==; darn=ietf.org
ARC-Authentication-Results: i=1; mx.google.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=or13.io; s=google; t=1785497528; x=1786102328; darn=ietf.org; h=content-type:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:from:to:cc:subject:date:message-id:reply-to :content-type; bh=zXMGJmnoJtU+giKkZoMQHRTlJ17k+3r+s0Q8hWLQYCQ=; b=Tiq3TTp0bsiO4lD/JEilseOVAlXk2i6sDu/iB5m4byU2bkl+MM9h/5ckRZx+9r7CTv wWBVRJ1fq6OwjvHinoxMNR3QIjUvLRv/Q92VIjp/JA+XhRMRkU6xdmdplphAfmMLmFGr xT2MwvrlHYjts/SB266XOY1Wnd+XEuQint5rk6mvZlcE2dQMYRAio/ptjvn56AI9+K/W Pe4bPRhuk0qluq2ncrqTPC0trTwqhU9OEYfLU1+93rUhIbQ0NPHv1+xXhRmd+NwC+q9K a43LKbvVAJBB3NIKof4C6LgianYeeOnaF2b+QNAHG5PbME8L2XIRmNC0wc6r6TULRiWS iM1Q==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1785497528; x=1786102328; h=content-type:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:x-gm-gg:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to:content-type; bh=zXMGJmnoJtU+giKkZoMQHRTlJ17k+3r+s0Q8hWLQYCQ=; b=ACJ2CkRVaNnIjrx8K/V0gtU1bK+EIK0IsXspZaBc+vGl5ezp9wpSCe5ip+5zGgjx+m eECXN9xPu43iPpMi+P89Wrlp/fIdr/qI7Mue7fgz5oNGqjUZLMxRBhVBcS7iyZItDZ28 0TVUGDkU1m12pZE5qcIhALl/Kq/Ugmsov1deuM19gP3Ni/iSfu+PdsGLWzlVEraUR5Xj k8A/NbXfu8P9fIBbTfYMiY6tZJGseFfmYNk1DMTUAoJwSokHxARsOLokCp3I3UV+GaJH kxB/Id6FHjSY6nLHdvg1lPeEqs5fp2IT/f7JmSjdQ6/qpeI8uVA8XV1xyjr/9dfNZy/M p0Iw==
X-Gm-Message-State: AOJu0Yz2AydobFjBzFTn2JKnOmVDdlIbbLQiuP61+cDWSl9H59CEERYy BWi3Gne9lhOLN4U7me7sc/xK7yrExpLWwcCPi8Ek8nAYpf9V5O3rHs9vvXi+vZiPzyDAgODFzgx kj11sdWu8FYQ/wgXUOZa+QMclm3DEwHqmHbCgGmtFKyO19ubD77X23z4z/w==
X-Gm-Gg: AR+sD12pTiSx0sKDZVPbglnQOq1N3QIXE0Gx6bOcgnUzfQnVtvqvLHMhjsSuTDgpL3o CWvaY9vbt38V4u88H8cFRmfWMwRuUF03Vywu6u6DEl1pPdq1NeJCi/MUnQDidDvmpbKB2es7w/H vzl2swt3u0gHp14gS+K+NYVJ1KNxb77oB/rog6G/mvRCRrsfXVXsq+Vu8iBADq2q6fxA7w6bnJb rrc9zAZ+l1c7ZJiADQJjjXwLJHs0rJzTxA89GRLIZYRbB239RoWYGbI/8flhXaU6ze1lCKzDHWd CskseuYKEbi4ugWkzuHujOJ/wZ6PUTV567ZLUf6zhP63J7nWSu5ipYobxDEJnHnJ1recneGKxW1 mmJQ=
X-Received: by 2002:a05:6a21:4c0e:b0:3c3:9e07:640b with SMTP id adf61e73a8af0-3c91b3ff37cmr1622580637.74.1785497528327; Fri, 31 Jul 2026 04:32:08 -0700 (PDT)
MIME-Version: 1.0
References: <c6f4a75f-c0fd-4abb-b205-ef87af5047dd@cs.tcd.ie> <0885e4ae-dd35-affb-e257-e711a7bd87a3@foobar.org>
In-Reply-To: <0885e4ae-dd35-affb-e257-e711a7bd87a3@foobar.org>
From: Orie <orie@or13.io>
Date: Fri, 31 Jul 2026 06:31:57 -0500
X-Gm-Features: AUfX_myqlu7sg4k7EBkjOQb8quzgvUqDXBrbx0e42EiONOYl4ewwAlwnPVD4Lxo
Message-ID: <CAMzqgox__8peG87iqX05pMLm+6K1ZUKuMkpATcCdUZ0S9gsjxg@mail.gmail.com>
Subject: Re: Dealing with LLMs in IETF discussions draft
To: IETF-Discussion <ietf@ietf.org>
Content-Type: multipart/alternative; boundary="000000000000ec6e890657e689d2"
Message-ID-Hash: 2IH6YQAFFT2VJWMCXZKZ2BZNWXWNQMZT
X-Message-ID-Hash: 2IH6YQAFFT2VJWMCXZKZ2BZNWXWNQMZT
X-MailFrom: orie@or13.io
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-ietf.ietf.org-0; header-match-ietf.ietf.org-1; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: Stephen Farrell <stephen.farrell=40cs.tcd.ie@dmarc.ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
List-Id: "IETF-Discussion. This is the most general IETF mailing list, intended for discussion of technical, procedural, operational, and other topics for which no dedicated mailing lists exist." <ietf.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/Yp4yJpc5rqxMF5T_McoUKtGmRiY>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Owner: <mailto:ietf-owner@ietf.org>
List-Post: <mailto:ietf@ietf.org>
List-Subscribe: <mailto:ietf-join@ietf.org>
List-Unsubscribe: <mailto:ietf-leave@ietf.org>

Hi,

Allow me to jump straight to solutions : )

It sounds like the goal is more effective use of AI in IETF discussions.
Banning it won't work.
New participants won't be familiar with our policies, and we want AI to
bring them to us, and help them stay engaged, not push them away.
Over time we hope the dialogue will self-correct toward a set of norms we
all enjoy living with, or can at least tolerate.

Initially we would hope for voluntary adoption of additional context,
skills and methodology that improves everyone's experience.
This could be accomplished by offering IETF contributors some context they
can feed to their agents to improve the agents' behavior in this community,
for example:

1. Do not use emdashes.
2. Use bottom line up front when communicating on mailing lists.
3. Avoid walls of text with technical jargon, provide citations for terms
readers might not be familiar with.
4. Focus on technical discussions not personality issues, or non
technical commentary
5. Double check your assertions before posting them on a mailing list.
...etc.

Providing an easy way for IETF contributors to improve the quality of their
AI-assisted IETF contributions seems like an easy first step.

Another thing we can do, is invest in better reputation systems and tooling
for accessing them.
When I read comments from Stephen, I naturally consider them in the context
of my previous interactions with him and his expertise.
If you have an agent assisting you with judging consensus or focusing you
on where problems in a discussion may exist, you want to give that agent
some similar ability.
In small teams, you can address this by putting your org chart in the
agent's context, so it knows who you are and who your manager is, and can
generate text relevant to your role.
In the IETF, you might consider comments from previous security ADs on
security issues in your draft worth addressing before comments from first
time participants.
How will your AI know this?

Taking mailing list participation or internet draft counts directly would
not be wise, but other signals like in person meeting attendance, RFCs in
multiple streams, or other signals that are hard for an AI to forge can be
helpful when considering a contribution in the context of wider community
discussions.

This is an important topic, if we don't start tackling it, we will end up
with IETF mailing lists turning into their own flavor of:
https://en.wikipedia.org/wiki/Moltbook

Cheers,

OS

PS: Here is this same email rewritten by Claude with the prompt: "Make this
email shorter, and more professional"

Hi,

Let me jump straight to solutions.

The goal here is more effective use of AI in IETF discussions. Banning it
won't work. New participants won't know our policies, and we want AI to
bring them in and keep them engaged rather than push them away. Over time
the dialogue should self-correct toward norms we can all live with.

A reasonable first step is voluntary adoption of shared context that
improves agent behavior in this community. We could publish a short set of
guidelines IETF contributors can feed to their agents, for example:

1. Do not use em dashes.
2. Use bottom line up front on mailing lists.
3. Avoid walls of jargon; cite terms readers may not know.
4. Focus on technical substance, not personalities.
5. Verify assertions before posting.

Making it easy for contributors to improve the quality of their AI-assisted
contributions is low cost and high value.

A second step is better reputation signals and tooling to access them. When
I read a comment from Stephen, I weigh it against my prior interactions
with him and his expertise. An agent helping you judge consensus or locate
problems in a thread needs something similar. Small teams solve this by
putting the org chart in the agent's context. In the IETF, you might want
comments from former Security ADs on a security issue addressed before
those from first-time participants. How would your agent know that?

Raw mailing list or draft counts would be the wrong measure. Signals that
are harder to game, such as in-person meeting attendance or RFCs across
multiple streams, are more useful when weighing a contribution against the
wider discussion.

This is worth tackling now. If we don't, IETF mailing lists will end up as
their own flavor of https://en.wikipedia.org/wiki/Moltbook.

Cheers,

OS + Claude




On Fri, Jul 31, 2026 at 5:50 AM Nick Hilliard <nick@foobar.org> wrote:

> Stephen Farrell wrote on 31/07/2026 02:20:
>
> Myself and Chong Feng have posted an I-D [1] that (from two
> pretty different perspectives) aims to progress discussion
> of how we might better handle LLM text in IETF discussions.
>
> I think this'd be a fine topic for broad discussion.
>
>
> Hi Stephen,
>
> ok, this is interesting.
>
> On a separate issue in a separate domain, the president of the high court
> of Ireland published a set of guidelines on Wednesday regarding the use of
> generative AI for legal documents.
>
>
> https://www.courts.ie/practice-directions/full-practice-direction?url=practice-direction-on-the-responsible-use-of-generative-artificial-intelligence-in-court-documents
>
>
> I haven't read the document thoroughly yet, but it's an interim legal
> guidance document so is likely to have had some competent thought put into
> it. Perhaps there are things in the document that could be used to inform
> the ietf discussion / your ID.
>
> Nick
>
>