Re: Dealing with LLMs in IETF discussions draft
Orie <orie@or13.io> Fri, 31 July 2026 11:32 UTC
Return-Path: <orie@or13.io>
X-Original-To: ietf@mail2.ietf.org
Delivered-To: ietf@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 929481218E074 for <ietf@mail2.ietf.org>; Fri, 31 Jul 2026 04:32:10 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1785497530; bh=xopZXgp9dRUtGEUMTvXE8xTENgtGXj2uQc7lnsiykmA=; h=References:In-Reply-To:From:Date:Subject:To:Cc; b=y9tetc21JSwNP996t84Ttl9nS4COr/yRywGCIfcyMQ3EArPpGjUTCn5Vcjk5Q4y9Q 93k3qVuCr5McbDpFsUeDas9kju0Wz/V1VceQOJ5j6Xyy++xnC8FSr5X4r5vw07WIo+ eCh9tRKNeu636y/TT1uPVXkMk7u3Hdsrp+tRVCVY=
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=or13.io
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id frU3auVG3q_W for <ietf@mail2.ietf.org>; Fri, 31 Jul 2026 04:32:09 -0700 (PDT)
Received: from mail-pg1-x532.google.com (mail-pg1-x532.google.com [IPv6:2607:f8b0:4864:20::532]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id 9013A1218E068 for <ietf@ietf.org>; Fri, 31 Jul 2026 04:32:09 -0700 (PDT)
Received: by mail-pg1-x532.google.com with SMTP id 41be03b00d2f7-c999f162c9aso557457a12.3 for <ietf@ietf.org>; Fri, 31 Jul 2026 04:32:09 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; t=1785497528; cv=none; d=google.com; s=arc-20260327; b=J15uS+iQfBUH9dVFHDwqMQcAcBF1/tEkVPZXmZ63g7PJpsLKv6Q65RBQsi0rInQfHg 0HWci8j7VyA6ybYpRU/UxWXk/SzIc7BNIoXcfLDgFq+fEzxipNa+bfcc68gr4C3Uqziq hOQUBLnp1m1JOFZHh/l5tFGOTnX8grx5KJxFreAP0r3uknMa+xn/GpUash6qpZ2rwV65 xV9AZH/3xEeg77FYckhfuyEULM0lzRPQ0LC3aeizT8Rf6WswEqz6HNHWvAmPAn/gku/e bxvSIWINyA4zU/i4kET2/iKGcsN0zcHuVGpGES59URQskQNBQhsEj8/fHcxrE/x9QRR+ C1HQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=zXMGJmnoJtU+giKkZoMQHRTlJ17k+3r+s0Q8hWLQYCQ=; fh=jD5L10VIzsT8wvcp7fG59eTn1Ry8SJkWQugoP6q4OaE=; b=TZvkJdhVgYRzpAmnkrcykUxEOk49qlzo53kQLb6VEViTAM5qnGPLDUOE58vZkIStwz 9zAcODj/I+ECGWvvcTOQw3jEsAX6QM/34NU3PI0UTTMkPB8JyzA7xklvox0SUjwzkupI d0BqyBsaUDVrbWN1HrT4P+Iecc8UIHNFI8H/jaXuJJhY0I1zhWflrpHkPSOiMsI/mC2T FWYdC0+FMYUqAaQ9egW9K1oBRsWvwr3QqBzeqhA6GZ2KjGe5r3/3+ISr/5wBDWQXTJly 9vLnhh8zW12jSxhi01hnB6RBNjeT4GC6Eyu6yFYW7vlSu17t3KeKUpMbEDC4e/t32zZY rJFw==; darn=ietf.org
ARC-Authentication-Results: i=1; mx.google.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=or13.io; s=google; t=1785497528; x=1786102328; darn=ietf.org; h=content-type:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:from:to:cc:subject:date:message-id:reply-to :content-type; bh=zXMGJmnoJtU+giKkZoMQHRTlJ17k+3r+s0Q8hWLQYCQ=; b=Tiq3TTp0bsiO4lD/JEilseOVAlXk2i6sDu/iB5m4byU2bkl+MM9h/5ckRZx+9r7CTv wWBVRJ1fq6OwjvHinoxMNR3QIjUvLRv/Q92VIjp/JA+XhRMRkU6xdmdplphAfmMLmFGr xT2MwvrlHYjts/SB266XOY1Wnd+XEuQint5rk6mvZlcE2dQMYRAio/ptjvn56AI9+K/W Pe4bPRhuk0qluq2ncrqTPC0trTwqhU9OEYfLU1+93rUhIbQ0NPHv1+xXhRmd+NwC+q9K a43LKbvVAJBB3NIKof4C6LgianYeeOnaF2b+QNAHG5PbME8L2XIRmNC0wc6r6TULRiWS iM1Q==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1785497528; x=1786102328; h=content-type:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:x-gm-gg:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to:content-type; bh=zXMGJmnoJtU+giKkZoMQHRTlJ17k+3r+s0Q8hWLQYCQ=; b=ACJ2CkRVaNnIjrx8K/V0gtU1bK+EIK0IsXspZaBc+vGl5ezp9wpSCe5ip+5zGgjx+m eECXN9xPu43iPpMi+P89Wrlp/fIdr/qI7Mue7fgz5oNGqjUZLMxRBhVBcS7iyZItDZ28 0TVUGDkU1m12pZE5qcIhALl/Kq/Ugmsov1deuM19gP3Ni/iSfu+PdsGLWzlVEraUR5Xj k8A/NbXfu8P9fIBbTfYMiY6tZJGseFfmYNk1DMTUAoJwSokHxARsOLokCp3I3UV+GaJH kxB/Id6FHjSY6nLHdvg1lPeEqs5fp2IT/f7JmSjdQ6/qpeI8uVA8XV1xyjr/9dfNZy/M p0Iw==
X-Gm-Message-State: AOJu0Yz2AydobFjBzFTn2JKnOmVDdlIbbLQiuP61+cDWSl9H59CEERYy BWi3Gne9lhOLN4U7me7sc/xK7yrExpLWwcCPi8Ek8nAYpf9V5O3rHs9vvXi+vZiPzyDAgODFzgx kj11sdWu8FYQ/wgXUOZa+QMclm3DEwHqmHbCgGmtFKyO19ubD77X23z4z/w==
X-Gm-Gg: AR+sD12pTiSx0sKDZVPbglnQOq1N3QIXE0Gx6bOcgnUzfQnVtvqvLHMhjsSuTDgpL3o CWvaY9vbt38V4u88H8cFRmfWMwRuUF03Vywu6u6DEl1pPdq1NeJCi/MUnQDidDvmpbKB2es7w/H vzl2swt3u0gHp14gS+K+NYVJ1KNxb77oB/rog6G/mvRCRrsfXVXsq+Vu8iBADq2q6fxA7w6bnJb rrc9zAZ+l1c7ZJiADQJjjXwLJHs0rJzTxA89GRLIZYRbB239RoWYGbI/8flhXaU6ze1lCKzDHWd CskseuYKEbi4ugWkzuHujOJ/wZ6PUTV567ZLUf6zhP63J7nWSu5ipYobxDEJnHnJ1recneGKxW1 mmJQ=
X-Received: by 2002:a05:6a21:4c0e:b0:3c3:9e07:640b with SMTP id adf61e73a8af0-3c91b3ff37cmr1622580637.74.1785497528327; Fri, 31 Jul 2026 04:32:08 -0700 (PDT)
MIME-Version: 1.0
References: <c6f4a75f-c0fd-4abb-b205-ef87af5047dd@cs.tcd.ie> <0885e4ae-dd35-affb-e257-e711a7bd87a3@foobar.org>
In-Reply-To: <0885e4ae-dd35-affb-e257-e711a7bd87a3@foobar.org>
From: Orie <orie@or13.io>
Date: Fri, 31 Jul 2026 06:31:57 -0500
X-Gm-Features: AUfX_myqlu7sg4k7EBkjOQb8quzgvUqDXBrbx0e42EiONOYl4ewwAlwnPVD4Lxo
Message-ID: <CAMzqgox__8peG87iqX05pMLm+6K1ZUKuMkpATcCdUZ0S9gsjxg@mail.gmail.com>
Subject: Re: Dealing with LLMs in IETF discussions draft
To: IETF-Discussion <ietf@ietf.org>
Content-Type: multipart/alternative; boundary="000000000000ec6e890657e689d2"
Message-ID-Hash: 2IH6YQAFFT2VJWMCXZKZ2BZNWXWNQMZT
X-Message-ID-Hash: 2IH6YQAFFT2VJWMCXZKZ2BZNWXWNQMZT
X-MailFrom: orie@or13.io
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-ietf.ietf.org-0; header-match-ietf.ietf.org-1; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: Stephen Farrell <stephen.farrell=40cs.tcd.ie@dmarc.ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
List-Id: "IETF-Discussion. This is the most general IETF mailing list, intended for discussion of technical, procedural, operational, and other topics for which no dedicated mailing lists exist." <ietf.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/Yp4yJpc5rqxMF5T_McoUKtGmRiY>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Owner: <mailto:ietf-owner@ietf.org>
List-Post: <mailto:ietf@ietf.org>
List-Subscribe: <mailto:ietf-join@ietf.org>
List-Unsubscribe: <mailto:ietf-leave@ietf.org>
Hi, Allow me to jump straight to solutions : ) It sounds like the goal is more effective use of AI in IETF discussions. Banning it won't work. New participants won't be familiar with our policies, and we want AI to bring them to us, and help them stay engaged, not push them away. Over time we hope the dialogue will self-correct toward a set of norms we all enjoy living with, or can at least tolerate. Initially we would hope for voluntary adoption of additional context, skills and methodology that improves everyone's experience. This could be accomplished by offering IETF contributors some context they can feed to their agents to improve the agents' behavior in this community, for example: 1. Do not use emdashes. 2. Use bottom line up front when communicating on mailing lists. 3. Avoid walls of text with technical jargon, provide citations for terms readers might not be familiar with. 4. Focus on technical discussions not personality issues, or non technical commentary 5. Double check your assertions before posting them on a mailing list. ...etc. Providing an easy way for IETF contributors to improve the quality of their AI-assisted IETF contributions seems like an easy first step. Another thing we can do, is invest in better reputation systems and tooling for accessing them. When I read comments from Stephen, I naturally consider them in the context of my previous interactions with him and his expertise. If you have an agent assisting you with judging consensus or focusing you on where problems in a discussion may exist, you want to give that agent some similar ability. In small teams, you can address this by putting your org chart in the agent's context, so it knows who you are and who your manager is, and can generate text relevant to your role. In the IETF, you might consider comments from previous security ADs on security issues in your draft worth addressing before comments from first time participants. How will your AI know this? Taking mailing list participation or internet draft counts directly would not be wise, but other signals like in person meeting attendance, RFCs in multiple streams, or other signals that are hard for an AI to forge can be helpful when considering a contribution in the context of wider community discussions. This is an important topic, if we don't start tackling it, we will end up with IETF mailing lists turning into their own flavor of: https://en.wikipedia.org/wiki/Moltbook Cheers, OS PS: Here is this same email rewritten by Claude with the prompt: "Make this email shorter, and more professional" Hi, Let me jump straight to solutions. The goal here is more effective use of AI in IETF discussions. Banning it won't work. New participants won't know our policies, and we want AI to bring them in and keep them engaged rather than push them away. Over time the dialogue should self-correct toward norms we can all live with. A reasonable first step is voluntary adoption of shared context that improves agent behavior in this community. We could publish a short set of guidelines IETF contributors can feed to their agents, for example: 1. Do not use em dashes. 2. Use bottom line up front on mailing lists. 3. Avoid walls of jargon; cite terms readers may not know. 4. Focus on technical substance, not personalities. 5. Verify assertions before posting. Making it easy for contributors to improve the quality of their AI-assisted contributions is low cost and high value. A second step is better reputation signals and tooling to access them. When I read a comment from Stephen, I weigh it against my prior interactions with him and his expertise. An agent helping you judge consensus or locate problems in a thread needs something similar. Small teams solve this by putting the org chart in the agent's context. In the IETF, you might want comments from former Security ADs on a security issue addressed before those from first-time participants. How would your agent know that? Raw mailing list or draft counts would be the wrong measure. Signals that are harder to game, such as in-person meeting attendance or RFCs across multiple streams, are more useful when weighing a contribution against the wider discussion. This is worth tackling now. If we don't, IETF mailing lists will end up as their own flavor of https://en.wikipedia.org/wiki/Moltbook. Cheers, OS + Claude On Fri, Jul 31, 2026 at 5:50 AM Nick Hilliard <nick@foobar.org> wrote: > Stephen Farrell wrote on 31/07/2026 02:20: > > Myself and Chong Feng have posted an I-D [1] that (from two > pretty different perspectives) aims to progress discussion > of how we might better handle LLM text in IETF discussions. > > I think this'd be a fine topic for broad discussion. > > > Hi Stephen, > > ok, this is interesting. > > On a separate issue in a separate domain, the president of the high court > of Ireland published a set of guidelines on Wednesday regarding the use of > generative AI for legal documents. > > > https://www.courts.ie/practice-directions/full-practice-direction?url=practice-direction-on-the-responsible-use-of-generative-artificial-intelligence-in-court-documents > > > I haven't read the document thoroughly yet, but it's an interim legal > guidance document so is likely to have had some competent thought put into > it. Perhaps there are things in the document that could be used to inform > the ietf discussion / your ID. > > Nick > >
- Dealing with LLMs in IETF discussions draft Stephen Farrell
- Re: Dealing with LLMs in IETF discussions draft George Michaelson
- Re: Dealing with LLMs in IETF discussions draft Stephen Farrell
- Re: Dealing with LLMs in IETF discussions draft Nathanael Ritz
- Re: Dealing with LLMs in IETF discussions draft Nick Hilliard
- Re: Dealing with LLMs in IETF discussions draft Orie
- Re: Dealing with LLMs in IETF discussions draft Stephen Farrell
- Re: Dealing with LLMs in IETF discussions draft Orie
- Re: Dealing with LLMs in IETF discussions draft Nathanael Ritz
- Re: Dealing with LLMs in IETF discussions draft Stephen Farrell
- Re: Dealing with LLMs in IETF discussions draft Robert Sparks
- Re: Dealing with LLMs in IETF discussions draft John Levine
- Re: Dealing with LLMs in IETF discussions draft S Moonesamy
- Re: Dealing with LLMs in IETF discussions draft Mikael Abrahamsson
- Re: Dealing with LLMs in IETF discussions draft Ignacio De Castro Arribas
- RE: Dealing with LLMs in IETF discussions draft Andrew Campling
- Re: Dealing with LLMs in IETF discussions draft Vittorio Bertola
- Re: Dealing with LLMs in IETF discussions draft Laurence Lundblade
- Re: Dealing with LLMs in IETF discussions draft Brian E Carpenter
- Re: Dealing with LLMs in IETF discussions draft Stephen Farrell
- Re: Dealing with LLMs in IETF discussions draft Stephen Farrell
- Re: Dealing with LLMs in IETF discussions draft Laurence Lundblade
- Re: Dealing with LLMs in IETF discussions draft Brian E Carpenter
- Re: Dealing with LLMs in IETF discussions draft Rob Wilton (rwilton)
- Re: Dealing with LLMs in IETF discussions draft Stephen Farrell
- Re: Dealing with LLMs in IETF discussions draft Toerless Eckert
- Re: Dealing with LLMs in IETF discussions draft S Moonesamy
- Re: Dealing with LLMs in IETF discussions draft George Michaelson
- Re: Dealing with LLMs in IETF discussions draft Brian E Carpenter
- Re: Dealing with LLMs in IETF discussions draft George Michaelson
- Re: Dealing with LLMs in IETF discussions draft Brian E Carpenter
- Re: Dealing with LLMs in IETF discussions draft George Michaelson
- Re: Dealing with LLMs in IETF discussions draft Mikael Abrahamsson
- Re: Dealing with LLMs in IETF discussions draft S Moonesamy
- Re: Dealing with LLMs in IETF discussions draft Toerless Eckert
- Re: Dealing with LLMs in IETF discussions draft Stephen Farrell
- Re: Dealing with LLMs in IETF discussions draft Toerless Eckert
- Re: Dealing with LLMs in IETF discussions draft Stephen Farrell
- Re: Dealing with LLMs in IETF discussions draft Toerless Eckert
- Re: Dealing with LLMs in IETF discussions draft Adam Wiethuechter
- Re: Dealing with LLMs in IETF discussions draft Brian E Carpenter
- Re: Dealing with LLMs in IETF discussions draft Jay Daley
- Re: Dealing with LLMs in IETF discussions draft Benoit@everything-ops.net
- Re: Dealing with LLMs in IETF discussions draft Stephen Farrell
- Re: Dealing with LLMs in IETF discussions draft Andrew Newton (andy)
- Re: Dealing with LLMs in IETF discussions draft Laurence Lundblade
- Re: Dealing with LLMs in IETF discussions draft Jay Daley
- Re: Dealing with LLMs in IETF discussions draft Nathanael Ritz
- Re: Dealing with LLMs in IETF discussions draft chong feng
- Re: Dealing with LLMs in IETF discussions draft Rob Wilton (rwilton)
- Re: Dealing with LLMs in IETF discussions draft chong feng
- Re: Dealing with LLMs in IETF discussions draft S Moonesamy
- Re: Dealing with LLMs in IETF discussions draft Brian E Carpenter
- Re: Dealing with LLMs in IETF discussions draft Christian Huitema
- Re: Dealing with LLMs in IETF discussions draft S Moonesamy
- Re: Dealing with LLMs in IETF discussions draft Stephen Farrell
- Re: Dealing with LLMs in IETF discussions draft Brian E Carpenter
- Re: Dealing with LLMs in IETF discussions draft Ramesh
- Re: Dealing with LLMs in IETF discussions draft Brian Campbell
- Re: Dealing with LLMs in IETF discussions draft Jay Daley
- Re: Dealing with LLMs in IETF discussions draft Brian E Carpenter
- Re: Dealing with LLMs in IETF discussions draft Laurence Lundblade
- Re: Dealing with LLMs in IETF discussions draft Phillip Hallam-Baker
- Re: Dealing with LLMs in IETF discussions draft John Levine
- Re: Dealing with LLMs in IETF discussions draft Stephen Farrell