Revised IETF LLM Tools

Mark Nottingham <mnot@mnot.net> Wed, 27 May 2026 22:01 UTC

Return-Path: <mnot@mnot.net>
X-Original-To: wgchairs@mail2.ietf.org
Delivered-To: wgchairs@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 8AEAEF644485 for <wgchairs@mail2.ietf.org>; Wed, 27 May 2026 15:01:45 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1779919305; bh=3nT4YHnNoUItXTjwWWVX5GfgSrGNmJoXwegHJu9bhnk=; h=From:Subject:Date:References:To:In-Reply-To; b=rTD+N6kCtW58AR3LewLSoqX3dcnTJ9HwGSdnv2Qobq9HrJJNQxsm/8+k8/T3EqwWZ 2TjUJ3Wj+clT+euj3CV1pmxJ4627Xdjc0oizBw/v3XbzQ17uBlkcM18hyE1ypepf42 g9e9gDFDRnqOmwRrnw+GKyb0FcPCKuLvCvKRhOc0=
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -2.799
X-Spam-Level:
X-Spam-Status: No, score=-2.799 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_VALIDITY_CERTIFIED_BLOCKED=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=mnot.net header.b="fPUME2Ju"; dkim=pass (2048-bit key) header.d=messagingengine.com header.b="CUxQGERE"
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1axkpglSdXku for <wgchairs@mail2.ietf.org>; Wed, 27 May 2026 15:01:44 -0700 (PDT)
Received: from fout-b1-smtp.messagingengine.com (fout-b1-smtp.messagingengine.com [202.12.124.144]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id 14746F64438C for <wgchairs@ietf.org>; Wed, 27 May 2026 15:01:19 -0700 (PDT)
Received: from phl-compute-10.internal (phl-compute-10.internal [10.202.2.50]) by mailfout.stl.internal (Postfix) with ESMTP id 0F49F1D000DA for <wgchairs@ietf.org>; Wed, 27 May 2026 18:01:11 -0400 (EDT)
Received: from phl-frontend-04 ([10.202.2.163]) by phl-compute-10.internal (MEProxy); Wed, 27 May 2026 18:01:12 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mnot.net; h=cc :content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm1; t=1779919271; x=1780005671; bh=zUzH78WKVo3uDd521DrjkspUm6qyCNbR8BfKYZUfXIQ=; b= fPUME2JulrnelKxI9E2+3BysDZLBxaf0AchRhLs9W0hKhhEYNn2Klpb6pUgDIMcR tfBxfQB8NPMtzdyk/irBqA8FBA7VhSN+GPptg3j54oZXwGYZkXh5fxJ3ctqeSFvX qJirJLGkm5LIxdXu9VbK5xLFLOo1I7D4B2A5Zthyc+UqpxnEnZlGiEDYh8YnTOwy tvm73hDN3poAYbnoMriyRSksFjwFPQG0XjAHlYR6cVY71jUEk2zfsZietVTXgE+N MoVpWgey0FcKlSARpQHbmbYeX3siuczN5BJDISfu01yJLdMHMKIuocTwpldc1r6z Ymh1gugcPevqtjD7c8obdA==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:subject:subject:to:to:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm3; t=1779919271; x=1780005671; bh=z UzH78WKVo3uDd521DrjkspUm6qyCNbR8BfKYZUfXIQ=; b=CUxQGERESSf0NLu8S t3XXCqeIhXELyCIBFeKbgpeMYVw8hXFdI8rpeBIzFSiX6E/LFSGMNYz5ZbHZxdhM 01Sz59zKOGfutliY7yybY1rX5wvzN/XtQOrBvfHTJpu6IozXjOhGVRnvYKTRzDHL a9DAYRo52tFWaOPwqiCOEt4pRpMEPTFqV9vRiLFKkd3pRmGvnCCWfdPHzeQ/jTjc BQkwapUZfTNb7kjrcsoWtz/CXbvrMaVfAUy8vHqj2NQGsIast47LqvB6gNcXuUNo AmisNnPyHSZSmffx4g2knRryltBQOCysB3saXXkoe35Laz3F68zjMFJ/5wcHN+zN 0NMDQ==
X-ME-Sender: <xms:p2kXasgj-OCsPZR7bdLt58iM427iOKS-HrpJ7n_3PZFoHRnXzi_ujA> <xme:p2kXaq59ypg0F4IOYyiDavHgJcKD0cP1JgfY0An0YTHVtCK0LMEH_8FSwc-IsjHfA 2vazTA5l7g4zwa5XHytoB1KseLP7Hjyx3w5DeVoevBieng0Hww1Aw>
X-ME-Received: <xmr:p2kXavKjOsTeBO5VgkgFCflxgGEw5ffrkJS6cCBExunoSHK2BKfwk2X0ll1S2kVZ0MIES0w2V-9xQ_ziVH22WYlLfQgigiozilH2c76SPIY__DHiPrlnNA>
X-ME-Proxy-Cause: dmFkZTEMblCSiC/ne0JpfdZDAXrEfjQZ+jopDqtAuMUvhpbGdDkhuWNwgN0CH32GqDoWMH ZTnDl0lpB4hRsT04/up4YEUBWC4UbHrdihB7KW9KzuaznpBAKCGYUhN02JOy8/4mZlx4kf xi88dmRbDYLnJOZNahRnK5vGoeKkiSRGGU1jwvoo39ytXVC+thZd32i/zrw4Y9FZ0xBo6I fiffXBSJYK9RDIvQdmkhkQQeewu7Ql/WUmMkhCzW9obW1IVmiuqfOtBbIlo+VzmBEVjfo6 Fqk1bAluVHd9W0cUAN6wWhigCHTkp72VhEVSYTxZgWFeeXOqyVDIxNeib7PzrLX2CavrtW GTd4904iynJvKJKhCViCu3Qck0V5++T0j8+Zyio+84O9sYaL9zZD02CSPb73Rv0Rk2XFUC 1WEPWBYNWeFQGGchNQROqeSOrGYHFqtZHP8Pc8SSj1V2CA9xMsUBoxP10A7sKHLOTBwHLx Bs06hWsPXW+mqliw/o/nEhAdgUEW4AbkM+MwsudekrH15/0DRF29swISyst0SHZ0vi8B6x YQqu2zE7RNbz+1t3Hugn7SovGn9otOrSnXGDW3n0r0rbxVo0vgTJbpB7avGR3ln0A1lYVy EwdaRS5Oydp10YVhyE+/NS8QKQzTuSnCXcNftSaAO0Oxv6JMN1EULE3cIiFw
X-ME-Proxy: <xmx:p2kXaqFO--GVkNegep8W2_xPOIeXpEcCn_qwgZg7fsPUrqtKDTdE0Q> <xmx:p2kXatWLM5fhipBNLcEbl1g1xICtujqjkCzJ1X1i95apELQbaZoWaA> <xmx:p2kXathoZbdGkSyqQGGm_lnFwAiT0EcdO-NXZ4dFSiO_HQ7K6yvMag> <xmx:p2kXamSppMqxFgErQx-tpWIWqp_MoN5iNvSJ2Cjomwdhg5NNQ_o0BA> <xmx:p2kXajLgPywHWzQKXr5qgbdfvCcQ7YqiMgTKRn0NyXp4Fp9utIcj4VeE>
Feedback-ID: ie6694242:Fastmail
Received: by mail.messagingengine.com (Postfix) with ESMTPA for <wgchairs@ietf.org>; Wed, 27 May 2026 18:01:10 -0400 (EDT)
From: Mark Nottingham <mnot@mnot.net>
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.600.51.1.1\))
Subject: Revised IETF LLM Tools
Date: Thu, 28 May 2026 08:01:05 +1000
References: <7C5F050B-BE4C-4F11-81D5-6E044CE3FFC0@mnot.net>
To: WG Chairs <wgchairs@ietf.org>
In-Reply-To: <7C5F050B-BE4C-4F11-81D5-6E044CE3FFC0@mnot.net>
Message-Id: <946D14A0-2CCD-45C9-998B-C88F04136C36@mnot.net>
X-Mailer: Apple Mail (2.3864.600.51.1.1)
Message-ID-Hash: NPCCM26PKIIN54LOXHEV4HDKEXPPGKCU
X-Message-ID-Hash: NPCCM26PKIIN54LOXHEV4HDKEXPPGKCU
X-MailFrom: mnot@mnot.net
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-wgchairs.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
X-Mailman-Version: 3.3.9rc6
Precedence: list
List-Id: Working Group Chairs <wgchairs.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/wgchairs/iZDVFhNBc-tmFIXHcIlfQ8wX8kU>
List-Archive: <https://mailarchive.ietf.org/arch/browse/wgchairs>
List-Help: <mailto:wgchairs-request@ietf.org?subject=help>
List-Owner: <mailto:wgchairs-owner@ietf.org>
List-Post: <mailto:wgchairs@ietf.org>
List-Subscribe: <mailto:wgchairs-join@ietf.org>
List-Unsubscribe: <mailto:wgchairs-leave@ietf.org>

Hey all,

I've revised and renamed the tools below; it now includes a local MCP server. In my testing, it's pretty effective; you can chat away with a working group's corpus pretty to pretty good effect from eg Claude, OpenCode, etc.

  https://pypi.org/project/ietf-llm/

Still under development, but suggestions / issues welcome.

Cheers,


> On 19 Mar 2026, at 11:07 am, Mark Nottingham <mnot@mnot.net> wrote:
> 
> Just thought I'd convey something I found useful for understanding the state of a WG's discussions.
> 
> Google's NotebookLM:
>  https://notebooklm.google.com/
> allows you to ground a LLM in a specific set of documents. 
> 
> I've put all of the materials I have for the AIPREF Working Group into a notebook, including:
> 
> - the Charter
> - meeting agendas
> - meeting minutes
> - drafts (including all revisions)
> - mailing list archives
> 
> The result is an LLM I can chat with about the history and arguments made in the WG. Although (of course) I can't trust it completely, I'm finding it's a very good way to interact with the 'memory' of a WG. In particular it can serve as 'another set of eyes' that doesn't have the biases that I may have.
> 
> For the mailing list archive, I found that NotebookLM doesn't like just taking an mbox file, so I* wrote a script to pre-process an archive by stripping attachments, simplifying headers, and removing quoted material. See:
> https://gist.github.com/mnot/7c0c87f3bf3cc5bbcc97acb57eb1e332
> 
> The main issue I have now is keeping it up-to-date.
> 
> Hope this helps,
> 
> 
> 
> * Gemini
> 
> --
> Mark Nottingham   https://www.mnot.net/
> 

--
Mark Nottingham   https://www.mnot.net/