Re: Revised IETF LLM Tools

Rohan Mahy <rohan.mahy@gmail.com> Tue, 14 July 2026 15:08 UTC

Return-Path: <rohan.mahy@gmail.com>
X-Original-To: wgchairs@mail2.ietf.org
Delivered-To: wgchairs@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 3EDCF1169E0E5 for <wgchairs@mail2.ietf.org>; Tue, 14 Jul 2026 08:08:05 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1784041685; bh=+C+RGY3TmUb7dp8VkR04KU+zvBc9dOQncNDyji2Eggg=; h=References:In-Reply-To:From:Date:Subject:To:Cc; b=aJwIdHdvoxyDpJ3Gy3yXDSzBtC2A9pW+1neXFLXoOSVFMsDLhxuWFF9tcLdXY8NZA HS5hBsxyHKFCU3siuPfz3a408iRjLX3+RWNn1AnlkFtKLPiYPCtGufWOyIIgk+B5Hz bNlIb2ChJyKw8bWRCO1ihwHPfwDSfdOHAxGDASQo=
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -2.098
X-Spam-Level:
X-Spam-Status: No, score=-2.098 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 86hWQMjKELbv for <wgchairs@mail2.ietf.org>; Tue, 14 Jul 2026 08:08:04 -0700 (PDT)
Received: from mail-wr1-x435.google.com (mail-wr1-x435.google.com [IPv6:2a00:1450:4864:20::435]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id BD6801169E0D9 for <wgchairs@ietf.org>; Tue, 14 Jul 2026 08:08:04 -0700 (PDT)
Received: by mail-wr1-x435.google.com with SMTP id ffacd0b85a97d-47df440fcd5so2477473f8f.3 for <wgchairs@ietf.org>; Tue, 14 Jul 2026 08:08:04 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; t=1784041678; cv=none; d=google.com; s=arc-20260327; b=EU7rWYx0FtKdhA/kgHi/IOQS30x1gvyhV5cAlIJfFQcLBXwdCgIk1wTHZGESN0X4FV F0lhJzLRh84OgTzwFAxcaCMIjpqgUuFVX3PucctP6DV3YnCOLCmXbMLsG2mTkxzGObGL WDoRvrqehSY9QcgL+LfEaUU0kAOtG+uuw47l9HPBrWL4TybHgKQStQ1BsNFUPlOyBByU iiD57WHrD1UK1NsN7GMB1TqaDekStg2aov5QlAs+WlBi1d3HnC0Uq+dLUlFdwGAWWPzy xCuomeZN/iJ30ZwdbNPc14QnCmWhKQcdLu2VC0Qngg8IrXZVo0v5RmcVZ+JXmMTypZt8 +C7A==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=b6NApo/C0d0D+FiOrvzpPTToH+4vKqzJzsThjX0vX9s=; fh=d6WTXShqe/UvEQ+QuXRGcE+KE70IM1wfHPuEl0iojAY=; b=lTvOr19wEoRb8krqvt2G5ths8kWhGxoIOKrJLCM+0+n/VwKkDPOHUYKQIsDGKB2NEk 5L6VQIDmIWG4N19cPFER6EI/aO/WvD9KmXSCK2Vay1EVCpFrPePNIKQyGNTEGNBaW9Tn DkFgovTWRlQ/upaJZmdgtKzUQv8Yaelv5MmFHJ0sXYqwUqUm9XOe4wI/CYGhSkSeQ/rF XAVusOR1Uqbq9a7xgJ1Ja/usLCZBJluxN/PLE+ewLkfpIKIWL7A1yQ/TkzQOFUyT0GRT 3+ZtIvhaa6QDNW+zoV7D3igKxppgKtaiWNvgrYdpmbc15fcn7gIZkbMiz05sflN5LR1J sTlA==; darn=ietf.org
ARC-Authentication-Results: i=1; mx.google.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1784041678; x=1784646478; darn=ietf.org; h=content-type:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:from:to:cc:subject:date:message-id:reply-to :content-type; bh=b6NApo/C0d0D+FiOrvzpPTToH+4vKqzJzsThjX0vX9s=; b=rABYwLGXOFXM5uaqCioydel1xHWLuMhGtqT9zhkoq4gvIVzgQtew6cjcgRI7YylkOk o0JpEA/YWEgky5ijxc+y/1gLQTvX4YSpIbaD9ZkNCuDOmj3bR3VAoGeezXeLlgJELd8U O2suLchsNOCrAiNknWotffJ774zS3nnszFjSUMLQpiPU1KSJZScUKEK758Xxs13rx0R2 FFBm525AGqP7UTt97+ZrA1J8v/rehmrhflOliQ/ASvUDoZIf3Uc/2EnSqDlworlvjciL x9zgqPcCzR/LbsKvX6zN2OFr8NGvQDL+KXEutoVf42CEEPbm3VQbClUKD9jQrLvlZ1gf Ljhw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1784041678; x=1784646478; h=content-type:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:x-gm-gg:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to:content-type; bh=b6NApo/C0d0D+FiOrvzpPTToH+4vKqzJzsThjX0vX9s=; b=PJnLTCl6wi3X4R0x28m/QgH9YRi30Q8wjpG5nZRYxS+dOCi3fyhdtwBIpZ66UWv4GS QoCRTx0PT+X2spBBEVpAQmqlOhdoz55HAMKYVvQfdx/oeAJp+G5UMHXaCMKFXFmDwiGa DCxSnZwRx3YK/srBIjmlsXQ/fkw6CTbRWUHLdkV2lWt1FCc0sPtw3klinpCqfV9sWhFj bLlP9w7yN42jTLAwcX4ILmDUppW72yTftFZKMca63IQtvi6HJvkTiztp1tgufum+1FKW /nfMDdaqEfJ1XolahKPo22u8wfsQK+XdPJgRn8Bw46tma1v1kLqLj1NsWf+VXUvN0DZ+ CBTA==
X-Gm-Message-State: AOJu0Yya/tzNiqx36JGOss9Gz2U1ztfBqEuoEnL8c4UHxpeuJDBsf8Vd vCvn6J/2mBoFfSAJ4F/aeOB4tw/84qSap9C1fX04lBzjyPcnm6ERgwgmbaG9ICvpGRxAXEeaHU9 e9U+mpfA0eJ3bYE7HF8NOQ2qOKHhJc152PQ==
X-Gm-Gg: AfdE7cmR1U18ZrVtkcc4hH4uGag5yaodIkW2Z7ABZXFXsQGkUlCoMmCHMebbJv8rzb3 M5b06z1j9PMXLrGX4eny7zkDx52hSN5ZeAp/g26kmH3ZXOVU7e8WP4cn0B3nPq5XOrRnHPM8CyD f6o8Dc1U3tQWYXko1FP0+6Cj/AsLV39YzRhJVwSfyaG0rYy7WCOuJ+ra/zGd1V4Hn3I8CQldpYK LIsSH93ZV1H0gkNMjXOdUSWKFkvM2gPq0lp8KQK1wEz8h/iHNCC1OGJckeLNPuYqW7vSnpOlJYo hl/v3wIGmRGJb/pKhmabDFGSKksfMRtxOxVADa7VVQCfs/IY+qqLikUdnQ==
X-Received: by 2002:a05:6000:985:b0:47d:ef25:ff3b with SMTP id ffacd0b85a97d-47f2dd00a3amr16358569f8f.49.1784041677221; Tue, 14 Jul 2026 08:07:57 -0700 (PDT)
MIME-Version: 1.0
References: <7C5F050B-BE4C-4F11-81D5-6E044CE3FFC0@mnot.net> <946D14A0-2CCD-45C9-998B-C88F04136C36@mnot.net>
In-Reply-To: <946D14A0-2CCD-45C9-998B-C88F04136C36@mnot.net>
From: Rohan Mahy <rohan.mahy@gmail.com>
Date: Tue, 14 Jul 2026 17:07:46 +0200
X-Gm-Features: AUfX_mwdCTIm2ll2h7ZIwz0Hn54ef3_ygXxjcDWpLl62Rz1bks3t5SSPLO0AVho
Message-ID: <CAKoiRuahS=KiRVw49v4e31R-kZGKCCZPdBstFVpRQREM+exJaA@mail.gmail.com>
Subject: Re: Revised IETF LLM Tools
To: Mark Nottingham <mnot=40mnot.net@dmarc.ietf.org>
Content-Type: multipart/alternative; boundary="0000000000006f725f065693922e"
Message-ID-Hash: O2E5SQMLCO44KHHISO27U5PXOUHAXQCA
X-Message-ID-Hash: O2E5SQMLCO44KHHISO27U5PXOUHAXQCA
X-MailFrom: rohan.mahy@gmail.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-wgchairs.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: WG Chairs <wgchairs@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
List-Id: Working Group Chairs <wgchairs.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/wgchairs/wW1Q5p1SXZeO672UUot5NhOC66k>
List-Archive: <https://mailarchive.ietf.org/arch/browse/wgchairs>
List-Help: <mailto:wgchairs-request@ietf.org?subject=help>
List-Owner: <mailto:wgchairs-owner@ietf.org>
List-Post: <mailto:wgchairs@ietf.org>
List-Subscribe: <mailto:wgchairs-join@ietf.org>
List-Unsubscribe: <mailto:wgchairs-leave@ietf.org>

Mark,
You email archive tool strips quoted lines, so how do you deal with inline
comments and +1 on specific quoted paragraphs?

thanks,
-rohan

On Thu, 28 May 2026, 00:01 Mark Nottingham, <mnot=40mnot.net@dmarc.ietf.org>
wrote:

> Hey all,
>
> I've revised and renamed the tools below; it now includes a local MCP
> server. In my testing, it's pretty effective; you can chat away with a
> working group's corpus pretty to pretty good effect from eg Claude,
> OpenCode, etc.
>
>   https://pypi.org/project/ietf-llm/
>
> Still under development, but suggestions / issues welcome.
>
> Cheers,
>
>
> > On 19 Mar 2026, at 11:07 am, Mark Nottingham <mnot@mnot.net> wrote:
> >
> > Just thought I'd convey something I found useful for understanding the
> state of a WG's discussions.
> >
> > Google's NotebookLM:
> >  https://notebooklm.google.com/
> > allows you to ground a LLM in a specific set of documents.
> >
> > I've put all of the materials I have for the AIPREF Working Group into a
> notebook, including:
> >
> > - the Charter
> > - meeting agendas
> > - meeting minutes
> > - drafts (including all revisions)
> > - mailing list archives
> >
> > The result is an LLM I can chat with about the history and arguments
> made in the WG. Although (of course) I can't trust it completely, I'm
> finding it's a very good way to interact with the 'memory' of a WG. In
> particular it can serve as 'another set of eyes' that doesn't have the
> biases that I may have.
> >
> > For the mailing list archive, I found that NotebookLM doesn't like just
> taking an mbox file, so I* wrote a script to pre-process an archive by
> stripping attachments, simplifying headers, and removing quoted material.
> See:
> > https://gist.github.com/mnot/7c0c87f3bf3cc5bbcc97acb57eb1e332
> >
> > The main issue I have now is keeping it up-to-date.
> >
> > Hope this helps,
> >
> >
> >
> > * Gemini
> >
> > --
> > Mark Nottingham   https://www.mnot.net/
> >
>
> --
> Mark Nottingham   https://www.mnot.net/
>
>