Re: Automatic Minutes Generation

Eric Rescorla <ekr@rtfm.com> Sun, 12 October 2025 10:32 UTC

Return-Path: <ekr@rtfm.com>
X-Original-To: wgchairs@mail2.ietf.org
Delivered-To: wgchairs@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 47F9071CEDAE for <wgchairs@mail2.ietf.org>; Sun, 12 Oct 2025 03:32:41 -0700 (PDT)
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -1.897
X-Spam-Level:
X-Spam-Status: No, score=-1.897 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_NONE=0.001] autolearn=ham autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=rtfm-com.20230601.gappssmtp.com
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3sKlBne_KxVM for <wgchairs@mail2.ietf.org>; Sun, 12 Oct 2025 03:32:40 -0700 (PDT)
Received: from mail-yw1-x1135.google.com (mail-yw1-x1135.google.com [IPv6:2607:f8b0:4864:20::1135]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id 7BEF071CEDA7 for <wgchairs@ietf.org>; Sun, 12 Oct 2025 03:32:40 -0700 (PDT)
Received: by mail-yw1-x1135.google.com with SMTP id 00721157ae682-71d601859f5so32339407b3.0 for <wgchairs@ietf.org>; Sun, 12 Oct 2025 03:32:40 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rtfm-com.20230601.gappssmtp.com; s=20230601; t=1760265154; x=1760869954; darn=ietf.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=vcNF+aMGpZwRyrESPqEUefRUZFrDmbJjRci4YEaHKlE=; b=FufwZUYPtIFdqCr/m01Q/bvwnOyyRqVa7Cn1AxqbrHCmTdht/9E2IFzkYa4ivU219h 3DGFMXk8UtSFhYJ9T31XY4nZEHFpYXrpmndN0lLjvnQzlMRe4isRIHzgk7G2RRssX2Q7 0n4r0m65Uqwh3YEMki6xyrqFiSNjpjfkxXBhh04YJgGzAgNkTJDlH80vASKUb+3pA0JS Bwty7e7/bswgBvNQxX2qzog30jqHA+XMREhC9SWkxjDr7kbxc7u9UUhJfDU59RntUy9t pPc8dRfCtF64kxOf95Ahxqguj3B0XLboUGkz+nlsA+FkVzR5PTka/hIQIzMt2/kYQUZk h6uw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1760265154; x=1760869954; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=vcNF+aMGpZwRyrESPqEUefRUZFrDmbJjRci4YEaHKlE=; b=krwbUV9VP707sPr9O9oAqtr6sFMdOIKTgTD2Uwo13dKTM5kuu+YKXQjRGNGqUCR0QF q7lAgQYXMUfCHvUidJpuEQnzCQovgI1oIDVqrKbSmZXRaWnPlXm5sTL1Ka2olfqoRNJf zMIOBzwo1StyxBvrJDE+5gDFkTM1Do0c5pjz3gQf0ZnRc6gMGL/ehK7PsmneoCtC5OKv jwBmzrMuiD9QkQlOthDEphJMRBhvWKanedxPwGxnZe53uDKT1cSYDle8+u18GZN/4bqK FWDkPvlK/LLBZNikATUgkt8t1O3nnI25VQt0q1+vbS6GtXNIWbloy6aVEDpio2bCQ+ik VLrQ==
X-Gm-Message-State: AOJu0YyesIPHRI+I9Wx6oXzhgFZ0MSVndH4lp7PWlKcbUWz8+VGODKUx jDaD/JlU051U1oOH74/ZdBpI33I5LCfYHfDbtyPYcdxyQ8qHmPV0xkhE4bUtHY+KBkCjGIu6KJi j1i6IPawXsyyhGjojlxxXDuZkFqsIk5bpjR8p7itTca7TaXfRpVdwjjqbmjlc
X-Gm-Gg: ASbGnct2St7foWLBOSCi5b55klNqrpwgs9Pi8kftcfJF91rQway6LYn0lZkPmvdgUJK 8ajLkKj3EeM+ZJL2lGbkqtTdcfvC/p0RyH70SX6ns7cARJnbmfFKf2KfuNfa9B8+0zpJS0gm4qX yl19uyqyOm+8oAigAOL4E3IVaAhdydKpCpAcOgM0Mf8Az8RYZaG/I1BK/I0F8VyBfgpr4nIUU4h grdoJ2HawbI9Kk2SGiOrePyROr+5hmxV0FWfxRhYN0zsRIglIRwQmcU1wY44W28/fyKDIuTg//3 ahbhOb5JjCRdrWn4XpKdPv0r5yzeO0nMhFEIL4JO
X-Google-Smtp-Source: AGHT+IHIIV+WdWr7V084ZQvvuJBqqeuq3vdY8qVpkoeFRsJOvBLX2bjBnR3d2urRF9aE7204r2O2S54tk3GFoPEpB3I=
X-Received: by 2002:a53:bd86:0:b0:63c:f5a7:3fa with SMTP id 956f58d0204a3-63cf5a70a39mr3520452d50.62.1760265153770; Sun, 12 Oct 2025 03:32:33 -0700 (PDT)
MIME-Version: 1.0
References: <CABcZeBOG5=c-c=RwLAGBotYAb+CJX5xomaM67R3aoascJ4Vc-A@mail.gmail.com> <edee89f378fa43699caed6da9da94a09@huawei.com>
In-Reply-To: <edee89f378fa43699caed6da9da94a09@huawei.com>
From: Eric Rescorla <ekr@rtfm.com>
Date: Sun, 12 Oct 2025 03:31:56 -0700
X-Gm-Features: AS18NWASiWk1hpcTm8QwfRFqv8aFMuQW_pnjBzo-z7rmFabN8-InDk8z2_OH9RA
Message-ID: <CABcZeBNbQeiYfozq_SA6+hSvs=j4R5_DSt0LhWhfnTZCKw232w@mail.gmail.com>
Subject: Re: Automatic Minutes Generation
To: Xipengxiao <xipengxiao@huawei.com>
Content-Type: multipart/alternative; boundary="000000000000338e420640f3ab68"
Message-ID-Hash: 2UROD6RN4D7CQQY44MBZL3HRUZMJ5QMH
X-Message-ID-Hash: 2UROD6RN4D7CQQY44MBZL3HRUZMJ5QMH
X-MailFrom: ekr@rtfm.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-wgchairs.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: Working Group Chairs <wgchairs@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
List-Id: Working Group Chairs <wgchairs.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/wgchairs/LOgnXTobOzIY52xHK3cDCpF1tvA>
List-Archive: <https://mailarchive.ietf.org/arch/browse/wgchairs>
List-Help: <mailto:wgchairs-request@ietf.org?subject=help>
List-Owner: <mailto:wgchairs-owner@ietf.org>
List-Post: <mailto:wgchairs@ietf.org>
List-Subscribe: <mailto:wgchairs-join@ietf.org>
List-Unsubscribe: <mailto:wgchairs-leave@ietf.org>

On Sun, Oct 12, 2025 at 2:37 AM Xipengxiao <xipengxiao@huawei.com> wrote:

> Hi Eric,
>
>
>
> Thank you for the tool. I will give it a try in IETF 124.  I really think
> all WGs should try to use AI to increase efficiency. In IETF 123 I also
> tried ChatGPT o3 for producing meeting minutes from the transcript.  It’s
> generally good but there is one hallucination so in the end I still used
> the human version.  But as you said, asking a person to take the minutes
> really adds to his/her burden, and the result is not much better than
> ChatGPT’s output. The only benefit of a human minutes is I can be sure that
> there is no hallucination.
>

>
> Just curious, did your tool do anything beyond using an AI LLM to
> summarize the transcript?
>

Not really. There's a bunch of supporting machinery [0] to get the list of
sessions out of the proceedings, download the transcript, etc., and
then assemble the summaries into a site, but it's more or less what
you'd expect.

You can find an architecture diagram at: https://ietfminutes.org/about.html

-Ekr



[0] Primarily written by Claude.


XiPeng
>
>
>
> *From:* Eric Rescorla <ekr@rtfm.com>
> *Sent:* Sunday, October 12, 2025 4:03 AM
> *To:* Working Group Chairs <wgchairs@ietf.org>
> *Subject:* PSA: Automatic Minutes Generation
>
>
>
> Hi Chairs,
>
> Like many of you, I've long been unsatisfied with the situation around
> IETF minute taking, in which we conscript someone into taking minutes,
> thus preventing them from fully participating, and often with mediocre
> results.
>
> In an attempt to partly address this situation, I've put together an
> automatic minutes generator at (https://ietfminutes.org/) The site
> takes as input the Meetecho transcript and produces AI-generated
> minutes. I've gone back and made minutes through IETF 112 (November
> 2021) and I plan to produce minutes for IETF 124 (Montreal) once
> transcripts are available, shortly after the meeting.
>
> Hopefully others will find this useful.
>
> -Ekr
>
> P.S. I'm not a WG chair, so you should make sure to keep
> me on CC if you want a response.
>