Re: PSA: Automatic Minutes Generation
Eric Rescorla <ekr@rtfm.com> Wed, 05 November 2025 14:40 UTC
Return-Path: <ekr@rtfm.com>
X-Original-To: wgchairs@mail2.ietf.org
Delivered-To: wgchairs@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id E81238379960 for <wgchairs@mail2.ietf.org>; Wed, 5 Nov 2025 06:40:08 -0800 (PST)
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -1.797
X-Spam-Level:
X-Spam-Status: No, score=-1.797 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_NONE=0.001] autolearn=no autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=rtfm-com.20230601.gappssmtp.com
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YnBB-1c0Dqoe for <wgchairs@mail2.ietf.org>; Wed, 5 Nov 2025 06:40:08 -0800 (PST)
Received: from mail-yx1-xb12e.google.com (mail-yx1-xb12e.google.com [IPv6:2607:f8b0:4864:20::b12e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id 5D2CC8379937 for <wgchairs@ietf.org>; Wed, 5 Nov 2025 06:40:08 -0800 (PST)
Received: by mail-yx1-xb12e.google.com with SMTP id 956f58d0204a3-63f97c4eccaso5037234d50.2 for <wgchairs@ietf.org>; Wed, 05 Nov 2025 06:40:08 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rtfm-com.20230601.gappssmtp.com; s=20230601; t=1762353608; x=1762958408; darn=ietf.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=ylvQ54DDA3NrOWWfBBKo5hDwjFlC1uqbv2z23z0Occs=; b=moz4fkEWxbl/VQqWcNLLziL9u2hSu4cSVZ5KVDIG3fBkE9NC7mAAkkCG6n9yxiYTpm MUqgTki7Tux6QuPGlWamaOvrn1s4fzFBopEUnEIglQxjdLSKoBOAqYKb1/XBx46rFHeC LrJdT8IrBxZ/ajah6d6D02Q0xdGO6BLYyl5hKK/p3Q2Vi7632JlGpikEGjWwOyNe9X07 Lmevj/8bDzscQBWOfXCn5W+OXU7PVcdsd1KvPkJ08lcOzFFLU+gJ0qSxSyrfMyRh52FL Y2n4FkI4uUCjXLxl+m/SZbMW2XdYRXSkis3Obqm+sLM+980K9zvnqxFOiV9hxSjqGCBg Y3FQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1762353608; x=1762958408; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ylvQ54DDA3NrOWWfBBKo5hDwjFlC1uqbv2z23z0Occs=; b=OuroZ2bBB07F+Q/5S7AvQ0t0SJ7jVnTaVo60oU4vmYMelpPkQr6CiDx666mrl3rZ8s /Jd/VU/jksKr+K05BEZ5aSBll3xuYP3pfBlyrbwS1FW69cCfesUxb6ci1TxalMoUlZ+V 6glSq4/eOLFgkhpF7vhX6el4qN4IXnTnA4N3npS1g9WbnK7W7QtEOGl2VBY5mGF3ZCYw DZ/TXbbGuBETU9TbD44ZTK6AK/3Hso7+8ZHSfLoc+Wx2YndaKDshIU/AdXilnvP1aF8o HNmm/ouQ0NdTEL4ASRbYrF+vRuPdA0dcNXX7YbOOF8UXMaxWuJAZAmBIattNhl+1gWIE vQPQ==
X-Forwarded-Encrypted: i=1; AJvYcCUhwPBzCC6zTts5zw9uND84iOWh9EqCbIhNZiQyV6CUEcd92ogYY92vLuCAzw2vv1a58w8C4oUihQ==@ietf.org
X-Gm-Message-State: AOJu0Yw2CKBIcfdk4T9LmR5/ky9JE/fnnc1EZOrMWNM0d4e6ebpiFrrQ A08S2eTkmwFdsCdZD1NLnrwv0eo0VnVnQ4bkUVdU/eUBN1nn0QXKXh17L6zJIo5KQThr4VkwUKa bQEXLW3/kZq4vgcASeWhSnvrbyLXguXDcjRAb1eyMXg==
X-Gm-Gg: ASbGncuyKr2RMuYWvncmh8CsTWWItJbyujgKRfAMMeI4qoihD1fxvfxbB0dLWtyS2uY XgvlSA3uyhOn6Zm28Aw2sVW3rZNHrVZ4Ny8gqkltukdpthBYCKd77Kx4mPd/Dt6DY8CzxiTI6Dy JKy+Lo7tKYCzK2dUgQ2FNp30PJ4IG0E7cvwtugBVKvzkFSbLLO7QmqWJUAN/fAw51lM2QDGet/W ovV3/A6syTSz8JVUtqRWG4jiW7fQGMFoGI1Q38GMVc8eC1c/9eDEE5ORLKi/5ZGKDZlT6TwczOk M3+ynC56Fv43NoTwGcEcWfr0YQErxandTXwo9gY5B9ZVBjNNkpYjPOdgJxoIuxjdT1H3xOh/cjU /4AIkCm+8d2jQjDG+WZ5Z+rxksoeYSQ0ZtQp7pBM=
X-Google-Smtp-Source: AGHT+IEkVypb/5Hd0spzKMOVCwHaW//pDsw4wtdYcItFbwV7iYSNxbxUf0zdY7OX/3anY2HUTH5p3f4Sl9Xzzs/qu3w=
X-Received: by 2002:a05:690e:1557:10b0:63f:b5d8:9daa with SMTP id 956f58d0204a3-63fd34a84afmr2513060d50.7.1762353607707; Wed, 05 Nov 2025 06:40:07 -0800 (PST)
MIME-Version: 1.0
References: <CABcZeBOG5=c-c=RwLAGBotYAb+CJX5xomaM67R3aoascJ4Vc-A@mail.gmail.com> <CABcZeBP+B5SiW_5QX0KjSqLtoeq_AjT3ZY5dOkJ8tGFHiqgRpg@mail.gmail.com> <SA3PR11MB7625A166D787BF002D51B21D96C4A@SA3PR11MB7625.namprd11.prod.outlook.com> <CAMzqgowjYnmXD73j5LK+=OtC-38iPJg1VFXjGGOfEqSN_q44Jw@mail.gmail.com> <CAMm+Lwg=CzE8LmRz2Etr=UPfcxnTLv=3H_nfmB1m02YPwe0yPQ@mail.gmail.com>
In-Reply-To: <CAMm+Lwg=CzE8LmRz2Etr=UPfcxnTLv=3H_nfmB1m02YPwe0yPQ@mail.gmail.com>
From: Eric Rescorla <ekr@rtfm.com>
Date: Wed, 05 Nov 2025 06:39:31 -0800
X-Gm-Features: AWmQ_bl1AILUJfhYJyCLAhn4m-qxE8DLdLbyTsRuzEDhJbUXF3JVJ9ex73L-qXA
Message-ID: <CABcZeBOk+FR=1vBanASF0SvH0+SeRD8R2MCGw_gkL24LCxqLxQ@mail.gmail.com>
Subject: Re: PSA: Automatic Minutes Generation
To: Phillip Hallam-Baker <phill@hallambaker.com>
Content-Type: multipart/alternative; boundary="000000000000c19ab00642d9ec6a"
Message-ID-Hash: 3OS4UWSFKO5J545VIYOPQCYD724QDDTE
X-Message-ID-Hash: 3OS4UWSFKO5J545VIYOPQCYD724QDDTE
X-MailFrom: ekr@rtfm.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-wgchairs.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: "Lemmons, Chris" <Chris_Lemmons=40comcast.com@dmarc.ietf.org>, Working Group Chairs <wgchairs@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
List-Id: Working Group Chairs <wgchairs.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/wgchairs/79ejMHQn4qDRx6JuvKl50GbiksA>
List-Archive: <https://mailarchive.ietf.org/arch/browse/wgchairs>
List-Help: <mailto:wgchairs-request@ietf.org?subject=help>
List-Owner: <mailto:wgchairs-owner@ietf.org>
List-Post: <mailto:wgchairs@ietf.org>
List-Subscribe: <mailto:wgchairs-join@ietf.org>
List-Unsubscribe: <mailto:wgchairs-leave@ietf.org>
On Wed, Nov 5, 2025 at 6:23 AM Phillip Hallam-Baker <phill@hallambaker.com> wrote: > Does the datatracker also track the result of shows of hands? I was > scribing yesterday and it was a bit of a pain juggling multiple screens. I > was pretty sure that the information was being captured but since I didn't > know for sure had to do it. > > A point I am rather skeptical about is the ability of an LLM to > accurately capture the conclusions from mic interactions which frequently > start off with a hazy question, receive a hazy answer and gradually > converge on a common understanding. In those cases, it is the common > understanding that we want to go into the minutes, not necessarily how we > got there. > It's reasonable to be skeptical of this, but we don't have to discuss it in a vacuum, because I've generated 10+ IETF's worth of historical minutes, plus the minutes I'm generating for this meeting, so people can judge for themselves how good a job they do. As should be clear, it's not like I'm generating these minutes by hand, so if you think they're bad and don't want to use them, I'm not offended, and I doubt Gemini will be either. -Ekr > On Tue, Nov 4, 2025 at 3:24 PM Orie <orie@or13.io> wrote: > >> Hi, >> >> I filed https://github.com/ietf-tools/datatracker/issues/9881 as a >> proposal to integrate autominutes into datatracker directly. >> >> I think it's important to enable corrections and clarifications in >> minutes, especially to support direct links to related resources. >> >> Regards, >> >> OS >> >> On Tue, Nov 4, 2025 at 11:39 AM Lemmons, Chris <Chris_Lemmons= >> 40comcast.com@dmarc.ietf.org> wrote: >> >>> Just a usage report… I found the real-ish time notes very helpful after >>> taking notes for MOPS. I took notes as normal for the session, but after >>> the session when the auto-minutes were available, I double-checked against >>> them. I found that the auto-minutes had slightly mischaracterized some >>> conversations, but not any worse than a human does. It did, however, make >>> *different* mistakes than I did, so I was able to correct my notes with >>> the things it captured effectively. It was very useful that the >>> auto-minutes were available very quickly after the session while my memory >>> was still fresh. >>> >>> Many thanks for your efforts here, they are very much appreciated. >>> >>> *From: *Eric Rescorla <ekr@rtfm.com> >>> *Date: *Monday, November 3, 2025 at 3:32 PM >>> *To: *Working Group Chairs <wgchairs@ietf.org> >>> *Subject: *Re: PSA: Automatic Minutes Generation >>> >>> Update: >>> I am generating live-ish minutes for IETF 124 at: >>> https://ietfminutes.org/minutes/ietf124/index.html >>> <https://urldefense.com/v3/__https://ietfminutes.org/minutes/ietf124/index.html__;!!CQl3mcHX2A!Cp64CfaSh9BVeM9KKwGj5sFMR2ueryvxZh8WRGSaEZpko5keJ9ZPkFiqE3WPWX12o7SsF5aNhAEzPw$> >>> >>> It takes some time for Meetecho to produce the transcripts, so they're >>> not available right after the meeting, but as a reference point Monday >>> Session I is now available. >>> >>> -Ekr >>> >>> >>> On Sat, Oct 11, 2025 at 7:02 PM Eric Rescorla <ekr@rtfm.com> wrote: >>> >>> Hi Chairs, >>> >>> Like many of you, I've long been unsatisfied with the situation around >>> IETF minute taking, in which we conscript someone into taking minutes, >>> thus preventing them from fully participating, and often with mediocre >>> results. >>> >>> In an attempt to partly address this situation, I've put together an >>> automatic minutes generator at (https://ietfminutes.org/ >>> <https://urldefense.com/v3/__https://ietfminutes.org/__;!!CQl3mcHX2A!Cp64CfaSh9BVeM9KKwGj5sFMR2ueryvxZh8WRGSaEZpko5keJ9ZPkFiqE3WPWX12o7SsF5by2XDQvg$>). >>> The site >>> takes as input the Meetecho transcript and produces AI-generated >>> minutes. I've gone back and made minutes through IETF 112 (November >>> 2021) and I plan to produce minutes for IETF 124 (Montreal) once >>> transcripts are available, shortly after the meeting. >>> >>> Hopefully others will find this useful. >>> >>> -Ekr >>> >>> P.S. I'm not a WG chair, so you should make sure to keep >>> me on CC if you want a response. >>> >>>
- PSA: Automatic Minutes Generation Eric Rescorla
- RE: Automatic Minutes Generation Xipengxiao
- Re: Automatic Minutes Generation Eric Rescorla
- Re: PSA: Automatic Minutes Generation Alan DeKok
- Re: PSA: Automatic Minutes Generation Dirk Kutscher
- Re: PSA: Automatic Minutes Generation Eric Rescorla
- Re: PSA: Automatic Minutes Generation Eric Rescorla
- Re: PSA: Automatic Minutes Generation Eric Rescorla
- Re: PSA: Automatic Minutes Generation Rifaat Shekh-Yusef
- Re: PSA: Automatic Minutes Generation Suresh Krishnan
- Re: PSA: Automatic Minutes Generation Eric Rescorla
- RE: PSA: Automatic Minutes Generation Gunter van de Velde (Nokia)
- Re: PSA: Automatic Minutes Generation Eric Rescorla
- Re: PSA: Automatic Minutes Generation Mo Zanaty (mzanaty)
- Re: PSA: Automatic Minutes Generation Lemmons, Chris
- Re: PSA: Automatic Minutes Generation Orie
- Re: PSA: Automatic Minutes Generation Phillip Hallam-Baker
- Re: PSA: Automatic Minutes Generation Eric Rescorla
- Re: PSA: Automatic Minutes Generation Robert Sparks
- Re: PSA: Automatic Minutes Generation Phillip Hallam-Baker
- Re: PSA: Automatic Minutes Generation Peter Thomassen
- Re: PSA: Automatic Minutes Generation Robert Sparks