Re: AI slop "contributions" to IETF working groups

George Michaelson <ggm@algebras.org> Tue, 10 February 2026 04:27 UTC

Return-Path: <ggm@algebras.org>
X-Original-To: ietf@mail2.ietf.org
Delivered-To: ietf@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id DA3DFB47E9FF for <ietf@mail2.ietf.org>; Mon, 9 Feb 2026 20:27:32 -0800 (PST)
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level:
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=algebras-org.20230601.gappssmtp.com
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2YwtE7Ch0m9X for <ietf@mail2.ietf.org>; Mon, 9 Feb 2026 20:27:31 -0800 (PST)
Received: from mail-ej1-x62e.google.com (mail-ej1-x62e.google.com [IPv6:2a00:1450:4864:20::62e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id 68FACB47E9E2 for <ietf@ietf.org>; Mon, 9 Feb 2026 20:27:31 -0800 (PST)
Received: by mail-ej1-x62e.google.com with SMTP id a640c23a62f3a-b885e8c6727so591219966b.1 for <ietf@ietf.org>; Mon, 09 Feb 2026 20:27:31 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; t=1770697650; cv=none; d=google.com; s=arc-20240605; b=WdJj7FLLE8P0XkpeHTlCDxpxPuLzvvfZS4uKoPQoFXV07lngs8/f/4zf2DF13DBMaK EevLVhyfzYbjkXn0BuhtwqEnA3aT16S1/+CdFIuB2APXEXSN6COkBwWThK1JQY5BSEIh X0/oNDiUgBHVwm3Oi0sZ1e4E9uKkRM4YOcumlsroNfHozIgQJpgFacx2T3tT0RPMYNpp i7VcXveOFoE8IKOJ+LtdgMi/aJOnCfsnCR90GgoUUOD9nb9YH9sfq01bJPqaF5rnYY/o +AqmGnEK2mAPz4LhwgbKjdOSpFriV2R9egeg8SSRuw3ewB/SsQNj0dQkz4laxGHp9twH 4zMA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :dkim-signature; bh=vtJw3GgB3hkxCno2d9Uq33ML2vYl9BO5++cd8GeKnWM=; fh=a2cEQeP+r/54ovGJSzlfqN5OkD9dL+F3y38K1V0Riks=; b=Wy6/yTCb/CTvh1YvfIpLAhD0R1JvSRDTd3mXccvJN26i0GuFjFPobK2sNIRwKqjYnD pPdXrqvK4xHXGg/iqpMhr6kb9d/Bz4Ai1+4rnskGLv/BsJZPdKR1UpOnZix3kCzZvvP/ 0xnAkL26oWtcbLAvYXrurE4dQloCL+tAfgOtOpmJA6VPKE+I6zDPtkid3a6wDrN8kd/P ubCVIg4gR1Yy0HpZVP24FZ7Oj6mrgHuAYvZb0Buc9FrS6ahffedFwsNMrsB5vIAz77Vb e174A1rkVkRREjCFvd5KPL83ZYErlqtNkM3eDziG/C4jHaI0pcgtLuAT2jhJjXcbfNOF RbPw==; darn=ietf.org
ARC-Authentication-Results: i=1; mx.google.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=algebras-org.20230601.gappssmtp.com; s=20230601; t=1770697650; x=1771302450; darn=ietf.org; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=vtJw3GgB3hkxCno2d9Uq33ML2vYl9BO5++cd8GeKnWM=; b=WIceYk4gYBjalHuDYikNPVXq1PVxr7SHBReIgY+fn+lSJLZj1d6K5Hh1A6TviAcf2q jdLand66rOZ5Nn+pX8G/fVYzjji7wQRetALsb/qlbGAezA4UkvJqr7yf40thPkyX7gtq T0zVc4lBzukgiwcEYZrNRDyHzDxLdh8y0YoEynWRbKaY9CJloVRIc/XHCu6DX8yaKsdV qjJAOyJsnaXq434U7i/rKlnbgb1QpPYc1t14TVD+wbPbFHttitWftCYHDibYhJipLQ/U CSgrRWHeBRdlfV6rEFKhFEHlKorlOY30r7ejtum4zeEC/LfElGvS846ZML361kqhwbe3 YDiQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1770697650; x=1771302450; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-gg:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=vtJw3GgB3hkxCno2d9Uq33ML2vYl9BO5++cd8GeKnWM=; b=ux4NqIIm6GM5Ad6+Jgg0vSyJppyl1ldgta+T8+ZWpW0U+Jlga8HLsWSuoIAWL9AyIf xLWXZjm2Y8wcTY/URaQkQFW3d1ROe25X754l21DRo0FoBE0wArBH7jqszIL3ivJz3+Jx aT/WkIKkIr5C+MV3CIwOz9DV3vIseAI8LAtUPovY1or8L8PmR5/9Abjyo6CPeWqEYiUz G9jT0g4tjLZc68M0Gf2dp1lNXa8qHlxUmLRcrpkfwzvYg0Ow8D7Bz9MvrC5ZfwNdyPp0 nGRlY6ZbqCEw0UWy9HWdgjlEXvDQp87Py1RPNTid5+o6q4m3ofHfcDxvPHXhWeFk9Uxl tfDQ==
X-Gm-Message-State: AOJu0YzcRxQHJniM6e7oCrf7r4kvIUjaYDkm51L7JL6VI7LFfqzrTeN1 0nnnSxCt+tUN8Z2p1be+VPyGyENYm5hZC9uHsAinZGxFDhUWiu8q0SBLsuJpYyyskkTWQVMeClP LYuxTxBHCMb+CTsm6YC94AgI8ETffFRkyoXsXgYEnk2U3Zi4HqGJ9LcHO1b+erPM=
X-Gm-Gg: AZuq6aJVFjC7aeQrP+hPN/yTICpV9ILTnWaf2YKKkxP+Fh6aDzPTEvnzwx8k+O3EYsf o73c0mYfX6OxjJDYzIMRlmd5ch9Rz3ZhFVj9YYuFZT/JvJs+tLLWcN87k1xWc6Q/FSeDY1w2Eok pz3/CaseZKOcqvhw2kt36+kRWA3GjBvnSCiezRoftFYSGGzfe4uNy1UnrsMbmBx0skYK23wINiL iloI3ja9u7F7DKTtW7FxvgPt6JS4iKscpA4b2GVAjNg9PNyCg/7Wn13VZome4aLrqvPKN3VnzWX ik7LrplP7v3FW4FAaNZo+PlCbdFoOAJN4S94TF8emEjbAg/qSPu5jAak6OZR0up+7P/aBHvh7Vq pIyu7/xt9DU6pndYS/+OZrH4bu6ze7gJ+3JR8yvAmKaNlO3nzWtKawcDZf7Wz
X-Received: by 2002:a17:907:9281:b0:b87:105f:312b with SMTP id a640c23a62f3a-b8f50bc3542mr59204566b.16.1770697650032; Mon, 09 Feb 2026 20:27:30 -0800 (PST)
MIME-Version: 1.0
References: <7b702e8f-d2be-5b08-e262-33fbed538f98@foobar.org> <460BCE12-4C45-45D0-94C8-83B8E2D45049@gmail.com> <922b6d08-1cb5-4791-974f-ff17850de25f@gmail.com> <5DCE2993-39C8-4FAC-AD91-7B8E504E996C@gmail.com> <20260208015537.8D945F5944ED@ary.qy> <cd492277-0bca-4219-a3ad-eb75ccd2ebe7@gmail.com> <698aa5f4.050a0220.1f3b50.1612SMTPIN_ADDED_BROKEN@mx.google.com> <CAKr6gn0-7qthGkaUQ_7_j=dW-6cdMRqnS51anTLFkUF9yqkKFw@mail.gmail.com> <57b0523a-5fc7-4c63-a600-f46ea5e1cf4e@gmail.com>
In-Reply-To: <57b0523a-5fc7-4c63-a600-f46ea5e1cf4e@gmail.com>
From: George Michaelson <ggm@algebras.org>
Date: Tue, 10 Feb 2026 14:27:18 +1000
X-Gm-Features: AZwV_QhmqFm5zYqC9R_DigVGnKEjZ-m-0kUckMRCK4xunSSS4FEZ4RsWIt0zsXQ
Message-ID: <CAKr6gn2c2LkNUn5NGhruAPtxoB9toVSC72nBRRc7vyqAJBszYg@mail.gmail.com>
Subject: Re: AI slop "contributions" to IETF working groups
To: ietf@ietf.org
Content-Type: multipart/alternative; boundary="0000000000006f5ca6064a70ac3e"
Message-ID-Hash: BNOLAAAVUJRE6TR3MYOFYFDEOTK4USU6
X-Message-ID-Hash: BNOLAAAVUJRE6TR3MYOFYFDEOTK4USU6
X-MailFrom: ggm@algebras.org
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-ietf.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
X-Mailman-Version: 3.3.9rc6
Precedence: list
List-Id: "IETF-Discussion. This is the most general IETF mailing list, intended for discussion of technical, procedural, operational, and other topics for which no dedicated mailing lists exist." <ietf.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/6-jUOS0ByknAxkWQPhVG-aY7OjE>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Owner: <mailto:ietf-owner@ietf.org>
List-Post: <mailto:ietf@ietf.org>
List-Subscribe: <mailto:ietf-join@ietf.org>
List-Unsubscribe: <mailto:ietf-leave@ietf.org>

I guess I was more focussed on the "breach" sense that people submit
documents on a basis the work is proffered in good faith in a certain
condition and so if we're asking questions which they tick NO and we
subsequently have reason to think they were YES, the problem here isn't the
quality of the solution, the problem is that somebody was misleading.

For IPR, we have strong law issues. So, its a well dug trail road.  For AI,
we don't have well dug lines. Thats my concern because the people, the
process side of this, have to make decisions.

I don't disagree machine based methods are coming to do validation, checks,
maybe even code. I don't like this when it's referred to the giant
statistical machine-in-the-sky but we've had "this schema has been checked
by xxx" for a long time now. I can live with post-hoc review and checks by
machines.

What concerns me, is what we do when we ask people to say something, and
then discover they didn't answer truthfully.

In emails, I've already seen people make a reasoned case that for EFL
speakers there is a role for systems which do better than their otherwise
poor english skills. I don't personally believe we're ready to be tolerant
of that in normative language contexts, and I am a lot more confident we
don't want to be led to critique which has no human reasoning in it, just a
machine review.

-G (No Hats)

On Tue, Feb 10, 2026 at 11:18 AM Brian E Carpenter <
brian.e.carpenter@gmail.com> wrote:

> On 10-Feb-26 16:31, George Michaelson wrote:
> > Not to disagree with anything said, what would people want from our
> mechanistic processes when a breach is discovered, especially when it's
> discovered late in process like during AUTHOR48
>
> George, if our WG Last Call/Shepherd review/IETF Last Call/IESG review
> sequence doesn't find an AI-induced error, I'm not sure we should blame the
> AI. I don't see any difference from human error, by the time we send a
> draft off to the RFC people. All I'm saying is that it should be
> acknowledged up front and verified by a human before posting.
>
> In any case, AI isn't automatically bad. For example, I could imagine
> designing a protocol and then asking an AI to look for race conditions**.
> As others have said, there are many valid uses of AI.
>
> ** We probably aren't quite there yet, but see:
> https://chatgpt.com/share/698aaede-0438-8002-bc1f-a3b3b7411c52
>
> So having an AI verify our designs is probably coming Real Soon Now.
>
>      Brian
>
> >
> > If you want specific outcomes like a stall, or a reject then it's going
> to need careful definition and probably implies other process cost like
> appeals.
> >
> > G (no hats)
> >
> > On Tue, 10 Feb 2026, 10:28 Cheng Li, <c.l=40huawei.com@dmarc.ietf.org
> <mailto:40huawei.com@dmarc.ietf.org>> wrote:
> >
> >
> >     Agree with Bob and Brian that we need to request a disclosure of
> using AI.
> >
> >     I do not like to read an AI generated document, especially, without
> human checking, feeling unprofessional and uncomfortable.
> >
> >
> >
> >     Thanks,
> >     Cheng
> >
> >
> >
> >
>  ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
> >
> >     李呈 Li Cheng
> >     Mobile: +86-15116983550(中国电话)
> >     Mail: c.l@huawei.com <mailto:c.l@huawei.com>
> >
> >     *发件人:*Brian E Carpenter <brian.e.carpenter@gmail.com <mailto:
> brian.e.carpenter@gmail.com>>
> >     *收件人:*ietf@ietf.org <mailto:ietf@ietf.org> <ietf@ietf.org <mailto:
> ietf@ietf.org>>
> >     *时 间:*2026-02-10 04:14:21
> >     *主 题:*Re: AI slop "contributions" to IETF working groups
> >
> >     On 08-Feb-26 14:55, John Levine wrote:
> >     > It appears that Bob Hinden  <bob.hinden@gmail.com <mailto:
> bob.hinden@gmail.com>> said:
> >     >> I like the idea of requiring a disclosure that an Internet Draft
> was written with AI tools.  I agree probably not for emails.
> >     >
> >     > I expect that the people whose drafts most suffer from being
> written by an LLM will lie about it, either because
> >     > their English is too poor to understand the rules, or they have
> perverse incentives like an an employer that
> >     > gives them a bonus for publishing an RFC.
> >     >
> >     > Then what?  I'm not saying we shouldn't ask, but I'm saying we
> need to be prepared for noncompliance.
> >
> >     Of course, but if we make it a submission requirement - check the
> "AI used" box - there's really no harm, no shame.
> >
> >     Actually there are perhaps two boxes to check:
> >
> >     1. Was AI used in the production of this draft? [yes/no]
> >     2. If yes, did the authors personally verify the AI-generated
> material? [yes/no]
> >
> >     The attachment was generated by ChatGPT.
> >
> >          Brian
> >
>