Re: AI slop "contributions" to IETF working groups

Phillip Hallam-Baker <phill@hallambaker.com> Tue, 10 February 2026 18:34 UTC

Return-Path: <hallam@gmail.com>
X-Original-To: ietf@mail2.ietf.org
Delivered-To: ietf@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 31FA9B4DD5CB for <ietf@mail2.ietf.org>; Tue, 10 Feb 2026 10:34:53 -0800 (PST)
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -1.893
X-Spam-Level:
X-Spam-Status: No, score=-1.893 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, FREEMAIL_FORGED_FROMDOMAIN=0.001, FREEMAIL_FROM=0.001, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=0.001, RCVD_IN_VALIDITY_CERTIFIED_BLOCKED=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id u0Lnw0oLSjaI for <ietf@mail2.ietf.org>; Tue, 10 Feb 2026 10:34:52 -0800 (PST)
Received: from mail-qv1-f43.google.com (mail-qv1-f43.google.com [209.85.219.43]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id 54241B4DD5C4 for <ietf@ietf.org>; Tue, 10 Feb 2026 10:34:52 -0800 (PST)
Received: by mail-qv1-f43.google.com with SMTP id 6a1803df08f44-897002b7576so13204166d6.3 for <ietf@ietf.org>; Tue, 10 Feb 2026 10:34:52 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; t=1770748486; cv=none; d=google.com; s=arc-20240605; b=S7q+m/QgbNCsISm6k2MWI3gSC9GYpnXxeKaU4gFCXcInnHc57XeLm/jlk65jcDYq3l v8iu7N+LIAs80gB43GsxmhOTKpHW+fgW9sWCqE+kg+gScDkMUAfEa60cj0RLRQT9vNEm UdD6v5Nv4yOt/SHyWX9ZpqhBaGgF/mbUQ0Sks2Ki2lTJNkrUHfszVlXU7Cua1mn8gKpz +/Oc5iMMEtfXbrXOiOIDQzWNYt9avREAJs1HH4CBCPR7H7lcPVYMakGyY9xN1THFF6Cn 1vE5JT7oIfAGZw4YPafMPDDy/C+vlxqlOt3EwiU+I5w6jfhkZCC4+8tx7LnLDIaB44Y9 RUmA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version; bh=y3736G5LhH62ERzBQhWeNvePepiOWj5w/5kOHbHPrfo=; fh=twkRfdMRweAF/9Mq1HaKwVqaXOcln7h4N3PpPiUAvos=; b=XlBMqZRlcwGZmXcPInk/u3On3j0qtDSR4WFErlx6X2FjGp53CQza8L310u/SUpeQ0C 0u1zti4qQqM5WT/QzDD1PwXu4MBCU8j41IQESNOHS2j1gb2by9AeGA/xfEmfsW7zgoVy 5WLMSoRsOivWgFTQJFpB3/9qxpnfJcdmHzVJSiWHF1IMSNcl12mNoBOXyZLv2rkYPBJA 65QrGE7z9ZXpDzAgO5AvqdhxG3TJ5aXsZ54y05Q+E7mVypSlR0mnn7pmOLVvTXTuP0Be E1LmG11fTPQUsNnYnZMtFJKJbwN9qlNnPf2GNg7Jbp8/n6wDZwzrL7/BHpp466BGq0Ji x0fA==; darn=ietf.org
ARC-Authentication-Results: i=1; mx.google.com; arc=none
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1770748486; x=1771353286; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-gg:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=y3736G5LhH62ERzBQhWeNvePepiOWj5w/5kOHbHPrfo=; b=AYhMC+/x8geNZJDQgl4qLRymLa9wkuebRHpFZpceuXeTobjvfMhBeT3f28JCJ6b674 VjsmXCDAlGOXPoJmQacRrYAcMZMMBE9sWQMglrG4IgAKJOAYC+0W4nlIROebXvBEMxFc I0g8fQ1u/pKwmF9DrhLk5q4o5QZkSIFjEKo7jvCsrYyKMKisghx2jJq3U3gPZoamU377 lCpYc6tUgQTll/SXiz+Ibho01JcoJ8u1SHxAI+nSsA+g4aI7u6YERhTD1sU0oqoNx4Sl MMPn/5XHGpVGNOsXSI5K98HYztU5kSMV4BWlTYyG0qWHvJecUh80UOpLGtv5/J0B75TP vXRA==
X-Forwarded-Encrypted: i=1; AJvYcCVlcSudkANxZrlhflDhfOV6cpvLR3D6rObb/ahv1Pte8qvM+b1AZ0XW9I+rWRR+asnsCmBa@ietf.org
X-Gm-Message-State: AOJu0YwmuehNallH980aezD2UGipIKY3NZR0LJhA5chQYj8tTkAPWPRC 8La4+Har2Anr+CaTCDuAOUHPubIXtwq0jkZPDBRpc0JmPf6Ax3S79cHBPo27Kkhy6CJD1dRRQFU Y0peKjvs8Pn/FsoMnSZLywwq9wyPBHks=
X-Gm-Gg: AZuq6aLHuxqVvry7N94z9d3+rwT1cfwCigayVWMNpkvm4b0YHIMzyhaGzlehkyn274k Zo6GFPt/aZA6Z9BY55aGQ7H3D8NfWduXUx7ibtlHi1ewKdvVj/nIzcv1YdbL5juv0C5hHWWeYI1 hVecguldRBs6snF6vXUE8+IPXjILySGRw/KaXs4+60Cn7YRr1mzL3Z3pw7O09Nyh+mtz0/soPTk bhOSDy6HgMkDEQAaQ//35ulJOJsJCTsqkxmvSKeVkVTMVd/m2BUuiTu9cTloP2i/0qeOY9neuHt n5Z0MEdvi6h+Gj2+PsTXXaxbXgiON9gh01ajwzIM4AF83UwOVUHooczAjJ8t833G
X-Received: by 2002:ac8:7d8c:0:b0:502:f01d:1b43 with SMTP id d75a77b69052e-506398ae01cmr215084391cf.29.1770748486118; Tue, 10 Feb 2026 10:34:46 -0800 (PST)
MIME-Version: 1.0
References: <7b702e8f-d2be-5b08-e262-33fbed538f98@foobar.org> <460BCE12-4C45-45D0-94C8-83B8E2D45049@gmail.com> <922b6d08-1cb5-4791-974f-ff17850de25f@gmail.com> <5DCE2993-39C8-4FAC-AD91-7B8E504E996C@gmail.com> <20260208015537.8D945F5944ED@ary.qy> <cd492277-0bca-4219-a3ad-eb75ccd2ebe7@gmail.com> <m27bsk6d9c.fsf@ja.int.chopps.org> <d5bccc8e-f013-c3e5-09cc-30913983b2f0@foobar.org> <b94b3e13-ebc9-4fb1-932f-89b05c2ce3ec@joelhalpern.com> <28670ac9-159c-4830-afe7-c5df4ce354da@htt-consult.com>
In-Reply-To: <28670ac9-159c-4830-afe7-c5df4ce354da@htt-consult.com>
From: Phillip Hallam-Baker <phill@hallambaker.com>
Date: Tue, 10 Feb 2026 13:34:34 -0500
X-Gm-Features: AZwV_Qh-SS9vy1y1mp12LQpXPNohdEG-AvDJNU5F7nAgQNcFwEEq0RZ4_y-tuwc
Message-ID: <CAMm+LwiDfNb1j3khkWCik8ZTziyzOFFyqEZqbVX_F9DStwx9yQ@mail.gmail.com>
Subject: Re: AI slop "contributions" to IETF working groups
To: Robert Moskowitz <rgm-ietf=40htt-consult.com@dmarc.ietf.org>
Content-Type: multipart/alternative; boundary="0000000000008072fb064a7c8239"
Message-ID-Hash: 4KGFO3I3NXL7GC26W3YSXIZPB24Z6JML
X-Message-ID-Hash: 4KGFO3I3NXL7GC26W3YSXIZPB24Z6JML
X-MailFrom: hallam@gmail.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-ietf.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: ietf@ietf.org
X-Mailman-Version: 3.3.9rc6
Precedence: list
List-Id: "IETF-Discussion. This is the most general IETF mailing list, intended for discussion of technical, procedural, operational, and other topics for which no dedicated mailing lists exist." <ietf.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/cEiMVPPc1UvWUqgvxeWV5JsrwWI>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Owner: <mailto:ietf-owner@ietf.org>
List-Post: <mailto:ietf@ietf.org>
List-Subscribe: <mailto:ietf-join@ietf.org>
List-Unsubscribe: <mailto:ietf-leave@ietf.org>

How is using an AI different from using fuzzing though?

One of the most effective hacking tools is to simply spam the inputs with
garbage and see what happens. So it isn't exactly surprising that when
people write code in unsafe languages without null pointer and array bounds
checking, they can discover low hanging fruit vulnerabilities faster than
others.

What such testing doesn't show is that the code is secure because AI
generated tests aren't exhaustive. Just as 'write slop, check it by
fuzzing' isn't a valid method for producing secure code, neither is 'check
with AI'.


On Tue, Feb 10, 2026 at 11:20 AM Robert Moskowitz <rgm-ietf=
40htt-consult.com@dmarc.ietf.org> wrote:

> Last week, one of my activities was observing an Aviation Cyber Rodeo
> with a "Capture the Flag" activity.  Two classes of participants and
> awards.  One for college students; one for industry people.  break into
> our test systems (no actual aircraft or airports used).
>
> One industry person who is really good at finding flaws in aviation
> stuff and advises all over the world, spent his day ONLY using AI to
> attack.  His goal was to mimic the attackers to better understand their
> methods and how he may then develop "Purple Teams" Strategies to rally
> the defenses, as we all know the attacks can win once they try.
>
> He won.  He penetrated every system and technology and did it faster
> than anyone else.  And there were two really experienced industry attack
> teams there.
>
> At one point he joked that he was ahead of me.  He had better, as I was
> not competing.  I was there as an observer and advisor to those building
> the tests that were attacked.  ;)
>
> Scary.  That AI-guided attacks are so effective...
>
> Really scary, as some of these systems in real world would take some $6B
> and 10 years to replace.  Thus the need for isolation.  But is it really
> isolated?
>
> On 2/10/26 10:35 AM, Joel Halpern wrote:
> > I presume most folks in this discussiona re aware that we are far from
> > alone in this problem?  For example, Bruce Schneier has a nice summary
> > of some of the examples and dimensions in
> >
> https://www.schneier.com/blog/archives/2026/02/the-ai-generated-text-arms-race.html
> >
> > Yours,
> >
> > Joel
> >
> > On 2/10/2026 7:05 AM, Nick Hilliard wrote:
> >> Christian Hopps wrote on 10/02/2026 11:37:
> >>> So anyway, while we’re (IETF) considering requiring disclosure of AI
> >>> tool use here, I think it’s worth considering what exactly we’d like
> >>> this disclosure to accomplish. Is it a filter flag (i.e., if checked
> >>> “Yes” it get’s dropped to /dev/null by a personal email filter)? Does
> >>> it help in reviewing the document knowing that AI tools were used.
> >> IDs and formal documents are only part of the issue. Possibly a
> >> greater problem is a contingent of people who are issuing commands like:
> >>
> >> "ingest {URL of I-D}, identify 3 substantial problems in the text,
> >> write a single paragraph of concise text for each problem in a format
> >> suitable for submission to an ietf mailing list"
> >>
> >> then cut-n-paste the output into an email.
> >>
> >> Nick
> >>
>
>