[Web-bot-auth] Follow-up from IETF 126: Comments on draft-illyes-webbotauth-cbcp

Sauron <sauron@google.com> Mon, 27 July 2026 12:42 UTC

Return-Path: <illyes@google.com>
X-Original-To: web-bot-auth@mail2.ietf.org
Delivered-To: web-bot-auth@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 4D2FE11F3D3AA for <web-bot-auth@mail2.ietf.org>; Mon, 27 Jul 2026 05:42:26 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1785156146; bh=k3GFNHfv1t8sKbVV2mSOXBcVnEJemBFlkiOk3CjgBo4=; h=From:Date:Subject:To:Cc; b=Zye8Zz1bvMAJpZic+fZINrGFeF6Oh3g8b0SlGnToBX0mkkK7FpOjWI2XNdFePfrBM IxLkqqNcUHbdxhsXFNUiNX850/d8EsdlK50AKoJZq5BJHzpkM2TPFbFhaRxQXOggH6 IOSkR8v1CNIvkGrM7aCqDIeTtWYS1z3tXaHJUNEE=
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -17.09
X-Spam-Level:
X-Spam-Status: No, score=-17.09 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_KAM_HTML_FONT_INVALID=0.01, USER_IN_DEF_DKIM_WL=-7.5, USER_IN_DEF_SPF_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id rsN_a2c2Twcj for <web-bot-auth@mail2.ietf.org>; Mon, 27 Jul 2026 05:42:25 -0700 (PDT)
Received: from mail-qt1-x82c.google.com (mail-qt1-x82c.google.com [IPv6:2607:f8b0:4864:20::82c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id 632EF11F3D379 for <web-bot-auth@ietf.org>; Mon, 27 Jul 2026 05:42:22 -0700 (PDT)
Received: by mail-qt1-x82c.google.com with SMTP id d75a77b69052e-51c01c79467so390771cf.0 for <web-bot-auth@ietf.org>; Mon, 27 Jul 2026 05:42:22 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; t=1785156142; cv=none; d=google.com; s=arc-20260327; b=l4sXusICluI8uq2GtcKkmoa2/4LVObjyliOGa2y3gCUSBuEFBeGseyYW6MsLnwtC7W iCif+NbDiyuZy5C4lfp/w+wX8v+b1SAAHv2e8ucEHaWPdizrQNJIOqt/F9TFPOoXvJzR HWUSJeXBKMDAP0Yf5BEpDP1JQT9ncK4mN2NSKQFNjdqoUHMPVBrkrq9jvYmmT1cFPOa3 MNHeXeHz3yGP72UbIx8KsdpCG07m39GB8F540IgvqLP3fnPxigN9wnPth1ywG3PHWaLQ 87Re0dr6akpBG9+LZMnBi6ORp5b0L1b/up3mfBhk32huTomHfFoA0i0OgB9OGYaQqwr+ Vsww==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=cc:to:subject:message-id:date:from:mime-version:dkim-signature; bh=k3GFNHfv1t8sKbVV2mSOXBcVnEJemBFlkiOk3CjgBo4=; fh=JSl9HeNjX+uApWAUWo6rXAlwP+sDVRrx5BO7KYu3/V4=; b=lO5qd/bcvnR4uz0PX8looL3Z40OxefthJuX3UVCgg93EbKt+OZqZvGkjy73u25Mn8g vc827aU2Gz4U22z+Y9Bak5WSfmJXzLh0zDaXU1McAshWwWCU59xu2NxEEwHnN0rWu2W/ hDaG4rlDmKVVxPzDaNaDf7kcYDSJA0u/38ni2azPwUbKfHThCdEV20RvCuR5/A3h/I+a 9EEfVG774JXi6szgI5+evbNynex+VgyAytYmasp6oUiLSB10i4QYe+dULx0DPS7EyrAx Etua+d2HpiOKKRJHeVBGdywOFpZTk2fQ3EJ9qbB/NWZfsFMW8e/F9c3KxLbCaS2ULNU4 AeMA==; darn=ietf.org
ARC-Authentication-Results: i=1; mx.google.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20251104; t=1785156142; x=1785760942; darn=ietf.org; h=content-type:cc:to:subject:message-id:date:from:mime-version:from :to:cc:subject:date:message-id:reply-to:content-type; bh=k3GFNHfv1t8sKbVV2mSOXBcVnEJemBFlkiOk3CjgBo4=; b=Um7IUBL1JT1uFYSyEJDYY3WYFg/M7BAL8ASpvQC2wRvIgKDoCWMwbTHfL4DzOUu/JC b2tL9Rl+9/SFDgVHjgZp3yOAvlQMX6/5CGXoD2Dp9vviSqtjAkKjJp/2baN+DFR4f60C YbVWw5IJNzRhGa/dlPaZOH4VjuCGNF+P21vp8PE/MAW3kgGAnLpTrllk/OrI+R7poHLg HH9bsF5COvdvo2mdSnVu56xz00tvb4xKDRY3jcIHYASvmiILqUpj+sAidO879YHFQvaD uovxEFKbCpXir+16SFsC5Uxcb6j6ZOVTEziMXqwr/n8Yw3YmcPX6i+1M+m5auJg/vpak ldMg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1785156142; x=1785760942; h=content-type:cc:to:subject:message-id:date:from:mime-version :x-gm-gg:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to:content-type; bh=k3GFNHfv1t8sKbVV2mSOXBcVnEJemBFlkiOk3CjgBo4=; b=a19hTlb5ECkxo/sMvwT2biFe+jG2QFfQtq4WVI2CN1tDv/kCZQEyts8GiM1hYdPcW/ bb6FyMDzjY9VbMdyTYkU95H5of6rR/9cX2WPd/Nez6UGjgl7J02dbYKS9lMtpYWBwn2f KnjO5IEtfSjBhR2Mf4NfmPt9dAfLr7laYlIm4M/ViHJYHje7z+qvC8rg9F7o9zTuLmtT dPtxmKlH9HMSIDm8wF01wYjOrQLkuuaBRCrUqAWLUSJYqlixrPIFz9Apbet6sXcBHo8C vQQT3CivWBG1TTLvGHK/vVhtrhyEGi4myJr8y13sy9ehGlCstjene8LTqTdPr6XAZzzY H1IA==
X-Gm-Message-State: AOJu0YzS6QN+kUfw348lf12KT0mSk1Bnhrv9Wyhh8G3D8nMDhFglW/dt z63wcLl5A3kSe3LR+adEbYs396jLbf4S9ZMTpUkcLgrz9oO7qTrP+DSD3Px0GFGIMXr/FBxhe4l h74AfIA3P6DAUHKtz7ALiMjNBfdRsqOF1OpuNwhD/gzKkVYz8nPDEiF85ErQ=
X-Gm-Gg: AR+sD11v76JZPchI/+h2LHPEKMppOElmF680u0P+qQzuxL2UuzSAtW7v/v/Rc7TaTzU lThfZ15dwaLSLg7ajScIeGdhvUCqRuFfsxHLJuVrAF6HhRQ0ZqNnnqz9V6HXkHCFcQEMMNKAl1d w+HbBFGqtgKoI6pCvJba7RXqPZTqUXFuo+l/47UB3XxHhSM1tO4+NQTrFDwsanpvkygpfoTEk26 9w45N68b10+c2FOpe1of85zKwLse+7zgLfYvv2O+PHwO6gIyPQA4Pe2rwL54vN05sQzdwesMvvf 4Gqga7ek8ovyd9xb5IIkKTqhmX0YDGHM3ch15TP+nbXEXi8z0gvUg1Z0qJaLdlR1tKwKadhX2g6 fFI1eGj8hX4djeqxQbcE=
X-Received: by 2002:ac8:5a05:0:b0:51c:6b7:d3de with SMTP id d75a77b69052e-529a7684c63mr30422041cf.5.1785156141091; Mon, 27 Jul 2026 05:42:21 -0700 (PDT)
MIME-Version: 1.0
From: Sauron <sauron@google.com>
Date: Mon, 27 Jul 2026 14:42:08 +0200
X-Gm-Features: AUfX_mz8h4NOAEL7i3Sewtg6bzocwg80sFCdBFzZo2ojZizjFiHrHrpaxAKYSDw
Message-ID: <CADTQi=dSGTGJtczLTZ1ua77C8h4pvGhrVkz3MZV7SO280MJrKQ@mail.gmail.com>
To: web-bot-auth@ietf.org
Content-Type: multipart/alternative; boundary="000000000000aa9a9a0657970d61"
Message-ID-Hash: FPNZRG2KJGTKS6KHKPIOGTLI75442ETM
X-Message-ID-Hash: FPNZRG2KJGTKS6KHKPIOGTLI75442ETM
X-MailFrom: illyes@google.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: "Mirja Kuehlewind (IETF)" <ietf@kuehlewind.net>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [Web-bot-auth] Follow-up from IETF 126: Comments on draft-illyes-webbotauth-cbcp
List-Id: Authentication of non-human users to human-oriented Web sites <web-bot-auth.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/web-bot-auth/-xDKXlKdpC_b8oQnEOURt3vltvg>
List-Archive: <https://mailarchive.ietf.org/arch/browse/web-bot-auth>
List-Help: <mailto:web-bot-auth-request@ietf.org?subject=help>
List-Owner: <mailto:web-bot-auth-owner@ietf.org>
List-Post: <mailto:web-bot-auth@ietf.org>
List-Subscribe: <mailto:web-bot-auth-join@ietf.org>
List-Unsubscribe: <mailto:web-bot-auth-leave@ietf.org>

Hi all,

Thanks for the engagement and support during the working group session at
IETF126.

As mentioned during the meeting, we are looking for even more feedback on
the Crawler Best Practices draft:
https://datatracker.ietf.org/doc/draft-illyes-webbotauth-cbcp/ /
https://github.com/garyillyes/cbcp

Specifically, input on the scope, rate control conventions, and handling of
non-malicious crawlers would be really useful to help move the draft
forward. Please send any comments to the list or open issues directly on
GitHub.

Thanks,
Gary

PS: if you have ideas where to send the following two drafts that CBCP
depends on, that would be hugely welcome
1. JAFAR: https://datatracker.ietf.org/doc/draft-illyes-webbotauth-jafar/

2. REP-ext https://datatracker.ietf.org/doc/draft-illyes-repext/