IETF Logo Mail Archive

Re: [Last-Call] Last Call: <draft-koster-rep-06.txt> (Robots Exclusion Protocol) to Informational RFC

John Levine <johnl@taugh.com> Mon, 28 February 2022 22:35 UTC

Return-Path: <johnl@iecc.com>
X-Original-To: last-call@ietfa.amsl.com
Delivered-To: last-call@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 629EB3A166B for <last-call@ietfa.amsl.com>; Mon, 28 Feb 2022 14:35:53 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.861
X-Spam-Level:
X-Spam-Status: No, score=-1.861 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.248, RCVD_IN_DNSWL_BLOCKED=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=iecc.com header.b=uIsjFRQv; dkim=pass (2048-bit key) header.d=taugh.com header.b=LSgzYJiu
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ObTTsNxoYVvA for <last-call@ietfa.amsl.com>; Mon, 28 Feb 2022 14:35:48 -0800 (PST)
Received: from gal.iecc.com (gal.iecc.com [IPv6:2001:470:1f07:1126:0:43:6f73:7461]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5F6DB3A1644 for <last-call@ietf.org>; Mon, 28 Feb 2022 14:35:06 -0800 (PST)
Received: (qmail 38372 invoked from network); 28 Feb 2022 22:35:04 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=iecc.com; h=date:message-id:from:to:cc:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:cleverness; s=95e2.621d4e18.k2202; bh=yEZL7U6Cw7Ax8dTNtYVb7O21d/IMXTR1XtCfk0lm2uQ=; b=uIsjFRQvW+JCwTbRPo4E3/zJUQKSAVaeI8Eroqu/COOMmwvkRFAQKUXdkpxpUubKSVucbS2sUd3LKmpIeupiZyooX6t/XiJQKDUXZndviH5znAS7oDcn00E4/cWukm2ioDzrimEIzpKyyB0C9q0i8OO5CPJqrRqVfy34nPYYGL1qTyIicMb/y4KFqHwxDTyxGQ6Pt/EYn+rL5mCYsJ2GLl6EA+4qbmmUYxrLY5j+nCBEDsCbDPiBNFsUnWKsbMas8tG13wNHPklD18zTF9RFBalMtUlctaIAquN+HDLEb6VR2sxGxHebd3xnpTGWeFp03Sq26PPtecGZoFJazaxiJg==
DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=taugh.com; h=date:message-id:from:to:cc:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:cleverness; s=95e2.621d4e18.k2202; bh=yEZL7U6Cw7Ax8dTNtYVb7O21d/IMXTR1XtCfk0lm2uQ=; b=LSgzYJiuiBnaPeQJ8lyvbxR+8zs27Cf59Ue39FtRBdHju+mZK2kwq159qDCMjKjJytpzdFTmJtQoqHeZXXHLzkX7zRmXN/fAHMqI4W5XUpCI74zBQ2JrAnUdiQoZT/1bbMkeW3BRrkx6slxdiOcQmbI8Q6xs9wyPui8Fv0T/fSil7ZsEzf5GWOInMGIIOo6GKq6rsJAA27xBBcK3Jbc+CPu+0pdZzwhq8SA6CLBBEsRKM1GR0QZvYXTwjzl3x8gvwCNnadM+31EV/L7G5ZU3Sy8ManNx5TBtU3/RtosRrJecpdu6N/7pNlc0gs1K+A3EN06Yi/F8/rxkZL2ncyW4uA==
Received: from ary.qy ([IPv6:2001:470:1f07:1126::78:696d:6170]) by imap.iecc.com ([IPv6:2001:470:1f07:1126::78:696d:6170]) with ESMTPS (TLS1.2 ECDHE-RSA AES-256-GCM AEAD) via TCP6; 28 Feb 2022 22:35:03 -0000
Received: by ary.qy (Postfix, from userid 501) id 787D13844319; Mon, 28 Feb 2022 17:35:01 -0500 (EST)
Date: 28 Feb 2022 17:35:01 -0500
Message-Id: <20220228223503.787D13844319@ary.qy>
From: "John Levine" <johnl@taugh.com>
To: last-call@ietf.org
Cc: mcr+ietf@sandelman.ca
In-Reply-To: <2597.1646071002@localhost>
Organization: Taughannock Networks
X-Headerized: yes
Cleverness: minimal
Mime-Version: 1.0
Content-type: text/plain; charset=utf-8
Content-transfer-encoding: 8bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/last-call/j1TgULbMyEABeLMStcFvM0S2yxI>
Subject: Re: [Last-Call] Last Call: <draft-koster-rep-06.txt> (Robots Exclusion Protocol) to Informational RFC
X-BeenThere: last-call@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF Last Calls <last-call.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/last-call>, <mailto:last-call-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/last-call/>
List-Post: <mailto:last-call@ietf.org>
List-Help: <mailto:last-call-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/last-call>, <mailto:last-call-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 28 Feb 2022 22:35:54 -0000

It appears that Michael Richardson  <mcr+ietf@sandelman.ca> said:
>I see that the document is Informational.
>I'm unclear if this document is identical to the 1996 description, or if
>there are changes against the 1996 version.

It adds provision for encoding UTF-8 characters in URLs and says
patterns can have * and $ metacharacters and # comments.

>I wonder if 2.3.1.2.  Redirects should suggest the file be moved to
>/.well-known/robots.txt with a redirect, that perhaps shouldn't be counted.
>That would be a change which may be more than desired.

That seems like a poor idea for a widely implemented 25 year old spec.  But
see the "no derivatives" license on the draft.

R's,
John

v2.8.7 | Report a Bug | By Email