IETF Logo Mail Archive

Re: [Last-Call] Last Call: <draft-koster-rep-06.txt> (Robots Exclusion Protocol) to Informational RFC

Ted Hardie <ted.ietf@gmail.com> Wed, 02 March 2022 08:35 UTC

Return-Path: <ted.ietf@gmail.com>
X-Original-To: last-call@ietfa.amsl.com
Delivered-To: last-call@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E736E3A135C; Wed, 2 Mar 2022 00:35:29 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.106
X-Spam-Level:
X-Spam-Status: No, score=-2.106 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id yByq1LKYnzqP; Wed, 2 Mar 2022 00:35:25 -0800 (PST)
Received: from mail-il1-x12d.google.com (mail-il1-x12d.google.com [IPv6:2607:f8b0:4864:20::12d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 0AD003A135B; Wed, 2 Mar 2022 00:35:25 -0800 (PST)
Received: by mail-il1-x12d.google.com with SMTP id w4so841972ilj.5; Wed, 02 Mar 2022 00:35:24 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=9oQDGy3jmfX7J3uv569YtlVP2kFOuL3vUfXXh1q1qgk=; b=bxDEZB4RYBaJmPP5GhileaeNEuprCxsqMiQShXKf6wXkJFvZdLmhDikBDjJ4EqqV1A at+wRSCAZ9/yHiuIqwtCHkoA6GiUaBUdrxsY5ordUGAvBcA4fDLbFuBpL8j4yqaIiesm AX/rTWs03nQvwQ0mgbrvlxdE1bLTED3YsD5LtZVbfduRUTykcRqI+Gp54CLEzibigtWb 0LYYzeFf0QlXN6u38d+v8ftr6NeBaVxLhO8MXWjgbKRor0uOPbGHSH1tEzxEQv7eEU9a /dFlIUsB3d62kj2fHkZUf6OxCEmOjN3BpEiEDBM3vd3jc7DXNKr7gAEgtQQebstxvDeO J7Iw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=9oQDGy3jmfX7J3uv569YtlVP2kFOuL3vUfXXh1q1qgk=; b=Y8mcLYg6FRAnG+DXqxAaZsJ/cWyIkpgwrdHR0TpO0YDqUNLWf98gbrAMrl9rETNq2P CVrUFQd8uoUP07/riQ111djuKGVp4CXQl9uEy4IFVWReoQC9YaQ0EWTAdkK7NcT7FVx+ i56Q1UGeZhlM4Ff9HC3EMeMfwlzWdUG3AwKub8ULOP5y4rnbQyNw5Zq0TBbJATqd6SDo CV0j4EMeh3nUyHGoJ/WWzbuJIt0rq8+AryNUyuqT7u43QUVmxT9kP/+UisR5uEp3lN4k 2846gOZLjE9UKawfZI3l5U77iQIhsn3tIGKiPaH7lot2uRlUeGhsmLDqhnn0cXuHXXAK NoPg==
X-Gm-Message-State: AOAM532T3MTgCkpiUwxtlHc4faM6eb14IlTJpnoQYQE9OeLVY/dR98GC kd8+RbxnPu76+48scL0OAExRR/lfZtl6NgxUkjQ/cgDc
X-Google-Smtp-Source: ABdhPJyMX0SvDNgSiglgULRMONVpBbBhs99/Pnpk3XCSs3Dleo9OK4s3271KaxrQ+FYMDkbyTdYac65BGlIugIfxwpw=
X-Received: by 2002:a05:6e02:1beb:b0:2bf:eed2:cd93 with SMTP id y11-20020a056e021beb00b002bfeed2cd93mr26150661ilv.99.1646210123971; Wed, 02 Mar 2022 00:35:23 -0800 (PST)
MIME-Version: 1.0
References: <164606998882.28525.15371769982481176731@ietfa.amsl.com> <2597.1646071002@localhost>
In-Reply-To: <2597.1646071002@localhost>
From: Ted Hardie <ted.ietf@gmail.com>
Date: Wed, 2 Mar 2022 08:34:18 +0000
Message-ID: <CA+9kkMBrdnnwKogRn4LyTnumjy8VGOaXFB4zJsFtWfqNFPWRNg@mail.gmail.com>
To: Michael Richardson <mcr+ietf@sandelman.ca>
Cc: last-call@ietf.org, draft-koster-rep@ietf.org
Content-Type: multipart/alternative; boundary="000000000000aa3fb905d93829ad"
Archived-At: <https://mailarchive.ietf.org/arch/msg/last-call/22NyKsqLOPczNV_YQ5L2r1vEGlE>
Subject: Re: [Last-Call] Last Call: <draft-koster-rep-06.txt> (Robots Exclusion Protocol) to Informational RFC
X-BeenThere: last-call@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF Last Calls <last-call.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/last-call>, <mailto:last-call-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/last-call/>
List-Post: <mailto:last-call@ietf.org>
List-Help: <mailto:last-call-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/last-call>, <mailto:last-call-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 02 Mar 2022 08:35:31 -0000

On Mon, Feb 28, 2022 at 5:56 PM Michael Richardson <mcr+ietf@sandelman.ca>
wrote:

>
> It's good to see robots.txt coming to the IETF.
> I think that this is coming via AD sponsorship.  Was there a dispatch
> discussion/action that I missed?
>

It came to the ART list for discussion in 2019, if you're looking for some
of the previous background.

regards,

Ted




>
> I see that the document is Informational.
> I'm unclear if this document is identical to the 1996 description, or if
> there are changes against the 1996 version.
>
> Are there plans to revise the protocol further, and this is the first step?
>
> I wonder if 2.3.1.2.  Redirects should suggest the file be moved to
> /.well-known/robots.txt with a redirect, that perhaps shouldn't be counted.
> That would be a change which may be more than desired.
>
> (I was thinking on the weekend about some extensions that would fit nicely
> into robots.txt)
>
> --
> Michael Richardson <mcr+IETF@sandelman.ca>   . o O ( IPv6 IøT consulting )
>            Sandelman Software Works Inc, Ottawa and Worldwide
>
>
>
>
>

v2.8.7 | Report a Bug | By Email