Last Call: <draft-koster-rep-08.txt> (Robots Exclusion Protocol) to Proposed Standard

The IESG <iesg-secretary@ietf.org> Thu, 05 May 2022 17:24 UTC

MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit
From: The IESG <iesg-secretary@ietf.org>
To: IETF-Announce <ietf-announce@ietf.org>
Subject: Last Call: <draft-koster-rep-08.txt> (Robots Exclusion Protocol) to Proposed Standard
Auto-Submitted: auto-generated
Precedence: bulk
CC: Ted Hardie <ted.ietf@gmail.com>, draft-koster-rep@ietf.org, superuser@gmail.com, ted.ietf@gmail.com
Reply-To: last-call@ietf.org
Sender: iesg-secretary@ietf.org
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit
Message-ID: <165177144451.21157.981700432753087513@ietfa.amsl.com>
Date: Thu, 05 May 2022 10:24:04 -0700
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf-announce/640Y7TeNaflm30ar4KHwwe-Y0ko>

The IESG has received a request from an individual submitter to consider the
following document: - 'Robots Exclusion Protocol'
  <draft-koster-rep-08.txt> as Proposed Standard

The IESG plans to make a decision in the next few weeks, and solicits final
comments on this action. Please send substantive comments to the
last-call@ietf.org mailing lists by 2022-06-02. Exceptionally, comments may
be sent to iesg@ietf.org instead. In either case, please retain the beginning
of the Subject line to allow automated sorting.

Abstract


   This document specifies and extends the "Robots Exclusion Protocol"
   method originally defined by Martijn Koster in 1996 for service
   owners to control how content served by their services may be
   accessed, if at all, by automatic clients known as crawlers.




The file can be obtained via
https://datatracker.ietf.org/doc/draft-koster-rep/



No IPR declarations have been submitted directly on this I-D.


The document contains these normative downward references.
See RFC 3967 for additional information: 
    rfc1945: Hypertext Transfer Protocol -- HTTP/1.0 (Informational - Internet Engineering Task Force (IETF))

Last Call: <draft-koster-rep-08.txt> (Robots Excl… The IESG