Draft submission: Robots Exclusion Protocol
Gary Illyes <garyillyes@google.com> Wed, 10 July 2019 11:52 UTC
Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9C492120111 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 10 Jul 2019 04:52:44 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.649
X-Spam-Level:
X-Spam-Status: No, score=-2.649 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_ADSP_CUSTOM_MED=0.001, HEADER_FROM_DIFFERENT_DOMAINS=0.249, HTML_MESSAGE=0.001, MAILING_LIST_MULTI=-1, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id idV7j3w_STLj for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 10 Jul 2019 04:52:42 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [IPv6:2603:400a:ffff:804:801e:34:0:38]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id EE4C41200A3 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Wed, 10 Jul 2019 04:52:41 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.89) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1hlB78-00012F-0M for ietf-http-wg-dist@listhub.w3.org; Wed, 10 Jul 2019 11:50:22 +0000
Resent-Message-Id: <E1hlB78-00012F-0M@frink.w3.org>
Received: from uranus.w3.org ([128.30.52.58]) by frink.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from <ylafon@w3.org>) id 1hlB76-00011J-4f for ietf-http-wg@listhub.w3.org; Wed, 10 Jul 2019 11:50:20 +0000
Received: from www-data by uranus.w3.org with local (Exim 4.89) (envelope-from <ylafon@w3.org>) id 1hlB76-0004M1-0k for ietf-http-wg@listhub.w3.org; Wed, 10 Jul 2019 11:50:20 +0000
Received: from titan.w3.org ([2603:400a:ffff:804:801e:34:0:4c]) by frink.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from <ylafon@w3.org>) id 1hl4yJ-0001VQ-Qs for ietf-http-wg@listhub.w3.org; Wed, 10 Jul 2019 05:16:51 +0000
Received: from raoul.w3.org ([128.30.52.128]) by titan.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from <ylafon@w3.org>) id 1hl4yH-0006sf-EG for ietf-http-wg@w3.org; Wed, 10 Jul 2019 05:16:51 +0000
Received: from homard.platy.net ([80.67.176.7] helo=[192.168.1.129]) by raoul.w3.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from <ylafon@w3.org>) id 1hl4yH-00038O-3V for ietf-http-wg@w3.org; Wed, 10 Jul 2019 05:16:49 +0000
Content-Type: multipart/alternative; boundary="Apple-Mail=_3751BAC1-D19F-4B95-8740-C962231AE712"
Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\))
From: Gary Illyes <garyillyes@google.com>
Resent-From: Yves Lafon <ylafon@w3.org>
Date: Sun, 07 Jul 2019 20:46:23 +0000
Resent-Date: Wed, 10 Jul 2019 07:16:45 +0200
Resent-To: HTTP Working Group <ietf-http-wg@w3.org>
Message-Id: <CADTQi=dnWwgFC65KEwj7WqHjvm=-ZEAv6iRODGUq=_LM+TWyDg@mail.gmail.com>
X-Name-Md5: efe3dad792d606410c9cc49cedaffc94
To: ietf-http-wg@w3.org
X-Mailer: Apple Mail (2.3445.104.11)
X-W3C-Hub-Spam-Status: No, score=0.7
X-W3C-Hub-Spam-Report: ALL_TRUSTED=-1, BAYES_40=-0.001, DKIM_ADSP_CUSTOM_MED=0.001, HEADER_FROM_DIFFERENT_DOMAINS=0.249, HTML_MESSAGE=0.001, NML_ADSP_CUSTOM_MED=0.9, W3C_NW=0.5
X-W3C-Scan-Sig: titan.w3.org 1hl4yH-0006sf-EG 311c60d2a7ba4df10afaf6785f6bf9db
X-caa-id: 56e7c65976
X-Original-To: ietf-http-wg@w3.org
Subject: Draft submission: Robots Exclusion Protocol
Archived-At: <https://www.w3.org/mid/CADTQi=dnWwgFC65KEwj7WqHjvm=-ZEAv6iRODGUq=_LM+TWyDg@mail.gmail.com>
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/36782
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <https://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>
Hi HTTP WG, As you may have seen, a group has gotten together with Martijn Koster to create an internet-draft which restates the Robots Exclusion Protocol using updated ABNF and prescriptions. The current draft is (draft-koster-rep). If you get a chance, we'd appreciate your confirming that it matches your understanding of current practice and that the specification is clear even for edge cases. You can send mail to me to forward on to the author team or address it to the emails listed in the draft. Thanks for your help, Gary Illyes Google Switzerland https://datatracker.ietf.org/doc/draft-koster-rep/ <https://datatracker.ietf.org/doc/draft-koster-rep/>
- Draft submission: Robots Exclusion Protocol Gary Illyes
- Re: Draft submission: Robots Exclusion Protocol Mark Nottingham