[art] Draft submission: Robots Exclusion Protocol

Gary Illyes <garyillyes@google.com> Sun, 07 July 2019 20:44 UTC

Return-Path: <illyes@google.com>
X-Original-To: art@ietfa.amsl.com
Delivered-To: art@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 277B5120223 for <art@ietfa.amsl.com>; Sun, 7 Jul 2019 13:44:36 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -17
X-Spam-Level:
X-Spam-Status: No, score=-17 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, USER_IN_DEF_DKIM_WL=-7.5, USER_IN_DEF_SPF_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zcSO59IWWbfg for <art@ietfa.amsl.com>; Sun, 7 Jul 2019 13:44:34 -0700 (PDT)
Received: from mail-ed1-x52a.google.com (mail-ed1-x52a.google.com [IPv6:2a00:1450:4864:20::52a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 20F061200CE for <art@ietf.org>; Sun, 7 Jul 2019 13:44:33 -0700 (PDT)
Received: by mail-ed1-x52a.google.com with SMTP id k21so12691705edq.3 for <art@ietf.org>; Sun, 07 Jul 2019 13:44:33 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=bkVdkh6IMTu01nc3fdfa4E7qVPsMyzLpcicxBEKEjhI=; b=Uk/Xl6DchpzHlK1U7iDsudcknC/GDxqUR8LXUiAJh3nmqVGiu9idWp2wnxwzkuqa+1 O9IGYrRYuSVZhR7IciwFWDDgZmegZ6/MSQcEy0rl/UP1m9Nqrt0lpQcSLiBvueJP8DHu P89tkUMZLjff10qr9xNjwBT6G0BLZpLJVNZ1vGjjHkYzXddM5WHd4kzRIN+Ma42A5U8U Rix5hmj3UjJOuLmcaNV4Y2YGZUTRr+zQCKdpWJv3lyyt04BiEOS7Gq7EgoGPfVCiaAhu nvA7lGQw3ebHMv411torq5PHbXPYUU14mHNiSAQfQjY/nPGrJRHUXHwMPEkK/yzik566 WZJg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=bkVdkh6IMTu01nc3fdfa4E7qVPsMyzLpcicxBEKEjhI=; b=YAFw0I711gSQH7JsN5RFNx6KIz20VdkVuO55baTkOLxdH1KiSk8tqcAX3rBQtvhd2m TcKCMqigJqpU0OmJKzJDNXC8L7h6gGzeSl0DgLeUCQHs9v/q8LXyc+2BiLux8ZS7YJZK Pe4kwruel4RP3iLg0Iq+0YtE0ERn9KWWQBEMdoCpHURod/G63gHj52prO9O4YA2RneIT 2aKyVyRivVS+YFFE+P6Xin2QL0jd+DOwEDV1lQIqKCKiRFymzxA2vT+xWdm9U35F8o+A 4Xf03BQI89Lv9XUEoNqguZvevvyyYZYyyYPjnTYw6O8CBq9tq+l8FNgJImu7p8eQMWK1 f1ug==
X-Gm-Message-State: APjAAAVKJvuP3qhQnE3N0sVL72KWaI3F3CIPF3nw6UDJEwk1SMnGWepu ZtI23aRQwyo7C86rkk3614CJf7eYoTtUnSFMUMlroOzbozM=
X-Google-Smtp-Source: APXvYqxrjpyVbf5EQ2S7EIYOqxysFMP/AyxidG7A/+1mgEmJ8pjmybDmQHISo+C8x9/UPWJ0ygp35EbxAaMJcCeJxdw=
X-Received: by 2002:a50:ac07:: with SMTP id v7mr16573176edc.205.1562532271126; Sun, 07 Jul 2019 13:44:31 -0700 (PDT)
MIME-Version: 1.0
From: Gary Illyes <garyillyes@google.com>
Date: Sun, 07 Jul 2019 22:44:20 +0200
Message-ID: <CADTQi=fpo7OMET7N_EZPq+n+xZq_sysf=mDoZzTNvaHxWh-Qbw@mail.gmail.com>
To: art@ietf.org
Content-Type: multipart/alternative; boundary="000000000000f8cf8b058d1d6493"
Archived-At: <https://mailarchive.ietf.org/arch/msg/art/yTDFIun5ewez7QHSVe7whrr7EMs>
Subject: [art] Draft submission: Robots Exclusion Protocol
X-BeenThere: art@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Applications and Real-Time Area Discussion <art.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/art>, <mailto:art-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/art/>
List-Post: <mailto:art@ietf.org>
List-Help: <mailto:art-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/art>, <mailto:art-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 07 Jul 2019 20:44:53 -0000

Hi ART,

As you may have seen, a group has gotten together with Martijn Koster to
create an internet-draft which restates the Robots Exclusion Protocol using
updated ABNF and prescriptions.  The current draft is (draft-koster-rep).
If you get a chance, we'd appreciate your confirming that it matches your
understanding of current practice and that the specification is clear even
for edge cases.  You can send mail to me to forward on to the author team
or address it to the emails listed in the draft.

Thanks for your help,
Gary Illyes
Google Switzerland

https://datatracker.ietf.org/doc/draft-koster-rep/