Re: [auth48] *[AD] Re: AUTH48: RFC-to-be 9309 <draft-koster-rep-12> for your review

Gary Illyes <garyillyes@google.com> Wed, 31 August 2022 18:43 UTC

Return-Path: <illyes@google.com>
X-Original-To: auth48archive@ietfa.amsl.com
Delivered-To: auth48archive@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 794C1C14EB1C for <auth48archive@ietfa.amsl.com>; Wed, 31 Aug 2022 11:43:54 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -22.106
X-Spam-Level:
X-Spam-Status: No, score=-22.106 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001, USER_IN_DEF_DKIM_WL=-7.5, USER_IN_DEF_SPF_WL=-7.5] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 75vifK5a11Lx for <auth48archive@ietfa.amsl.com>; Wed, 31 Aug 2022 11:43:49 -0700 (PDT)
Received: from mail-wr1-x42e.google.com (mail-wr1-x42e.google.com [IPv6:2a00:1450:4864:20::42e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1D5D2C15C502 for <auth48archive@rfc-editor.org>; Wed, 31 Aug 2022 11:43:45 -0700 (PDT)
Received: by mail-wr1-x42e.google.com with SMTP id w5so3241834wrn.12 for <auth48archive@rfc-editor.org>; Wed, 31 Aug 2022 11:43:45 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date; bh=/Rlvt0l3rODxy4S62MF1PhfcUGiH5vCDVZj6+GgDk78=; b=KjJXyW3icCXFc0EPKei/7bCctU/IHDnjsfHxhndkmlCgIQcpAoJSSQ0SDPS3kzDcqw n57nQ9uOJxM+xUI/AERtA82AdLX7u7tDaSmY+uDlzphkwTTQ6yHR5G415qrDuC8uU5yJ OQc/WWdwBFTk4Am4NBvX6r80iE/3gJrLeVonWACl8yzVthZ8gdSJGKrf+lW5eU32sXZF 45rEZfaIUCqILmf37Tt1LZK00Ff7ADCDWkDl1hIJQHSKjUs+zQKLCOQcmSWvdDE6rakk RL2ScDf+xCSCVjTT90OP/Id9C6DSRkehLSmWMLIw0nU/shwHXuJc0BBFJYJ2kUxBE4Y7 8qfQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=/Rlvt0l3rODxy4S62MF1PhfcUGiH5vCDVZj6+GgDk78=; b=u8Yh5buCqJeGyKx6qxsvv/OJsF/EkT6s/QNthabH81EE0GseE+C9LxeS1Gi71IBCci 2lv1RTVMZiMiMYYoujSnsALgRuArLzo2ZLFt4tW/dGJT+XknwhjT2CBDq2QzTapacgA6 mh3METQWjFmFZibcP6Ryo8pQ3t/dOFJZLmWQPvBV6qG8dqSKu00JbFguDOTH8Zbm+kew 6ajFYrtIc7BzoW6RlZsRBYt7etewKJw0sxDTGpXdr6LV/hNmxdcIz+AxWvVOA5KPIGXi VyWmC3IjR5KdFJJjf9nGyHwxZhZ5nUOFWK+V07GQWRpeqrExvumt6VAVU3mrDZ0RGn6W RorA==
X-Gm-Message-State: ACgBeo3mNsbsJevSBAS6K686mx0PL3x6HpQBnok0CjcKjIlFuqDSeEly Mz8ciNDtSnSB6SJIcx2SbKeBoI1cbjdXkOkVKVUDow==
X-Google-Smtp-Source: AA6agR5AWzAzmF4dMDzwWYBDExeZ8eD7XZ8X5seYGi27Bi1jRkYbayTDVmvKz51gtCoX73hdH//9mZ4St0eRnY8R2O0=
X-Received: by 2002:a5d:5a85:0:b0:226:d59e:fb53 with SMTP id bp5-20020a5d5a85000000b00226d59efb53mr10390884wrb.322.1661971422861; Wed, 31 Aug 2022 11:43:42 -0700 (PDT)
MIME-Version: 1.0
References: <20220826062352.D7AF555D46@rfcpa.amsl.com> <CADTQi=eJZ0wPeu7o5_FLmsG_Wmm0cJAYWHrsrL-mwzSw7rDFFw@mail.gmail.com> <60464F20-D118-4701-8EBA-8F0A0973B35A@amsl.com> <CAL0qLwZpBQQfHUeDwR2FygMTrbX6WEq3qKJtLkWxzTd0_O3Tig@mail.gmail.com> <CADTQi=cvkRBo4wdKtgMZuVJuduCy03tFRR_naMVh7dapdk0L_g@mail.gmail.com> <CAL0qLwbEAqSNAGVA=chjHA-Zr9MAsrKWLY__hLbUvGuWyxBqTQ@mail.gmail.com> <CADTQi=dDMpK554YLVhGY9U2fDXuUBrE6qe-QdCKFU7CVUwwevA@mail.gmail.com>
In-Reply-To: <CADTQi=dDMpK554YLVhGY9U2fDXuUBrE6qe-QdCKFU7CVUwwevA@mail.gmail.com>
From: Gary Illyes <garyillyes@google.com>
Date: Wed, 31 Aug 2022 20:43:31 +0200
Message-ID: <CADTQi=en_HNrCbgjCUVNaAp39FBddGc=ijx2XxYKyvsUAF5qjw@mail.gmail.com>
To: "Murray S. Kucherawy" <superuser@gmail.com>
Cc: Henner Zeller <henner@google.com>, Lynne Bartholomew <lbartholomew@amsl.com>, Martijn Koster <m.koster@greenhills.co.uk>, RFC System <rfc-editor@rfc-editor.org>, Ted Hardie <ted.ietf@gmail.com>, auth48archive@rfc-editor.org, lizzi@google.com
Content-Type: multipart/mixed; boundary="0000000000004a26e205e78de045"
Archived-At: <https://mailarchive.ietf.org/arch/msg/auth48archive/roHGWuXIP-IXZp3jTih2fkZhdX4>
Subject: Re: [auth48] *[AD] Re: AUTH48: RFC-to-be 9309 <draft-koster-rep-12> for your review
X-BeenThere: auth48archive@rfc-editor.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: "Archiving AUTH48 exchanges between the RFC Production Center, the authors, and other related parties" <auth48archive.rfc-editor.org>
List-Unsubscribe: <https://mailman.rfc-editor.org/mailman/options/auth48archive>, <mailto:auth48archive-request@rfc-editor.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/auth48archive/>
List-Post: <mailto:auth48archive@rfc-editor.org>
List-Help: <mailto:auth48archive-request@rfc-editor.org?subject=help>
List-Subscribe: <https://mailman.rfc-editor.org/mailman/listinfo/auth48archive>, <mailto:auth48archive-request@rfc-editor.org?subject=subscribe>
X-List-Received-Date: Wed, 31 Aug 2022 18:43:54 -0000

I put an xref to RFC 9110 at the first appearance of HTTP in the prose:
https://github.com/google/robotstxt/blob/master/protocol-draft/rfc9309.xml#L180

Updated XML also attached.



On Wed, Aug 31, 2022 at 8:13 PM Gary Illyes <garyillyes@google.com> wrote:

> Sure, makes sense; we can do that. In that case I'll use the latest HTTP
> RFC instead of 1945
>
> On Wed, 31 Aug 2022 at 20:11, Murray S. Kucherawy <superuser@gmail.com>
> wrote:
>
>> Fair enough.  I wonder though if we should have some kind of link to what
>> HTTP is anyway, perhaps attached to its first appearance in the prose after
>> the introduction.  It really is a normative dependency here, even if it is
>> ubiquitous.
>>
>> -MSK
>>
>> On Wed, Aug 31, 2022 at 11:02 AM Gary Illyes <garyillyes@google.com>
>> wrote:
>>
>>> We could, if there was an RFC that says that clients must follow *at
>>> least* 5 hops. Unfortunately all I can find is the opposite, follow *up to*
>>> 5 hops (because more is likely a loop).
>>>
>>> On Wed, 31 Aug 2022 at 19:59, Murray S. Kucherawy <superuser@gmail.com>
>>> wrote:
>>>
>>>> The new "MUST NOT" is fine.  Rather than deleting it, should we replace
>>>> the reference to RFC 1945 with a reference to one of the newer HTTP RFCs?
>>>>
>>>> -MSK, ART AD
>>>>
>>>> On Mon, Aug 29, 2022 at 10:39 AM Lynne Bartholomew <
>>>> lbartholomew@amsl.com> wrote:
>>>>
>>>>> Dear Gary, Lizzi, Martijn, and *AD (Murray),
>>>>>
>>>>> * Murray, please let us know if you approve (1) the removal of
>>>>> Normative Ref. RFC 1945 and (2) a new sentence containing "MUST NOT" in
>>>>> Section 2.2.4.
>>>>>
>>>>> Gary, thank you very much for the updated XML files!
>>>>>
>>>>> Martijn, your contact information in the Authors' Addresses section
>>>>> now appears as follows.  Please confirm that this is as desired:
>>>>>
>>>>>    Martijn Koster (editor)
>>>>>    Suton Lane
>>>>>    Wymondham, Norfolk
>>>>>    NR18 9JG
>>>>>    United Kingdom
>>>>>    Email: m.koster@greenhills.co.uk
>>>>>
>>>>> The latest files are posted here:
>>>>>
>>>>>    https://www.rfc-editor.org/authors/rfc9309.txt
>>>>>    https://www.rfc-editor.org/authors/rfc9309.pdf
>>>>>    https://www.rfc-editor.org/authors/rfc9309.html
>>>>>    https://www.rfc-editor.org/authors/rfc9309.xml
>>>>>    https://www.rfc-editor.org/authors/rfc9309-diff.html
>>>>>    https://www.rfc-editor.org/authors/rfc9309-rfcdiff.html
>>>>>    https://www.rfc-editor.org/authors/rfc9309-auth48diff.html
>>>>>
>>>>>    https://www.rfc-editor.org/authors/rfc9309-xmldiff1.html
>>>>>    https://www.rfc-editor.org/authors/rfc9309-xmldiff2.html
>>>>>
>>>>> Gary, Lizzi, and Martijn, we have noted your approvals on the AUTH48
>>>>> status page:
>>>>>
>>>>>    https://www.rfc-editor.org/auth48/rfc9309
>>>>>
>>>>> Thanks again!
>>>>>
>>>>> RFC Editor/lb
>>>>>
>>>>>
>>>>> > From: Gary Illyes <garyillyes=40google.com@dmarc.ietf.org>
>>>>> > Subject: Re: AUTH48: RFC-to-be 9309 <draft-koster-rep-12> for your
>>>>> review
>>>>> > Date: August 29, 2022 at 2:41:50 AM PDT
>>>>> > To: Martijn Koster <m.koster@greenhills.co.uk>, Henner Zeller <
>>>>> henner@google.com>
>>>>> > Cc: rfc-editor@rfc-editor.org, lizzi@google.com, Ted Hardie <
>>>>> ted.ietf@gmail.com>, "Murray S. Kucherawy" <superuser@gmail.com>,
>>>>> auth48archive@rfc-editor.org
>>>>> >
>>>>> > Thank you. Done on github (
>>>>> https://github.com/google/robotstxt/blob/master/protocol-draft/rfc9309.xml#L18)
>>>>> and attached to this email again.
>>>>> >
>>>>> > Henner, we need the last LGTM from you.
>>>>>
>>>>>
>>>>> > From: Martijn Koster <m.koster@greenhills.co.uk>
>>>>> > Subject: Re: AUTH48: RFC-to-be 9309 <draft-koster-rep-12> for your
>>>>> review
>>>>> > Date: August 29, 2022 at 2:01:13 AM PDT
>>>>> > To: Gary Illyes <garyillyes@google.com>
>>>>> > Cc: rfc-editor@rfc-editor.org, henner@google.com, lizzi@google.com,
>>>>> Ted Hardie <ted.ietf@gmail.com>, "Murray S. Kucherawy" <
>>>>> superuser@gmail.com>, auth48archive@rfc-editor.org
>>>>> >
>>>>> > Hi Gary,
>>>>> >
>>>>> > Please remove my organisation Stalworthy Computing, Ltd  from
>>>>> >
>>>>> https://github.com/google/robotstxt/blob/master/protocol-draft/rfc9309.xml#L18
>>>>> >
>>>>> > The rest LGTM
>>>>> >
>>>>> > Thanks,
>>>>> >
>>>>> > — Martijn
>>>>>
>>>>>
>>>>> > From: Lizzi Sassman <lizzi=40google.com@dmarc.ietf.org>
>>>>> > Subject: Re: AUTH48: RFC-to-be 9309 <draft-koster-rep-12> for your
>>>>> review
>>>>> > Date: August 26, 2022 at 12:58:13 PM PDT
>>>>> > To: Gary Illyes <garyillyes@google.com>
>>>>> > Cc: rfc-editor@rfc-editor.org, Martijn Koster <
>>>>> m.koster@greenhills.co.uk>, Henner Zeller <henner@google.com>, Ted
>>>>> Hardie <ted.ietf@gmail.com>, superuser@gmail.com,
>>>>> auth48archive@rfc-editor.org
>>>>> >
>>>>> > The draft LGTM.
>>>>> >
>>>>> > Thanks,
>>>>> > Lizzi
>>>>>
>>>>> > On Aug 26, 2022, at 7:08 AM, Gary Illyes <garyillyes=
>>>>> 40google.com@dmarc.ietf.org> wrote:
>>>>> >
>>>>> > Thank you for your edits and review. Lizzi and I addressed the
>>>>> comments received and attached the updated XML to this email (also at
>>>>> https://github.com/google/robotstxt/blob/master/protocol-draft/rfc9309.xml
>>>>> )
>>>>> >
>>>>> > The draft attached looks good to me and from my perspective approved
>>>>> for publication.
>>>>> >
>>>>> > Martijn, Lizzi, Henner, please review this draft and provide
>>>>> feedback (probably on GitHub) and/or approval for publication.
>>>>> >
>>>>> >
>>>>> > On Fri, Aug 26, 2022 at 8:24 AM <rfc-editor@rfc-editor.org> wrote:
>>>>> > *****IMPORTANT*****
>>>>> >
>>>>> > Updated 2022/08/25
>>>>> >
>>>>> > RFC Author(s):
>>>>> > --------------
>>>>> >
>>>>> > Instructions for Completing AUTH48
>>>>> >
>>>>> > Your document has now entered AUTH48.  Once it has been reviewed and
>>>>> > approved by you and all coauthors, it will be published as an RFC.
>>>>> > If an author is no longer available, there are several remedies
>>>>> > available as listed in the FAQ (https://www.rfc-editor.org/faq/).
>>>>> >
>>>>> > You and you coauthors are responsible for engaging other parties
>>>>> > (e.g., Contributors or Working Group) as necessary before providing
>>>>> > your approval.
>>>>> >
>>>>> > Planning your review
>>>>> > ---------------------
>>>>> >
>>>>> > Please review the following aspects of your document:
>>>>> >
>>>>> > *  RFC Editor questions
>>>>> >
>>>>> >    Please review and resolve any questions raised by the RFC Editor
>>>>> >    that have been included in the XML file as comments marked as
>>>>> >    follows:
>>>>> >
>>>>> >    <!-- [rfced] ... -->
>>>>> >
>>>>> >    These questions will also be sent in a subsequent email.
>>>>> >
>>>>> > *  Changes submitted by coauthors
>>>>> >
>>>>> >    Please ensure that you review any changes submitted by your
>>>>> >    coauthors.  We assume that if you do not speak up that you
>>>>> >    agree to changes submitted by your coauthors.
>>>>> >
>>>>> > *  Content
>>>>> >
>>>>> >    Please review the full content of the document, as this cannot
>>>>> >    change once the RFC is published.  Please pay particular
>>>>> attention to:
>>>>> >    - IANA considerations updates (if applicable)
>>>>> >    - contact information
>>>>> >    - references
>>>>> >
>>>>> > *  Copyright notices and legends
>>>>> >
>>>>> >    Please review the copyright notice and legends as defined in
>>>>> >    RFC 5378 and the Trust Legal Provisions
>>>>> >    (TLP – https://trustee.ietf.org/license-info/).
>>>>> >
>>>>> > *  Semantic markup
>>>>> >
>>>>> >    Please review the markup in the XML file to ensure that elements
>>>>> of
>>>>> >    content are correctly tagged.  For example, ensure that
>>>>> <sourcecode>
>>>>> >    and <artwork> are set correctly.  See details at
>>>>> >    <https://authors.ietf.org/rfcxml-vocabulary>.
>>>>> >
>>>>> > *  Formatted output
>>>>> >
>>>>> >    Please review the PDF, HTML, and TXT files to ensure that the
>>>>> >    formatted output, as generated from the markup in the XML file,
>>>>> is
>>>>> >    reasonable.  Please note that the TXT will have formatting
>>>>> >    limitations compared to the PDF and HTML.
>>>>> >
>>>>> >
>>>>> > Submitting changes
>>>>> > ------------------
>>>>> >
>>>>> > To submit changes, please reply to this email using ‘REPLY ALL’ as
>>>>> all
>>>>> > the parties CCed on this message need to see your changes. The
>>>>> parties
>>>>> > include:
>>>>> >
>>>>> >    *  your coauthors
>>>>> >
>>>>> >    *  rfc-editor@rfc-editor.org (the RPC team)
>>>>> >
>>>>> >    *  other document participants, depending on the stream (e.g.,
>>>>> >       IETF Stream participants are your working group chairs, the
>>>>> >       responsible ADs, and the document shepherd).
>>>>> >
>>>>> >    *  auth48archive@rfc-editor.org, which is a new archival mailing
>>>>> list
>>>>> >       to preserve AUTH48 conversations; it is not an active
>>>>> discussion
>>>>> >       list:
>>>>> >
>>>>> >      *  More info:
>>>>> >
>>>>> https://mailarchive.ietf.org/arch/msg/ietf-announce/yb6lpIGh-4Q9l2USxIAe6P8O4Zc
>>>>> >
>>>>> >      *  The archive itself:
>>>>> >         https://mailarchive.ietf.org/arch/browse/auth48archive/
>>>>> >
>>>>> >      *  Note: If only absolutely necessary, you may temporarily opt
>>>>> out
>>>>> >         of the archiving of messages (e.g., to discuss a sensitive
>>>>> matter).
>>>>> >         If needed, please add a note at the top of the message that
>>>>> you
>>>>> >         have dropped the address. When the discussion is concluded,
>>>>> >         auth48archive@rfc-editor.org will be re-added to the CC
>>>>> list and
>>>>> >         its addition will be noted at the top of the message.
>>>>> >
>>>>> > You may submit your changes in one of two ways:
>>>>> >
>>>>> > An update to the provided XML file
>>>>> >  — OR —
>>>>> > An explicit list of changes in this format
>>>>> >
>>>>> > Section # (or indicate Global)
>>>>> >
>>>>> > OLD:
>>>>> > old text
>>>>> >
>>>>> > NEW:
>>>>> > new text
>>>>> >
>>>>> > You do not need to reply with both an updated XML file and an
>>>>> explicit
>>>>> > list of changes, as either form is sufficient.
>>>>> >
>>>>> > We will ask a stream manager to review and approve any changes that
>>>>> seem
>>>>> > beyond editorial in nature, e.g., addition of new text, deletion of
>>>>> text,
>>>>> > and technical changes.  Information about stream managers can be
>>>>> found in
>>>>> > the FAQ.  Editorial changes do not require approval from a stream
>>>>> manager.
>>>>> >
>>>>> >
>>>>> > Approving for publication
>>>>> > --------------------------
>>>>> >
>>>>> > To approve your RFC for publication, please reply to this email
>>>>> stating
>>>>> > that you approve this RFC for publication.  Please use ‘REPLY ALL’,
>>>>> > as all the parties CCed on this message need to see your approval.
>>>>> >
>>>>> >
>>>>> > Files
>>>>> > -----
>>>>> >
>>>>> > The files are available here:
>>>>> >    https://www.rfc-editor.org/authors/rfc9309.xml
>>>>> >    https://www.rfc-editor.org/authors/rfc9309.html
>>>>> >    https://www.rfc-editor.org/authors/rfc9309.pdf
>>>>> >    https://www.rfc-editor.org/authors/rfc9309.txt
>>>>> >
>>>>> > Diff file of the text:
>>>>> >    https://www.rfc-editor.org/authors/rfc9309-diff.html
>>>>> >    https://www.rfc-editor.org/authors/rfc9309-rfcdiff.html (side by
>>>>> side)
>>>>> >
>>>>> > Diff of the XML:
>>>>> >    https://www.rfc-editor.org/authors/rfc9309-xmldiff1.html
>>>>> >
>>>>> > The following files are provided to facilitate creation of your own
>>>>> > diff files of the XML.
>>>>> >
>>>>> > Initial XMLv3 created using XMLv2 as input:
>>>>> >    https://www.rfc-editor.org/authors/rfc9309.original.v2v3.xml
>>>>> >
>>>>> > XMLv3 file that is a best effort to capture v3-related format
>>>>> updates
>>>>> > only:
>>>>> >    https://www.rfc-editor.org/authors/rfc9309.form.xml
>>>>> >
>>>>> >
>>>>> > Tracking progress
>>>>> > -----------------
>>>>> >
>>>>> > The details of the AUTH48 status of your document are here:
>>>>> >    https://www.rfc-editor.org/auth48/rfc9309
>>>>> >
>>>>> > Please let us know if you have any questions.
>>>>> >
>>>>> > Thank you for your cooperation,
>>>>> >
>>>>> > RFC Editor
>>>>> >
>>>>> > --------------------------------------
>>>>> > RFC9309 (draft-koster-rep-12)
>>>>> >
>>>>> > Title            : Robots Exclusion Protocol
>>>>> > Author(s)        : M. Koster, Ed., G. Illyes, Ed., H. Zeller, Ed.,
>>>>> L. Sassman, Ed.
>>>>> > WG Chair(s)      :
>>>>> > Area Director(s) :
>>>>> >
>>>>> >
>>>>> > <rfc9309.xml>
>>>>>
>>>>> --
>>> Thanks,
>>> Gary
>>>
>> --
> Thanks,
> Gary
>