Re: [art] Artart last call review of draft-koster-rep-06

[Francesca Palombini <[e-mail]>]

Todd: many thanks for this review – I can see that the authors have addressed your comments in v-07 and I believe the draft has been improved from it. I balloted No Objection on this document.

Francesca

From: Todd Herr via Datatracker <[e-mail]>
Date: Thursday, 3 March 2022 at 17:52
To: [e-mail] <[e-mail]>
Cc: [e-mail] <[e-mail]>, [e-mail] <[e-mail]>
Subject: Artart last call review of draft-koster-rep-06
Reviewer: Todd Herr
Review result: Ready with Issues

Comments from Todd Herr ([e-mail])

* I found section 2.2.3, Special Characters, confusing. Specifically, the
  first table in that section includes an entry for the "$" character,
  and the middle column in that row contains text that says "A URI MUST
  end with a $."

  However, there is at least one URI in the table in section 2.2.2 that
  doesn't end with a $, as well as one in the second table in section 2.2.3
  that doesn't end with a $, as well as other URIs scattered throughout the
  document that don't end with a $.

  Can this be clarified, please?

* In section 2.3.1.3, Unavailable status, the crawler is given a choice
  of accessing any resources on the server or using a cached version of
  robots.txt.

  I'm having trouble envisioning a crawler that wouldn't take advantage
  of this situation to crawl the entire site, so I'm wondering if the
  second MAY clause is even worth stating?

* Section 2.6 has a subject/verb disagreement:

  "Listing URIs in the robots.txt file exposes the URI publicly and
   thus making the URIs discoverable."

  In that sentence, "making" should be replaced by "makes".