Re: [rfc-i] Wrong Internet search results for new RFCs

On Mon, May 02, 2022 at 10:17:18PM -0400, John Levine wrote:
> It appears that Toerless Eckert  <tte@cs.fau.de> said:
> >When i search for RFC9148 on google or bing, i do only get
> >
> >https://www.rfc-editor.org/rfc/authors/rfc9148.html
> >
> >And of course the URL already does not exist anymore.
> >And yes, i did at least send a note to google.
> >
> >I assume that google/bing get these URLs from the searchable directory
> >
> >https://www.rfc-editor.org/rfc/authors/
> 
> No, that's not how search engines work. They only add working URLs to
> their index,

Sure, but they need to find the URL first, and given how these "authors"
URLs are typically private-email used, i wouldn't know where the
search engines would find he URLs other than from the index URL.

> and this is particularly strange since I helped the RPC
> put site maps on the rfc-editor site that have the right URLs for all
> of the RFCs.

The site-map would list a URL like https://www.rfc-editor.org/rfc/authors/rfc9148.html
given how its temporary... ?!

> When I do a search I see the nonexistent authors page and also a bunch
> of pages at https://sandbox-ng.ietf.org/.  This suggests that something got
> spidered very strangely during the datatracker upgrade.
> 
> I can see if I can ask the RPC to resubmit the site index which should help
> it clean out the bad rfc-editor URLs.

Thanks!
    Toerless

_______________________________________________
rfc-interest mailing list
rfc-interest@rfc-editor.org
https://mailman.rfc-editor.org/mailman/listinfo/rfc-interest