Re: [weirds] [Regops] Search Engines Indexing RDAP Server Content

["John Levine" <[e-mail]>]

>We have a difference of opinion, because I tend to think that it's a *good* idea to restrict access
>to *some* data based on a client's identify and level of authorization. I do not want *my* PII
>appearing in search engine search results because it's accessible via RDAP.

Sorry, but I really don't understand what you want here.  There have
been vertical WHOIS search engines forever that let you search WHOIS
data in various ways.  Most of them charge money, but as often as not
some access is free.  That horse left the barn a decade ago.

The stuff that search engines can see is exactly the same as what
casual users see.  If you're saying that you want to make some stuff
unavailable to anyone who doesn't have a password, OK, but now aren't
you running into the whole ICANN mess of what's in WHOIS and what
isn't?

R's,
John

PS: On the third hand, if you want to make it slightly harder for
casual searches to find RDAP info, publishing a robots.txt that says
"Disallow: /" should take about 30 seconds. and will keep the entire
site out of all of the legit search engines.