IETF Logo Mail Archive

Re: [rfc-i] Wrong Internet search results for new RFCs

John R Levine <johnl@taugh.com> Thu, 05 May 2022 03:52 UTC

Return-Path: <rfc-interest-bounces@rfc-editor.org>
X-Original-To: ietfarch-rfc-interest-archive@ietfa.amsl.com
Delivered-To: ietfarch-rfc-interest-archive@ietfa.amsl.com
Received: from ietfa.amsl.com (localhost [IPv6:::1]) by ietfa.amsl.com (Postfix) with ESMTP id 9D588C159827 for <ietfarch-rfc-interest-archive@ietfa.amsl.com>; Wed, 4 May 2022 20:52:03 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1651722723; bh=Mw3D672tD9Y0MVXdbZ/rhNZSlgXYMhd4iF3HaNKtqNs=; h=Date:From:To:In-Reply-To:References:Subject:List-Id: List-Unsubscribe:List-Archive:List-Post:List-Help:List-Subscribe; b=GmqteLfYUV8NzHEPh8sWdakX2gZQ7+0x0X+XZx2PLYjCL/6EkVx4aDVhP79gPzjxL QQxEXzLT+p6opFko5xSOuCMnIo46GdDNNlG2eZUrL5btsf1gBNKgp+XrKgD5DXL0/N HTy/jkmznO5p5B0u8YM78QIunoq+2ZTBVCAtELFE=
X-Mailbox-Line: From rfc-interest-bounces@rfc-editor.org Wed May 4 20:52:03 2022
Received: from ietfa.amsl.com (localhost [IPv6:::1]) by ietfa.amsl.com (Postfix) with ESMTP id 71249C1594B1; Wed, 4 May 2022 20:52:03 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1651722723; bh=Mw3D672tD9Y0MVXdbZ/rhNZSlgXYMhd4iF3HaNKtqNs=; h=Date:From:To:In-Reply-To:References:Subject:List-Id: List-Unsubscribe:List-Archive:List-Post:List-Help:List-Subscribe; b=GmqteLfYUV8NzHEPh8sWdakX2gZQ7+0x0X+XZx2PLYjCL/6EkVx4aDVhP79gPzjxL QQxEXzLT+p6opFko5xSOuCMnIo46GdDNNlG2eZUrL5btsf1gBNKgp+XrKgD5DXL0/N HTy/jkmznO5p5B0u8YM78QIunoq+2ZTBVCAtELFE=
X-Original-To: rfc-interest@ietfa.amsl.com
Delivered-To: rfc-interest@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7264EC1594B2 for <rfc-interest@ietfa.amsl.com>; Wed, 4 May 2022 20:52:01 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.096
X-Spam-Level:
X-Spam-Status: No, score=-2.096 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=iecc.com header.b=wYZjl2pd; dkim=pass (2048-bit key) header.d=taugh.com header.b=CncnhTRa
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id uLiReh4vb1iU for <rfc-interest@ietfa.amsl.com>; Wed, 4 May 2022 20:51:56 -0700 (PDT)
Received: from gal.iecc.com (gal.iecc.com [IPv6:2001:470:1f07:1126:0:43:6f73:7461]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B49EEC15949F for <rfc-interest@rfc-editor.org>; Wed, 4 May 2022 20:51:56 -0700 (PDT)
Received: (qmail 58161 invoked from network); 5 May 2022 03:51:53 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=iecc.com; h=date:message-id:from:to:subject:in-reply-to:references:mime-version:content-type:content-transfer-encoding; s=e32d.627349d9.k2205; bh=H5QtT8VwE/UVOrW9wm6xYefHHiwv1j9LuetMI2ni55Q=; b=wYZjl2pd9J0tkvV08zs1SWAGtj1yGB/0kvCTOFn6BTxKTYiKfkm2NzTdKQgOzLFjfTtKUqRcNVlZhv0tMJ4ab3g+RIFqGxY79M4i2Qy0DIxgh5WjFicFoU24h60GZuR8atQzdFf7QnKsRP28KEI0/V+VnkunOv0gn32tg1SRmGMCLemjSCgXME1HxC31Dm9G6I+kXzyuz/yQhrXp3nYLtj/vUlHTkufY59wdR+2tw2bRBF3OHiedufVMg/K0NxPJCFcdATbcyraaJ6Zy+UV7a639gWTz1W0J769Xs+QGKLmfCkeI6ObbFvJfWTw262tsCPy6hsvNGe1oAjOlX1h0xA==
DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=taugh.com; h=date:message-id:from:to:subject:in-reply-to:references:mime-version:content-type:content-transfer-encoding; s=e32d.627349d9.k2205; bh=H5QtT8VwE/UVOrW9wm6xYefHHiwv1j9LuetMI2ni55Q=; b=CncnhTRat3ptfMiqJef+wIIkqZpsmpgPD2kr48VL4/4jxEWLNwZTXPG0GHxzmpLJQm3QI65Bm1pE2HJmHRtdIrEdCK3LyvZ3n7RDloVCgA8LXxnc05YwyzsCZzwPrN6U2NCunZ1kxuOeiy+hCiKpw98kisNF1EDahuT1AXHlICL+rsA3bYa3xyPgNnMMvzEraz19crzrDbjKRRfCA5YmWwzR++gRk8xyXSIehDL9pAmmTtYzOZCyOKkw//8hVUQHBCraba6SKfNMn5oGQZROah3L0ErCI98jTTURW7qOJRBGZqZWhsdpB1QUHekUUoqOI4gRVNpHObbRPT0LGu8VXQ==
Received: from ary.qy ([IPv6:2001:470:1f07:1126::78:696d:6170]) by imap.iecc.com ([IPv6:2001:470:1f07:1126::78:696d:6170]) with ESMTPS (TLS1.3 ECDHE-RSA AES-256-GCM AEAD) via TCP6; 05 May 2022 03:51:53 -0000
Received: by ary.qy (Postfix, from userid 501) id 6E20F3F64533; Wed, 4 May 2022 23:51:51 -0400 (EDT)
Received: from localhost (localhost [127.0.0.1]) by ary.qy (Postfix) with ESMTP id DDDCC3F64515 for <rfc-interest@rfc-editor.org>; Wed, 4 May 2022 23:51:51 -0400 (EDT)
Date: Wed, 04 May 2022 23:51:51 -0400
Message-ID: <428106bf-3b81-3f09-2341-7e3ccbe5eb7b@taugh.com>
From: John R Levine <johnl@taugh.com>
To: rfc-interest@rfc-editor.org
X-X-Sender: johnl@ary.qy
In-Reply-To: <20220504022700.ACBD33F5687A@ary.qy>
References: <20220504022700.ACBD33F5687A@ary.qy>
MIME-Version: 1.0
Archived-At: <https://mailarchive.ietf.org/arch/msg/rfc-interest/T1uT7LCo4JQAfBvnqNXmbFD3Aic>
Subject: Re: [rfc-i] Wrong Internet search results for new RFCs
X-BeenThere: rfc-interest@rfc-editor.org
X-Mailman-Version: 2.1.34
Precedence: list
List-Id: "A list for discussion of the RFC series and RFC Editor functions." <rfc-interest.rfc-editor.org>
List-Unsubscribe: <https://mailman.rfc-editor.org/mailman/options/rfc-interest>, <mailto:rfc-interest-request@rfc-editor.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rfc-interest/>
List-Post: <mailto:rfc-interest@rfc-editor.org>
List-Help: <mailto:rfc-interest-request@rfc-editor.org?subject=help>
List-Subscribe: <https://mailman.rfc-editor.org/mailman/listinfo/rfc-interest>, <mailto:rfc-interest-request@rfc-editor.org?subject=subscribe>
Content-Transfer-Encoding: base64
Content-Type: text/plain; charset="utf-8"; Format="flowed"
Errors-To: rfc-interest-bounces@rfc-editor.org
Sender: rfc-interest <rfc-interest-bounces@rfc-editor.org>

On Tue, 3 May 2022, John Levine wrote:
> It appears that Eliot Lear  <lear@lear.ch> said:
>> Unless someone made a recent change robots.txt, someone is harvesting
>> the exclusions. ...
>
> The bogus files are under /rfc/authors which wasn't in the robots.txt
> until I noticed it and asked the RPC to update it, which they did a
> few hours ago, around 22:50 UTC.
>
> I also explained how to add a <meta> tag to the auto-generated index
> pages, ...

The index pages now have the <meta> tags so between the robots.txt and 
the tags I expect the funky pages will age out of Google and Bing.

R's,
John

_______________________________________________
rfc-interest mailing list
rfc-interest@rfc-editor.org
https://mailman.rfc-editor.org/mailman/listinfo/rfc-interest

v2.23.0 | Report a Bug | By Email