Re: [Tools-team] tools.ietf.org omits to include w3c robot

Bob Briscoe <rbriscoe@jungle.bt.co.uk> Mon, 02 November 2009 14:53 UTC

Return-Path: <rbriscoe@jungle.bt.co.uk>
X-Original-To: tools-team@core3.amsl.com
Delivered-To: tools-team@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 1ADA228C170 for <tools-team@core3.amsl.com>; Mon, 2 Nov 2009 06:53:17 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.616
X-Spam-Level:
X-Spam-Status: No, score=-0.616 tagged_above=-999 required=5 tests=[AWL=-0.913, BAYES_40=-0.185, DNS_FROM_RFC_BOGUSMX=1.482, RCVD_IN_DNSWL_LOW=-1]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zAbvt++hg7RT for <tools-team@core3.amsl.com>; Mon, 2 Nov 2009 06:53:10 -0800 (PST)
Received: from smtp2.smtp.bt.com (smtp2.smtp.bt.com [217.32.164.150]) by core3.amsl.com (Postfix) with ESMTP id 1DFDB28C169 for <tools-team@ietf.org>; Mon, 2 Nov 2009 06:53:09 -0800 (PST)
Received: from i2kc06-ukbr.domain1.systemhost.net ([193.113.197.70]) by smtp2.smtp.bt.com with Microsoft SMTPSVC(6.0.3790.3959); Mon, 2 Nov 2009 14:53:28 +0000
Received: from cbibipnt05.iuser.iroot.adidom.com ([147.149.196.177]) by i2kc06-ukbr.domain1.systemhost.net with Microsoft SMTPSVC(6.0.3790.3959); Mon, 2 Nov 2009 14:53:27 +0000
Received: From bagheera.jungle.bt.co.uk ([132.146.168.158]) by cbibipnt05.iuser.iroot.adidom.com (WebShield SMTP v4.5 MR1a P0803.399); id 1257173605460; Mon, 2 Nov 2009 14:53:25 +0000
Received: from MUT.jungle.bt.co.uk ([10.73.5.180]) by bagheera.jungle.bt.co.uk (8.13.5/8.12.8) with ESMTP id nA2ErNjn023570; Mon, 2 Nov 2009 14:53:23 GMT
Message-Id: <200911021453.nA2ErNjn023570@bagheera.jungle.bt.co.uk>
X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9
Date: Mon, 02 Nov 2009 14:53:23 +0000
To: Henrik Levkowetz <henrik@levkowetz.com>
From: Bob Briscoe <rbriscoe@jungle.bt.co.uk>
In-Reply-To: <4AE990DD.1020403@levkowetz.com>
References: <200910291218.n9TCIPLq015333@bagheera.jungle.bt.co.uk> <4AE990DD.1020403@levkowetz.com>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"; format="flowed"
X-Scanned-By: MIMEDefang 2.56 on 132.146.168.158
X-OriginalArrivalTime: 02 Nov 2009 14:53:27.0284 (UTC) FILETIME=[3C136340:01CA5BCC]
Cc: tools-team@ietf.org
Subject: Re: [Tools-team] tools.ietf.org omits to include w3c robot
X-BeenThere: tools-team@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: "The purpose of the TOOLS team is to provide IETF feedback and guidance during the development of software tools to support various parts of IETF activities." <tools-team.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tools-team>
List-Post: <mailto:tools-team@ietf.org>
List-Help: <mailto:tools-team-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 02 Nov 2009 14:53:17 -0000

Henrik,

Excellent. I've tested and the new rules allow in the W3C robot.

Cheers



Bob

At 12:55 29/10/2009, Henrik Levkowetz wrote:
>Hi Bob,
>
>On 2009-10-29 13:18 Bob Briscoe said the following:
> > Henrik,
> >
> > While running the W3C hyperlink checker <http://validator.w3.org/>
> > over one of my Web pages, it told me it couldn't check all my
> > hyperlinks to tools.ietf.org due to robot exclusion rules.
> >
> > You may want to add the W3C link checker to 
> <http://tools.ietf.org/robots.txt>
> >
> > Here's the suggested text from the W3C:
> > <http://validator.w3.org/docs/checklink.html#bot>
>
>I've updated tools.ietf.org/robots.txt accordingly.  Thanks for the note :-)
>
>
>Best,
>
>         Henrik

________________________________________________________________
Bob Briscoe,                                BT Innovate & Design