RE: [Asrg] Some data on the validity of MAIL FROM addresses

"Tom Thomson" <tthomson@neosinteractive.com> Tue, 20 May 2003 19:46 UTC

Received: from www1.ietf.org (ietf.org [132.151.1.19] (may be forged)) by ietf.org (8.9.1a/8.9.1a) with ESMTP id PAA27960 for <asrg-archive@odin.ietf.org>; Tue, 20 May 2003 15:46:12 -0400 (EDT)
Received: (from mailnull@localhost) by www1.ietf.org (8.11.6/8.11.6) id h4KJCdQ28664 for asrg-archive@odin.ietf.org; Tue, 20 May 2003 15:12:39 -0400
Received: from ietf.org (odin.ietf.org [132.151.1.176]) by www1.ietf.org (8.11.6/8.11.6) with ESMTP id h4KJCdB28661 for <asrg-web-archive@optimus.ietf.org>; Tue, 20 May 2003 15:12:39 -0400
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id PAA27930; Tue, 20 May 2003 15:45:41 -0400 (EDT)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 19ID26-0000Do-00; Tue, 20 May 2003 15:44:22 -0400
Received: from ietf.org ([132.151.1.19] helo=www1.ietf.org) by ietf-mx with esmtp (Exim 4.12) id 19ID25-0000Dl-00; Tue, 20 May 2003 15:44:21 -0400
Received: from www1.ietf.org (localhost.localdomain [127.0.0.1]) by www1.ietf.org (8.11.6/8.11.6) with ESMTP id h4KJ6DB27516; Tue, 20 May 2003 15:06:13 -0400
Received: from ietf.org (odin.ietf.org [132.151.1.176]) by www1.ietf.org (8.11.6/8.11.6) with ESMTP id h4KJ5lB27480 for <asrg@optimus.ietf.org>; Tue, 20 May 2003 15:05:47 -0400
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id PAA27740 for <asrg@ietf.org>; Tue, 20 May 2003 15:38:50 -0400 (EDT)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 19ICvS-0000BR-00 for asrg@ietf.org; Tue, 20 May 2003 15:37:30 -0400
Received: from host217-35-105-169.in-addr.btopenworld.com ([217.35.105.169] helo=mail.neosinteractive.com) by ietf-mx with esmtp (Exim 4.12) id 19ICvR-0000BO-00 for asrg@ietf.org; Tue, 20 May 2003 15:37:29 -0400
Received: from tthompson ([217.35.105.173] unverified) by mail.neosinteractive.com with Microsoft SMTPSVC(5.0.2195.5329); Tue, 20 May 2003 20:44:37 +0100
From: Tom Thomson <tthomson@neosinteractive.com>
To: Kee Hinckley <nazgul@somewhere.com>, Eric Dean <eric@purespeed.com>
Cc: Alan DeKok <aland@freeradius.org>, asrg@ietf.org
Subject: RE: [Asrg] Some data on the validity of MAIL FROM addresses
Message-ID: <IOEPKAPPDKHPENCKFNNGIEBBCFAA.tthomson@neosinteractive.com>
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Priority: 3 (Normal)
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook IMO, Build 9.0.6604 (9.0.2911.0)
In-Reply-To: <p06001208baef4283debf@[192.168.1.104]>
Importance: Normal
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106
X-OriginalArrivalTime: 20 May 2003 19:44:37.0468 (UTC) FILETIME=[3F0F69C0:01C31F08]
Content-Transfer-Encoding: 7bit
Sender: asrg-admin@ietf.org
Errors-To: asrg-admin@ietf.org
X-BeenThere: asrg@ietf.org
X-Mailman-Version: 2.0.12
Precedence: bulk
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/asrg>, <mailto:asrg-request@ietf.org?subject=unsubscribe>
List-Id: Anti-Spam Research Group - IRTF <asrg.ietf.org>
List-Post: <mailto:asrg@ietf.org>
List-Help: <mailto:asrg-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/asrg>, <mailto:asrg-request@ietf.org?subject=subscribe>
List-Archive: <https://www1.ietf.org/pipermail/asrg/>
Date: Tue, 20 May 2003 20:38:39 +0100
Content-Transfer-Encoding: 7bit
Content-Transfer-Encoding: 7bit

> Well, actually I collected some of this data as well.  But without
> corresponding data on non-spam, it's not very useful.  Certainly each
> of the steps you outline includes an increased number of false
> positives.
>
> There were 7376 unique senders.
> 4298 had some "problem" with the HELO or DNS information.
>
> 10	No A record for the HELO domain

Is <domain> equivalent to <host> or was there a reason for that particular
change between RFC788 and RFC821?  For example did RFC822 legitimize HELO
EXAMPLE.COM from the host MAILSENDER42.EXAMPLE.COM?  If the change was
meaningful, you should not expect thee to be an A record.

> 702	The hostname for the HELO doesn't resolve

There isn't a hostname to resolve, is there?  So why should this imaginary
thing resolve?

> 1330	Unqualified domain in the HELO
> 2030	Sender domain does not match the HELO

What does "match" mean?  Does A.B.COM match B.COM?  Does B.COM match
A.B.COM? (Is "match" symmetric?).  If these don't match, expect false
positives from people whose mailservers use a host (rfc788) in helo, as the
transmitting MUA may not run on that machine.

<snip>
> Obviously those all overlapped a good deal.  Your immediate reaction
> might be to make sure that the sender domain matches the HELO.  After
> all, it would nail half the spam right there.  But then again, it
> would also block most of the mail coming from my domain and many
> others.  My mail server always uses the primary domain name in the
> HELO, no matter which domain it sends for.  That's probably true of
> most servers.

Quite so.  That's why RMX records or some other scheme to achieve the same
effect may be useful.

Tom

_______________________________________________
Asrg mailing list
Asrg@ietf.org
https://www1.ietf.org/mailman/listinfo/asrg