Re: Extending news to EAI

"Charles Lindsey" <> Fri, 05 February 2010 17:13 UTC

Return-Path: <>
Received: from localhost (localhost []) by (Postfix) with ESMTP id 77FB73A6943 for <>; Fri, 5 Feb 2010 09:13:26 -0800 (PST)
X-Virus-Scanned: amavisd-new at
X-Spam-Flag: NO
X-Spam-Score: -5.475
X-Spam-Status: No, score=-5.475 tagged_above=-999 required=5 tests=[AWL=0.203, BAYES_00=-2.599, HELO_MISMATCH_COM=0.553, RCVD_IN_DNSWL_MED=-4, URI_HEX=0.368]
Received: from ([]) by localhost ( []) (amavisd-new, port 10024) with ESMTP id P-H2iSiiD5yZ for <>; Fri, 5 Feb 2010 09:13:24 -0800 (PST)
Received: from (Balder-227.Proper.COM []) by (Postfix) with ESMTP id DC2003A6896 for <>; Fri, 5 Feb 2010 09:13:23 -0800 (PST)
Received: from (localhost []) by (8.14.2/8.14.2) with ESMTP id o15HC8DD031481 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 5 Feb 2010 10:12:08 -0700 (MST) (envelope-from
Received: (from majordom@localhost) by (8.14.2/8.13.5/Submit) id o15HC88D031480; Fri, 5 Feb 2010 10:12:08 -0700 (MST) (envelope-from
X-Authentication-Warning: majordom set sender to using -f
Received: from ( []) by (8.14.2/8.14.2) with ESMTP id o15HC6Zg031472 for <>; Fri, 5 Feb 2010 10:12:07 -0700 (MST) (envelope-from
Received: from [] ([] country=GB ident=postmaster^pop3^clerew&man^ac*uk) by with esmtpa (Gradwell gwh-smtpd 1.290) id 4b6c5165.771.25e for; Fri, 5 Feb 2010 17:12:05 +0000 (envelope-sender <>)
Received: from (localhost []) by (8.13.7/8.13.7) with ESMTP id o15HC1ji004053 for <>; Fri, 5 Feb 2010 17:12:01 GMT
Received: (from news@localhost) by (8.13.7/8.13.7/Submit) id o15HC1NR004050 for; Fri, 5 Feb 2010 17:12:01 GMT
Xref: clerew local.usefor:25239
Path: clerew!chl
From: "Charles Lindsey" <>
Subject: Re: Extending news to EAI
Content-Type: text/plain; charset=iso-8859-1
Message-ID: <>
Content-Transfer-Encoding: 8bit
X-Newsreader: NN version 6.5.2 (NOV)
References: <> <D599DB8FD691431D8E6C6E6B75B56400@Iulius>
Mime-Version: 1.0
Date: Fri, 5 Feb 2010 14:54:14 GMT
Lines: 77
Precedence: bulk
List-Archive: <>
List-Unsubscribe: <>
List-ID: <>

In <D599DB8FD691431D8E6C6E6B75B56400@Iulius> Julien ÉLIE <> writes:

>Hi Charles,

>> So the experimental protocol would start off with the extensions allowed
>> by RFC5535, and then add UTF-8 in the Newsgroups header.

>I think it will also require to change the possible values for "argument"

>   control         =  "Control:" SP *WSP control-command *WSP CRLF
>   control-command =  verb *( 1*WSP argument )
>   verb            =  token
>   argument        =  1*( %x21-7E )

>We need to be able to use UTF-8 in "argument".

>Could it also be possible to extend dist-list to allow UTF-8 distributions?

>   distribution    =  "Distribution:" SP dist-list CRLF
>   dist-list       =  *WSP dist-name
>                      *( [FWS] "," [FWS] dist-name ) *WSP
>   dist-name       =  ALPHA / DIGIT
>                      *( ALPHA / DIGIT / "+" / "-" / "_" )

Yes, there are various minor things that would need to be extended apart
from the Newgroups header (including the newsgroups line and the
checkgroups message).

>Incidentally, may it exist hostnames in UTF-8 (for the Path: header field)
>or are they always canonized in ASCII?

That is an interesting question, which would need dicussion, but does not
look like a show stopper.

>> It has already been established that the existing transport mechanisms
>> will move such articles around without problem.

>Is there any record of that?  Which news servers (and versions) were tested?

It should be documented in the early archives of this list.

Here is a typical Path for an article that reached


It is really a question of whether a server has it in its active file. If
so, then there is no reason why it should not pass straight through it.
The flooding algorithm will, as usual, find a way around any servers that
don't participate, but is will simply be a configuration affair rather
than any failure of implementation.

The real difficulty will be in user agents. I can read the danish group in
Opera, but for some reason it doesn't like yours. Ensuring there is a
working Path between your server and might be worth a try.

>> Some early USEFOR drafts show how the Newsgroups header was to be
>> extended. In particular, it required some very strict normalization, so
>> that a si...

>The last draft seems to be -09, Section 5.5:

Charles H. Lindsey ---------At Home, doing my own thing------------------------
Tel: +44 161 436 6131            Web:
Email:      Snail: 5 Clerewood Ave, CHEADLE, SK8 3JU, U.K.
PGP: 2C15F1A9      Fingerprint: 73 6D C2 51 93 A0 01 E7 65 E8 64 7E 14 A4 AB A5