Re: ietf-nntp Backfill

"Clive D.W. Feather" <Clive@on-the-train.demon.co.uk> Mon, 16 December 1996 23:42 UTC

Received: from cnri by ietf.org id aa19713; 16 Dec 96 18:42 EST
Received: from ACADEM2.ACADEM.COM by CNRI.Reston.VA.US id aa26547; 16 Dec 96 18:42 EST
Received: (from majordomo@localhost) by academ2.academ.com (8.8.3/8.7.3) id RAA00756 for ietf-nntp-outgoing; Mon, 16 Dec 1996 17:40:26 -0600 (CST)
X-Authentication-Warning: academ2.academ.com: majordomo set sender to owner-ietf-nntp using -f
Received: from academ.com (root@ACADEM.COM [198.137.249.2]) by academ2.academ.com (8.8.3/8.7.3) with ESMTP id RAA00751 for <ietf-nntp@ACADEM2.ACADEM.COM>; Mon, 16 Dec 1996 17:40:23 -0600 (CST)
Received: from relay-7.mail.demon.net (relay-7.mail.demon.net [194.217.242.9]) by academ.com (8.8.3/8.7.1) with SMTP id RAA04699 for <ietf-nntp@academ.com>; Mon, 16 Dec 1996 17:40:21 -0600 (CST)
Received: from on-the-train.demon.co.uk ([158.152.83.191]) by relay-6.mail.demon.net id aa629889; 16 Dec 96 23:30 GMT
Message-ID: <wriZDoApG0syEwVJ@on-the-train.demon.co.uk>
Date: Sun, 15 Dec 1996 00:09:13 +0000
To: Jon Ribbens <jon@oaktree.co.uk>
Cc: clive@demon.net, ietf-nntp@academ.com
From: "Clive D.W. Feather" <Clive@on-the-train.demon.co.uk>
Reply-To: clive@demon.net
Subject: Re: ietf-nntp Backfill
In-Reply-To: <199612131547.PAA02423@black.oaktree.co.uk>
MIME-Version: 1.0
X-Mailer: Turnpike Version 3.01 <81yImECxEkLwWotvkdN7a29E6a>
Sender: owner-ietf-nntp@academ.com
Precedence: bulk

Jon Ribbens <jon@oaktree.co.uk> writes
>I am looking at INN 1.4 for this reply.

Okay. However, bear in mind that my original message was to address the
general issue.

>> [Q1] When a group becomes the current group, is the set of articles made
>> available to the client fixed at that moment ?
>Yes and no. The list of article numbers available is fixed at the
>moment you execute 'group'.
>> [Q2] When will new articles become available and expired/cancelled ones
>> become unavailable ? Is it:
>New ones will become available and deleted ones will become unavailable
>immediately. However 'NEXT' will not attempt to show deleted articles,
>and it will not attempt to show newly-arrived articles. This seems
>reasonable to me.

So you are saying that NEXT from article 1200 might give article 1234,
even though there is an article 1212 ?

Hmm. I would never have thought of that as being a behaviour permitted
by RFC 977. But I can see where it comes from.

>> [Q5] Can an article appear with a number between the previous limits,
>> such as 1250 ?
>No.

Someone said at the BOF that this *does* happen with INN.

>> There are three common scenarios posited for NNTP clients and servers. I
>> call these "monotonic", "backfilling", and "wind-back". They answer the
>> first three questions:
>Wind-back?

"wind", as in winding a crank.

>> Servers appear to exist of all three kinds,
>Is there more than one site in existance which uses backfilling?

I don't know.

>> A sensible client needs to allow for the user wanting to mark articles
>> as unread. Therefore it must be able to cope with the backfilling
>> strategy, by (for example) maintaining a list of ranges.
>No. An unread article and an unavailable article are not the same
>thing.

Any mechanism for passing the concept "article 1234 is unread" between
session can equally cope with passing the concept "article 1234 hasn't
appeared yet". That's what I meant.

>> Given this, there seems little reason to require that servers be
>> monotonic.
>Given that almost every news client in existance requires that
>servers be monotonic, I would suggest that it would be a very
>good idea for the new NNTP specification to require it too.

Yet several people at the BOF thought that backfilling was reasonable.

>> On the other hand, there are advantages to the answer to Q4 being "no".
>> If it is, then it is possible to forget everything about articles with
>> numbers below the current minimum.
>There are 'advantages'!? Surely you mean 'it is essential that the
>answer to Q4 be "no"'? Otherwise, due to the occasionaly cancelled
>article and so on interrupting the numbering range, the news client
>must maintain a list of ranges which grows without bound.

Bear in mind that one long-lived low-numbered article can have the same
effect.

>Not only this, but on every connection it must explicitly check
>for every article not found before, in order to produce a valid
>display of available articles.

No, because a walk using NEXT will show what is and isn't there.

>The
>newsreader *must* have some mechanism of saying "well, this
>article is never going to turn up now, I don't need to worry
>about it any more".

I agree that it's highly desirable. But since the RFC currently says
nothing about article number behaviour, the question needs raising.

>Backfilling is not necessary, no widely used servers do it,

Not what was said at the BOF.

>It is a Bad Thing. RFC 977 did not allow it,

Where doesn't it allow it ? What wording forbids it ?

>It should be possible to fetch news without
>recourse to heuristics.

Agreed.

-- 
Clive D.W. Feather    | Associate Director  | Director
Tel: +44 181 371 1138 | Demon Internet Ltd. | CityScape Internet Services Ltd.
Fax: +44 181 371 1150 | <clive@demon.net>   | <cdwf@cityscape.co.uk>
Written on my laptop - please reply to the Reply-To address <clive@demon.net>