Re: [apps-discuss] tail -f over HTTP -- what am I missing?

Nico Williams <nico@cryptonector.com> Wed, 30 April 2014 20:43 UTC

Return-Path: <nico@cryptonector.com>
X-Original-To: apps-discuss@ietfa.amsl.com
Delivered-To: apps-discuss@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3287C1A093B for <apps-discuss@ietfa.amsl.com>; Wed, 30 Apr 2014 13:43:56 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 1.411
X-Spam-Level: *
X-Spam-Status: No, score=1.411 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FM_FORGED_GMAIL=0.622, FRT_ADOBE2=2.455, IP_NOT_FRIENDLY=0.334] autolearn=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id mkn9o3DDjYMK for <apps-discuss@ietfa.amsl.com>; Wed, 30 Apr 2014 13:43:55 -0700 (PDT)
Received: from homiemail-a86.g.dreamhost.com (sub4.mail.dreamhost.com [69.163.253.135]) by ietfa.amsl.com (Postfix) with ESMTP id F068E1A08BE for <apps-discuss@ietf.org>; Wed, 30 Apr 2014 13:43:54 -0700 (PDT)
Received: from homiemail-a86.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a86.g.dreamhost.com (Postfix) with ESMTP id 811BD360075 for <apps-discuss@ietf.org>; Wed, 30 Apr 2014 13:43:53 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=cryptonector.com; h= mime-version:in-reply-to:references:date:message-id:subject:from :to:cc:content-type; s=cryptonector.com; bh=kIl2Hpm1RoLwNsO5l48L nFaN844=; b=bAp4cMwf/3RxYtuiMZTKWEPnoYkQq3p0p0xrIlu7GnviU4F5CqWq 54KAFLqIUh3wSz+xt09My9elTLvZRPAdtCmpAX+7gHkU1XX+0l2RuQRYGjDoEpU5 M9jQshncUTrXEh9m3CRj2tyjR9Pmz6x0QdR8nezE4QQeuIVR25L+ySc=
Received: from mail-wi0-f173.google.com (mail-wi0-f173.google.com [209.85.212.173]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: nico@cryptonector.com) by homiemail-a86.g.dreamhost.com (Postfix) with ESMTPSA id 356F736006B for <apps-discuss@ietf.org>; Wed, 30 Apr 2014 13:43:53 -0700 (PDT)
Received: by mail-wi0-f173.google.com with SMTP id z2so9827661wiv.0 for <apps-discuss@ietf.org>; Wed, 30 Apr 2014 13:43:51 -0700 (PDT)
MIME-Version: 1.0
X-Received: by 10.194.238.231 with SMTP id vn7mr3509868wjc.76.1398890631273; Wed, 30 Apr 2014 13:43:51 -0700 (PDT)
Received: by 10.216.29.200 with HTTP; Wed, 30 Apr 2014 13:43:51 -0700 (PDT)
In-Reply-To: <69092435372146fe921ac8fbc9ba78f6@BL2PR02MB307.namprd02.prod.outlook.com>
References: <CAK3OfOikH1ttqZ2TQPSK32FPoR=ReYEMUYQ88=X9LUD2N-ySzg@mail.gmail.com> <712251FA-8918-43DD-B987-72010D603A06@mnot.net> <CAK3OfOh+wi_11P_8V8NaZ7yobkxR0Zm--cUFFyw936mVaCBgQQ@mail.gmail.com> <D82CE0E7-7830-40F6-B4D3-95DE5B264C5C@mnot.net> <69092435372146fe921ac8fbc9ba78f6@BL2PR02MB307.namprd02.prod.outlook.com>
Date: Wed, 30 Apr 2014 15:43:51 -0500
Message-ID: <CAK3OfOjMhaD4x7YRN2mRXHFJUi4s20LiyWiAtwmhq-1rhH4eAQ@mail.gmail.com>
From: Nico Williams <nico@cryptonector.com>
To: Larry Masinter <masinter@adobe.com>
Content-Type: text/plain; charset="UTF-8"
Archived-At: http://mailarchive.ietf.org/arch/msg/apps-discuss/_smM1skOQPfFWB6NGAeqlM9RRus
Cc: Mark Nottingham <mnot@mnot.net>, Apps Discuss <apps-discuss@ietf.org>
Subject: Re: [apps-discuss] tail -f over HTTP -- what am I missing?
X-BeenThere: apps-discuss@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: General discussion of application-layer protocols <apps-discuss.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/apps-discuss>, <mailto:apps-discuss-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/apps-discuss/>
List-Post: <mailto:apps-discuss@ietf.org>
List-Help: <mailto:apps-discuss-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/apps-discuss>, <mailto:apps-discuss-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 30 Apr 2014 20:43:56 -0000

On Wed, Apr 30, 2014 at 9:55 AM, Larry Masinter <masinter@adobe.com> wrote:
>>> What were Range requests built for?
>> Mostly, interacting with PDFs, AIUI.
>
> http://tools.ietf.org/html/draft-ietf-http-range-retrieval-00
> notes that restarting partial downloads was also an original motivation.

Append-only logs seem like a good fit for this: downloads are always
partial!  :) (until the log is closed anyways)

> For some reason,  I had expected the web to migrate to using
> compound documents
> http://en.wikipedia.org/wiki/Compound_document
>
> but to avoid having to download the entire package before you
> could start  rendering.

Log files aren't compound documents.  I keep hearing that I should
treat log files as collections of resources, as if having millions of
100-200 byte resources scales, as if having a file per log entry would
be a good idea.  There's a reason we have log files and not log
directories.  Nor is it feasible to assign URIs to individual log
entries in a log file -- or if it is we'd have to put offsets into
those URIs and end up doing range requests in a different way.

> I think MPEG-Dash designers considered using range retrieval
> but decided it was too unreliably available (many proxies
> not doing range retrieval right).

Thanks, that's useful information.

Nico
--