Re: Issue with "bytes" Range Unit and live streaming

Mark Nottingham <mnot@mnot.net> Thu, 12 May 2016 01:04 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8481E12D0AB for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 11 May 2016 18:04:37 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.917
X-Spam-Level:
X-Spam-Status: No, score=-7.917 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HEADER_FROM_DIFFERENT_DOMAINS=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.996, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1mcC00dsk56p for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 11 May 2016 18:04:35 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 38DA712D110 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Wed, 11 May 2016 18:04:34 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.80) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1b0eyv-0004kj-Gs for ietf-http-wg-dist@listhub.w3.org; Thu, 12 May 2016 01:00:01 +0000
Resent-Date: Thu, 12 May 2016 01:00:01 +0000
Resent-Message-Id: <E1b0eyv-0004kj-Gs@frink.w3.org>
Received: from maggie.w3.org ([128.30.52.39]) by frink.w3.org with esmtps (TLS1.2:DHE_RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from <mnot@mnot.net>) id 1b0eyo-0004ZF-HR for ietf-http-wg@listhub.w3.org; Thu, 12 May 2016 00:59:54 +0000
Received: from mxout-07.mxes.net ([216.86.168.182]) by maggie.w3.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from <mnot@mnot.net>) id 1b0eym-0003fz-Vl for ietf-http-wg@w3.org; Thu, 12 May 2016 00:59:54 +0000
Received: from [192.168.1.101] (unknown [120.149.194.112]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by smtp.mxes.net (Postfix) with ESMTPSA id 0933222E255; Wed, 11 May 2016 20:59:27 -0400 (EDT)
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\))
From: Mark Nottingham <mnot@mnot.net>
In-Reply-To: <7277CE69-0350-4AC2-81BB-61F911087E9D@cablelabs.com>
Date: Thu, 12 May 2016 10:59:25 +1000
Cc: "ietf-http-wg@w3.org" <ietf-http-wg@w3.org>
Content-Transfer-Encoding: quoted-printable
Message-Id: <710FB0BE-8BD5-4F08-8BCC-A2C7F6CFE1E2@mnot.net>
References: <57102718.7010900@ecaspia.com> <2D09D61DDFA73D4C884805CC7865E61142655F7B@GAALPA1MSGUSRBF.ITServices.sbc.com> <D3370313.258AE%goran.ap.eriksson@ericsson.com> <57114878.1030606@ecaspia.com> <43C1ECE7-139E-4FC8-A46D-83887261B7BC@gbiv.com> <6AB4CBAA-E79D-4DAC-818D-65383B85B81B@gbiv.com> <0356EBBE092D394F9291DA01E8D28EC2021CEBE9AC@SEM001PD.sg.iaea.org> <5714A316.1080609@ecaspia.com> <9E953B010F1E974399030905C5DCB2E7183D2D4B@ESESSMB101.ericsson.se> <5715438F.4030100@ecaspia.com> <9E953B010F1E974399030905C5DCB2E7183D3011@ESESSMB101.ericsson.se> <57160081.9050307@ecaspia.com> <9E953B010F1E974399030905C5DCB2E7183D33A3@ESESSMB101.ericsson.se> <5716A8F8.6010208@ecaspia.com> <9E953B010F1E974399030905C5DCB2E7183D3DC4@ESESSMB101.ericsson.se> <5717C89C.1010601@ecaspia.com> <9E953B010F1E974399030905C5DCB2E7183D4070@ESESSMB101.ericsson.se> <CACweHNCFi_x5k6sZ0n3u3oNpa2rE7i-08fh9xtqfZFe4SfjSwA@mail.gmail.com> <5717EFB0.4050708@ecaspia.com> <6953797D-40FA-45C3-9294-9A1B0578D58E@gbiv. com> <5718466A.6010602@ecaspia.com> <0356EBBE092D394F9291DA01E8D28EC2022062FEF5@SEM002PD.sg.iaea.org> <7277CE69-0350-4AC2-81BB-61F911087E9D@cablelabs.com>
To: Darshak Thakore <d.thakore@cablelabs.com>
X-Mailer: Apple Mail (2.3124)
Received-SPF: pass client-ip=216.86.168.182; envelope-from=mnot@mnot.net; helo=mxout-07.mxes.net
X-W3C-Hub-Spam-Status: No, score=-8.2
X-W3C-Hub-Spam-Report: AWL=1.357, BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, W3C_AA=-1, W3C_DB=-1, W3C_IRA=-1, W3C_IRR=-3, W3C_WL=-1
X-W3C-Scan-Sig: maggie.w3.org 1b0eym-0003fz-Vl 14f9b3fae83adbeee3119fcfe232e691
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Issue with "bytes" Range Unit and live streaming
Archived-At: <http://www.w3.org/mid/710FB0BE-8BD5-4F08-8BCC-A2C7F6CFE1E2@mnot.net>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/31632
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

Hi Darshak,

I don't think that's where we're at. Based on the discussion so far, it seems like there are two possible paths forward:

1. Changing the 'bytes' range-unit to allow this use case
2. Minting a new range-unit

As discussed, both have downsides. What we need is data about how current implementations -- especially caching intermediaries -- behave when faced with a) 'bytes' used in the desired way, and b) a new range-unit.

Cheers,


> On 11 May 2016, at 5:57 AM, Darshak Thakore <d.thakore@cablelabs.com> wrote:
> 
> Hi all,
> 
> Based on feedback on this thread, it seems like the need for being able to send an open ended (read as unknown-last-byte-pos) Range response has been discussed a couple of times (with different use cases). Also there seems to be somewhat general agreement that the Content-Range ABNF in RFC 7233 is deficient in providing this. The initial argument has been, “is there a compelling enough need” and i think with different use cases popping up (log files, media streaming, gzip… others ??) there seems to be some value in defining a non-application specific Range unit that plugs this gap. Clearly fixing RFC 7233 is invasive and will result in thing breaking in unknown ways so that’s a no-go. With that, we can:
> 	• Ensure that the scope of this work item is narrow and restricted only to fixing the gap in RFC 7233
> 	• Define a new range unit (anything with “bytes” in it seems like a bad idea, so maybe call it “live-octets”, “blive”, “b-add" - suggestions welcome….)
> 	• Decide if there is enough interest/reason to do this as a WG item
> Any objects/suggestions to any of the above ?
> 
> Regards,
> Darshak 
> 
> 
> From: "K.Morgan@iaea.org" <K.Morgan@iaea.org>
> Date: Thursday, April 21, 2016 at 4:25 AM
> To: 'Craig Pratt' <craig@ecaspia.com>, "fielding@gbiv.com" <fielding@gbiv.com>
> Cc: "ietf-http-wg@w3.org" <ietf-http-wg@w3.org>
> Subject: RE: Issue with "bytes" Range Unit and live streaming
> Resent-From: <ietf-http-wg@w3.org>
> Resent-Date: Thursday, April 21, 2016 at 4:25 AM
> 
> On Thursday,21 April 2016 05:18 craig@ecaspia.com wrote: 
> > 
> > Re: Representation caching
> > 
> > Whether a representation is considered cacheable in this use case is at
> > the discretion of the origin server and specific to the use
> > case/application - as it should be (imho). There's no *necessity* in
> > having a periodically-appended resource marked non-cachable, correct? If
> > the resource mutates, it's not cacheable. If it's just being appended
> > to, it is cacheable. And if an appended resource stops being appended
> > to, it doesn't invalidate the cached representation.
> > 
>  
> I couldn't agree more. However, it seemed the prevailing sentiment when we tried to resolve the related issue of ranges before content codings, with a new bbcc unit (bytes-before-content-coding), was that the use cases for append-only growth represent an insignificant portion of HTTP traffic. “We live by app-specific protocols to handle these cases. What is so special ... that it must be addressed by http (in a very ugly way)?” [1]
>  
> [1] https://lists.w3.org/Archives/Public/ietf-http-wg/2014AprJun/1383.html
>  
>  
>  
> This email message is intended only for the use of the named recipient. Information contained in this email message and its attachments may be privileged, confidential and protected from disclosure. If you are not the intended recipient, please do not read, copy, use or disclose this communication to others. Also please notify the sender by replying to this message and then delete it from your system.

--
Mark Nottingham   https://www.mnot.net/