Re: Issue with "bytes" Range Unit and live streaming

"Adrien de Croy" <adrien@qbik.com> Thu, 12 May 2016 01:21 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 13F6312D50C for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 11 May 2016 18:21:39 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.917
X-Spam-Level:
X-Spam-Status: No, score=-7.917 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HEADER_FROM_DIFFERENT_DOMAINS=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.996, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id GL6ZFwGKmEwj for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Wed, 11 May 2016 18:21:36 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 828BF12D0A5 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Wed, 11 May 2016 18:21:36 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.80) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1b0fFb-0000Wl-R7 for ietf-http-wg-dist@listhub.w3.org; Thu, 12 May 2016 01:17:15 +0000
Resent-Date: Thu, 12 May 2016 01:17:15 +0000
Resent-Message-Id: <E1b0fFb-0000Wl-R7@frink.w3.org>
Received: from lisa.w3.org ([128.30.52.41]) by frink.w3.org with esmtps (TLS1.2:DHE_RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from <adrien@qbik.com>) id 1b0fFW-0000Vh-1X for ietf-http-wg@listhub.w3.org; Thu, 12 May 2016 01:17:10 +0000
Received: from smtp.qbik.com ([122.56.26.1]) by lisa.w3.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from <adrien@qbik.com>) id 1b0fFS-0000ij-AJ for ietf-http-wg@w3.org; Thu, 12 May 2016 01:17:09 +0000
Received: From [192.168.1.146] (unverified [192.168.1.146]) by SMTP Server [192.168.1.3] (WinGate SMTP Receiver v8.5.8 (Build 4881)) with SMTP id <0000724126@smtp.qbik.com>; Thu, 12 May 2016 13:16:36 +1200
From: Adrien de Croy <adrien@qbik.com>
To: Mark Nottingham <mnot@mnot.net>, Darshak Thakore <d.thakore@cablelabs.com>
Cc: "ietf-http-wg@w3.org" <ietf-http-wg@w3.org>
Date: Thu, 12 May 2016 01:16:36 +0000
Message-Id: <em1d43e7e6-ef31-49b0-82e5-011f739467b7@bodybag>
In-Reply-To: <710FB0BE-8BD5-4F08-8BCC-A2C7F6CFE1E2@mnot.net>
Reply-To: Adrien de Croy <adrien@qbik.com>
User-Agent: eM_Client/6.0.24928.0
Mime-Version: 1.0
Content-Type: text/plain; format="flowed"; charset="utf-8"
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=122.56.26.1; envelope-from=adrien@qbik.com; helo=smtp.qbik.com
X-W3C-Hub-Spam-Status: No, score=-5.3
X-W3C-Hub-Spam-Report: BAYES_00=-1.9, RP_MATCHES_RCVD=-1.416, SPF_PASS=-0.001, W3C_AA=-1, W3C_WL=-1
X-W3C-Scan-Sig: lisa.w3.org 1b0fFS-0000ij-AJ e0d9dcca84d7d739e3dd64861406a5b4
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Issue with "bytes" Range Unit and live streaming
Archived-At: <http://www.w3.org/mid/em1d43e7e6-ef31-49b0-82e5-011f739467b7@bodybag>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/31633
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

unless we allow Content-Length to also use the new unit (which I'd be 
dead against), I'd suggest we steer clear of minting any new range 
units.

All the proposed use cases for new range units that I've seen are 
application specific, and could arguably better be dealt with using 
another header.

Adrien


------ Original Message ------
From: "Mark Nottingham" <mnot@mnot.net>
To: "Darshak Thakore" <d.thakore@cablelabs.com>
Cc: "ietf-http-wg@w3.org" <ietf-http-wg@w3.org>
Sent: 12/05/2016 12:59:25 p.m.
Subject: Re: Issue with "bytes" Range Unit and live streaming

>Hi Darshak,
>
>I don't think that's where we're at. Based on the discussion so far, it 
>seems like there are two possible paths forward:
>
>1. Changing the 'bytes' range-unit to allow this use case
>2. Minting a new range-unit
>
>As discussed, both have downsides. What we need is data about how 
>current implementations -- especially caching intermediaries -- behave 
>when faced with a) 'bytes' used in the desired way, and b) a new 
>range-unit.
>
>Cheers,
>
>
>>  On 11 May 2016, at 5:57 AM, Darshak Thakore <d.thakore@cablelabs.com> 
>>wrote:
>>
>>  Hi all,
>>
>>  Based on feedback on this thread, it seems like the need for being 
>>able to send an open ended (read as unknown-last-byte-pos) Range 
>>response has been discussed a couple of times (with different use 
>>cases). Also there seems to be somewhat general agreement that the 
>>Content-Range ABNF in RFC 7233 is deficient in providing this. The 
>>initial argument has been, “is there a compelling enough need” and i 
>>think with different use cases popping up (log files, media streaming, 
>>gzip… others ??) there seems to be some value in defining a 
>>non-application specific Range unit that plugs this gap. Clearly 
>>fixing RFC 7233 is invasive and will result in thing breaking in 
>>unknown ways so that’s a no-go. With that, we can:
>>   • Ensure that the scope of this work item is narrow and restricted 
>>only to fixing the gap in RFC 7233
>>   • Define a new range unit (anything with “bytes” in it seems like a 
>>bad idea, so maybe call it “live-octets”, “blive”, “b-add" - 
>>suggestions welcome….)
>>   • Decide if there is enough interest/reason to do this as a WG item
>>  Any objects/suggestions to any of the above ?
>>
>>  Regards,
>>  Darshak
>>
>>
>>  From: "K.Morgan@iaea.org" <K.Morgan@iaea.org>
>>  Date: Thursday, April 21, 2016 at 4:25 AM
>>  To: 'Craig Pratt' <craig@ecaspia.com>, "fielding@gbiv.com" 
>><fielding@gbiv.com>
>>  Cc: "ietf-http-wg@w3.org" <ietf-http-wg@w3.org>
>>  Subject: RE: Issue with "bytes" Range Unit and live streaming
>>  Resent-From: <ietf-http-wg@w3.org>
>>  Resent-Date: Thursday, April 21, 2016 at 4:25 AM
>>
>>  On Thursday,21 April 2016 05:18 craig@ecaspia.com wrote:
>>  >
>>  > Re: Representation caching
>>  >
>>  > Whether a representation is considered cacheable in this use case 
>>is at
>>  > the discretion of the origin server and specific to the use
>>  > case/application - as it should be (imho). There's no *necessity* 
>>in
>>  > having a periodically-appended resource marked non-cachable, 
>>correct? If
>>  > the resource mutates, it's not cacheable. If it's just being 
>>appended
>>  > to, it is cacheable. And if an appended resource stops being 
>>appended
>>  > to, it doesn't invalidate the cached representation.
>>  >
>>
>>  I couldn't agree more. However, it seemed the prevailing sentiment 
>>when we tried to resolve the related issue of ranges before content 
>>codings, with a new bbcc unit (bytes-before-content-coding), was that 
>>the use cases for append-only growth represent an insignificant 
>>portion of HTTP traffic. “We live by app-specific protocols to handle 
>>these cases. What is so special ... that it must be addressed by http 
>>(in a very ugly way)?” [1]
>>
>>  [1] 
>>https://lists.w3.org/Archives/Public/ietf-http-wg/2014AprJun/1383.html
>>
>>
>>
>>  This email message is intended only for the use of the named 
>>recipient. Information contained in this email message and its 
>>attachments may be privileged, confidential and protected from 
>>disclosure. If you are not the intended recipient, please do not read, 
>>copy, use or disclose this communication to others. Also please notify 
>>the sender by replying to this message and then delete it from your 
>>system.
>
>--
>Mark Nottingham   https://www.mnot.net/
>
>