Re: Issue with "bytes" Range Unit and live streaming

Craig Pratt <craig@ecaspia.com> Fri, 15 April 2016 19:01 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C3DB712DE43 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Fri, 15 Apr 2016 12:01:22 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.193
X-Spam-Level:
X-Spam-Status: No, score=-7.193 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=0.001, MIME_HTML_ONLY=0.723, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.996, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=ecaspia-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id fEO6nDPUchRR for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Fri, 15 Apr 2016 12:01:20 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4B6AD12DA21 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Fri, 15 Apr 2016 12:01:12 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.80) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1ar8v9-0006yD-EQ for ietf-http-wg-dist@listhub.w3.org; Fri, 15 Apr 2016 18:56:47 +0000
Resent-Date: Fri, 15 Apr 2016 18:56:47 +0000
Resent-Message-Id: <E1ar8v9-0006yD-EQ@frink.w3.org>
Received: from maggie.w3.org ([128.30.52.39]) by frink.w3.org with esmtps (TLS1.2:DHE_RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from <craig@caspiaconsulting.com>) id 1ar8v4-0006xW-4R for ietf-http-wg@listhub.w3.org; Fri, 15 Apr 2016 18:56:42 +0000
Received: from mail-pa0-f41.google.com ([209.85.220.41]) by maggie.w3.org with esmtps (TLS1.2:RSA_ARCFOUR_SHA1:128) (Exim 4.80) (envelope-from <craig@caspiaconsulting.com>) id 1ar8v2-0004Jq-Ij for ietf-http-wg@w3.org; Fri, 15 Apr 2016 18:56:41 +0000
Received: by mail-pa0-f41.google.com with SMTP id fs9so39001192pac.2 for <ietf-http-wg@w3.org>; Fri, 15 Apr 2016 11:56:20 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ecaspia-com.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:organization:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding; bh=SpbBpWNNCEvD/EZFyZ4MRiY0yjwP9jPniqajX7juB4A=; b=U/tO9JOa6G/XxodAVyHDOPROk6XFiOKKp/JxGwzXizk5MHcK+2mro0vlqdQBcTqymh 6X+kFxRNek5xF3/2keVrJGIWdzKLmECKQ3PFwdn2iyFV90RJTa3AAGRffc3pUPl4ZAxq nQAsKc8HDb2vzPIHOqAknkgok9IxSBNSTE4KxYHAY8WlnL8A93WzqhDdh/fHbdt8P1PO qdRblE2UWwIDeq44QLi0LCaPwvdb6t2Pi2gNXInaz6SRzoze/hV/bRyQQ49vDqAHXqjn hqSN2ByghC+GxtCAkZJ0gvPvuuxjnuDPVfy7OkEcOpHg+m00f9jGTceyrYSE37yCT3P5 jk+A==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:organization :message-id:date:user-agent:mime-version:in-reply-to :content-transfer-encoding; bh=SpbBpWNNCEvD/EZFyZ4MRiY0yjwP9jPniqajX7juB4A=; b=XJ4HUl8YpIRIkYSXS0FqtDEAG0y25nOIy87Fu/d3xLKgE07xO+vipo6lvD6yJUIteP Z0+uNZtOTYJQrhwOH4HT1bVjYQy+RMWVpFRv5DrfPv251HVzj+0rg2CwAfoCopRVlEfa +9U29sujU+z3jjuYmJzukDDUF8K/a+AX7qjMgA9a98eFDz+5I4CI8W8b6o7Qq505SYsw JHD8sMc0OHgXIRwh5jVXPOcRK/cS/2nn9paHnzBT4OHoFM1cerGVJaCxc74v2WmksWfk 60gxrmvpWMB1f1Rrl9KJgM5u66wMz2WrrDApGFd+UTmMuq+/ZrjboQ+WddT8+fibviWR PyqQ==
X-Gm-Message-State: AOPr4FX11VbXAyYl4YG9cssRa9xYbODDRaKXe4Ig3n+YBsihOJbMRIeVT7L+40FnC1WtXQ==
X-Received: by 10.67.3.234 with SMTP id bz10mr31660344pad.96.1460746574027; Fri, 15 Apr 2016 11:56:14 -0700 (PDT)
Received: from [10.10.1.104] (50-193-209-61-static.hfc.comcastbusiness.net. [50.193.209.61]) by smtp.googlemail.com with ESMTPSA id q20sm66339051pfi.63.2016.04.15.11.56.12 for <ietf-http-wg@w3.org> (version=TLSv1/SSLv3 cipher=OTHER); Fri, 15 Apr 2016 11:56:12 -0700 (PDT)
To: ietf-http-wg@w3.org
References: <57102718.7010900@ecaspia.com> <5710E043.9020505@treenet.co.nz>
From: Craig Pratt <craig@ecaspia.com>
Organization: Caspia Consulting
Message-ID: <5711394D.3010509@ecaspia.com>
Date: Fri, 15 Apr 2016 11:56:13 -0700
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:38.0) Gecko/20100101 Thunderbird/38.6.0
MIME-Version: 1.0
In-Reply-To: <5710E043.9020505@treenet.co.nz>
Content-Type: text/html; charset="utf-8"
Content-Transfer-Encoding: 7bit
Received-SPF: pass client-ip=209.85.220.41; envelope-from=craig@caspiaconsulting.com; helo=mail-pa0-f41.google.com
X-W3C-Hub-Spam-Status: No, score=-3.9
X-W3C-Hub-Spam-Report: BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, MIME_HTML_ONLY=0.723, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001, W3C_AA=-1, W3C_WL=-1
X-W3C-Scan-Sig: maggie.w3.org 1ar8v2-0004Jq-Ij 787c263d8ad4501d0305a0ffcbbb8660
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Issue with "bytes" Range Unit and live streaming
Archived-At: <http://www.w3.org/mid/5711394D.3010509@ecaspia.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/31477
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

On 4/15/16 5:36 AM, Amos Jeffries wrote:
On 15/04/2016 11:26 a.m., Craig Pratt wrote:
Hello all,

We have a use case where we are "live streaming" media over HTTP. As with other 
(non-segmented) HTTP streaming applications, our live streaming solution has the 
HTTP client perform a GET on a URI representing the live audio or video content 
stream and with the server progressively returning data using chunked transfer 
coding. The data returned to the server is "live" so long as the client reads 
data as quickly as it's generated - with TCP flow control allowing the client's 
reading of the response data to be paced to the live chunk generation of the 
HTTP server.
Please be careful not to rely on the chunks arriving at the client in
the same sizes as were sent.

The chunked encoding is a hop-by-hop feature so any HTTP intermediary
which they travel through may re-code the chunk sizes according to its
own output needs.

Cheers
Amos


Most definitely - the client cannot make any presumption about the framing. In the renderers I've worked with, the chunk framing is removed before the AV renderer get the content.

The chunk size can affect the performance of the streaming, however. A single large chunk can cause a client to stall and introduce latency that persists for the duration of the streaming session. But clients are typically able to handle these "late" arrivals since they can also be caused by congestion.

What we're trying to prevent with this EC is requiring the client to continuously perform GETs to receive new chunks if/when the live content also supports random access. We want the client to simply be able to block on the socket while waiting for the data to arrive in the same way it would for a non-random-access live stream.

cp

--

craig pratt

Caspia Consulting

craig@ecaspia.com

503.746.8008