Re: [Hls-interest] LL-HLS Amendment Proposal: Optional part response headers for CDN efficiency.

Roger Pantos <rpantos@apple.com> Fri, 12 February 2021 18:39 UTC

Return-Path: <rpantos@apple.com>
X-Original-To: hls-interest@ietfa.amsl.com
Delivered-To: hls-interest@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0ADF43A09C7; Fri, 12 Feb 2021 10:39:54 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.34
X-Spam-Level:
X-Spam-Status: No, score=-2.34 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.25, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, T_REMOTE_IMAGE=0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=apple.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id JRYJpzGqqfzm; Fri, 12 Feb 2021 10:39:52 -0800 (PST)
Received: from ma1-aaemail-dr-lapp02.apple.com (ma1-aaemail-dr-lapp02.apple.com [17.171.2.68]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 0A55C3A0975; Fri, 12 Feb 2021 10:39:48 -0800 (PST)
Received: from pps.filterd (ma1-aaemail-dr-lapp02.apple.com [127.0.0.1]) by ma1-aaemail-dr-lapp02.apple.com (8.16.0.42/8.16.0.42) with SMTP id 11CIdKsM021144; Fri, 12 Feb 2021 10:39:47 -0800
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=apple.com; h=from : message-id : content-type : mime-version : subject : date : in-reply-to : cc : to : references; s=20180706; bh=/VC3uhLgNwU5BTqIqnRX91LgvBLwWaW8cAeiHE2FZVc=; b=mChuiGhiKz1vmppNkmOmV3C2oQFPXPiD96o/uDVZu6fK2uEQPWJ0gyOVA0ddQW6TySMK kh+5YyrUSTiF7+Cmxz3HJJYijZh5RC7QJ7krC35CPJhJNeDOLT8fkJQ3U5jLfFOKP8Ox Y/0eJUmvBKl3dhhXSfhXZ4xf6J3S1roRzhy73/q6ZAF5Hd7kaqrhy8v2VEHXsGtCoDLO IKS44ABmmJ5Tqcz5zSShCFwlkiehye/YkKRl+vmxqOfvhJRLYgT2Qo6wmszxXq66XhuM PmJcnce8uQnsnWuKK4mePevBHW2szpn8tU50/7Ix6u3ECwDjMkTShuEXxZgpAgQOviIx og==
Received: from rn-mailsvcp-mta-lapp02.rno.apple.com (rn-mailsvcp-mta-lapp02.rno.apple.com [10.225.203.150]) by ma1-aaemail-dr-lapp02.apple.com with ESMTP id 36hrnye616-6 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Fri, 12 Feb 2021 10:39:47 -0800
Received: from rn-mailsvcp-mmp-lapp01.rno.apple.com (rn-mailsvcp-mmp-lapp01.rno.apple.com [17.179.253.14]) by rn-mailsvcp-mta-lapp02.rno.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) with ESMTPS id <0QOF009K7IIBXZ50@rn-mailsvcp-mta-lapp02.rno.apple.com>; Fri, 12 Feb 2021 10:39:47 -0800 (PST)
Received: from process_milters-daemon.rn-mailsvcp-mmp-lapp01.rno.apple.com by rn-mailsvcp-mmp-lapp01.rno.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) id <0QOF00200II6BA00@rn-mailsvcp-mmp-lapp01.rno.apple.com>; Fri, 12 Feb 2021 10:39:47 -0800 (PST)
X-Va-A:
X-Va-T-CD: 7abe3f87f76ac8b0666e3136bd5d7d17
X-Va-E-CD: ffef869f93324cc6c54b44ebb4e62d2a
X-Va-R-CD: 58f34c67a96479fe75eea96b2ce5ea64
X-Va-CD: 0
X-Va-ID: 7f3d0362-f8f1-40c0-bcbe-73dd9c8c6521
X-V-A:
X-V-T-CD: 7abe3f87f76ac8b0666e3136bd5d7d17
X-V-E-CD: ffef869f93324cc6c54b44ebb4e62d2a
X-V-R-CD: 58f34c67a96479fe75eea96b2ce5ea64
X-V-CD: 0
X-V-ID: 363ac1c7-1003-4e90-8f30-93e437870bb3
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.369, 18.0.737 definitions=2021-02-12_07:2021-02-12, 2021-02-12 signatures=0
Received: from smtpclient.apple (unknown [17.149.235.97]) by rn-mailsvcp-mmp-lapp01.rno.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) with ESMTPSA id <0QOF010OPII5YY00@rn-mailsvcp-mmp-lapp01.rno.apple.com>; Fri, 12 Feb 2021 10:39:41 -0800 (PST)
From: Roger Pantos <rpantos@apple.com>
Message-id: <C4B329E3-B29C-4041-92A2-61FFB7ADDDEB@apple.com>
Content-type: multipart/alternative; boundary="Apple-Mail=_A4116AE9-914F-4CB9-BB5E-E04344E29394"
MIME-version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.32\))
Date: Fri, 12 Feb 2021 10:39:41 -0800
In-reply-to: <CANtXGXGRu+FuUMEhtV9LQNc_iT5qJN+V2OZjYLdtm3A_gLtKiw@mail.gmail.com>
Cc: hls-interest@ietf.org
To: Andrew Crowe <acrowe=40llnw.com@dmarc.ietf.org>
References: <CANtXGXGRu+FuUMEhtV9LQNc_iT5qJN+V2OZjYLdtm3A_gLtKiw@mail.gmail.com>
X-Mailer: Apple Mail (2.3654.80.0.2.32)
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.369, 18.0.737 definitions=2021-02-12_07:2021-02-12, 2021-02-12 signatures=0
Archived-At: <https://mailarchive.ietf.org/arch/msg/hls-interest/MU7wLhl4TB5ftHZzzUJV5ZW62kw>
Subject: Re: [Hls-interest] LL-HLS Amendment Proposal: Optional part response headers for CDN efficiency.
X-BeenThere: hls-interest@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussions about HTTP Live Streaming \(HLS\)." <hls-interest.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/hls-interest/>
List-Post: <mailto:hls-interest@ietf.org>
List-Help: <mailto:hls-interest-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 12 Feb 2021 18:39:54 -0000


> On Feb 9, 2021, at 7:54 AM, Andrew Crowe <acrowe=40llnw.com@dmarc.ietf.org> wrote:
> 
> Hello,
> 
> CMAF content packaged and delivered using LL-DASH and range-based LL-HLS are easily managed as duplicate content by CDNs as they specify only segment files. In fact, once the segment is complete, it can then be served out of CDN cache for players that are not Low Latency capable - effectively reducing latency for them as well. Part-based LL-HLS introduces individually named part files that then collapse to the separately named segment file upon final part completion. This then means that on first request for the whole collapsed segment file the CDN will have to go back to origin to request bytes that it likely already has in the individually named part files. CDNs can improve cache efficiency, origin hit rate, and whole segment delivery times with a little bit of additional information from origin.
> 
> 
> On request for a named part file an origin may provide a set of response headers:
> 
> *X-HLS-Part-Sequence*
> A multi value header that represents the current part sequence (index=1) and the total number of parts for the segment. The values will be separated by a forward slash ("/"). For example a 2 second segment with 8 parts per segment will respond to the 2nd part request (vid720_segment_1521.part2.m4v) like
> X-HLS-Part-Sequence: 2/8
> 
> 
> *X-HLS-Part-Offset*
> A single value header that represents the byte offset of the part in the segment. The first part of a segment will always be 0 while, for example the second .25s part of a 2mpbs stream (vid720_segment_1521.part2.m4v) may have a value like 623751
> 
> 
> *X-HLS-Part-Root-Segment*
> A single value header that provides the name of the root segment of the current part. This lets the CDN/proxy know which root file to concatenate the parts into. vid720_segment_1521.part2.m4v would have a value of vid720_segment_1521.m4v
> 
> 
> With the information from these three headers the CDN can recognize the individually named part files as ranges of a larger file, store them effectively and deliver a better experience to viewers across all formats. 

Hello Andrew. I’m interested in this proposal, but I’d also like to hear some feedback from others in the CDN and packager spaces. Specifically, I’d like to know if other folks:

- Agree that it’s a good way to solve the problem

- Can spot any problems or limitations in this proposal that might make it difficult to produce (or consume) these headers

- Can see themselves implementing it


thanks,

Roger Pantos
Apple Inc.

> 
> Regards,
> -Andrew
> -- 
>  <https://www.limelight.com/>
> Andrew Crowe Architect
> EXPERIENCE FIRST.
>  <>+1 859 583 3301 <tel:+1+859+583+3301>
> www.limelight.com <https://www.limelight.com/>
>  <https://www.facebook.com/LimelightNetworks> <https://www.linkedin.com/company/limelight-networks> <https://twitter.com/llnw>
> -- 
> Hls-interest mailing list
> Hls-interest@ietf.org
> https://www.ietf.org/mailman/listinfo/hls-interest