Re: [Hls-interest] Setting appropriate cache levels for blocking parts and playlists on reference stream

Jan Van Doorn <jvd@apple.com> Thu, 25 February 2021 16:51 UTC

Return-Path: <jvd@apple.com>
X-Original-To: hls-interest@ietfa.amsl.com
Delivered-To: hls-interest@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D5F033A1C52; Thu, 25 Feb 2021 08:51:41 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.667
X-Spam-Level:
X-Spam-Status: No, score=-2.667 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.57, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=apple.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id aXzYrOJ14OcJ; Thu, 25 Feb 2021 08:51:39 -0800 (PST)
Received: from ma1-aaemail-dr-lapp03.apple.com (ma1-aaemail-dr-lapp03.apple.com [17.171.2.72]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5378F3A1C51; Thu, 25 Feb 2021 08:51:38 -0800 (PST)
Received: from pps.filterd (ma1-aaemail-dr-lapp03.apple.com [127.0.0.1]) by ma1-aaemail-dr-lapp03.apple.com (8.16.0.42/8.16.0.42) with SMTP id 11PGh9rB003584; Thu, 25 Feb 2021 08:51:37 -0800
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=apple.com; h=from : message-id : content-type : mime-version : subject : date : in-reply-to : cc : to : references; s=20180706; bh=B8Hx0uGeuNyQvBVzb2f4p5brDRfq3qjCZfBO6HVYYIA=; b=HUIheyDTELw9EftkIcAnn0nOtHme98YyWCC9yv3hTcZSqXFCXqrdi+dfxfwfd0/ZuMUe sEydm+R9AfvCc2vw15tW9FQI3Pgx/tcdeqqiGHzq4y/QYzpiblv0dz7gF9YvVRqK66ep uC7wuv5Mu9YrnV6Tul43Pma/9Ibcs4dLPCzVbBJku+nCWi4UCEgDHVrfsrdhTUiTXuu3 Do9BHz5EVpVLiKjkBJxJCxMYAa3PKIHTsehzrFNRTKmymq/SsrOXbVo1Cr/Y0/4LfSRB 3O2/zA2K5jg8tzPC+qv8YicunGs3x7gKtlzaYo6DyOG9a9gJgbPqZf0v/FK3afeztr5Q aw==
Received: from ma-mailsvcp-mta-lapp04.corp.apple.com (ma-mailsvcp-mta-lapp04.corp.apple.com [10.226.18.136]) by ma1-aaemail-dr-lapp03.apple.com with ESMTP id 36u2a19nkq-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Thu, 25 Feb 2021 08:51:37 -0800
Received: from ma-mailsvcp-mmp-lapp01.apple.com (ma-mailsvcp-mmp-lapp01.apple.com [17.32.222.14]) by ma-mailsvcp-mta-lapp04.corp.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) with ESMTPS id <0QP300YEGG612430@ma-mailsvcp-mta-lapp04.corp.apple.com>; Thu, 25 Feb 2021 08:51:37 -0800 (PST)
Received: from process_milters-daemon.ma-mailsvcp-mmp-lapp01.apple.com by ma-mailsvcp-mmp-lapp01.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) id <0QP300400G3IN400@ma-mailsvcp-mmp-lapp01.apple.com>; Thu, 25 Feb 2021 08:51:37 -0800 (PST)
X-Va-A:
X-Va-T-CD: 81ca60fce39c2560b6c4a7e5841f9b8f
X-Va-E-CD: d579c85cfe55e66e8c29d44626661f00
X-Va-R-CD: 595a4736b3fd72321bd3a680e0a086b4
X-Va-CD: 0
X-Va-ID: cb57133d-d3f0-4ff7-b8cc-6b0848302187
X-V-A:
X-V-T-CD: 81ca60fce39c2560b6c4a7e5841f9b8f
X-V-E-CD: d579c85cfe55e66e8c29d44626661f00
X-V-R-CD: 595a4736b3fd72321bd3a680e0a086b4
X-V-CD: 0
X-V-ID: 6ba2ce56-6795-48c0-9134-82751213be8a
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.369, 18.0.761 definitions=2021-02-25_10:2021-02-24, 2021-02-25 signatures=0
Received: from smtpclient.apple (unknown [17.235.89.189]) by ma-mailsvcp-mmp-lapp01.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) with ESMTPSA id <0QP300KLGG60BR00@ma-mailsvcp-mmp-lapp01.apple.com>; Thu, 25 Feb 2021 08:51:37 -0800 (PST)
From: Jan Van Doorn <jvd@apple.com>
Message-id: <681F99B9-13AC-42A3-A9CF-91CF2EB373DF@apple.com>
Content-type: multipart/signed; boundary="Apple-Mail=_DB96E373-D023-44AC-BF13-4B2B8B37371F"; protocol="application/pkcs7-signature"; micalg="sha-256"
MIME-version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.32\))
Date: Thu, 25 Feb 2021 09:51:36 -0700
In-reply-to: <E9A4B216-35B6-404B-AEAE-5D01748517F2@akamai.com>
Cc: "hls-interest@ietf.org" <hls-interest@ietf.org>
To: "Law, Will" <wilaw=40akamai.com@dmarc.ietf.org>
References: <60DBD56F-A93F-4E82-A134-5CE8D61BEFDF@akamai.com> <878DEBA0-A89D-4147-BEB1-B91F2649F4A2@apple.com> <E9A4B216-35B6-404B-AEAE-5D01748517F2@akamai.com>
X-Mailer: Apple Mail (2.3654.80.0.2.32)
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.369, 18.0.761 definitions=2021-02-25_10:2021-02-24, 2021-02-25 signatures=0
Archived-At: <https://mailarchive.ietf.org/arch/msg/hls-interest/coOtRGoHPHsLvK7SHZIwHIrcoe8>
Subject: Re: [Hls-interest] Setting appropriate cache levels for blocking parts and playlists on reference stream
X-BeenThere: hls-interest@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussions about HTTP Live Streaming \(HLS\)." <hls-interest.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/hls-interest/>
List-Post: <mailto:hls-interest@ietf.org>
List-Help: <mailto:hls-interest-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 25 Feb 2021 16:51:42 -0000


> On Feb 25, 2021, at 9:30 AM, Law, Will <wilaw=40akamai.com@dmarc.ietf.org> wrote:
> 
> Hartelijk bedankt!

Graag gedaan!
 
> I see the blocked playlist responses now have a max-age of 24, however the blocked media segments, such as the one shown below, are still at 300?

You're right, I missed a spot ;-). I think I have it right now? 

> GET /cmaf/media2/lowLatencySeg.mp4?segment=filePart280896.4.mp4 HTTP/2
> Host: ll-hls-test.apple.com
> User-Agent: curl/7.64.1
> Accept: */*
>
* Connection state changed (MAX_CONCURRENT_STREAMS == 100)!
< HTTP/2 200
< access-control-allow-origin: *
< block-duration: 243.192089ms
< cache-control: max-age=24
< content-length: 251821
< content-type: video/mp4
< server: ATS/8.1.1
< date: Thu, 25 Feb 2021 16:49:18 GMT
< access-control-expose-headers: age
< age: 0
< via: http/1.1 ussea4-edge-tx-004.ts.apple.com (ApacheTrafficServer/8.1.1 [uScMsSfWpSeN:t cCMp sS])
< cdnuuid: 301e6547-bc22-4e1c-b534-0198e21bc471-420944344
< x-cache: miss
< ms-in-cache: 0
<

>  
> Request URL: https://ll-hls-test.apple.com/cmaf/media1/lowLatencySeg.mp4?segment=filePart280487.3.mp4 <https://ll-hls-test.apple.com/cmaf/media1/lowLatencySeg.mp4?segment=filePart280487.3.mp4>
> Request Method: GET
> Status Code: 200
> Remote Address: 17.253.30.233:443
> Referrer Policy: strict-origin-when-cross-origin
> access-control-allow-origin: *
> access-control-expose-headers: age
> age: 1
> block-duration: 837.994439ms
> cache-control: max-age=300
> cdnuuid: b2341c67-2b51-4783-99f8-19e417e2c786-421560565
> content-length: 67099
> content-type: video/mp4
> date: Thu, 25 Feb 2021 16:23:01 GMT
> ms-in-cache: 0
> server: ATS/8.1.1
> via: http/1.1 ussea4-edge-tx-002.ts.apple.com <http://ussea4-edge-tx-002.ts.apple.com/> (ApacheTrafficServer/8.1.1 [uScMsSfWpSeN:t cCMp sS])
> x-cache: miss
>  
> Cheers
> Will
>  
>  
> From: Jan Van Doorn <jvd=40apple.com@dmarc.ietf.org>
> Date: Thursday, February 25, 2021 at 7:53 AM
> To: "Law, Will" <wilaw@akamai.com>
> Cc: "hls-interest@ietf.org" <hls-interest@ietf.org>
> Subject: Re: [Hls-interest] Setting appropriate cache levels for blocking parts and playlists on reference stream
>  
> Hi Will,
>  
> I updated the cmaf reference stream to have targetduration*6 as max-age. The ll-hls-origin-example.go will be updated accordingly in the next release of the Low Latency HLS Tools package.
>  
> Cheers,
> JvD
>  
> 
> 
>> On Feb 12, 2021, at 9:52 AM, Law, Will <wilaw=40akamai.com@dmarc.ietf.org <mailto:wilaw=40akamai.com@dmarc.ietf.org>> wrote:
>>  
>> A given LL-HLS stream consists of a sequence of playlists, parts and segments. The parts are only referenced within 3 target-durations from the live edge and hence can have a relatively short cache TTL , say 6 target durations to be safe . Segments however maybe requested by any client scrubbing within the DVR window, as well as further behind live by non-low-latency clients. These segments need a much longer TTL, at least the length of the DVR window, or longer if the live stream is converted to a VOD asset . Maximum cache efficiency is achieved when the proxy edge is able to evict objects as soon as their useful life has ended.
>>  
>> The current IETF spec addresses this with “Successful responses to blocking Media segment requests should be cached for six Target Durations.”,  “Successful responses to blocking Playlist requests should be cached for six Target Durations.” and “Origin servers should use Cache-Control headers to communicate the desired cache lifetime.”
>>  
>> Observing the Apple reference stream at https://ll-hls-test.apple.com/cmaf/master.m3u8 <https://ll-hls-test.apple.com/cmaf/master.m3u8>, with a target duration of 4. I note for successful responses that :
>>  
>> Non-blocking media playlist response: max-age = 1
>> Blocking media playlist response: max-age = 60
>> Blocking part response: max-age = 300
>> Non-blocking part response: max-age = 300
>> Non-blocking segment response: max-age = 300
>>  
>> Would it be more correct to have blocking media object (part) responses have a max-age of 24?
>>  
>> Should blocking media playlist responses also be reduced to  24?
>>  
>> Cheers
>> Will
>>  
>> -- 
>> Hls-interest mailing list
>> Hls-interest@ietf.org <mailto:Hls-interest@ietf.org>
>> https://www.ietf.org/mailman/listinfo/hls-interest <https://www.ietf.org/mailman/listinfo/hls-interest>