Re: [Hls-interest] HLS Content Steering v1.3b1 spec update

"Law, Will" <wilaw@akamai.com> Fri, 19 November 2021 21:34 UTC

Return-Path: <wilaw@akamai.com>
X-Original-To: hls-interest@ietfa.amsl.com
Delivered-To: hls-interest@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 01E163A0B30; Fri, 19 Nov 2021 13:34:21 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.8
X-Spam-Level:
X-Spam-Status: No, score=-2.8 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.701, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=akamai.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id XCIQjWb_Ssnw; Fri, 19 Nov 2021 13:34:16 -0800 (PST)
Received: from mx0a-00190b01.pphosted.com (mx0a-00190b01.pphosted.com [IPv6:2620:100:9001:583::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id AD7373A0B2A; Fri, 19 Nov 2021 13:34:13 -0800 (PST)
Received: from pps.filterd (m0122333.ppops.net [127.0.0.1]) by mx0a-00190b01.pphosted.com (8.16.1.2/8.16.1.2) with ESMTP id 1AJJina8016935; Fri, 19 Nov 2021 21:34:10 GMT
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=akamai.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : content-id : content-transfer-encoding : mime-version; s=jan2016.eng; bh=5jWhD3H7if41kn3O3HNtjulxLUrA40OqpcPqyLRdJt0=; b=hkvUm8QNafQpisbAsgqVCo7sLYh0BgJAoaOuh5Ywvd0N+7Y4ExJxFSMOPvJEaiBP3wET F3p07RghqJ1IbxSpxyfG9rtWKUtpeFo19VY1SVEja+XiVJuyYG4qynA+2ASRbgMb68uO MRpk+mQDJxAxliDe6O3hsPhqW2c7tbClroy72H4PHycIeHNJDduUhI/XGcia6fXlgPNX XyFR3fuvsZJqyrRd9u45k4FYb5uL3a12wIysBsKEisHoUPvW47uZTYTL9/qOeL86PPmC YMcA9c3cNYCSVY5IwjyJMw3I4IijDmAMEzt/SmamcCJmD4Q+fxO8wLaBE0KmZU9z4Skx mA==
Received: from prod-mail-ppoint7 (a72-247-45-33.deploy.static.akamaitechnologies.com [72.247.45.33] (may be forged)) by mx0a-00190b01.pphosted.com (PPS) with ESMTPS id 3cejbta3ba-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 19 Nov 2021 21:34:10 +0000
Received: from pps.filterd (prod-mail-ppoint7.akamai.com [127.0.0.1]) by prod-mail-ppoint7.akamai.com (8.16.1.2/8.16.1.2) with SMTP id 1AJLKr0G014433; Fri, 19 Nov 2021 16:34:09 -0500
Received: from email.msg.corp.akamai.com ([172.27.165.113]) by prod-mail-ppoint7.akamai.com with ESMTP id 3cdsyx05kc-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Fri, 19 Nov 2021 16:34:09 -0500
Received: from USTX2EX-DAG1MB2.msg.corp.akamai.com (172.27.165.120) by ustx2ex-dag1mb1.msg.corp.akamai.com (172.27.165.119) with Microsoft SMTP Server (TLS) id 15.0.1497.24; Fri, 19 Nov 2021 15:34:09 -0600
Received: from USTX2EX-DAG1MB2.msg.corp.akamai.com ([172.27.165.120]) by ustx2ex-dag1mb2.msg.corp.akamai.com ([172.27.165.120]) with mapi id 15.00.1497.024; Fri, 19 Nov 2021 15:34:08 -0600
From: "Law, Will" <wilaw@akamai.com>
To: Roger Pantos <rpantos=40apple.com@dmarc.ietf.org>
CC: Naiwei Zheng <naiwei=40apple.com@dmarc.ietf.org>, "hls-interest@ietf.org" <hls-interest@ietf.org>
Thread-Topic: [Hls-interest] HLS Content Steering v1.3b1 spec update
Thread-Index: AQHX3WphJ9BzjbxCKkyiPDqeSvPVvqwLC20AgACquID//4faAA==
Date: Fri, 19 Nov 2021 21:34:07 +0000
Message-ID: <2A6A39CD-A1B2-4C1D-A446-EC36FEAE6579@akamai.com>
References: <01FE85D3-2FA5-4088-8C88-345D1BDBD932@apple.com> <D39444AF-89AF-480D-B338-22F1211CFAF2@akamai.com> <CD30434C-0442-418C-B7FC-088B7C66C073@apple.com>
In-Reply-To: <CD30434C-0442-418C-B7FC-088B7C66C073@apple.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/16.54.21101001
x-ms-exchange-messagesentrepresentingtype: 1
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [172.27.118.139]
Content-Type: text/plain; charset="utf-8"
Content-ID: <2FFA126F3703164789467036C1F6E494@akamai.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.425, 18.0.790 definitions=2021-11-19_10:2021-11-17, 2021-11-19 signatures=0
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 phishscore=0 mlxscore=0 adultscore=0 spamscore=0 bulkscore=0 mlxlogscore=999 suspectscore=0 malwarescore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2110150000 definitions=main-2111190114
X-Proofpoint-ORIG-GUID: bqkQt7QApx24Wc4PhHWhwLekMwDYoTob
X-Proofpoint-GUID: bqkQt7QApx24Wc4PhHWhwLekMwDYoTob
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.790,Hydra:6.0.425,FMLib:17.0.607.475 definitions=2021-11-19_15,2021-11-17_01,2020-04-07_01
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 phishscore=0 priorityscore=1501 adultscore=0 clxscore=1011 lowpriorityscore=0 spamscore=0 suspectscore=0 malwarescore=0 impostorscore=0 mlxlogscore=999 mlxscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2110150000 definitions=main-2111190114
Archived-At: <https://mailarchive.ietf.org/arch/msg/hls-interest/1YHlx2G3hVIFDAjPDKQCHSO5vCI>
Subject: Re: [Hls-interest] HLS Content Steering v1.3b1 spec update
X-BeenThere: hls-interest@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussions about HTTP Live Streaming \(HLS\)." <hls-interest.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/hls-interest/>
List-Post: <mailto:hls-interest@ietf.org>
List-Help: <mailto:hls-interest-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Nov 2021 21:34:21 -0000

@Roger re "Can you illustrate the use case for URLs as Pathway-IDs?"

Yes - I was looking at steering from the point of view of a distributor who needs to steer both HLS and DASH content, and wondering if the same steering response could be used to steer both formats. Since DASH has the concept of BaseURLs (functionally equivalent to multi-source HLS variants), it turns out  that as long as we add the steering server URL to the manifest and add some sort of pathway-ID to each BaseURL, then it is relatively trivial to also steer a DASH player with no changes to the steering server output. This idea is captured at https://github.com/Dash-Industry-Forum/DASH-IF-IOP/issues/406. While discussing this it was raised that instead of adding a new attribute to the baseURL, we could simply use the baseURL itself as the identifier. Hence my question to Naiwei as to whether the current restrictions on characters could be relaxed.

If the answer is no, and no-one else raises use-cases that requires URLs inside pathway-IDs, then I think it's fine and can rescind the request __  We have another workaround (discussed this morning actually) on the DASH side which is to override the existing serviceLocation attribute of BaseURL as use that as a pathway-ID. I think that will work.

I am reasonably confident that the currently defined steering server response will be able to be used interoperably across formats, and that is a good prospect for anyone currently building a steering service. 

Cheers
Will

 

On 11/19/21, 12:44 PM, "Roger Pantos" <rpantos=40apple.com@dmarc.ietf.org> wrote:

    Hello Will,

    > On Nov 19, 2021, at 10:33 AM, Law, Will <wilaw=40akamai.com@dmarc.ietf.org> wrote:
    > 
    > Hi Naiwei
    > 
    > Thanks for updating us on this new cloning proposal. Two questions for you:
    > 
    > 1. Can you clarify the desired behavior
    > 
    > If the multivariant playlist contains a pathway entry for CDN-A with the following value: 
    > 
    > https://urldefense.com/v3/__https://backup.example.com/content/videos/video12/eng.m3u8?tokenA=12345__;!!GjvTz_vk!AnSQiYq4xneY6XEgulqwaRIdBXzXOqy0iPbAONBSEhZGSLABcUX3q9tI_rsg$ 
    > 
    > and then the player receives a steering response which includes a clone instruction for CDN-A with 
    > 
    > "PARAMS":
    > {
    > "tokenA": "6789",
    > "tokenB": "55555"
    > }
    > 
    > Does it construct the following variant URI for the clone of CDN-A as
    > 
    > https://urldefense.com/v3/__https://backup.example.com/content/videos/video12/eng.m3u8?tokenA=6789&tokenB=5555__;!!GjvTz_vk!AnSQiYq4xneY6XEgulqwaRIdBXzXOqy0iPbAONBSEhZGSLABcUX3qznyrFV1$ 
    > 
    > In other words, should 
    > 1. New params should be added to the URI, preserving  the existing params?
    > 2. Params having the same name as an existing param should update the value?

    As Naiwei indicated the answer is "yes." We can add some clarifying language to the spec ("Pathway Cloning"): ".., replacing any existing name/value pair with the same name."

    > 
    > 2. The current spec limits the pathway-ID string to allow only characters from the set [a..z], [A..Z], [0..9], '.', '-', and '_'. This prohibits the use of URLs as pathway-IDs, since "://" is excluded. Since you are revising the steering spec, is there any chance the character restrictions could be expanded to include "://"? The use case is interoperability of the steering server response to steer non-HLS traffic. 

    Can you illustrate the use case for URLs as Pathway-IDs?


    Roger.

    > 
    > Cheers
    > 
    > Will
    > 
    > 
    > On 11/19/21, 9:25 AM, "Naiwei Zheng" <naiwei=40apple.com@dmarc.ietf.org> wrote:
    > 
    >    Hi everyone,
    > 
    >    We really appreciate the kind and thoughtful feedback we received from the community since we announced the Content Steering feature.
    > 
    >    As you may recall, we scaled back our original design for Content Steering based on your feedback. Since then, we've heard from three very large content partners that they do in fact require the ability to introduce new content Pathways during playback, ones that were not part of the original Multivariant Playlist, in order to take advantage of Content Steering.
    > 
    >    To address that requirement, we are updating the Content Steering spec. Version 1.3 (draft) adds a provision for producing new pathways by "cloning" existing ones. This support is explicitly optional, for both the server and the client.
    > 
    >    The 1.3 spec also specifies that stable IDs must be present to enable Content Steering for downloadable content. This is because stable IDs are essential for coordinating bit-identical variants and renditions across different Pathways, so that downloader can continue fetching from a bit-identical stream after switching Pathways.
    > 
    >    For more info, review the attached spec document, and as always, your comments are welcomed, either to his-interest or directly to us at http-live-streaming-review@group.apple.com.
    > 
    >    Thank you!
    > 
    >    Naiwei Zheng
    >    HLS Team, Apple Inc.
    > 
    > 
    > -- 
    > Hls-interest mailing list
    > Hls-interest@ietf.org
    > https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/hls-interest__;!!GjvTz_vk!AnSQiYq4xneY6XEgulqwaRIdBXzXOqy0iPbAONBSEhZGSLABcUX3q9zgI6d3$ 

    -- 
    Hls-interest mailing list
    Hls-interest@ietf.org
    https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/hls-interest__;!!GjvTz_vk!AnSQiYq4xneY6XEgulqwaRIdBXzXOqy0iPbAONBSEhZGSLABcUX3q9zgI6d3$