Re: [Hls-interest] Survey: signaling HLS client capability

Ofer Shem Tov <ost@verizonmedia.com> Sun, 30 May 2021 08:23 UTC

Return-Path: <ost@verizonmedia.com>
X-Original-To: hls-interest@ietfa.amsl.com
Delivered-To: hls-interest@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id EE42B3A3408 for <hls-interest@ietfa.amsl.com>; Sun, 30 May 2021 01:23:57 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.087
X-Spam-Level:
X-Spam-Status: No, score=-2.087 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, T_REMOTE_IMAGE=0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=verizonmedia.com header.b=uaiCKKiz; dkim=pass (2048-bit key) header.d=verizonmedia.com header.b=A3fk+uEa
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id FUtpi2QuJk06 for <hls-interest@ietfa.amsl.com>; Sun, 30 May 2021 01:23:53 -0700 (PDT)
Received: from mx0b-00505701.pphosted.com (mx0b-00505701.pphosted.com [148.163.139.55]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 58A9E3A3402 for <hls-interest@ietf.org>; Sun, 30 May 2021 01:23:53 -0700 (PDT)
Received: from pps.filterd (m0212276.ppops.net [127.0.0.1]) by mx0b-00505701.pphosted.com (8.16.0.43/8.16.0.43) with SMTP id 14U8IubF021750 for <hls-interest@ietf.org>; Sun, 30 May 2021 08:23:52 GMT
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=verizonmedia.com; h=mime-version : from : date : message-id : subject : to : content-type; s=pps1; bh=dPpl51QTLbyyqBaLwH4kKj99YefH+dn2SnM9cYYDVt0=; b=uaiCKKizGyoJmsJ9FyZ3tD+CBFusrcua4S2wrsWjkJznsb1qfptNXhBkq0cnY3ToH7pe J7G+77XiN3qymiVWnmChvwNCoYC54CZdakQEVkFVXzVhTUsum+11TNpy4nQG93rFkWyO kaftDHur6zqGyGbbMUjnZhPxeC889u7kuk2BZFjuMZwaJvm4Rz3VlPA5bKHkSsomOFRn sTUSx3j3l2+LAUMbGr7n1eI/2mVf03VQTi+Sssk5g7ogAbw3QNyBNuCPKHS8/I/Ond4T OEu6STxxpTZMvZF41Y0BSihk7Mm7cXkd9l+0CLhElihdwVN8q1YuQ8cSX7+CaIv3Ax1R aQ==
Received: from mail-il1-f198.google.com (mail-il1-f198.google.com [209.85.166.198]) by mx0b-00505701.pphosted.com with ESMTP id 38uyn838bv-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for <hls-interest@ietf.org>; Sun, 30 May 2021 08:23:52 +0000
Received: by mail-il1-f198.google.com with SMTP id p11-20020a056e02104bb02901c6927c3934so5873308ilj.20 for <hls-interest@ietf.org>; Sun, 30 May 2021 01:23:51 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=verizonmedia.com; s=google; h=mime-version:from:date:message-id:subject:to; bh=dPpl51QTLbyyqBaLwH4kKj99YefH+dn2SnM9cYYDVt0=; b=A3fk+uEa5QrExoPt4M5u36WntwC1P4PjYwi0FXPhycuQaqkz6qHtprPmU9WqW6P6pR Igdbj6WJPO8HvuMUTGraXJWaURkWfKrSiBsstwxrQnFffVSpPteHYtUTakeEHiwnMwtc OZno+BV1gDMmVF4Q/HRqM52Ua1/ujUX7Po1gzaW52cnXLqkloFtI2DUrZUpHsNRlEKcO 2tfbSwzCFlhIGwO/pqJDKgraa8jt+ZS2hzxLh8ZbJDIAiWSpJo8Fqp8bY5uTbBGCrvjx dpvl46s6+1vtOY19zq2ZcxBkQMYQQ8FO97AevPoJzmeZEE7ssfLHBpCpiG7Nur+C7x/l +CtA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=dPpl51QTLbyyqBaLwH4kKj99YefH+dn2SnM9cYYDVt0=; b=E1PQzXC9ww86rdNo5U3ILqJ1BYYdcgH3dJoIgKMrThPjbUvGXfDT6q1X2lgXdED2dX gOfuA/Y3KNPgMeKqOERDrmhUh24K61Ja5Yq9UP2HJ5wIHrZDNuA9XAzcjy02yVvIdbos EGP92CsNt3eCZz3SccoOWqm1dRVtrZkzz1ryDL6T/5TLJg9pCkrFPG/U2earVowytDWQ 87PQ/rp/9ZzsI85wdhGC76tbm+LhB6Md+TIOXJx/CfKnsVnc7w17UUa4qvwUndk1L4RK aTW1qD/eMz4fhH2c5+Y4KBOAGHN8udV1b+LUvWcfMhG9GV8qysZIApRVOf8biR+qdxMC l1GQ==
X-Gm-Message-State: AOAM531Hs30hRHhv1g/1AfYaVvn+grenKWAXU7PH9TiJeQsxPpRH4mw9 1gWR53SsZh9gq6Tz/MNBS6NcRnTUs4gt94dcGdA1kqOEhAWB+ul3HuRMuNnTYX6adfhmEuZVn28 OWzvOS09G5JDItQstSKrPhhgSiUL1LA==
X-Received: by 2002:a5e:974d:: with SMTP id h13mr12863545ioq.150.1622363031014; Sun, 30 May 2021 01:23:51 -0700 (PDT)
X-Google-Smtp-Source: ABdhPJzXmXBI/gEYpGIEmOVPIPkwuo5uRiQ6cvGIUUiLJlGKp/1A8Zgjmk7qUwB3AlOgfkD8LF26VYbnbkf1i4y/Rnc=
X-Received: by 2002:a5e:974d:: with SMTP id h13mr12863528ioq.150.1622363030514; Sun, 30 May 2021 01:23:50 -0700 (PDT)
MIME-Version: 1.0
From: Ofer Shem Tov <ost@verizonmedia.com>
Date: Sun, 30 May 2021 11:23:39 +0300
Message-ID: <CAHEE8Lr-0ea2HMr4ZBKecOJ8ZOuNFpf6hnX4OTSZDWbkEJPTJA@mail.gmail.com>
To: hls-interest@ietf.org
Content-Type: multipart/alternative; boundary="000000000000218a7905c387d47a"
X-Proofpoint-GUID: WoAsg6O1Cn9Hw6aCpH5jLaFb5UfRC2hX
X-Proofpoint-ORIG-GUID: WoAsg6O1Cn9Hw6aCpH5jLaFb5UfRC2hX
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.391, 18.0.761 definitions=2021-05-30_05:2021-05-27, 2021-05-30 signatures=0
X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 impostorscore=0 malwarescore=0 adultscore=0 spamscore=0 mlxscore=0 phishscore=0 bulkscore=0 mlxlogscore=999 suspectscore=0 lowpriorityscore=0 priorityscore=1501 clxscore=1011 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2104190000 definitions=main-2105300069
Archived-At: <https://mailarchive.ietf.org/arch/msg/hls-interest/JIH_9BqMp0FDnQ7tVFJFJEmlGrc>
Subject: Re: [Hls-interest] Survey: signaling HLS client capability
X-BeenThere: hls-interest@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussions about HTTP Live Streaming \(HLS\)." <hls-interest.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/hls-interest/>
List-Post: <mailto:hls-interest@ietf.org>
List-Help: <mailto:hls-interest-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 30 May 2021 08:23:58 -0000

On the Yahoo side of Verizon Media we have been using an internal Video
Policy API (since 2015) for filtering streams based on user agent, our
player capabilities (per platform), content type (sports, finance, etc.)
and the stream variants information.

The reasons to do that were:

- Compatibility with older devices (for example b-frames on some devices
used to be an issue)
- Devices not supporting 60FPS
- Filtering out low bitrate streams for TV devices like Apple TV
- Filtering out high bit rates for phones (data cap considerations, etc.)
- Selecting the starting bitrate by putting it first in the master playlist
- Removing higher bitrates in case of network issues (for events with
millions of concurrent)
- Testing non HTTP transports like UDP and QUIC for compatible players
- CDN selection (for compatibility issues with some players)

One important note is that in addition to bitrate filtering we added
resolution filtering when VBR was added to HLS. It is an easier filter to
manage because of different types of encodings and content (sports has much
higher bitrate than finance for the same resolution).

Ofer

---------- Forwarded message ----------
From: Roger Pantos <rpantos@apple.com>
To: hls-interest@ietf.org
Cc:
Bcc:
Date: Thu, 20 May 2021 09:00:30 -0700
Subject: [Hls-interest] Survey: signaling HLS client capability
With the increasing number of optional features in HLS (such as low
latency, content steering, interstitial support, different codecs, etc.),
there is a desire in some quarters to present different streams to
different devices, beyond the regular variant stream selection performed on
the client.

We're considering some kind of signal of client capability, such as a query
parameter on the Master Playlist URL, to support this kind of server
decision. But before we go too far I'd like to understand if it would
actually be of practical benefit, and what universe of use cases it makes
sense to support. So:

- Do you think you would use this kind of thing? For what?

- If you are already doing something along these lines, perhaps driven by
the User-Agent string or something else, what requirement is driving that?

(Alternately, if you think that this would only make things worse, let us
know why!)

Feel free to respond here, or to send your response privately to
http-live-streaming-review@group.apple.com.


thanks,

Roger Pantos
Apple Inc.

-- 
<http://www.verizonmedia.com>

Ofer Shem Tov

Distinguished Software Dev Engineer
Media Platform

M +972548842664
2A Jabotinsky St.
Amot Atrium 36th Floor
Ramat Gan

<http://www.facebook.com/verizonmedia>   <http://twitter.com/verizonmedia>
<https://www.linkedin.com/company/verizon-media/>
<http://www.instagram.com/verizonmedia>