[Hls-interest] Use of characteristic tags for Subtitles in HLS streaming

James Hart <jwhart76@gmail.com> Thu, 22 July 2021 15:45 UTC

Return-Path: <jwhart76@gmail.com>
X-Original-To: hls-interest@ietfa.amsl.com
Delivered-To: hls-interest@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id EDA0E3A4AD6 for <hls-interest@ietfa.amsl.com>; Thu, 22 Jul 2021 08:45:07 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.847
X-Spam-Level:
X-Spam-Status: No, score=-1.847 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id gyrF1CtDyRpk for <hls-interest@ietfa.amsl.com>; Thu, 22 Jul 2021 08:45:05 -0700 (PDT)
Received: from mail-pj1-x1035.google.com (mail-pj1-x1035.google.com [IPv6:2607:f8b0:4864:20::1035]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 089F33A4AD2 for <hls-interest@ietf.org>; Thu, 22 Jul 2021 08:45:04 -0700 (PDT)
Received: by mail-pj1-x1035.google.com with SMTP id gv20-20020a17090b11d4b0290173b9578f1cso3902219pjb.0 for <hls-interest@ietf.org>; Thu, 22 Jul 2021 08:45:04 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=jb1br0nSKjCcmhuJjzP+zuyJBNc836q4jJhyzpvHNZo=; b=SgjCzvHHoIaR+Nke9yX/p6vr4FYF/ISqnF2QlDZdPvexQBMKSlKyoX0756saoj0e/G G+yHPICOPPwIoh/UB4N8apJZwuSXaBka/VGX/CKdIYe2dhHMyzIcLRNK1ZmGFjMtNM4r WI5aioz23uTn1D1Gw+WIPcFXQVuZyVsxrPwE4Wod2IeKWYLSWaL+3vNPJYy2Ur0uJZXJ pneqR0E4xs8QW3dSkGIxxZJz5l0B9cvfOYWtOurrk6dv9XYjboc90QYwF8B7rNvJCRCu 2VUTPOhCvtk25JQ+mDf7Qfi8X3azIY8FWtLLNFnZsm7niuMzBIMltZ1g5RN6y2yYXo8Z a35g==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=jb1br0nSKjCcmhuJjzP+zuyJBNc836q4jJhyzpvHNZo=; b=tCFXAgYiIuc4VFtGm2EEgPyJh9u0RJrrhFBjBtuQZLLPBSqpY1vT47k+8iT79mrXn0 bqKgGyh4FyxFXXucWwTiwZcpUM13sQ8yeBeSK+uTxuq47R8Lh5ggdXiEJ0x8Kt6fQ9Mk dSEJpCP/jkuWHnxR+Oq2DdzZ8sbxJsUQ0Ugom3Wn/tLzJc+GZLth7SepFdCjObk8VEo5 8/2cMdfMuN4MYtuo4hgQHYPbsMaJUYkTnxi+5qx9U1x/3HcRH52dyDxPr5oPiAiiSCCF Rs3J4PCR0S2ICCtymi/Ruunsqj4rcBs7qjSD4vh1YfgntIM5nfwmtDIYGgdS2414L2C/ HPBA==
X-Gm-Message-State: AOAM532U/HEtiIOL0Jg6s1pupDncI4rENKYRt2Rl9i+mgb9ZU7HpQ5m1 CLtwiYrwb5IbNPDrX/9PDFNoBUa0QjD3Cq/3nqoGuaughsU=
X-Google-Smtp-Source: ABdhPJwsFwREynuYcWB+DB356szNyq8Tht1lvY4lUru4I7WNFGC8UA9Gkts6l29igzTAtpuEfsy4vjJtLz1EcvfFJbo=
X-Received: by 2002:a65:490b:: with SMTP id p11mr538584pgs.313.1626968703408; Thu, 22 Jul 2021 08:45:03 -0700 (PDT)
MIME-Version: 1.0
From: James Hart <jwhart76@gmail.com>
Date: Thu, 22 Jul 2021 16:44:52 +0100
Message-ID: <CACwHNnMk3NCJ7jHcCJTMUBqWS5_bCZPqBYepa9XeDoMjGNSbGg@mail.gmail.com>
To: hls-interest@ietf.org
Content-Type: multipart/alternative; boundary="000000000000a09b7305c7b82ba5"
Archived-At: <https://mailarchive.ietf.org/arch/msg/hls-interest/hq9ia1rsSS4y8YFMzUfwza1Bmmc>
Subject: [Hls-interest] Use of characteristic tags for Subtitles in HLS streaming
X-BeenThere: hls-interest@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussions about HTTP Live Streaming \(HLS\)." <hls-interest.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/hls-interest/>
List-Post: <mailto:hls-interest@ietf.org>
List-Help: <mailto:hls-interest-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 22 Jul 2021 15:45:08 -0000

Hello,

I am trying to determine the correct use of the characteristics tags for
subtitles in HTTP LIve Streaming and i am a little confused by the various
sources of information and hoping some clarifications can be provided on
what devices require:

>From RFC-8216-09
<https://datatracker.ietf.org/doc/html/draft-pantos-hls-rfc8216bis-09#section-4.4.6.1>
i
see:

A SUBTITLES Rendition MAY include the following characteristics:
> "public.accessibility.transcribes-spoken-dialog",
> public.accessibility.describes-music-and-sound", and
> "public.easy-to-read" (which indicates that the subtitles have been edited
> for ease of reading).


>From the HLS Authoring Specification
<https://developer.apple.com/documentation/http_live_streaming/hls_authoring_specification_for_apple_devices>
for Apple Devices i see only one characteristic defined:


4.5. If a subtitles track is intended to provide accessibility for people
> who are deaf or hard of hearing, it MUST be marked with the attribute
> CHARACTERISTICS="public.accessibility.describes-music-and-sound".
> (Subtitles with this attribute value are treated the same as closed
> captions.)


Then if i compare this with the sample streams on the Developer Site
<https://developer.apple.com/streaming/examples/> i can see one such
example contains subtitles
<https://developer.apple.com/streaming/examples/basic-stream-osx-ios5.html>with
the characteristics "public.accessibility.transcribes-spoken-dialog,
public.accessibility.describes-music-and-sound" within the top level m3u8,
which does not appear aligned fully with the HLS authoring specification.
For reference this was the example i used:

$ curl '
> https://devstreaming-cdn.apple.com/videos/streaming/examples/bipbop_16x9/bipbop_16x9_variant.m3u8
> '
> #EXTM3U
>
> #EXT-X-MEDIA:TYPE=AUDIO,GROUP-ID="bipbop_audio",LANGUAGE="eng",NAME="BipBop
> Audio 1",AUTOSELECT=YES,DEFAULT=YES
> #EXT-X-MEDIA:TYPE=AUDIO,GROUP-ID="bipbop_audio",LANGUAGE="eng",NAME="BipBop
> Audio 2",AUTOSELECT=NO,DEFAULT=NO,URI="alternate_audio_aac/prog_index.m3u8"
>
>
>
> #EXT-X-MEDIA:TYPE=SUBTITLES,GROUP-ID="subs",NAME="English",DEFAULT=YES,AUTOSELECT=YES,FORCED=NO,LANGUAGE="en",CHARACTERISTICS="public.accessibility.transcribes-spoken-dialog,
> public.accessibility.describes-music-and-sound"
> ,URI="subtitles/eng/prog_index.m3u8"
> < - - snip - - >



Appreciate some pointers on the correct signaling here.

Many thanks,

James Hart