[Hls-interest] rendition report clarification

Scott Kellicker <scott@blankcanvas.video> Fri, 26 March 2021 15:47 UTC

Return-Path: <scott@blankcanvas.video>
X-Original-To: hls-interest@ietfa.amsl.com
Delivered-To: hls-interest@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6C0543A21F6 for <hls-interest@ietfa.amsl.com>; Fri, 26 Mar 2021 08:47:51 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.098
X-Spam-Level:
X-Spam-Status: No, score=-2.098 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=blankcanvas.video
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id csZp-DNhrF4M for <hls-interest@ietfa.amsl.com>; Fri, 26 Mar 2021 08:47:46 -0700 (PDT)
Received: from mail-ej1-x631.google.com (mail-ej1-x631.google.com [IPv6:2a00:1450:4864:20::631]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 76D103A2258 for <hls-interest@ietf.org>; Fri, 26 Mar 2021 08:47:39 -0700 (PDT)
Received: by mail-ej1-x631.google.com with SMTP id w3so9112416ejc.4 for <hls-interest@ietf.org>; Fri, 26 Mar 2021 08:47:39 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=blankcanvas.video; s=google; h=mime-version:from:date:message-id:subject:to; bh=cb2BLnI5l9RcIsdAF8PJ2m9fV/Ihgq6wZTINSrEl5H8=; b=YCuJOnspKyTJNG3tY/bY1j0xEm0dHJXMBvohC7wKup3sMvym4YW58F3itsX7hIabs5 HHz9c81dy8N3q5YfXkP12CQUHzAEER5UT8p16t7KTtmimg+UjX3iaByfIX5WhnpC4bhP 3KoPIh3XWstsJUCTa58b6c3XXFEHNcRVALE33BvNH/Vh7IqPKFCJ1FH44ndWirCJiMcu qdn1Lx2C5GmaqeENaMsS5kG46b1wlNgqoYjxncKuuhGaQMsDTCMbF1w+uu3vu/AyCKjt h+lW0/Vu3ki/21EnOanStgiJCrDwSp0L7eVp1C3ahwDM0UvULOEltzKMXiVeb2Y1o/B3 IbOw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=cb2BLnI5l9RcIsdAF8PJ2m9fV/Ihgq6wZTINSrEl5H8=; b=s1RMyQb9vQvifbIXHrecM8+v+x7hMnqGq0aC/G04NJOP6Um1/NmN46n/RYHZgKyVD4 /81YYV24pdRdIt1/QYc8t1heynHq74kMZrSI0/bTLYZVl/Mq67DnfMLf42+XZ2iltM0a 0PTHvbzj5GGIm6U19mvUNhIYJmunDiwHf8rOEnGdyQXHp+Zo+s7C6gzIYiEJ2zjzA42q rCnow7yME9jzKyl0/PcdNM7rDOrPt9l7f0Bx0L0jf0M3NKHChPxX9P9/UzyvHuaAxdfY rJ7oi5VLJQpVDjcz5zkUa6IAfZ8YEpbyiN1rCdNIemolVDhKikr7LJvdXsZTBjM52b2j ZZjg==
X-Gm-Message-State: AOAM532qPb77cEQh52MvvH7WKamHpzd2vGpIuLQBmZsPmScrRjKB6p8o rcPp/tUXuHVEViV7E6FIRG/KULyGi/5D7LyJlkurE3kT4nXEdSsM
X-Google-Smtp-Source: ABdhPJzB36I//uB4FI6NGUqTXsha3fKstOPtimxFCbt5kWhahoNnrbq+jlaO+WeajR80qIFOqw+mkQDJ3fo4Ptd9dSE=
X-Received: by 2002:a17:906:cb0a:: with SMTP id lk10mr15845141ejb.479.1616773655927; Fri, 26 Mar 2021 08:47:35 -0700 (PDT)
MIME-Version: 1.0
From: Scott Kellicker <scott@blankcanvas.video>
Date: Fri, 26 Mar 2021 11:47:25 -0400
Message-ID: <CAO1sBqhBf1GKXwxAQ8HePSheD1eTQEPbh9RjPPB3zDjsdPj1zw@mail.gmail.com>
To: hls-interest@ietf.org
Content-Type: multipart/alternative; boundary="00000000000071b40305be72739f"
Archived-At: <https://mailarchive.ietf.org/arch/msg/hls-interest/Qf5sT2-vEXkTv89IA8BeCyQ6b0o>
Subject: [Hls-interest] rendition report clarification
X-BeenThere: hls-interest@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussions about HTTP Live Streaming \(HLS\)." <hls-interest.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/hls-interest/>
List-Post: <mailto:hls-interest@ietf.org>
List-Help: <mailto:hls-interest-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 26 Mar 2021 15:47:58 -0000

At least to me the spec is not clear about rendition-reports between audio
streams and video streams.  Looking at LLHLS streams produced by several
companies, I see different behavior.

To take an example.  If I have one audio group rendition and 3 video
renditions which point back to the audio group.  For example:

curl http://IP/playlist.m3u8
#EXTM3U
#EXT-X-VERSION:6
#EXT-X-MEDIA:TYPE=AUDIO,GROUP-ID="Audio",URI="audio1.m3u8"
#EXT-X-STREAM-INF:BANDWIDTH=3600000,CODECS="avc1.4d4c28,mp4a.40.2",RESOLUTION=1920x1080,AUDIO="Audio"
video1.m3u8
#EXT-X-STREAM-INF:BANDWIDTH=1400000,CODECS="avc1.4d4c1e,mp4a.40.2",RESOLUTION=540x360,AUDIO="Audio"
video2.m3u8
#EXT-X-STREAM-INF:BANDWIDTH=750000,CODECS="avc1.4d4c15,mp4a.40.2",RESOLUTION=320x240,AUDIO="Audio"
video3.m3u8

Q. When I return the m3u8 for one of the video renditions, should the
REND-REPORT contain the audio m3u8?

$ curl http://IP/video1.m3u8 |grep REND. ; should have all the audio RRs
when requesting video m3u8
#EXT-X-RENDITION-REPORT:URI="audio1=.m3u8",LAST-MSN=131,LAST-PART=1
#EXT-X-RENDITION-REPORT:URI="video2.m3u8",LAST-MSN=131,LAST-PART=1
#EXT-X-RENDITION-REPORT:URI="video3.m3u8",LAST-MSN=131,LAST-PART=1

Q. Conversely, when I return the rendition report for the audio rendition,
should it contain the 3 video rend report entries?

curl http://IP/audio1.m3u8 |grep REND.  ; should have all the video RRs
when requesting audio m3u8
#EXT-X-RENDITION-REPORT:URI="video1.m3u8",LAST-MSN=122,LAST-PART=1
#EXT-X-RENDITION-REPORT:URI="video2.m3u8",LAST-MSN=122,LAST-PART=1
#EXT-X-RENDITION-REPORT:URI="video3.m3u8",LAST-MSN=122,LAST-PART=1



mediastreamvalidator would seem to answer "yes" to both questions.
However, in my experience MSV is often wrong and can conflict with the
spec.  (And what ultimately matters is the spec AND what players expect)


Scott Kellicker
Blank Canvas Video LLC