Re: [Hls-interest] rendition report clarification

Eryk Vershen <evershen@apple.com> Mon, 29 March 2021 15:53 UTC

Return-Path: <evershen@apple.com>
X-Original-To: hls-interest@ietfa.amsl.com
Delivered-To: hls-interest@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6400E3A1910 for <hls-interest@ietfa.amsl.com>; Mon, 29 Mar 2021 08:53:02 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.85
X-Spam-Level:
X-Spam-Status: No, score=-0.85 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FAKE_REPLY_B=1.269, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H4=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=apple.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id RlZacnZjKvek for <hls-interest@ietfa.amsl.com>; Mon, 29 Mar 2021 08:52:58 -0700 (PDT)
Received: from rn-mailsvcp-ppex-lapp24.apple.com (rn-mailsvcp-ppex-lapp24.rno.apple.com [17.179.253.38]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 184723A190E for <hls-interest@ietf.org>; Mon, 29 Mar 2021 08:52:57 -0700 (PDT)
Received: from pps.filterd (rn-mailsvcp-ppex-lapp24.rno.apple.com [127.0.0.1]) by rn-mailsvcp-ppex-lapp24.rno.apple.com (8.16.0.43/8.16.0.43) with SMTP id 12TFclpA005633; Mon, 29 Mar 2021 08:52:56 -0700
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=apple.com; h=from : content-type : mime-version : subject : message-id : date : cc : to; s=20180706; bh=OLsqgVuQoMEz9sp2n46oDrCqOu5gtj5TWz6ILIyF9GU=; b=gLe6ypSwMGYYtktZ/VokVUDvMkDuis1FZhPPajEd+vQCnLkH5H1tbjPxGnCI5WJnOQzz B88et7GAd8Xz8whUOjmCRVqj3YKxZTCYJPny0UjXaUdqxYrbWiqnq3acl+vQ2emmfauT nj5MymINYKUl6Lw5YLOuirA+pksfbOGb9Cc53jKyEyn3QZr5DDJNnHH3pNO3629x6XaJ s3WGHEOTnjnlTThVEnK1lV5rjJF3cuevh/uQGhlPneoYC1qpcQxrfOTGiXRn5gI2ymP0 9HtwScKIte3mxAwJIfp4udleAOpnagXkPoDLB1kWJXQISNdfbCKigtmZ9cJkOpyU2jrG 6w==
Received: from rn-mailsvcp-mta-lapp01.rno.apple.com (rn-mailsvcp-mta-lapp01.rno.apple.com [10.225.203.149]) by rn-mailsvcp-ppex-lapp24.rno.apple.com with ESMTP id 37j2a98qgr-5 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Mon, 29 Mar 2021 08:52:56 -0700
Received: from rn-mailsvcp-mmp-lapp01.rno.apple.com (rn-mailsvcp-mmp-lapp01.rno.apple.com [17.179.253.14]) by rn-mailsvcp-mta-lapp01.rno.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) with ESMTPS id <0QQQ005CKMS7EGH0@rn-mailsvcp-mta-lapp01.rno.apple.com>; Mon, 29 Mar 2021 08:52:55 -0700 (PDT)
Received: from process_milters-daemon.rn-mailsvcp-mmp-lapp01.rno.apple.com by rn-mailsvcp-mmp-lapp01.rno.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) id <0QQQ00A00MNSHX00@rn-mailsvcp-mmp-lapp01.rno.apple.com>; Mon, 29 Mar 2021 08:52:55 -0700 (PDT)
X-Va-A:
X-Va-T-CD: d37bbba2ebe698aedb59d1ac80ce8931
X-Va-E-CD: 8044f246ba27096e4e5383a550dd9d6d
X-Va-R-CD: 555e737531372ca97f4432935b30bea2
X-Va-CD: 0
X-Va-ID: 71e5f068-1695-42fc-b262-a354ff7aca09
X-V-A:
X-V-T-CD: d37bbba2ebe698aedb59d1ac80ce8931
X-V-E-CD: 8044f246ba27096e4e5383a550dd9d6d
X-V-R-CD: 555e737531372ca97f4432935b30bea2
X-V-CD: 0
X-V-ID: 62f350c6-f6af-4195-a628-e1950433b6fc
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.369, 18.0.761 definitions=2021-03-29_10:2021-03-26, 2021-03-29 signatures=0
Received: from [17.11.71.203] by rn-mailsvcp-mmp-lapp01.rno.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) with ESMTPSA id <0QQQ00WMKMS2VN00@rn-mailsvcp-mmp-lapp01.rno.apple.com>; Mon, 29 Mar 2021 08:52:51 -0700 (PDT)
From: Eryk Vershen <evershen@apple.com>
Content-type: multipart/alternative; boundary="Apple-Mail=_C2DD5931-312C-415D-801F-FE9ECBAA1201"
MIME-version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\))
Message-id: <368B6536-394A-42CB-8E01-123559BD98A1@apple.com>
Date: Mon, 29 Mar 2021 08:52:50 -0700
Cc: hls-interest@ietf.org
To: Scott Kellicker <scott@blankcanvas.video>
X-Mailer: Apple Mail (2.3608.80.23.2.2)
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.369, 18.0.761 definitions=2021-03-29_10:2021-03-26, 2021-03-29 signatures=0
Archived-At: <https://mailarchive.ietf.org/arch/msg/hls-interest/RKD3rjGkm7VyCw0uAjo2_Gt1zwk>
Subject: Re: [Hls-interest] rendition report clarification
X-BeenThere: hls-interest@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussions about HTTP Live Streaming \(HLS\)." <hls-interest.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/hls-interest/>
List-Post: <mailto:hls-interest@ietf.org>
List-Help: <mailto:hls-interest-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 29 Mar 2021 15:53:02 -0000

> From: Scott Kellicker <scott@blankcanvas.video <mailto:scott@blankcanvas.video>>
> Date: March 26, 2021 at 8:48:44 AM PDT
> To: hls-interest@ietf.org <mailto:hls-interest@ietf.org>
> Subject: [Hls-interest] rendition report clarification
> 
> 
> At least to me the spec is not clear about rendition-reports between audio streams and video streams.  Looking at LLHLS streams produced by several companies, I see different behavior.
> 
> To take an example.  If I have one audio group rendition and 3 video renditions which point back to the audio group.  For example:
> 
> curl http://IP/playlist.m3u8 <http://ip/playlist.m3u8>
> #EXTM3U
> #EXT-X-VERSION:6
> #EXT-X-MEDIA:TYPE=AUDIO,GROUP-ID="Audio",URI="audio1.m3u8"
> #EXT-X-STREAM-INF:BANDWIDTH=3600000,CODECS="avc1.4d4c28,mp4a.40.2",RESOLUTION=1920x1080,AUDIO="Audio"
> video1.m3u8
> #EXT-X-STREAM-INF:BANDWIDTH=1400000,CODECS="avc1.4d4c1e,mp4a.40.2",RESOLUTION=540x360,AUDIO="Audio"
> video2.m3u8
> #EXT-X-STREAM-INF:BANDWIDTH=750000,CODECS="avc1.4d4c15,mp4a.40.2",RESOLUTION=320x240,AUDIO="Audio"
> video3.m3u8
> 
> Q. When I return the m3u8 for one of the video renditions, should the REND-REPORT contain the audio m3u8?
> 
> $ curl http://IP/video1.m3u8 <http://ip/video1.m3u8> |grep REND. ; should have all the audio RRs when requesting video m3u8
> #EXT-X-RENDITION-REPORT:URI="audio1=.m3u8",LAST-MSN=131,LAST-PART=1
> #EXT-X-RENDITION-REPORT:URI="video2.m3u8",LAST-MSN=131,LAST-PART=1
> #EXT-X-RENDITION-REPORT:URI="video3.m3u8",LAST-MSN=131,LAST-PART=1

Yes.

See Appendix B.1 in draft-pantos-hls-rfc8216bis-07 (or later) -

   "Each Media Playlist contains one EXT-X-RENDITION-REPORT tag for each
    Media Playlist (Rendition) in the Master Playlist, except for the Media Playlist
    to which the EXT-X-RENDITION-REPORT tag is being added, and Playlists
    that contain the EXT-X-I-FRAMES-ONLY tag."


> Q. Conversely, when I return the rendition report for the audio rendition, should it contain the 3 video rend report entries?
> 
> curl http://IP/audio1.m3u8 <http://ip/audio1.m3u8> |grep REND.  ; should have all the video RRs when requesting audio m3u8
> #EXT-X-RENDITION-REPORT:URI="video1.m3u8",LAST-MSN=122,LAST-PART=1
> #EXT-X-RENDITION-REPORT:URI="video2.m3u8",LAST-MSN=122,LAST-PART=1
> #EXT-X-RENDITION-REPORT:URI="video3.m3u8",LAST-MSN=122,LAST-PART=1

Yes, for the same reason.


> mediastreamvalidator would seem to answer "yes" to both questions.  However, in my experience MSV is often wrong and can conflict with the spec.  (And what ultimately matters is the spec AND what players expect)

Please take the time to submit bugs against the mediastreamvalidator.

regards,
Eryk Vershen
Apple Inc

> 
> Scott Kellicker
> Blank Canvas Video LLC
> 
> 
> -- 
> Hls-interest mailing list
> Hls-interest@ietf.org <mailto:Hls-interest@ietf.org>
> https://www.ietf.org/mailman/listinfo/hls-interest <https://www.ietf.org/mailman/listinfo/hls-interest>