Re: [Hls-interest] coming to Apple HLS clients later this year: M-JPEG support

Roger Pantos <rpantos@apple.com> Wed, 23 February 2022 18:06 UTC

Return-Path: <rpantos@apple.com>
X-Original-To: hls-interest@ietfa.amsl.com
Delivered-To: hls-interest@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id EBBD23A10FE for <hls-interest@ietfa.amsl.com>; Wed, 23 Feb 2022 10:06:17 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.672
X-Spam-Level:
X-Spam-Status: No, score=-2.672 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.576, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_MSPIKE_H5=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=apple.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1AtRDtEcFLm8 for <hls-interest@ietfa.amsl.com>; Wed, 23 Feb 2022 10:06:13 -0800 (PST)
Received: from ma1-aaemail-dr-lapp01.apple.com (ma1-aaemail-dr-lapp01.apple.com [17.171.2.60]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1F22B3A1033 for <hls-interest@ietf.org>; Wed, 23 Feb 2022 10:06:12 -0800 (PST)
Received: from pps.filterd (ma1-aaemail-dr-lapp01.apple.com [127.0.0.1]) by ma1-aaemail-dr-lapp01.apple.com (8.16.0.42/8.16.0.42) with SMTP id 21NHx2q1008006; Wed, 23 Feb 2022 10:06:11 -0800
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=apple.com; h=from : message-id : content-type : mime-version : subject : date : in-reply-to : cc : to : references; s=20180706; bh=lRXndcpKoaUNvZbDjVm8SSas/H7Ej8a1ypkpr6LLrjI=; b=r2tg/iY4UHWF/6L3wWVsOZM1d8VeNDBjndR5l9a6XP8NmP7Ewi8TTxWYJRVkEjhytCL+ TBIqR52QNdQLhs2Ctub+ADtzutakj2neg9SFGQz7dNpxVH5Ycg1hRRAZIon3N2jLtP5a zwjujL08VbrZAEN5OzlFcvnJXYZ5TMcy3TIj4pUC0CCt0jicWhcg53rde6GjBzruLXx5 GNhTQXZZCIEP+joYnrtxHbnDRfZ+V0krMtgF0RbdWDkZofHYgaEGAOPBibBmbl1wZdve QZh3g5UyfiuooXzxAB+CBkyoQOyKrvp3QTmlUZ1jT9ZSlIPJXdIG1PFro0jHjxk+q4uL hQ==
Received: from rn-mailsvcp-mta-lapp01.rno.apple.com (rn-mailsvcp-mta-lapp01.rno.apple.com [10.225.203.149]) by ma1-aaemail-dr-lapp01.apple.com with ESMTP id 3eb0385rvu-2 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Wed, 23 Feb 2022 10:06:11 -0800
Received: from rn-mailsvcp-mmp-lapp03.rno.apple.com (rn-mailsvcp-mmp-lapp03.rno.apple.com [17.179.253.16]) by rn-mailsvcp-mta-lapp01.rno.apple.com (Oracle Communications Messaging Server 8.1.0.12.20210903 64bit (built Sep 3 2021)) with ESMTPS id <0R7R0096IRMA16H0@rn-mailsvcp-mta-lapp01.rno.apple.com>; Wed, 23 Feb 2022 10:06:10 -0800 (PST)
Received: from process_milters-daemon.rn-mailsvcp-mmp-lapp03.rno.apple.com by rn-mailsvcp-mmp-lapp03.rno.apple.com (Oracle Communications Messaging Server 8.1.0.12.20210903 64bit (built Sep 3 2021)) id <0R7R00I00RE5Y300@rn-mailsvcp-mmp-lapp03.rno.apple.com>; Wed, 23 Feb 2022 10:06:10 -0800 (PST)
X-Va-A:
X-Va-T-CD: 0044008fef94597283a45d761ef7a504
X-Va-E-CD: 18fa313a53dff409db6c2488b7e792d9
X-Va-R-CD: 929e8339eeb80c3a2cedcd4e479e2aa7
X-Va-CD: 0
X-Va-ID: b7b30f1a-57b3-4f8a-912a-41c71ec38d63
X-V-A:
X-V-T-CD: 0044008fef94597283a45d761ef7a504
X-V-E-CD: 18fa313a53dff409db6c2488b7e792d9
X-V-R-CD: 929e8339eeb80c3a2cedcd4e479e2aa7
X-V-CD: 0
X-V-ID: 0c5a24e3-2bee-496b-9f75-4ebb9866ae67
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.425, 18.0.816 definitions=2022-02-23_09:2022-02-23, 2022-02-23 signatures=0
Received: from smtpclient.apple ([17.11.89.98]) by rn-mailsvcp-mmp-lapp03.rno.apple.com (Oracle Communications Messaging Server 8.1.0.12.20210903 64bit (built Sep 3 2021)) with ESMTPSA id <0R7R00P4SRM99H00@rn-mailsvcp-mmp-lapp03.rno.apple.com>; Wed, 23 Feb 2022 10:06:10 -0800 (PST)
From: Roger Pantos <rpantos@apple.com>
Message-id: <A7C0E64D-7260-4F0D-96F2-27963D2ACF5A@apple.com>
Content-type: multipart/alternative; boundary="Apple-Mail=_66B20F28-DCA6-4579-A533-E86694FE1FC3"
MIME-version: 1.0 (Mac OS X Mail 16.0 \(3696.80.82.1.1\))
Date: Wed, 23 Feb 2022 10:06:09 -0800
In-reply-to: <CAF-MBSJq3MQ-oeOeed9BgMmn8BR+9QX2-YSpbq1vn=w3eTK_Jw@mail.gmail.com>
Cc: hls-interest@ietf.org, hls-announce@lists.apple.com
To: Alex Giladi <alex.giladi@gmail.com>
References: <5EDBFCDA-9040-4443-9694-C5D7E7F79C1C@apple.com> <CAF-MBSJq3MQ-oeOeed9BgMmn8BR+9QX2-YSpbq1vn=w3eTK_Jw@mail.gmail.com>
X-Mailer: Apple Mail (2.3696.80.82.1.1)
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.425, 18.0.816 definitions=2022-02-23_09:2022-02-23, 2022-02-23 signatures=0
Archived-At: <https://mailarchive.ietf.org/arch/msg/hls-interest/fzS7hcrwa3CYdrO9dcb2iNpoJdQ>
Subject: Re: [Hls-interest] coming to Apple HLS clients later this year: M-JPEG support
X-BeenThere: hls-interest@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussions about HTTP Live Streaming \(HLS\)." <hls-interest.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/hls-interest/>
List-Post: <mailto:hls-interest@ietf.org>
List-Help: <mailto:hls-interest-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 23 Feb 2022 18:06:18 -0000

Hi Alex. A platform with a software decoder for individual HEVC images can in principle consume I-frame playlists containing HDR10 / Dolby Vision / HLG segments.


Roger. 

> On Feb 23, 2022, at 10:01 AM, Alex Giladi <alex.giladi@gmail.com> wrote:
> 
> Hi Roger,
> What do we do for HDR? Any plans for HEIF?
> Best,
> Alex.
> 
> On Wed, Feb 23, 2022 at 10:04 AM Roger Pantos <rpantos=40apple.com@dmarc.ietf.org <mailto:40apple.com@dmarc.ietf.org>> wrote:
> Hi folks. This is just a quick heads-up to let you know that in an OS release later this year, the Apple HLS clients will be updated to support Motion-JPEG fMP4 segments (i.e. JPEG images inside fMP4 containers). This will allow you to provide I-frame playlists (for both VOD and live content) that contain JPEG I-frames, rather than AVC or HEVC as previously supported.
> 
> We're doing this to support interoperability with lower-end devices from other manufacturers that cannot spawn a second video decoder instance, but can decode JPEG in software.
> 
> M-JPEG is specified in ISO/IEC 23008-12 "High efficiency coding and media delivery in heterogeneous environments —Part 12: Image File Format."  The 4cc codec type is 'mjpg' with no parameters (http://mp4ra.org/#/codecs <http://mp4ra.org/#/codecs>), So an example EXT-X-I-FRAME-STREAM-INF would be:
> 
> #EXT-X-I-FRAME-STREAM-INF:BANDWIDTH=331000,CODECS="mjpg",URI="iframe_index.m3u8"
> 
> We also plan to update our mediafilesegmenter tool to enable it to produce M-JPEG fMP4 segments from JPEG source.
> 
> 
> regards,
> 
> Roger Pantos
> Apple Inc.
> -- 
> Hls-interest mailing list
> Hls-interest@ietf.org <mailto:Hls-interest@ietf.org>
> https://www.ietf.org/mailman/listinfo/hls-interest <https://www.ietf.org/mailman/listinfo/hls-interest>