[Hls-interest] coming to Apple HLS clients later this year: M-JPEG support

[Roger Pantos <[e-mail]>]

Hi folks. This is just a quick heads-up to let you know that in an OS release later this year, the Apple HLS clients will be updated to support Motion-JPEG fMP4 segments (i.e. JPEG images inside fMP4 containers). This will allow you to provide I-frame playlists (for both VOD and live content) that contain JPEG I-frames, rather than AVC or HEVC as previously supported.

We're doing this to support interoperability with lower-end devices from other manufacturers that cannot spawn a second video decoder instance, but can decode JPEG in software.

M-JPEG is specified in ISO/IEC 23008-12 "High efficiency coding and media delivery in heterogeneous environments —Part 12: Image File Format."  The 4cc codec type is 'mjpg' with no parameters (http://mp4ra.org/#/codecs), So an example EXT-X-I-FRAME-STREAM-INF would be:

#EXT-X-I-FRAME-STREAM-INF:BANDWIDTH=331000,CODECS="mjpg",URI="iframe_index.m3u8"

We also plan to update our mediafilesegmenter tool to enable it to produce M-JPEG fMP4 segments from JPEG source.


regards,

Roger Pantos
Apple Inc.