[Hls-interest] AV sync issues with AES 128 encrypted non-multiplexed HLS streams in macOS 10.15.4

Boy van Dijk <boy@unified-streaming.com> Wed, 20 May 2020 14:41 UTC

Return-Path: <boy@unified-streaming.com>
X-Original-To: hls-interest@ietfa.amsl.com
Delivered-To: hls-interest@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 48F793A0A63 for <hls-interest@ietfa.amsl.com>; Wed, 20 May 2020 07:41:29 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level:
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=unified-streaming-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id IIyzFkXoxA6v for <hls-interest@ietfa.amsl.com>; Wed, 20 May 2020 07:41:26 -0700 (PDT)
Received: from mail-ed1-x534.google.com (mail-ed1-x534.google.com [IPv6:2a00:1450:4864:20::534]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A52C43A0A62 for <hls-interest@ietf.org>; Wed, 20 May 2020 07:41:26 -0700 (PDT)
Received: by mail-ed1-x534.google.com with SMTP id l5so3295215edn.7 for <hls-interest@ietf.org>; Wed, 20 May 2020 07:41:26 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=unified-streaming-com.20150623.gappssmtp.com; s=20150623; h=from:content-transfer-encoding:mime-version:subject:message-id:date :to; bh=NhvpV/U6Ydp+uQ4f+mJgj0MwVsNAZp++dVhhgcqIGDw=; b=Rps3L5Ojbr5vTkR5w2XTM+QUkg5Yq6sPLC1hweY5/ddCgAc2687PL+f4kh7SpWHZjS x2AN8IzunKXe+nl5Tojz5eSt5ZeWTNh0aYruDFaOOAMPEvk9w1C+LoyclUYJvzntmcWa 5nJMolIiBKAHA1g0ezIPEDiertR3u7iLCO2FkgXRld1Ge7F4xkwJVUKvFmuJZkesji8L 4o0Kwz2RcL9pwi23NSIsNlbJMzPkOlZGY5dIx+5TTNvETmOSFt4ow/qdeoxFIe+u27Hb wRDJ0zhaCXoUELqLNHQCOFIdg2mFbGKF17gRyoBx0RCyXxwlhKVHAWGmvsR+cP5VIwj1 fRwQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:message-id:date:to; bh=NhvpV/U6Ydp+uQ4f+mJgj0MwVsNAZp++dVhhgcqIGDw=; b=BUHFN8BVAh8hgaCCLR5voa0LgFcEd/7ud8q4kJ7u3DvJrmLlOGA27+Iv8/2x8g0FeT ToyXQAyNB8MJviqKfWQyl8U0XnhtzASBNp0jfbJkY5JcpjaJx8Bo4vwTCmQfcto+JxAE xbpo23zz3H9vE88I0SZtYTjp2s7PIFS2kYo/fS+EoDZcGo+VxFYyDMgztuWjhj0EcneQ NiEo6nHXUI/l97WKPABj9EMRFSohRjrOcqV8mWBoP+CUZggbdga08H2htYZ7K24hel3c 2C0upz8a9+HJwJ1jmdsiDQ9EYDCQM1qlIw2ess5i25/cZrp73HaH6MzchAxGKi+OqiWT GPXQ==
X-Gm-Message-State: AOAM5324VfObPlh6IJoI7ynBb/0PyY3GWlLuyYn/fu+C1un9XKlEK4FV nSCq+o690DZdlwd+Jvctzcsk3Qv+3zlY3w==
X-Google-Smtp-Source: ABdhPJzv483DFXWOOgYL4q1nfJ8jSSRaurVY2TVGYbzOqnD1JGXDZ/7y6b/ZlTjXMnPRiKnaj1BmnQ==
X-Received: by 2002:aa7:da8c:: with SMTP id q12mr3761851eds.334.1589985684214; Wed, 20 May 2020 07:41:24 -0700 (PDT)
Received: from [192.168.1.4] (e145144.upc-e.chello.nl. [213.93.145.144]) by smtp.gmail.com with ESMTPSA id j10sm2017177edn.75.2020.05.20.07.41.23 for <hls-interest@ietf.org> (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 20 May 2020 07:41:23 -0700 (PDT)
From: Boy van Dijk <boy@unified-streaming.com>
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\))
Message-Id: <34B34DAC-BA92-43F2-B6F1-8867F1CCEFC8@unified-streaming.com>
Date: Wed, 20 May 2020 16:41:22 +0200
To: hls-interest@ietf.org
X-Mailer: Apple Mail (2.3608.80.23.2.2)
Archived-At: <https://mailarchive.ietf.org/arch/msg/hls-interest/H5BgN2eXonTDMw2DGZwy_W0nDaE>
Subject: [Hls-interest] AV sync issues with AES 128 encrypted non-multiplexed HLS streams in macOS 10.15.4
X-BeenThere: hls-interest@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Discussions about HTTP Live Streaming \(HLS\)." <hls-interest.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/hls-interest/>
List-Post: <mailto:hls-interest@ietf.org>
List-Help: <mailto:hls-interest-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hls-interest>, <mailto:hls-interest-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 20 May 2020 14:43:40 -0000

Hi,

Some of our customer have notified us about AV sync issues when streaming AES 128 encrypted HLS streams in macOS 10.15.4 / Safari 13.1.

After some investigation, it is clear that these issues only happen with non-multiplexed content. 

The issues become worse the longer you play the stream. After about 10 minutes it's very easily noticeable.

As we have seen this issue with content packaged with different products, and because it's only reproducible in the latest public release of macOS, it seems this is a bug on Apple's side.

This is a demo stream that exhibits the issue, generated by just-in-time packager Unified Origin (the sync issues can be noticed from about 5 minutes into the content): 

https://demo.unified-streaming.com/video/tears-of-steel/tears-of-steel-aes.ism/.m3u8?hls_no_multiplex

In case I need to report this bug elsewhere, or if additional info is needed, please let me know.

Thanks.

Boy (Unified Streaming)