Re: [AVTCORE] Call for Framemarking implementation experience

Bernard Aboba <bernard.aboba@gmail.com> Sun, 22 November 2020 21:54 UTC

Return-Path: <bernard.aboba@gmail.com>
X-Original-To: avt@ietfa.amsl.com
Delivered-To: avt@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C3A933A0E05 for <avt@ietfa.amsl.com>; Sun, 22 Nov 2020 13:54:59 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.197
X-Spam-Level:
X-Spam-Status: No, score=-0.197 tagged_above=-999 required=5 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id SK8tLADe6xho for <avt@ietfa.amsl.com>; Sun, 22 Nov 2020 13:54:58 -0800 (PST)
Received: from mail-lj1-x22f.google.com (mail-lj1-x22f.google.com [IPv6:2a00:1450:4864:20::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BB47D3A0E04 for <avt@ietf.org>; Sun, 22 Nov 2020 13:54:57 -0800 (PST)
Received: by mail-lj1-x22f.google.com with SMTP id t22so3551966ljk.0 for <avt@ietf.org>; Sun, 22 Nov 2020 13:54:57 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=dnibQpQ3+BD5OfDM+oRb4k+kjE8PPCFjEWwDbm7CQG4=; b=QQ7u7iWz5eUprAl7Yd9mb7MmzpqDx4kONKOWWR00TITFcihsDzfm/nJ+m6Dy3ryHWO eiQsY7p2ZHwGWRfVHPcafzUGgdEc/YDNfm+i+GpZvAikPMUb5PwuqhhxCY9FuoTw1BHE ioncfec/CsZ8yGvRNFODPBmNC3BRoE3JzGvHnjg7PUCYbopM8sqHsA41gkPRYnReg4ax mKxZBu8qjAMMcyGFjB4a+gDuNMi6PqQt/kZwhHzbWHIJ6WyQZ6DvIH7+XF1xLbbd+kfK lAYd3cjh14wLFfG4VDkd1Ao61K0kEMYkWf6q8Lh69FZNFqf6vMYxIBJobClgzs2/zY3Z tQNQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=dnibQpQ3+BD5OfDM+oRb4k+kjE8PPCFjEWwDbm7CQG4=; b=XedzTe+5P/jN8ffQ7bb9qwlAhxl1FNJqqTU7SKLnt7ZF5X+x0HljGnQNPgHwzXsrO0 3uPz9ByPDgZsnMGZNw2VortHTEBDDh7xnxYfOszwLglmgXjeVX7UhywduStgMvQma+ne o5L+uCIwaO6vBJmVbGoBO1PGiWpXhQVcyJ332Ew0B3vPOwQj2PyBuoeytfKaYkZwVWYH P5GXysrwaj1KqrcMxjaHreXG/CG+DX+bwjR9zCiylz76ROX3umHpx5XjcPlgkRqOn7Cv EopshQONTaSDnzPsXJ7L6K3ElfzKuPr0rGVavc9qQH56ZB2dG7ymVrJ/mnjzgaJswRG4 KqJQ==
X-Gm-Message-State: AOAM532bDiGkID5Ke/YsE9a2bsAWkbNPLxPlHn3nM9Pyn9exgJJGvHP3 zdIY1o3BthdeGfvtHvmQ+lZqR7HxIiCoCnXxXyE=
X-Google-Smtp-Source: ABdhPJzYiSjIoahRl6UIsINwQzLmo2JvTRjk3SfPpm8yRf0RbAr9BASE6V90lp3N0XuQ1fj86jmfUCTZdHU2JYC3rHI=
X-Received: by 2002:a2e:9ecd:: with SMTP id h13mr12441281ljk.238.1606082095640; Sun, 22 Nov 2020 13:54:55 -0800 (PST)
MIME-Version: 1.0
References: <E0140570-4164-43C9-9202-2C3C85B8AA69@gmail.com> <aa038039-18f3-a662-b934-8438d639161e@gmail.com>
In-Reply-To: <aa038039-18f3-a662-b934-8438d639161e@gmail.com>
From: Bernard Aboba <bernard.aboba@gmail.com>
Date: Sun, 22 Nov 2020 13:54:45 -0800
Message-ID: <CAOW+2dsn4mMDMCOFjXsZzSL0NMKMby51C9zJ-FgGTVwe3G+p=g@mail.gmail.com>
To: Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com>
Cc: IETF AVTCore WG <avt@ietf.org>
Content-Type: multipart/alternative; boundary="000000000000ca742e05b4b92036"
Archived-At: <https://mailarchive.ietf.org/arch/msg/avt/A5JMCe2VpsSPQswpe32vZGhcP9s>
Subject: Re: [AVTCORE] Call for Framemarking implementation experience
X-BeenThere: avt@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Audio/Video Transport Core Maintenance <avt.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/avt>, <mailto:avt-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/avt/>
List-Post: <mailto:avt@ietf.org>
List-Help: <mailto:avt-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/avt>, <mailto:avt-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 22 Nov 2020 21:55:00 -0000

Sergio --

Did the P/U bit issue in VP9 render framemarking completely unusable with
VP9?  Or were there some set of use cases (e.g. simulcast-only, temporal
scalability only, etc.) in which it still could be useful?  If the P/U
issue had been solved, would the list of VP9 use cases be expanded?

Did you implement support for H.264/AVC with temporal scalability based on
framemarking?  If so, did you consider it usable for that purpose?

Any implementation experience with VP8?

On Sun, Nov 22, 2020 at 1:24 PM Sergio Garcia Murillo <
sergio.garcia.murillo@gmail.com> wrote:

> I implemented an slightly modified version of an earlier draft of the
> Framemarking on both my SFU and a custom libwebrtc for supporting VP9 SVC
> with perc-lite e2ee:
>
> https://codereview.webrtc.org/2954503002/
>
> https://github.com/murillo128/draft-berger-avtext-framemarking/commit/35cdb229108251f12bc1cdf77909df83a51d3994
>
> I don't think we ever got to solve the question about the P/U bits on the
> vp9 payload draft:
>
> https://mailarchive.ietf.org/arch/msg/avtext/ntfDsjMJjuruDPenp6-w0k0__Rk/
>
> I plan to remove the framemarking code soon as it is no longer needed for
> SFrame with standard VP9 packetization and not supported by libwebrtc for
> other codecs neither (h264 with temporal scalability was a nice feature
> though).
>
> Best regards
> Sergio
>
>
> On 22/11/2020 16:24, Bernard Aboba wrote:
>
> During WGLC, questions were raised about implementation experience with
> draft-IETF-AVTEXT-framemarking. If you have implemented the specification,
> please respond to this thread with your observations.
>
> Some notes relating to WebRTC.org:
>
> Frame marking support (-07) appears to have been first added to the
> WebRTC.org implementation in 2017:
> https://codereview.webrtc.org/2954503002/
> https://bugs.chromium.org/p/webrtc/issues/detail?id=7765
>
> The commits refer appears to support temporal scalability with H.264/AVC.
>
> In 2019 support was added to the H.264 receiver in Chrome M76:
> https://groups.google.com/g/discuss-webrtc/c/Y7TIuNbgP8M/m/UoXP-RuxAwAJ
>
> In March 2020, Issue 7765 on support for framemarking was closed as ‘won’t
> fix’.
>
> A security issue was found in April 8, 2020:
> https://bugs.chromium.org/p/chromium/issues/detail?id=1042933
>
> Framemarking support was removed from WebRTC.org in June, 2020 and from
> Chrome starting in M85:
> http://bugs.webrtc.org/11637
>
>
>
>
>
>
> _______________________________________________
> Audio/Video Transport Core Maintenanceavt@ietf.orghttps://www.ietf.org/mailman/listinfo/avt
>
>
> _______________________________________________
> Audio/Video Transport Core Maintenance
> avt@ietf.org
> https://www.ietf.org/mailman/listinfo/avt
>