IETF Logo Mail Archive

Re: [AVTCORE] Proposed addition to VP9 RTP payload: advance signaling of inter-layer dependency

Alexandre GOUAILLARD <agouaillard@gmail.com> Wed, 10 June 2020 11:10 UTC

Return-Path: <agouaillard@gmail.com>
X-Original-To: avt@ietfa.amsl.com
Delivered-To: avt@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 338783A0926 for <avt@ietfa.amsl.com>; Wed, 10 Jun 2020 04:10:43 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ZlCgVsfCzY9x for <avt@ietfa.amsl.com>; Wed, 10 Jun 2020 04:10:41 -0700 (PDT)
Received: from mail-io1-xd2e.google.com (mail-io1-xd2e.google.com [IPv6:2607:f8b0:4864:20::d2e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 33CBD3A0924 for <avt@ietf.org>; Wed, 10 Jun 2020 04:10:41 -0700 (PDT)
Received: by mail-io1-xd2e.google.com with SMTP id m81so1701606ioa.1 for <avt@ietf.org>; Wed, 10 Jun 2020 04:10:41 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=JVpP8oKymej44Kj+111K9sUCW4VvpQhUHoOz0GEr6Lc=; b=sSrTwfJ2/9HZ5GA4pZ4YjQcWb0XoFdZZ2SIia3u7vgBi0uHWRFVEBnTaHx8plv/vuw 5LS/tmwVsiVtJx93/e+97WKVxOFTUx1HhQ17/N6looF+e8NIsRCoeqFJ0wPNma0UZ+hc WRMNMmzYzpBpYwHos5TWCzTLEMcMFrFAdx96b4J2P7lpZVWblpUBj1/1Zp3BNUWbwCXf HedEHyminNjQxOaIKG/fITBaE4nd05K/jrBoKQ3nRHD4gdtaDegoJh83qAHuxHPGw3CB DAlHLM2nuDcZ6zUWx6uukTeJr0Sc2mfCLel9sCwCsuAGoG19sDM0qm8dsl6rutfE9HEp 8Y/g==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=JVpP8oKymej44Kj+111K9sUCW4VvpQhUHoOz0GEr6Lc=; b=JGRDr0LyiT6LAo5Gr4u+wrQsnMwpwa5mAq7N1u4ylB5BVk0oW+jN/ZkbbWjgR129mw 8KNVQM/kpL0gn3C/x5fVrfs23l9nrVTIr5VHlEJvgiw1oRbEIgdFJgWKHhkDyahN4kcg qJ/LCK3jJdEPjMhjdaI0ceuTAqY1PXO5LP6luIJdUIoJwScNL8pV8k/ghLrKRg4mPZOl /zI5731vl2mU8v/omsF8GxG66IGwtVuXcmWeT04lCbqL/EShOg4u8LWI2nyWFSoNfLuO DMhtanOioMjDFQtD+AJFcGIHDyc4+PVRKmkgDjddiNu9TzHLBQXDU+wIvq+VK0IudLOP olYQ==
X-Gm-Message-State: AOAM532jpc3HpXSPPoaeZeH0WOE5/E/V9zlGnOQYZtRygL8rVgHRH/9m Xnx42wGgU8cWBsU5lA20VvmBEZgmgzxlxTZc5iY=
X-Google-Smtp-Source: ABdhPJzo4TEAViYfCWHkPQ4heaazwAnFYYUxO91Ec0n9YSq/wccsNcyV68Nk+VFE+SzdaCyteriYkNkJwN9bk65pvFw=
X-Received: by 2002:a6b:e60e:: with SMTP id g14mr2726538ioh.141.1591787440508; Wed, 10 Jun 2020 04:10:40 -0700 (PDT)
MIME-Version: 1.0
References: <664C0F98-7017-4F3B-8D74-A3D88EE6671B@8x8.com>
In-Reply-To: <664C0F98-7017-4F3B-8D74-A3D88EE6671B@8x8.com>
From: Alexandre GOUAILLARD <agouaillard@gmail.com>
Date: Wed, 10 Jun 2020 13:10:29 +0200
Message-ID: <CAHgZEq6KVbGBOZg_pLVFTcJ-Xe-1wCFnSKmFeCXfyJU8_8kwow@mail.gmail.com>
To: Jonathan Lennox <jonathan.lennox@8x8.com>
Cc: avt@ietf.org, Sergey Silkin <ssilkin@google.com>
Content-Type: multipart/alternative; boundary="000000000000f3139e05a7b8e473"
Archived-At: <https://mailarchive.ietf.org/arch/msg/avt/FBCGsw0uhh9pfpzjcfNgyq3uJu0>
Subject: Re: [AVTCORE] Proposed addition to VP9 RTP payload: advance signaling of inter-layer dependency
X-BeenThere: avt@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Audio/Video Transport Core Maintenance <avt.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/avt>, <mailto:avt-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/avt/>
List-Post: <mailto:avt@ietf.org>
List-Help: <mailto:avt-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/avt>, <mailto:avt-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 10 Jun 2020 11:10:43 -0000

+1 support.

On Tue, Jun 9, 2020 at 11:27 PM Jonathan Lennox <jonathan.lennox@8x8.com>
wrote:

> Hi, all —
>
> Sergey Silkin of Google has proposed an addition to the VP9 RTP payload.
>
> The problem he’s observed is that when a lower spatial layer frame of a
> picture is not used for prediction by a higher layer, in the current spec
> it’s only possible to know this when the higher-layer frame is received
> (based on its “D” bit).  This means that if a middlebox or decoder would
> need to buffer the packets of the lower-layer frame in order to decide
> reliably whether or not it needs to be relayed or decoded.
>
> Sergey’s proposal (with some wording tweaks by me) is to use the
> currently-reserved bit in the first byte of the VP9 payload header as a “Z”
> byte, defined as:
>
>           Z: Not a reference frame for upper spatial
>           layers. If set to 1, indicates that frames with higher
>           spatial layers SID+1 of the current and following pictures
>           do not depend on the current spatial layer SID frame.  This
>           enables a decoder which is targeting a higher spatial layer
>           to know that it can safely discard this packet's frame
>           without processing it, without having to wait for the "D"
>           bit in the higher-layer frame (see below).
>
> This has been implemented (and is being used) in Chrome, which is by far
> the dominant VP9 RTP payload implementation.
>
> As this solves a real problem and is being used in running code, my
> inclination is to add it to the spec. Are there any objections?
>
> The pull request to add this to the spec is at
> https://github.com/juberti/draughts/pull/117 .
>
> Jonathan Lennox
> (Writing as document editor)
>
> _______________________________________________
> Audio/Video Transport Core Maintenance
> avt@ietf.org
> https://www.ietf.org/mailman/listinfo/avt
>


-- 
Alex. Gouaillard, PhD, PhD, MBA
------------------------------------------------------------------------------------
President - CoSMo Software Consulting, Singapore
------------------------------------------------------------------------------------
sg.linkedin.com/agouaillard

   -

v2.23.0 | Report a Bug | By Email