[avtext] Frame marking & VP9 SVC

Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com> Tue, 28 March 2017 13:54 UTC

Return-Path: <sergio.garcia.murillo@gmail.com>
X-Original-To: avtext@ietfa.amsl.com
Delivered-To: avtext@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A00CB128DF3 for <avtext@ietfa.amsl.com>; Tue, 28 Mar 2017 06:54:31 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level:
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id iaja97g_EWNe for <avtext@ietfa.amsl.com>; Tue, 28 Mar 2017 06:54:28 -0700 (PDT)
Received: from mail-wr0-x230.google.com (mail-wr0-x230.google.com [IPv6:2a00:1450:400c:c0c::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 47A4F128ACA for <avtext@ietf.org>; Tue, 28 Mar 2017 06:54:27 -0700 (PDT)
Received: by mail-wr0-x230.google.com with SMTP id u1so106584765wra.2 for <avtext@ietf.org>; Tue, 28 Mar 2017 06:54:27 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=to:from:subject:message-id:date:user-agent:mime-version; bh=Xm/zh9cscRkGpY66g6ROKM+RbJe2tIPeRu6s+kP6DZo=; b=MSQrc73VUIE7NbLSW6nwbM49YZx4caqJ53eSRQtimHB8WOd6Lie3scz6/Uy+8OXHYM 1rDyqN25dGGRhdhuczcZ/v9L1Ru/Gp4ON8RSthDV48IbPmoSyeikd/FY5aEFMCn74NGG bp3dde2NJJ0br6oULn2W4oQU3ptzXHTBGImh5IwGOiWeRmZp9nNenkzYc23tOoKpAGik pPdNRosrUFEPs4zsKWgmCuLzl3i5JWZ0lAJSlfGYSJ944TE/jGQWORSAc8FprzBT3jsI ova6bANOB1VYYUkujMysBnhNnplDpRReukRn1LLONrZZZCjsFp4RpEdwJS4VQ/YKTeWS c83Q==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version; bh=Xm/zh9cscRkGpY66g6ROKM+RbJe2tIPeRu6s+kP6DZo=; b=Lj7aRry+JbsTiSGcrmaqFp8oLEZ2vtfvLaCPXLi8OYIbpeOJcyy6KUTEYWUZAdssIB gWuq9kwnBW2qcVvkeMvw4piizg100AAcAJDIes5SA5kfFGrcPu2DT8gvaE7WVJ2KZ9xo 1E3BitTQEW2MYf0LtcehDZfw4OHC/d79pRUyl0PtQSRVaDPM2tNzZrKWs4e/0+VSWDcs GYedYzb/WO9a5u9vVtRWXrIYlMsjN3kMgD7sTOA5mtLC+RD2WPu7Qcs2Ed+Uc74SSKft 50+I+X4tcHbikFwkI2FNWr2tSFvT94eTG+f8EEo2FkoQ4No75zioYUw0MSosRlS9GcXw xoyw==
X-Gm-Message-State: AFeK/H3NwgAo+I45fE3YT4Z9V3WKreU+LDjNZdyNw8+dENGcSzEcImImYiLYl4VMO6fppw==
X-Received: by 10.28.63.71 with SMTP id m68mr4206104wma.46.1490709265479; Tue, 28 Mar 2017 06:54:25 -0700 (PDT)
Received: from [192.168.1.37] (148.red-79-153-126.dynamicip.rima-tde.net. [79.153.126.148]) by smtp.googlemail.com with ESMTPSA id g23sm3748735wme.8.2017.03.28.06.54.24 for <avtext@ietf.org> (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 28 Mar 2017 06:54:24 -0700 (PDT)
To: avtext@ietf.org
From: Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com>
Message-ID: <ebdc7854-b390-d0e4-cfd1-d7df9c65aba4@gmail.com>
Date: Tue, 28 Mar 2017 15:54:24 +0200
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="------------271F95B27B4A1BAFFA14FA03"
Archived-At: <https://mailarchive.ietf.org/arch/msg/avtext/fHlbwH7kjw-ISrqbZhPtYZXnz38>
Subject: [avtext] Frame marking & VP9 SVC
X-BeenThere: avtext@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Audio/Video Transport Extensions working group discussion list <avtext.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/avtext>, <mailto:avtext-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/avtext/>
List-Post: <mailto:avtext@ietf.org>
List-Help: <mailto:avtext-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/avtext>, <mailto:avtext-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 28 Mar 2017 13:54:32 -0000

Hi,

I have been implementing the framemarking for PERC and I have some 
doubts regarding the VP9 LID mapping.

First, is that according to 
https://tools.ietf.org/html/draft-ietf-payload-vp9-03 there are no 
quality layers on VP9 SVC they are considered as case of spatial layers:

    VP9 supports quality layers as spatial layers without any resolution
    changes; hereinafter, the term "spatial layer" is used to represent
    both spatial and quality layers.

So, shouldn't the LID reference to the spatial layer ID only  and omit 
the quality layer id completely? Also, the spatial layer id is 3 bits on 
that draft.

Also, in order to be able to implement VP9 SVC layer selection, the SFU 
needs the information of the P and U bits of the VP9 header description:

    P: Inter-picture predicted layer frame.  When set to zero, the layer
       frame does not utilize inter-picture prediction.  In this case,
       up-switching to current spatial layer's frame is possible from
       directly lower spatial layer frame.  P SHOULD also be set to zero
       when encoding a layer synchronization frame in response to an LRR
       [I-D.ietf-avtext-lrr 
<https://tools.ietf.org/html/draft-ietf-payload-vp9-03#ref-I-D.ietf-avtext-lrr>] message (seeSection 5.4 
<https://tools.ietf.org/html/draft-ietf-payload-vp9-03#section-5.4>).  When P is set to
       zero, the T bit (described below) MUST also be set to 0 (if
       present).

    U: Switching up point.  If this bit is set to 1 for the current
       frame with temporal layer ID equal to T, then "switch up" to a
       higher frame rate is possible as subsequent higher temporal
       layer frames will not depend on any frame before the current
       frame (in coding time) with temporal layer ID greater than T.


Without that info, the SFU won't be able to upscale, so it would be 
required to add that information on the VP9 LID.
Including that changes, it would be something like this:

     0                   1                   2                   3
     0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
    +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
    |  ID=2 |  L=2  |S|E|I|D|B| TID |0|0|0|P|U|SID  |    TL0PICIDX  |
    +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+


Best regards
Sergio