[video-codec] missing rounding behavior in draft-fuldseth-netvc-thor

Jack Moffitt <jack@metajack.im> Mon, 20 July 2015 12:41 UTC

Return-Path: <metajack@gmail.com>
X-Original-To: video-codec@ietfa.amsl.com
Delivered-To: video-codec@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id EB2E21A7D82 for <video-codec@ietfa.amsl.com>; Mon, 20 Jul 2015 05:41:47 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.278
X-Spam-Level:
X-Spam-Status: No, score=-1.278 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FM_FORGED_GMAIL=0.622, FREEMAIL_FROM=0.001, SPF_PASS=-0.001] autolearn=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id O4pgeBRx-qD0 for <video-codec@ietfa.amsl.com>; Mon, 20 Jul 2015 05:41:47 -0700 (PDT)
Received: from mail-ig0-x22c.google.com (mail-ig0-x22c.google.com [IPv6:2607:f8b0:4001:c05::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 09F8C1A6EDA for <video-codec@ietf.org>; Mon, 20 Jul 2015 05:41:47 -0700 (PDT)
Received: by igbpg9 with SMTP id pg9so80291759igb.0 for <video-codec@ietf.org>; Mon, 20 Jul 2015 05:41:46 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=2QakBGeV4UYzdVDCIgPM9fwvqL/pIdRpcQMcBdDYYdo=; b=l51JHBCTsVDyb34zRy8Lfyh+pIOCtXDAElO08nHZq88qmIRk854s5CaappqWnMPKt9 43/BNi6ChkiUxAI65AwHna0s6ZY0fUOkLoyipFmtE1bON5X5xUDy24MG1EyG3Q4MDdnR W02PWdwR6ABSBHjtLmpARd7XFNX2AJpmUkGzZaYlIRFrPZrokZy2OP7zM4sKIC34YHht gz709GEnOXh6EE/FM6IG6xbPjwk0hLv3T1IV0K5xXjWXkjCU/Nbw9zKIONLcjuuJt9cM Q6s/eDrdVlzPjwos1HZmyYJ5ccoPX2xh+UzF6arH29q/Wy0BS+oo8LVjqOLp4OzBm5L9 QrDA==
MIME-Version: 1.0
X-Received: by 10.50.8.68 with SMTP id p4mr14915853iga.4.1437396106488; Mon, 20 Jul 2015 05:41:46 -0700 (PDT)
Sender: metajack@gmail.com
Received: by 10.79.65.88 with HTTP; Mon, 20 Jul 2015 05:41:46 -0700 (PDT)
Date: Mon, 20 Jul 2015 06:41:46 -0600
X-Google-Sender-Auth: zdhyc7A1tD5CGZDxZ38z9Rbgw1Y
Message-ID: <CAP7VpsWawtVUNHUwgNqf0ESBhurXRBHcS2LR-Huir-JQrBHisg@mail.gmail.com>
From: Jack Moffitt <jack@metajack.im>
To: "video-codec@ietf.org" <video-codec@ietf.org>
Content-Type: text/plain; charset="UTF-8"
Archived-At: <http://mailarchive.ietf.org/arch/msg/video-codec/u9_xAf4U-Fg3Smsfmo0bGJJUeBs>
Subject: [video-codec] missing rounding behavior in draft-fuldseth-netvc-thor
X-BeenThere: video-codec@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Video codec BoF discussion list <video-codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/video-codec>, <mailto:video-codec-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/video-codec/>
List-Post: <mailto:video-codec@ietf.org>
List-Help: <mailto:video-codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/video-codec>, <mailto:video-codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 20 Jul 2015 12:41:48 -0000

In section 8.2 on the constrained lowpass filter, the delta is computed with

Delta = max(-1,min(1,(A+B+C+D-4X+2)>>2))

but the Thor code uses a slightly more complex calculation. The draft
should probably be updated to match the code.

jack.