Re: [rtcweb] Video codec quality evaluations (Re: Agenda time request for draft-dbenham-webrtcvideomti)

Gaelle Martin-Cocher <gmartincocher@rim.com> Thu, 28 February 2013 22:55 UTC

Return-Path: <prvs=077171ed94=gmartincocher@rim.com>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 91B9221F89C0 for <rtcweb@ietfa.amsl.com>; Thu, 28 Feb 2013 14:55:44 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -5.203
X-Spam-Level:
X-Spam-Status: No, score=-5.203 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, MIME_QP_LONG_LINE=1.396, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id c5bbpi9p0gLD for <rtcweb@ietfa.amsl.com>; Thu, 28 Feb 2013 14:55:43 -0800 (PST)
Received: from mhs060cnc.rim.net (mhs060cnc.rim.net [208.65.73.34]) by ietfa.amsl.com (Postfix) with ESMTP id 84A9821F89B5 for <rtcweb@ietf.org>; Thu, 28 Feb 2013 14:55:43 -0800 (PST)
X-AuditID: 0a41282f-b7f456d0000006c9-5b-512fe066eba4
Received: from XCT108CNC.rim.net (xct108cnc.rim.net [10.65.161.208]) by mhs060cnc.rim.net (SBG) with SMTP id B9.A0.01737.660EF215; Thu, 28 Feb 2013 16:55:34 -0600 (CST)
Received: from XCT115CNC.rim.net (10.65.161.215) by XCT108CNC.rim.net (10.65.161.208) with Microsoft SMTP Server (TLS) id 14.2.328.9; Thu, 28 Feb 2013 17:55:34 -0500
Received: from XMB106BCNC.rim.net ([fe80::99b8:8d0e:cdcd:c00d]) by XCT115CNC.rim.net ([::1]) with mapi id 14.02.0328.009; Thu, 28 Feb 2013 17:55:33 -0500
From: Gaelle Martin-Cocher <gmartincocher@rim.com>
To: Harald Alvestrand <harald@alvestrand.no>
Thread-Topic: [rtcweb] Video codec quality evaluations (Re: Agenda time request for draft-dbenham-webrtcvideomti)
Thread-Index: AQHOFcjDTigXDSswI0yAtDwbUIIW7JiPu3gAgABv2wD//7QVUA==
Date: Thu, 28 Feb 2013 22:55:32 +0000
Message-ID: <92D0D52F3A63344CA478CF12DB0648AA265264DE@XMB106BCNC.rim.net>
References: <CD5381E5.95C4C%stewe@stewe.org> <512F7840.6070407@alvestrand.no> <92D0D52F3A63344CA478CF12DB0648AA26526250@XMB106BCNC.rim.net> <512FD7B6.8090009@alvestrand.no>
In-Reply-To: <512FD7B6.8090009@alvestrand.no>
Accept-Language: fr-FR, en-CA, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [10.65.160.249]
Content-Type: text/plain; charset="iso-8859-1"
content-transfer-encoding: quoted-printable
MIME-Version: 1.0
X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFrrNKsWRmVeSWpSXmKPExsXC5bjwgm7aA/1Ag4uztSyO9XWxWaz9187u wORxZcIVVo8lS34yBTBFNTDaJCWWlAVnpufp29kk5uXllySWpCqkpBYn2yr5pKYn5igEFGWW JSZXKrhkFifnJGbmphYpKWSm2CqZKCkU5CQmp+am5pXYKiUWFKTmpSjZcSlgABugssw8hdS8 5PyUzLx0WyXPYH9dCwtTS11DJTvdhE6ejPlPX7AXnJataJ8zmamB8Y94FyMnh4SAicT8FxuY IWwxiQv31rN1MXJxCAmsYpRYtGYCI4SzklHi58lOFghnLqNE/8E2JpAWNgEjiRknfoHZIgI6 Eg/3N4DZzALqEncWn2MHsYUFiiR+/bjGDlFTLNF+4CcjhO0ksXnlTLB6FgFViRfz/oPZvAKe EhOa90Et28QoMat/LliCU0BXYsLxA0DNHByMAioSJ5+GQ+wSl7j1ZD4TxAsCEkv2nId6R1Ti 5eN/rBC2osTeZ0ehbtOTuDF1ChuErS2xbOFrZoi9ghInZz5hAbGFBJQkWr+eZ5oAtB3JillI 2mchaZ+FpH0BI8sqRsHcjGIDM4PkvGS9osxcvbzUkk2M4NSiob+D8e17i0OMAhyMSjy8P67q BwqxJpYVV+YeYpTgYFYS4S2/BxTiTUmsrEotyo8vKs1JLT7E6AoMoYnMUtzJ+cC0l1cSb2xg gJujJM4rEigaKCSQDkxk2ampBalFMHOYODhB9nBJiRQD01FqUWJpSUY8KGnGFwPTplQD4xF+ BrHXPvc2fnqzzELhZczNHemyi3atWO9ayyNmuz7z6zuDPxf7Ew0WvG9M3Nics70pYbfYy8Mz WN8/uDrjicsupp3tlTmHbVlsp/xvMghzEWl9d88mWPrqhl1MtuoJj29m6EysNnqr7tuRK/B+ 3fQPOTvevrkv/2W/1DLBO/53bRXFcz7m7lBiKc5INNRiLipOBAAnH6VJbgMAAA==
Cc: "rtcweb@ietf.org" <rtcweb@ietf.org>
Subject: Re: [rtcweb] Video codec quality evaluations (Re: Agenda time request for draft-dbenham-webrtcvideomti)
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 28 Feb 2013 22:55:44 -0000

Thanks Harald,

:-)
It will be indeed interesting to have the full set of results.
I think the request of MPEG in resolution 14.1.3 is relevant as well to the discussion happening on this list too. 
Would you be in a position to provide an answer in Orlando?
That could help resolve the MTI selection.

Sincerely,
Gaëlle

-----Original Message-----
From: Harald Alvestrand [mailto:harald@alvestrand.no] 
Sent: Thursday, February 28, 2013 5:19 PM
To: Gaelle Martin-Cocher
Cc: rtcweb@ietf.org
Subject: Re: [rtcweb] Video codec quality evaluations (Re: Agenda time request for draft-dbenham-webrtcvideomti)

On 02/28/2013 09:50 PM, Gaelle Martin-Cocher wrote:

Good to hear from you here too, Gaelle!
> Harald,
>
> You may want to clarify that the document you provided is not a report but an input document, and a later revision corrected the source of it.
Yes, the "Source: AGH on IVC" was both wrong and misspelled!

The source was the three named individuals; it was provided as input to the meeting.
> Further tests and comparisons happen at that meeting (not necessarily very conclusive) and has pointed out by Rob, further tests for the next mpeg meeting were requested. Resolution 14.1.2 is pretty clear .

Yep, we're working on it as we speak; they will be ready by the April 
meeting. But not before Orlando!

>
> Sincerely,
> Gaelle
>
> -----Original Message-----
> From: rtcweb-bounces@ietf.org [mailto:rtcweb-bounces@ietf.org] On Behalf Of Harald Alvestrand
> Sent: Thursday, February 28, 2013 10:31 AM
> To: rtcweb@ietf.org
> Subject: [rtcweb] Video codec quality evaluations (Re: Agenda time request for draft-dbenham-webrtcvideomti)
>
> Sigh. I thought that after the drubbing draft-dbenham-webrtcvideomti got at the previous meeting, the authors would have either improved the attempts at quality evaluation or removed them.
>
> It seemed to me that there was rough consensus on the mailing list earlier that the quality of the two codecs was close enough that this was not going to convince anyone who had already taken a strong position based on the IPR issues.
>
> But if we are going to play the video codec quality evaluation game, I also have something I want to have on file here.
>
> Google has submitted VP8 as a candidate for standardization in ISO/IEC
> JTC1 SC29 WG11 (better known as MPEG). As part of that submission, we submitted a quantitative evaluation of VP8's quality compared to the then-current "IVC Test Model", which also included numbers compared to the AVC Baseline "anchors" that were part of the project description for the IVC effort.
>
> This was contributed to MPEG's January meeting in Geneva; the decision at that meeting was to continue the evaluation effort, with new data being made available before the next meeting in April.
>
> I'm enclosing the report with the test results; the tests were not done by Google; the scripts are available if anyone wants to run them for themselves.
>
>                          Harald
>
>
> ---------------------------------------------------------------------
> This transmission (including any attachments) may contain confidential information, privileged material (including material protected by the solicitor-client or other applicable privileges), or constitute non-public information. Any use of this information by anyone other than the intended recipient is prohibited. If you have received this transmission in error, please immediately reply to the sender and delete this information from your system. Use, dissemination, distribution, or reproduction of this transmission by unintended recipients is not authorized and may be unlawful.


---------------------------------------------------------------------
This transmission (including any attachments) may contain confidential information, privileged material (including material protected by the solicitor-client or other applicable privileges), or constitute non-public information. Any use of this information by anyone other than the intended recipient is prohibited. If you have received this transmission in error, please immediately reply to the sender and delete this information from your system. Use, dissemination, distribution, or reproduction of this transmission by unintended recipients is not authorized and may be unlawful.