Re: [rtcweb] VP8 vs H.264 - subjective evaluation

Basil Mohamed Gohar <basilgohar@librevideo.org> Wed, 23 October 2013 13:32 UTC

Return-Path: <basilgohar@librevideo.org>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BB53511E83F4 for <rtcweb@ietfa.amsl.com>; Wed, 23 Oct 2013 06:32:26 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.599
X-Spam-Level:
X-Spam-Status: No, score=-2.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id HANm5mFFKe1G for <rtcweb@ietfa.amsl.com>; Wed, 23 Oct 2013 06:32:21 -0700 (PDT)
Received: from mail.zaytoon.hidayahonline.net (zaytoon.hidayahonline.net [173.193.202.83]) by ietfa.amsl.com (Postfix) with ESMTP id 5F8C411E8408 for <rtcweb@ietf.org>; Wed, 23 Oct 2013 06:32:20 -0700 (PDT)
Received: from [10.10.40.120] (rrcs-98-103-138-67.central.biz.rr.com [98.103.138.67]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: basilgohar@librevideo.org) by mail.zaytoon.hidayahonline.net (Postfix) with ESMTPSA id 5102065AD55 for <rtcweb@ietf.org>; Wed, 23 Oct 2013 09:32:19 -0400 (EDT)
Message-ID: <5267CFE0.6040300@librevideo.org>
Date: Wed, 23 Oct 2013 09:32:16 -0400
From: Basil Mohamed Gohar <basilgohar@librevideo.org>
Organization: Libre Video
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130625 Thunderbird/17.0.7
MIME-Version: 1.0
To: rtcweb@ietf.org
References: <52665274.9080705@alvestrand.no> <52671AF7.5040107@librevideo.org> <5267882B.4060906@alvestrand.no>
In-Reply-To: <5267882B.4060906@alvestrand.no>
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: 7bit
Subject: Re: [rtcweb] VP8 vs H.264 - subjective evaluation
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 23 Oct 2013 13:32:27 -0000

On 10/23/2013 04:26 AM, Harald Alvestrand wrote:
> On 10/23/2013 02:40 AM, Basil Mohamed Gohar wrote:
>> On 10/22/2013 06:24 AM, Harald Alvestrand wrote:
>>> In my VP8 advocate draft, I referred to a subjective evaluation test
>>> (test with
>>> actual human viewers) done between VP8 and H.264 Baseline by a neutral
>>> (non-Google) laboratory.
>>>
>>> The attached presentation is the writeup of the results of that test.
>>>
>> Are the sources used in the video comparison test available anywhere?
>>
> They are under an MPEG license, so they're freely available to MPEG
> members for use in developing MPEG standards. If you fall within that
> category, I can send you the FTP server and password.
> 
> MPEG doesn't have the tradition of open materials that the IETF has.
> 

Well, that's unfortunate.  Thanks for clarifying, though.

It would be nice if, when time permits, a similar test can be made,
using the same criteria (encoding parameters, etc.), but with known
clips (e.g., from derf's collection, which has everything, including
both SD and HD clips).  Publishing the versions and exact encoding
parameters (including command line usage) would be helpful to that aim,
I suppose.

-- 
Libre Video
http://librevideo.org