Re: [rtcweb] New VP8 vs H.264 tests uploaded

Luca De Cicco <ldecicco@gmail.com> Thu, 04 April 2013 13:59 UTC

Return-Path: <ldecicco@gmail.com>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0EE7B21F8BD4 for <rtcweb@ietfa.amsl.com>; Thu, 4 Apr 2013 06:59:50 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.6
X-Spam-Level:
X-Spam-Status: No, score=-2.6 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, NO_RELAYS=-0.001]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qnwWT8bMGntz for <rtcweb@ietfa.amsl.com>; Thu, 4 Apr 2013 06:59:49 -0700 (PDT)
Received: from mail-ob0-x234.google.com (mail-ob0-x234.google.com [IPv6:2607:f8b0:4003:c01::234]) by ietfa.amsl.com (Postfix) with ESMTP id 4212F21F8BC0 for <rtcweb@ietf.org>; Thu, 4 Apr 2013 06:59:49 -0700 (PDT)
Received: by mail-ob0-f180.google.com with SMTP id wo10so2501305obc.25 for <rtcweb@ietf.org>; Thu, 04 Apr 2013 06:59:48 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:cc:content-type:content-transfer-encoding; bh=hDg78hyUfXKCzEOWRaQpoqjTjWoDSwrWqzovMdoarBA=; b=vI6bFi3wFV3HeFLlitmnmwSBItgR9vTg2WeudAmc0VcmOLsFICHXiJ3ZVRdn588rCx l5WGUuIFnlZ/FSPCfvg3HdMWQU1/ssJVl5767XwJRw6kyX+1TVxN9DlS8cyMJvh8C09q QDCto0ONmtFJSPuIMfo/jw15pZSgtiHeSJoPpKrcqQJA44/GRDQqRB4Bid598wLk5x+K T6DyvvA7+0bWIe5aS05wMsnf44CLJdImmly5lr1Ry650hSrUunOmfhGm2sVKYurtaf7J vBhdeNc7QIMQuQSMjjXNMWysjwe+9VRoatQtufyMUGOcZ5E1QdP3knI/dnJREgoIbwOd 9Aow==
MIME-Version: 1.0
X-Received: by 10.182.131.4 with SMTP id oi4mr4331731obb.64.1365083988827; Thu, 04 Apr 2013 06:59:48 -0700 (PDT)
Received: by 10.76.122.46 with HTTP; Thu, 4 Apr 2013 06:59:48 -0700 (PDT)
In-Reply-To: <515D8087.6080409@alvestrand.no>
References: <CAPVCLWbajJNS-DbXS-AJjakwovBKhhpXAmBaR_LYKjCyk7UnYg@mail.gmail.com> <515D3FA1.6050305@gmail.com> <515D8087.6080409@alvestrand.no>
Date: Thu, 04 Apr 2013 15:59:48 +0200
Message-ID: <CACHLvefcbhRZpmAjsa71bpW6Cm+shL4mZAkf2_j85vwx0vLG_A@mail.gmail.com>
From: Luca De Cicco <ldecicco@gmail.com>
To: Harald Alvestrand <harald@alvestrand.no>
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: quoted-printable
Cc: "rtcweb@ietf.org" <rtcweb@ietf.org>
Subject: Re: [rtcweb] New VP8 vs H.264 tests uploaded
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 04 Apr 2013 13:59:50 -0000

Why did you use baseline instead of mainline or highline for x264? It
should be better to compare
vp8 at least with the mainline profile.

Cheers,
Luca

On Thu, Apr 4, 2013 at 3:30 PM, Harald Alvestrand <harald@alvestrand.no> wrote:
> On 04/04/2013 10:53 AM, Sergio Garcia Murillo wrote:
>
> Hi Adrian,
>
> Could you explain how the encoding parametrization is comparable?
>
> x264 --nal-hrd cbr --vbv-maxrate ${rate} --vbv-bufsize ${rate} \
>       --vbv-init 0.8 --bitrate ${rate} --fps ${frame_rate} \
>       --profile baseline --no-scenecut --keyint infinite --preset veryslow \
>       --input-res ${width}x${height} \
>       --tune psnr \
>       -o ./encoded_clips/h264/${clip_stem}_${rate}kbps.mkv ${filename} \
>       2> ./logs/h264/${clip_stem}_${rate}kbps.txt
>
> vs:
>
>  ./bin/vpxenc --lag-in-frames=0 --target-bitrate=${rate} --kf-min-dist=3000
> \
>       --kf-max-dist=3000 --cpu-used=0 --fps=${frame_rate}/1
> --static-thresh=0 \
>       --token-parts=1 --drop-frame=0 --end-usage=cbr --min-q=2 --max-q=56 \
>       --undershoot-pct=100 --overshoot-pct=15 --buf-sz=1000 \
>       --buf-initial-sz=800 --buf-optimal-sz=1000 --max-intra-rate=1200 \
>       --resize-allowed=0 --drop-frame=0 --passes=1 --good
> --noise-sensitivity=0 \
>       -w ${width} -h ${height} ${filename} --codec=vp8 \
>       -o ./encoded_clips/vp8/${clip_stem}_${rate}kbps.webm \
>       &>./logs/vp8/${clip_stem}_${rate}kbps.txt
>
>
> Both have the same target bitrate and the same resolution, and neither
> generates periodic keyframes.
>
> Apart from that, I think they are comparable by virtue of being the
> parameters that were recommended for this test by people who like this
> particular codec implementation.
>
> Was there any specific parameter or parameter set you were wondering about?
>
>
>
>
> Best regards
> Sergio
>
> El 03/04/2013 18:20, Adrian Grange escribió:
>
> We have uploaded a new set of test results comparing VP8 to H.264. This
> latest set contains fixes for some of the problems in the previous set. We
> would like to extend our thanks to those who made suggestions as to how we
> could improve our methodology and encourage suggestions as to how we can
> make further improvements.
>
> In these tests we run x264 with the "veryslow" preset and VP8 with the
> "good, speed 0" setting in an attempt to produce comparable results.
>
> An overview of our results is available as follows:
>
> - A Quality comparison (psnr):
> http://downloads.webmproject.org/ietf_tests/vp8_vs_h264_quality.html
>
> - An Encode Speed comparison:
> http://downloads.webmproject.org/ietf_tests/vp8_vs_h264_speed.html
>
> - A comparison of the aggregate time required to decode all of the clips in
> the test:
> http://downloads.webmproject.org/ietf_tests/vp8vsh264-decodetime.txt
>
> All of our test scripts can either be downloaded from:
> http://downloads.webmproject.org/ietf_tests/vp8_vs_h264.tar.xz
> or checked out of our git/gerrit repository:
> git clone http://git.chromium.org/webm/vpx_codec_comparison.git
>
> The file README.txt, contained within, presents details of how to build and
> run the tests.
>
> The compressed video files--the output from the quality tests--can also be
> downloaded:
>
> VP8:
> http://downloads.webmproject.org/ietf_tests/vp8_videos/index.html
>
> H.264:
> http://downloads.webmproject.org/ietf_tests/h264_videos/index.html
>
> Adrian Grange
>
>
>
>
>
>
>
> _______________________________________________
> rtcweb mailing list
> rtcweb@ietf.org
> https://www.ietf.org/mailman/listinfo/rtcweb
>
>
>
>
> _______________________________________________
> rtcweb mailing list
> rtcweb@ietf.org
> https://www.ietf.org/mailman/listinfo/rtcweb
>
>
>
> _______________________________________________
> rtcweb mailing list
> rtcweb@ietf.org
> https://www.ietf.org/mailman/listinfo/rtcweb
>