Re: [rtcweb] New VP8 vs H.264 tests uploaded (UNCLASSIFIED)

Harald Alvestrand <harald@alvestrand.no> Thu, 04 April 2013 18:39 UTC

Return-Path: <harald@alvestrand.no>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D22A021F8EA6 for <rtcweb@ietfa.amsl.com>; Thu, 4 Apr 2013 11:39:20 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -110.599
X-Spam-Level:
X-Spam-Status: No, score=-110.599 tagged_above=-999 required=5 tests=[AWL=0.000, BAYES_00=-2.599, RCVD_IN_DNSWL_HI=-8, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Om3bfN1YyWFu for <rtcweb@ietfa.amsl.com>; Thu, 4 Apr 2013 11:39:20 -0700 (PDT)
Received: from eikenes.alvestrand.no (eikenes.alvestrand.no [158.38.152.233]) by ietfa.amsl.com (Postfix) with ESMTP id C6EC221F8E7E for <rtcweb@ietf.org>; Thu, 4 Apr 2013 11:39:19 -0700 (PDT)
Received: from localhost (localhost [127.0.0.1]) by eikenes.alvestrand.no (Postfix) with ESMTP id D6D6139E116 for <rtcweb@ietf.org>; Thu, 4 Apr 2013 20:39:18 +0200 (CEST)
X-Virus-Scanned: Debian amavisd-new at eikenes.alvestrand.no
Received: from eikenes.alvestrand.no ([127.0.0.1]) by localhost (eikenes.alvestrand.no [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0-CldgYug9VK for <rtcweb@ietf.org>; Thu, 4 Apr 2013 20:39:17 +0200 (CEST)
Received: from hta-dell.lul.corp.google.com (62-20-124-50.customer.telia.com [62.20.124.50]) by eikenes.alvestrand.no (Postfix) with ESMTPSA id 7F4C239E056 for <rtcweb@ietf.org>; Thu, 4 Apr 2013 20:39:17 +0200 (CEST)
Message-ID: <515DC8D5.8030206@alvestrand.no>
Date: Thu, 04 Apr 2013 20:39:17 +0200
From: Harald Alvestrand <harald@alvestrand.no>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130308 Thunderbird/17.0.4
MIME-Version: 1.0
To: rtcweb@ietf.org
References: <CAPVCLWbajJNS-DbXS-AJjakwovBKhhpXAmBaR_LYKjCyk7UnYg@mail.gmail.com> <515D3FA1.6050305@gmail.com> <515D96A2.1000602@cisco.com> <CAGgHUiRLAmGz7H5iY_cpiiKPPN6JXo1jc2-U7TZLe6k-qETo9Q@mail.gmail.com> <8486C8728176924BAF5BDB2F7D7EEDDF49A706CD@ucolhp9b.easf.csd.disa.mil> <9C2FAEDF6B678042ADE3B6686D7C6E150F8A7726@xmb-rcd-x07.cisco.com>
In-Reply-To: <9C2FAEDF6B678042ADE3B6686D7C6E150F8A7726@xmb-rcd-x07.cisco.com>
Content-Type: text/plain; charset="ISO-8859-1"; format="flowed"
Content-Transfer-Encoding: 7bit
Subject: Re: [rtcweb] New VP8 vs H.264 tests uploaded (UNCLASSIFIED)
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 04 Apr 2013 18:39:21 -0000

On 04/04/2013 08:23 PM, Thomas Davies (thdavies) wrote:
> The single-core encode speed I get from these settings is <5fps for the example I chose (which is one of the data points), so these are *not* real time tests.
>
> My understanding is that Google have selected a non-real-time encoding mode to show the capabilities of the VP8 technology and attempted to do the same with x264, hence the --tune veryslow parameter.

One of the tests we provide is a comparision of the encode time vs 
quality for the two codecs.
Of course this one varies a LOT even between different developers' 
machines (the absolute numbers, that is) - machines are very different 
in how fast they encode. Try it out!

>
> Best regards
>
> Thomas
>
> -----Original Message-----
> From: Roy, Radhika R CIV USARMY (US) [mailto:radhika.r.roy.civ@mail.mil]
> Sent: 04 April 2013 18:03
> To: Leon Geyser; Thomas Davies (thdavies)
> Cc: rtcweb@ietf.org
> Subject: RE: [rtcweb] New VP8 vs H.264 tests uploaded (UNCLASSIFIED)
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Yes, real-time applications (i.e. two-way or multipoint conversation)
> performance requirements are fundamentally much more stringent than those of
> the near-real-time (i.e. video streaming)/nor-real-time applications.
>
> So, settings for testing for each one of those applications must be done
> accordingly.
>
> Best regards,
> Radhika
>
> -----Original Message-----
> From: rtcweb-bounces@ietf.org [mailto:rtcweb-bounces@ietf.org] On Behalf Of
> Leon Geyser
> Sent: Thursday, April 04, 2013 12:56 PM
> To: Thomas Davies
> Cc: rtcweb@ietf.org
> Subject: Re: [rtcweb] New VP8 vs H.264 tests uploaded
>
> 	If the purpose is to show whether vp8 is superior as a *technology*
> to h264 CBP, then I think the comparison should use the best settings you
> have (ideally with a special full-on non-real time implementation) and test
> against the JM reference encoder. Ideally you would use the same or similar
> GOP structures, number of references, prediction and QP hierarchies.
> 	
>
> I thought WebRTC was meant for real-time communication. What would it
> benefit us if we test settings that won't be used or can't be used in
> practice?
>
> The tests need to test the encoders at realtime/low latency and at a
> constrained bitrate mode like CBR. We aren't archiving videos here :)
>
> A graph that shows the bitrate over time for each clip could be usefull to
> make sure that no encoder spikes the bitrate too high at certain moments.
> I welcome changes to the encoder settings as long as they stay realtime/low
> latency and constrained bitrate.
>   
> On 4 April 2013 17:05, Thomas Davies <thdavies@cisco.com> wrote:
>
>
> 	Harald,
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> _______________________________________________
> rtcweb mailing list
> rtcweb@ietf.org
> https://www.ietf.org/mailman/listinfo/rtcweb