Re: [rtcweb] New VP8 vs H.264 tests uploaded (UNCLASSIFIED)

"Roy, Radhika R CIV USARMY (US)" <radhika.r.roy.civ@mail.mil> Thu, 04 April 2013 17:02 UTC

Return-Path: <radhika.r.roy.civ@mail.mil>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 13D0121F8F43 for <rtcweb@ietfa.amsl.com>; Thu, 4 Apr 2013 10:02:58 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.599
X-Spam-Level:
X-Spam-Status: No, score=-2.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ys-BxCTlWyBC for <rtcweb@ietfa.amsl.com>; Thu, 4 Apr 2013 10:02:57 -0700 (PDT)
Received: from edge-cols.mail.mil (edge-cols.mail.mil [131.64.100.6]) by ietfa.amsl.com (Postfix) with ESMTP id 445C821F8F03 for <rtcweb@ietf.org>; Thu, 4 Apr 2013 10:02:56 -0700 (PDT)
Received: from UCOLHP3Q.easf.csd.disa.mil (131.64.100.156) by UCOLHP4Z.easf.csd.disa.mil (131.64.100.6) with Microsoft SMTP Server (TLS) id 14.2.309.2; Thu, 4 Apr 2013 17:02:46 +0000
Received: from UCOLHP9B.easf.csd.disa.mil ([169.254.10.116]) by UCOLHP3Q.easf.csd.disa.mil ([131.64.100.156]) with mapi id 14.03.0123.003; Thu, 4 Apr 2013 17:02:44 +0000
From: "Roy, Radhika R CIV USARMY (US)" <radhika.r.roy.civ@mail.mil>
To: Leon Geyser <lgeyser@gmail.com>, Thomas Davies <thdavies@cisco.com>
Thread-Topic: [rtcweb] New VP8 vs H.264 tests uploaded (UNCLASSIFIED)
Thread-Index: AQHOMUYMTI22SrfPpk2Gq2sQBPgFY5jGR+EAgAAAziA=
Date: Thu, 04 Apr 2013 17:02:43 +0000
Message-ID: <8486C8728176924BAF5BDB2F7D7EEDDF49A706CD@ucolhp9b.easf.csd.disa.mil>
References: <CAPVCLWbajJNS-DbXS-AJjakwovBKhhpXAmBaR_LYKjCyk7UnYg@mail.gmail.com> <515D3FA1.6050305@gmail.com> <515D96A2.1000602@cisco.com> <CAGgHUiRLAmGz7H5iY_cpiiKPPN6JXo1jc2-U7TZLe6k-qETo9Q@mail.gmail.com>
In-Reply-To: <CAGgHUiRLAmGz7H5iY_cpiiKPPN6JXo1jc2-U7TZLe6k-qETo9Q@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-originating-ip: [131.64.62.4]
Content-Type: multipart/signed; micalg="SHA1"; protocol="application/x-pkcs7-signature"; boundary="----=_NextPart_000_0058_01CE3134.B0076C60"
MIME-Version: 1.0
Cc: "rtcweb@ietf.org" <rtcweb@ietf.org>
Subject: Re: [rtcweb] New VP8 vs H.264 tests uploaded (UNCLASSIFIED)
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 04 Apr 2013 17:02:58 -0000

Classification: UNCLASSIFIED
Caveats: NONE

Yes, real-time applications (i.e. two-way or multipoint conversation)
performance requirements are fundamentally much more stringent than those of
the near-real-time (i.e. video streaming)/nor-real-time applications.

So, settings for testing for each one of those applications must be done
accordingly.

Best regards,
Radhika

-----Original Message-----
From: rtcweb-bounces@ietf.org [mailto:rtcweb-bounces@ietf.org] On Behalf Of
Leon Geyser
Sent: Thursday, April 04, 2013 12:56 PM
To: Thomas Davies
Cc: rtcweb@ietf.org
Subject: Re: [rtcweb] New VP8 vs H.264 tests uploaded

	If the purpose is to show whether vp8 is superior as a *technology*
to h264 CBP, then I think the comparison should use the best settings you
have (ideally with a special full-on non-real time implementation) and test
against the JM reference encoder. Ideally you would use the same or similar
GOP structures, number of references, prediction and QP hierarchies. 
	

I thought WebRTC was meant for real-time communication. What would it
benefit us if we test settings that won't be used or can't be used in
practice?

The tests need to test the encoders at realtime/low latency and at a
constrained bitrate mode like CBR. We aren't archiving videos here :)

A graph that shows the bitrate over time for each clip could be usefull to
make sure that no encoder spikes the bitrate too high at certain moments.
I welcome changes to the encoder settings as long as they stay realtime/low
latency and constrained bitrate.
 
On 4 April 2013 17:05, Thomas Davies <thdavies@cisco.com> wrote:


	Harald,



Classification: UNCLASSIFIED
Caveats: NONE