[rtcweb] Fundamental asymmetry [was Re: New VP8 vs H.264 tests uploaded]

Marc Petit-Huguenin <petithug@acm.org> Thu, 04 April 2013 16:14 UTC

Return-Path: <petithug@acm.org>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5A95F21F942D for <rtcweb@ietfa.amsl.com>; Thu, 4 Apr 2013 09:14:48 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.1
X-Spam-Level:
X-Spam-Status: No, score=-102.1 tagged_above=-999 required=5 tests=[AWL=-0.500, BAYES_00=-2.599, GB_AFFORDABLE=1, NO_RELAYS=-0.001, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0PHMLCiNU+40 for <rtcweb@ietfa.amsl.com>; Thu, 4 Apr 2013 09:14:47 -0700 (PDT)
Received: from implementers.org (implementers.org [IPv6:2604:3400:dc1:41:216:3eff:fe5b:8240]) by ietfa.amsl.com (Postfix) with ESMTP id 8F18E21F9653 for <rtcweb@ietf.org>; Thu, 4 Apr 2013 09:14:46 -0700 (PDT)
Received: from [IPv6:2601:9:4bc0:1f:3956:8dd9:a1c4:336] (unknown [IPv6:2601:9:4bc0:1f:3956:8dd9:a1c4:336]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (Client CN "Marc Petit-Huguenin", Issuer "implementers.org" (verified OK)) by implementers.org (Postfix) with ESMTPS id 1547020453; Thu, 4 Apr 2013 18:14:44 +0200 (CEST)
Message-ID: <515DA6F2.9020209@acm.org>
Date: Thu, 04 Apr 2013 09:14:42 -0700
From: Marc Petit-Huguenin <petithug@acm.org>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0.12) Gecko/20130116 Icedove/10.0.12
MIME-Version: 1.0
To: Adam Roach <adam@nostrum.com>
References: <CAPVCLWbajJNS-DbXS-AJjakwovBKhhpXAmBaR_LYKjCyk7UnYg@mail.gmail.com> <515D977C.6080501@matthew.at> <515D9AE7.4050608@nostrum.com>
In-Reply-To: <515D9AE7.4050608@nostrum.com>
X-Enigmail-Version: 1.4.1
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
Cc: rtcweb@ietf.org
Subject: [rtcweb] Fundamental asymmetry [was Re: New VP8 vs H.264 tests uploaded]
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 04 Apr 2013 16:14:48 -0000

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

On 04/04/2013 08:23 AM, Adam Roach wrote:
> On 4/4/13 10:08, Matthew Kaufman wrote:
>> And if so, would they care what anyone's tests other than their own
>> showed?
> 
> I for one, applaud the approach of publishing the exact tools and options
> used for encoding. Without that kind of transparency, it becomes very
> difficult to trust purported output. It's a "many eyes" approach to finding
> flaws with the comparisons thet goes a long way towards preventing claims
> of tester bias.
> 
> I do find it a bit odd that, although we've had proponents of both
> solutions show what they purport to be output of the codecs, the only
> "don't take my word for it, replicate my results at home on your own
> machine" transparency I've seen has been from the VP8 camp.
> 

That shows that there is a fundamental asymmetry between the VP8 camp and the
H.264.  It is nice to see technical comparisons like this one - and more of
them are needed - but a more important discussion, in my opinion, should be
about the fact that the VP8 camp is fundamentally about inclusiveness and the
H.264 camp about exclusiveness.  Cullen's comment in the meeting about the
fact that there is only 4 browsers and that they all but Mozilla have a fully
paid license for H.264 is symptomatic of the blindness of the H.264 camp to
the need of the RTCWeb/Webrtc community at large.  OTOH, the VP8 camp
consistently demonstrated, as with the OP email, willingness to work with the
community and make RTCWeb/Webrtc available and affordable to the whole
spectrum of participants.

As an independent developer, I do not need to look at the results of the tests
to choose my camp.

- -- 
Marc Petit-Huguenin
Email: marc@petit-huguenin.org
Blog: http://blog.marc.petit-huguenin.org
Profile: http://www.linkedin.com/in/petithug
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.12 (GNU/Linux)

iQIcBAEBCAAGBQJRXabwAAoJECnERZXWan7EYlIQAJjfdocrPpiPNqjQJgG4OpxP
lYE62oFsooJBP4a8hI0uxNFLMWLs/DsZC9LSYxXlvjWEs5kriOYrR48zWQHGuDQR
W9VWepdHPrgrRTdh67nn0pxILj7zMhDahaeFonPxO9luvzX/1H76DLfXJ/glW1zv
6KBqqUhriHEb4IPN/f1VQ5Xpw5OQoD912/2wimkbzRjBeoDeHZ2olKLYEvpmiOQL
/AYCe+xBi7Rr9ciJVksQ1JY2lL67RnKBP/23AYRlN0xNLnGnhafG7OIbBpMLWfCm
qU7mdTZtyoz3IxnyLEC4eqQT7pI+rysA4yC2ormJkAbsJbw7qI10U8fzyZkfdPyn
uOcVGwKdxjcQgJd1Z7F5QhgbWIAo3EuTIZ3Poa56oIPG4YQJ9dh66Iw8EIfh2GGh
r6kYBY+uCkdwALcpa5Cp0iiB4NmmhzWfBVoGurkby2dX2sXh+nKAFPYaKI2vdYDw
KfPkOPD2i9dzlEB867nLqzw1hElFvaW0PJAu+9RHuVLUlEda7XVIOCZYgBvy0R9n
TZbkkCpJrcr9vD0g8ORSTx3uAUJF0z7c85++HpDD/YwmccQzyhVMuD6YPREtyim+
9MtmluiI8ta6XEF9Q26KpCjg7Q0uLHhZEhS4jDEXFS3bDi1/bbM/Bw7tuiLAV2cC
Y4OvDTukQl0GHTdMCOP6
=gcyM
-----END PGP SIGNATURE-----