Re: [rtcweb] H.261 encoding samples at typical bitrates - sign language example

Gunnar Hellstrom <gunnar.hellstrom@omnitor.se> Thu, 05 December 2013 22:06 UTC

Return-Path: <gunnar.hellstrom@omnitor.se>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 79E5E1AE1E1 for <rtcweb@ietfa.amsl.com>; Thu, 5 Dec 2013 14:06:04 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level:
X-Spam-Status: No, score=-1.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id TwKQYiCfhHlT for <rtcweb@ietfa.amsl.com>; Thu, 5 Dec 2013 14:05:59 -0800 (PST)
Received: from vsp-authed-03-02.binero.net (vsp-authed02.binero.net [195.74.38.226]) by ietfa.amsl.com (Postfix) with ESMTP id D8D791AE1B9 for <rtcweb@ietf.org>; Thu, 5 Dec 2013 14:05:58 -0800 (PST)
Received: from smtp01.binero.se (unknown [195.74.38.28]) by vsp-authed-03-02.binero.net (Halon Mail Gateway) with ESMTPS for <rtcweb@ietf.org>; Thu, 5 Dec 2013 23:05:48 +0100 (CET)
Received: from [192.168.50.32] (81-224-110-16-no227.business.telia.com [81.224.110.16]) (Authenticated sender: gunnar.hellstrom@omnitor.se) by smtp-10-01.atm.binero.net (Postfix) with ESMTPA id B0A8D3A140 for <rtcweb@ietf.org>; Thu, 5 Dec 2013 23:05:47 +0100 (CET)
Message-ID: <52A0F8BD.9020107@omnitor.se>
Date: Thu, 05 Dec 2013 23:05:49 +0100
From: Gunnar Hellstrom <gunnar.hellstrom@omnitor.se>
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.1.1
MIME-Version: 1.0
To: rtcweb@ietf.org
References: <529D4A06.4080708@librevideo.org> <529D5CCD.8070801@librevideo.org> <CAOJ7v-1OOvWKd1M0xkm5Wy_rsf4_58UM-8hzB4HYqoQq4zchnw@mail.gmail.com> <CAOJ7v-1AATi0fkZJuz2kBgvpXVaJzvydDwvQsgTSCkUC9CCHbA@mail.gmail.com>
In-Reply-To: <CAOJ7v-1AATi0fkZJuz2kBgvpXVaJzvydDwvQsgTSCkUC9CCHbA@mail.gmail.com>
Content-Type: multipart/alternative; boundary="------------080304070202090409020803"
Subject: Re: [rtcweb] H.261 encoding samples at typical bitrates - sign language example
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb/>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 05 Dec 2013 22:06:04 -0000

The 289 kbit/s is clearly usable for sign language without problems. The 
fingers are clearly visible, the mouth shape and the eye-gaze direction.
If that was done with 25 fps it is good and sufficient. Never lower 
frame-rate below 20 fps!

With the size of the person, two persons could be fit into the same 
picture and still be good.

That matches the old observations from mid-90-s with the best conference 
units.

( the 541 kbit/s looks a bit overdone in artificial sharpening or 
something. Not as good as the 289. )

Gunnar

On 2013-12-05 22:21, Justin Uberti wrote:
> A frame comparison for the various encodings:
>
>
> On Thu, Dec 5, 2013 at 1:05 PM, Justin Uberti <juberti@google.com 
> <mailto:juberti@google.com>> wrote:
>
>     Ow, my eyes...
>
>     The 256 kbps and lower clips are unusable. The 512 kbps clip is
>     borderline, but might be usable if the framerate was cut in half.
>
>     Remember also that these test clips are far better than what would
>     be obtained from consumer webcams (i.e. good lighting, no shake,
>     no temporal noise), so real-world performance is likely to be
>     worse than what you see here.
>
>
>     On Mon, Dec 2, 2013 at 8:23 PM, Basil Mohamed Gohar
>     <basilgohar@librevideo.org <mailto:basilgohar@librevideo.org>> wrote:
>
>         On 12/02/2013 10:03 PM, Basil Mohamed Gohar wrote:
>         > Let's let any further discussions about the usability of
>         H.261, or any
>         > other codec for that matter, use actual examples going forward.
>         >
>         > The following is a VERY quick test of ffmpeg's h261 encoder
>         in the
>         > context of the IETF's rtcweb working group's discussion of
>         an MTI
>         > (mandatory-to-implement) video codec.
>         >
>         > sine_irene_cif.y4m taken from derf's collection:
>         >
>         > http://media.xiph.org/video/derf/y4m/sign_irene_cif.y4m
>         >
>         > ffmpeg version N-58565-gc122e69
>         >
>         > bitrate=64k,128k,256k,512k
>         >
>         > ffmpeg -i sign_irene_cif.y4m -codec:v h261 -b:v $bitrate -g 30
>         > sign_irene_cif.y4m-$bitrate.h261
>         >
>         > http://media.basilgohar.com/rtcweb/sign_irene_cif.y4m-64k.h261
>         > (real rate: 157.8kbits/s)
>         >
>         > http://media.basilgohar.com/rtcweb/sign_irene_cif.y4m-128k.h261
>         > (real rate: 165.6kbits/s)
>         >
>         > http://media.basilgohar.com/rtcweb/sign_irene_cif.y4m-256k.h261
>         > (real rate: 289.5kbits/s)
>         >
>         > http://media.basilgohar.com/rtcweb/sign_irene_cif.y4m-512k.h261
>         > (real rate: 541.8kbits/s)
>         >
>         > I apologize for the bitrate inflation, but if I had more
>         time I can
>         > tweak the settings for a more accurate number.  These are
>         simply the
>         > rates that ffmpeg produced with such a short clip at the
>         given requested
>         > rates.
>         >
>
>         I've updated the encoding settings as follows to get more accurate
>         resulting bitrates, but ffmpeg's h261 encoder seems to
>         bottom-out at
>         around ~140kbps, so the only examples from above that are
>         close (after
>         using the new settings) are 256k and 512k.
>
>         for bitrate in {1..512}k; do ffmpeg -i ../sign_irene_cif.y4m
>         -codec:v
>         h261 -b:v $bitrate -minrate $bitrate -maxrate $bitrate
>         -bufsize $bitrate
>         -qmax 1024 -g 30 -y sign_irene_cif.y4m-$bitrate.h261; done;
>
>         All the above posted examples can be viewed with mplayer and a
>         bash
>         command line using the following, if you're interested:
>
>         mplayer
>         http://media.basilgohar.com/rtcweb/sign_irene_cif.y4m-{64,128,256,512}k.h261
>         <http://media.basilgohar.com/rtcweb/sign_irene_cif.y4m-%7B64,128,256,512%7Dk.h261>
>
>         The full integer range of bitrates from 1 to 512 can be found
>         here:
>
>         http://media.basilgohar.com/rtcweb/h261/
>
>         Target bitrate and actual bitrate start to match around
>         150kbps with
>         these new settings.
>
>         I am currently exploring other codecs with the same
>         methodology and will
>         share the results accordingly.
>
>         --
>         Libre Video
>         http://librevideo.org
>         _______________________________________________
>         rtcweb mailing list
>         rtcweb@ietf.org <mailto:rtcweb@ietf.org>
>         https://www.ietf.org/mailman/listinfo/rtcweb
>
>
>
>
>
> _______________________________________________
> rtcweb mailing list
> rtcweb@ietf.org
> https://www.ietf.org/mailman/listinfo/rtcweb