Re: [rtcweb] Video resolution SHOULDs (Re: resolutions in draft-cbran-rtcweb-codec-01)

"Roni Even" <ron.even.tlv@gmail.com> Thu, 17 November 2011 11:06 UTC

Return-Path: <ron.even.tlv@gmail.com>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2C92621F9B03 for <rtcweb@ietfa.amsl.com>; Thu, 17 Nov 2011 03:06:25 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.568
X-Spam-Level:
X-Spam-Status: No, score=-3.568 tagged_above=-999 required=5 tests=[AWL=0.030, BAYES_00=-2.599, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-1]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ryY0bmisOiTa for <rtcweb@ietfa.amsl.com>; Thu, 17 Nov 2011 03:06:24 -0800 (PST)
Received: from mail-yw0-f44.google.com (mail-yw0-f44.google.com [209.85.213.44]) by ietfa.amsl.com (Postfix) with ESMTP id 1679621F9B01 for <rtcweb@ietf.org>; Thu, 17 Nov 2011 03:06:24 -0800 (PST)
Received: by ywt34 with SMTP id 34so1039430ywt.31 for <rtcweb@ietf.org>; Thu, 17 Nov 2011 03:06:23 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=from:to:cc:references:in-reply-to:subject:date:message-id :mime-version:content-type:x-mailer:thread-index:content-language; bh=Qk/rLIQ4dSqstiZgio982aK4KDjk5OatO93s1dgcW/o=; b=xMdq/Qt72aASqnZpcPtmWolXsKFR4gWQBMAQxCJnmhSL+yWwvlSpeRcIIdRx1sJxAN u0Y1vww5IwaBCdSBv7JKHnxEDjECPfl62c9JFSnF9DaHucF68SwB4UlRsuTE3L7uBiC/ /zhKeZyZUZVRec7F+XTw24b3ndEldR7IfkLVk=
Received: by 10.236.181.164 with SMTP id l24mr8323220yhm.22.1321527983646; Thu, 17 Nov 2011 03:06:23 -0800 (PST)
Received: from windows8d787f9 (dhcp-17b3.meeting.ietf.org. [130.129.23.179]) by mx.google.com with ESMTPS id y58sm5462564yhi.17.2011.11.17.03.06.20 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 17 Nov 2011 03:06:22 -0800 (PST)
From: Roni Even <ron.even.tlv@gmail.com>
To: 'Harald Alvestrand' <harald@alvestrand.no>, 'Stephan Wenger' <stewe@stewe.org>
References: <CAEAF771.33E5D%stewe@stewe.org> <4EC4DD84.8030202@alvestrand.no>
In-Reply-To: <4EC4DD84.8030202@alvestrand.no>
Date: Thu, 17 Nov 2011 13:03:41 +0200
Message-ID: <4ec4eaae.d289ec0a.6bc4.31cf@mx.google.com>
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="----=_NextPart_000_0061_01CCA529.56DE6780"
X-Mailer: Microsoft Office Outlook 12.0
Thread-Index: AcylES3mEEm9d9JHSLuDuDaxXYjjdQABZBug
Content-Language: en-us
Cc: rtcweb@ietf.org
Subject: Re: [rtcweb] Video resolution SHOULDs (Re: resolutions in draft-cbran-rtcweb-codec-01)
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 17 Nov 2011 11:06:25 -0000

HI,

I am not familiar with VP8 but for H.264 the specification says that a
complaint decoder must receive any stream from the encoder and crop/scale
for rendering.

In order to get over this limitation there are parameters  for the codec
that can limit the size starting from the level parameter. In the mobile
case since the BW is limited you will use a lower level that does not
support the HD resolution. For example level 1 is limited to 64 kbit/sec
with maximum resolution of 176x144, for the must support you need to have
192 kbit/sec level 1.1.

You can override the maximum resolution by lowering the maximum frame rate
and this are parameters specified in the H.264 payload specification.

There is also the SDP image attribute that allow the receiver to ask for
specific resolution and aspect ratio.

 

As for your suggested text, I am not sure why you need it since these are
requirement that the codec should support and not for using for send or
receive. It says that a candidate codec should have an HD mode, some older
codecs like H.261 did not have this mode.

 

 

 

 

Roni Even

 

 

From: rtcweb-bounces@ietf.org [mailto:rtcweb-bounces@ietf.org] On Behalf Of
Harald Alvestrand
Sent: Thursday, November 17, 2011 12:10 PM
To: Stephan Wenger
Cc: rtcweb@ietf.org
Subject: Re: [rtcweb] Video resolution SHOULDs (Re: resolutions in
draft-cbran-rtcweb-codec-01)

 

On 11/17/2011 05:54 PM, Stephan Wenger wrote: 

The highlighted part of Harald's suggestion below

 

   SHOULD support resolutions of 1920x1080, 1280x720, 720x480, 1024x768, 

      800x600, 640x480, 640 x 360 , 320x240 *if these resolutions can be
displayed on the target device*

 

seems sensible.  However, I have another issue.  I don't believe that naming
specific resolutions is advisable.  In a system where the rendering side has
almost undefined picture properties because they are typically rendered in
"windows", it IMO does not make much sense to limit yourself to certain
aspect ratios, picture sizes etc., even if those correspond to today's
preferred sensor resolutions (or integer fractions thereof).  Resampling an
input signal is cheap nowadays (at least compared to the encoding itself),
and cropping is even cheaper.

I would instead recommend naming one single MUST resolution (as the draft
does) to ensure minimum interoperability, and otherwise negotiate a
processing rate in macro blocks per second (or equivalent), with fixed
constraints around the aspect ratio.

For requirements, I prefer to list specifics, because they're testable.

One of my colleagues had a failing test the other day because he'd specified
a picture height of 94 pixels - he did not know that his encoders only
supported pixel counts that were multiples of 8.

Of course a device will not fail to interoperate just because it supports
decoding more resolutions than those that are required.

BTW, I believe 640x360 is a 16:9 aspect ratio, so handling both 16:9 and 4:3
seems to be a SHOULD based on this resolution list. I assume that's
intentional.