Re: [rtcweb] Changing video size (Re: use case:)

Stefan Håkansson LK <stefan.lk.hakansson@ericsson.com> Wed, 22 June 2011 06:06 UTC

Return-Path: <stefan.lk.hakansson@ericsson.com>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 681FD21F8585 for <rtcweb@ietfa.amsl.com>; Tue, 21 Jun 2011 23:06:34 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.299
X-Spam-Level:
X-Spam-Status: No, score=-6.299 tagged_above=-999 required=5 tests=[AWL=-0.001, BAYES_00=-2.599, HTML_MESSAGE=0.001, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id rARAimbenQJE for <rtcweb@ietfa.amsl.com>; Tue, 21 Jun 2011 23:06:33 -0700 (PDT)
Received: from mailgw9.se.ericsson.net (mailgw9.se.ericsson.net [193.180.251.57]) by ietfa.amsl.com (Postfix) with ESMTP id C598221F857E for <rtcweb@ietf.org>; Tue, 21 Jun 2011 23:06:32 -0700 (PDT)
X-AuditID: c1b4fb39-b7bfdae000005125-4c-4e0186679c9f
Received: from esessmw0184.eemea.ericsson.se (Unknown_Domain [153.88.253.124]) by mailgw9.se.ericsson.net (Symantec Mail Security) with SMTP id 2E.4C.20773.766810E4; Wed, 22 Jun 2011 08:06:31 +0200 (CEST)
Received: from ESESSCMS0362.eemea.ericsson.se ([169.254.1.208]) by esessmw0184.eemea.ericsson.se ([153.88.115.81]) with mapi; Wed, 22 Jun 2011 08:06:31 +0200
From: Stefan Håkansson LK <stefan.lk.hakansson@ericsson.com>
To: Bert Greevenbosch <Bert.Greevenbosch@huawei.com>, Justin Uberti <juberti@google.com>, "rtcweb@ietf.org" <rtcweb@ietf.org>
Date: Wed, 22 Jun 2011 08:06:28 +0200
Thread-Topic: [rtcweb] Changing video size (Re: use case:)
Thread-Index: AQHMMJDVCKk8354El0yZhe0D7WlXTJTI3I3QgAAF1PA=
Message-ID: <BBF498F2D030E84AB1179E24D1AC41D6147C4DA4CE@ESESSCMS0362.eemea.ericsson.se>
References: <5DA67EA1-77DC-4F55-850C-E76E0F133A81@cisco.com> <BANLkTi=g13whA3PCXKPW5Q7a2PzEDY3ESg@mail.gmail.com> <4DFF052A.8020202@alvestrand.no> <01A17A75-0700-416E-A4D4-C6EB97265F8B@cisco.com> <46A1DF3F04371240B504290A071B4DB601301A2E@SZXEML501-MBS.china.huawei.com> <BANLkTik=N6qtPRUesk3mi62rV1Lvixu54w@mail.gmail.com> <46A1DF3F04371240B504290A071B4DB601301A8D@SZXEML501-MBS.china.huawei.com>
In-Reply-To: <46A1DF3F04371240B504290A071B4DB601301A8D@SZXEML501-MBS.china.huawei.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: multipart/alternative; boundary="_000_BBF498F2D030E84AB1179E24D1AC41D6147C4DA4CEESESSCMS0362e_"
MIME-Version: 1.0
X-Brightmail-Tracker: AAAAAA==
Subject: Re: [rtcweb] Changing video size (Re: use case:)
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 22 Jun 2011 06:06:34 -0000

All,

this RFC could perhaps be useful for this purpose of signaling display size: http://www.rfc-editor.org/rfc/rfc6236.txt

Stefan

________________________________
From: rtcweb-bounces@ietf.org [mailto:rtcweb-bounces@ietf.org] On Behalf Of Bert Greevenbosch
Sent: den 22 juni 2011 07:56
To: Justin Uberti
Cc: rtcweb@ietf.org
Subject: Re: [rtcweb] Changing video size (Re: use case:)

Hi Justin, all,

Yes, that is a second issue. Even if the receiving end can signal its current display size, the streaming source might not be able to provide it. Therefore flexibility would be needed for the source on how to handle the display size information.

Best regards,
Bert


From: Justin Uberti [mailto:juberti@google.com]
Sent: 22 June 2011 11:59
To: Bert Greevenbosch
Cc: Cullen Jennings; Aron Rosenberg; rtcweb@ietf.org
Subject: Re: [rtcweb] Changing video size (Re: use case:)

Given the fact that this request for a video size change is an optimization (either of resources or user experience), I think that SHOULD is probably the strongest label we can put on it. Consider the case of a middlebox; if it has no capacity to scale the stream, due to compute or codec restrictions, there's not much it can do with this request.


However, whether we can cater for this also depends on the actual technical solution for negotiation and which codec to use. If adding video size negotiation will not increase complexity too much, I see no reason not to do it. However, if it adds much complexity to the solution, we might need to consider whether it is worth it. Therefore, maybe it should not be a requirement, but something weaker; i.e. it could be phrased as a SHOULD rather than a MUST.

Best regards,
Bert


-----Original Message-----
From: rtcweb-bounces@ietf.org<mailto:rtcweb-bounces@ietf.org> [mailto:rtcweb-bounces@ietf.org<mailto:rtcweb-bounces@ietf.org>] On Behalf Of Cullen Jennings
Sent: 22 June 2011 00:11
To: Aron Rosenberg
Cc: rtcweb@ietf.org<mailto:rtcweb@ietf.org>
Subject: Re: [rtcweb] Changing video size (Re: use case:)


On Jun 20, 2011, at 1:30 , Harald Alvestrand wrote:

> On 06/17/11 21:38, Aron Rosenberg wrote:
>> On Fri, Jun 17, 2011 at 11:09 AM, Cullen Jennings <fluffy@cisco.com<mailto:fluffy@cisco.com>> wrote:
>>
>> Video Size Change.
>>
>> Alice and Bob are in a video call in their browsers and have negotiate a high resolution video. Bob decides to change the size of the windows his browser is displaying video to a small size.  Bob's browser should be able to regenerate the video codec parameters with Alice's browser to change the resolution of video Alice sends to match the smaller size.
>>
>>
>> Changing compression due to a user change in window size is usually not done since it has a bad long term effect on video quality. In almost all the major video calling systems, video resolution is a function of current bandwidth (which changes as the rate control system detects differences) and/or constrained by the physical device, but not a function of a user dragging the window size. At an equivalent bitrate, it is better to compress a larger resolution and display it smaller (higher PSNR), then compress a smaller resolution if you are within the codec's effective bitrate for that larger resolution.

Consider two different video flows using the same codec ...

Stream A is 640 x 480 at 1mbps which is this scaled to 320x240 and displayed

Stream B is 320 x 240 at 1mbps which is displayed at 320x240.

My experience has been with modern video codecs that stream B will look better than stream A. As well as looking better, it will typically also have a better PSNR. There's a bunch of reasons why which are probably not worth going into here but give it a try and you will see what I mean. The key point is both streams where 1mbps. If stream B was sent at 256 kbps, then A would look better.




_______________________________________________
rtcweb mailing list
rtcweb@ietf.org<mailto:rtcweb@ietf.org>
https://www.ietf.org/mailman/listinfo/rtcweb
_______________________________________________
rtcweb mailing list
rtcweb@ietf.org<mailto:rtcweb@ietf.org>
https://www.ietf.org/mailman/listinfo/rtcweb