Re: [rtcweb] RTP Usage: RTCP XR metrics

Magnus Westerlund <magnus.westerlund@ericsson.com> Fri, 22 February 2013 08:33 UTC

Return-Path: <magnus.westerlund@ericsson.com>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7BC8C21F8432 for <rtcweb@ietfa.amsl.com>; Fri, 22 Feb 2013 00:33:31 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -105.905
X-Spam-Level:
X-Spam-Status: No, score=-105.905 tagged_above=-999 required=5 tests=[AWL=0.344, BAYES_00=-2.599, HELO_EQ_SE=0.35, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id BXFJZlKCilKs for <rtcweb@ietfa.amsl.com>; Fri, 22 Feb 2013 00:33:30 -0800 (PST)
Received: from mailgw7.ericsson.se (mailgw7.ericsson.se [193.180.251.48]) by ietfa.amsl.com (Postfix) with ESMTP id E887421F86BC for <rtcweb@ietf.org>; Fri, 22 Feb 2013 00:33:19 -0800 (PST)
X-AuditID: c1b4fb30-b7f0d6d000007e61-3d-51272d4e8741
Received: from esessmw0247.eemea.ericsson.se (Unknown_Domain [153.88.253.124]) by mailgw7.ericsson.se (Symantec Mail Security) with SMTP id 66.93.32353.E4D27215; Fri, 22 Feb 2013 09:33:19 +0100 (CET)
Received: from [127.0.0.1] (153.88.115.8) by esessmw0247.eemea.ericsson.se (153.88.115.94) with Microsoft SMTP Server id 8.3.279.1; Fri, 22 Feb 2013 09:33:18 +0100
Message-ID: <51272D4E.6060903@ericsson.com>
Date: Fri, 22 Feb 2013 09:33:18 +0100
From: Magnus Westerlund <magnus.westerlund@ericsson.com>
User-Agent: Mozilla/5.0 (Windows NT 6.1; rv:17.0) Gecko/20130107 Thunderbird/17.0.2
MIME-Version: 1.0
To: Qin Wu <bill.wu@huawei.com>
References: <512235A8.4000700@ericsson.com> <BFCD1C49F8A7451C8A9279B1C95B58DD@china.huawei.com> <90D7B53D-3177-429C-8108-CF2A720248FE@csperkins.org> <03725BD6E54C4C20B484AEBBCBA9066D@china.huawei.com>
In-Reply-To: <03725BD6E54C4C20B484AEBBCBA9066D@china.huawei.com>
X-Enigmail-Version: 1.5
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: 8bit
X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFprFLMWRmVeSWpSXmKPExsUyM+Jvja6/rnqgwaZuVovHcxewWix/eYLR Yu2/dnYHZo9p9++zebQcecvqsWTJT6YA5igum5TUnMyy1CJ9uwSujDU/t7IXdCtVNHafZ2pg nCbVxcjJISFgIvF3RhMLhC0mceHeerYuRi4OIYGTjBIPln1nhHCWM0p03ljBClLFK6Atcez9 YWYQm0VAVeLG6beMIDabgIXEzR+NbCC2qECwxIaDq5gg6gUlTs58ArZBREBeomHzXbB6ZgEz iStPv4DNFBYwkJh1bDWYLSRwglHi780SEJtTwEHiy8TTQLs4gK4Tl1jzhgOiVU9iytUWqDHy Es1bZzNDtGpLNDR1sE5gFJqFZPMsJC2zkLQsYGRexciem5iZk15uvokRGL4Ht/w22MG46b7Y IUZpDhYlcd5w1wsBQgLpiSWp2ampBalF8UWlOanFhxiZODilGhit2ZddPBURefbsujcruE6c O7767v/r04rYbnsbTPctvr7gyyyufblfmm9pBqoc3Lc25WFFwJWg/dwTZ07bupX/bN4ki4bZ Ql+5N/B6MTgq1iZe3WvHs7RE/PLZb1xTNLpTJDPtcnM+d0iYJj16fWL9Cpbgog1XxTqSvnaU Jj1Irs23al/y3nWvEktxRqKhFnNRcSIAoFG0ES0CAAA=
Cc: rtcweb@ietf.org, Colin Perkins <csp@csperkins.org>
Subject: Re: [rtcweb] RTP Usage: RTCP XR metrics
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 22 Feb 2013 08:33:31 -0000

On 2013-02-20 06:13, Qin Wu wrote:
> Hi, Colin:
> My aim is these block types are RECOMMENDED to be implemented, for
justification on why they are recommened,
> I think we can go to look at four RTCWeb communication requirements:

> "
>    F5            The browser MUST be able to render good quality
>                    audio and video even in the presence of
>                    reasonable levels of jitter and packet losses.
> 
> 
>    F6            The browser MUST be able to handle high loss and
>                    jitter levels in a graceful way.
> 
>    F10           The browser MUST support synchronization of
>                    audio and video.
> 
>    F38          The browser MUST be able to collect statistics,
>                    related to the transport of audio and video
>                    between peers, needed to estimate quality of
>                    service.
> " So my point is if you want to ask browser to ensure good quality
> for both audio and video in the presence of centain level of jitter and losses,
> you should be able to report jitter and losses to help you know what
> current level of jitter and packet loss is. You may need to collect more
> detailed statistics to help you decide what level of jitter and loss you
> don't want to exceed? PDV metrics block tell you more higher resolution of
> jitter comparing with using interarrival jitter provided by RTCP
> SR/RR. Statistics Summary Report Block defined in RFC3611 tell you
> how many packets are lost in a certain sequence number interval.
> burst loss rate, gap loss rate defined in the
> draft-ietf-xrblock-rtcp-xr-summary-stat tell you Proportion of packet
> lost. Therefore these relevant metrics block SHOULD
> be listed as "RECOMMENDED to be implemented", in my opinion.
> 

I don't see the strong requirements of how the WebRTC endpoint
implementation quality requirements (F5, F6 and F10) are strongly linked
to the F38.

One type of arguments is that the peer endpoint being provided with RTCP
XR reports will function better in providing media quality. I don't know
if that is true for the metrics you listed.

A second line of reasoning is around how F38 is addressed. Especially in
the light that the WebRTC endpoints that are browsers will have a stats
API that allows one to get that side of information, assuming that one
has access to influence the JS application and can upload the data to
where it is needed.

For these stats I think the potential motivation for RTCP XR boils down
to this:
1) The peer is not a Browser but has RTCP XR, and one wants to access
its view of the session, thus receiving and gathering RTCP XR reports
enables one to get a better view of the whole RTP session.

2) One want the collection to be in an WebRTC RTP media plane middlebox,
and it should get the endpoints view also, thus RTCP XR is good.

So do people have those reasons, and what information does one really
need in these contexts?

I think some clearer motivations around RTCP XR and each particular
metrics needs to be stated from any proponent.


> In addtion, Browser need to support synchronization of audio and
video, however how do you know a certain browser lost synchronization of
audio and video. I think Synchronization delay and offset metrics can
tell this. Therefore Synchronization delay and offset metrics, in my
opinion, RECOMMENDED to be implemented.

The question is how needs to know that the receiving browser has failed
or selected to not synchronize the media? I don't see that the sender
can do anything different from what they are doing. As I see it all
falls back to knowing what quality level did this session actually
achieve. Especially for synchronization it might be that losing the sync
was better than to increase the audio delay to 1 second as an example.

Cheers


Magnus Westerlund

----------------------------------------------------------------------
Multimedia Technologies, Ericsson Research EAB/TVM
----------------------------------------------------------------------
Ericsson AB                | Phone  +46 10 7148287
Färögatan 6                | Mobile +46 73 0949079
SE-164 80 Stockholm, Sweden| mailto: magnus.westerlund@ericsson.com
----------------------------------------------------------------------