Re: [xrblock] AD Evaluation of draft-ietf-xrblock-rtcweb-rtcp-xr-metrics-06

Varun Singh <varun@callstats.io> Sun, 08 October 2017 13:11 UTC

Return-Path: <varun@callstats.io>
X-Original-To: xrblock@ietfa.amsl.com
Delivered-To: xrblock@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9BC581342C2 for <xrblock@ietfa.amsl.com>; Sun, 8 Oct 2017 06:11:33 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.7
X-Spam-Level:
X-Spam-Status: No, score=-2.7 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=callstats.io
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id dqNovcsno41T for <xrblock@ietfa.amsl.com>; Sun, 8 Oct 2017 06:11:31 -0700 (PDT)
Received: from mail-lf0-x233.google.com (mail-lf0-x233.google.com [IPv6:2a00:1450:4010:c07::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5BDA3134226 for <xrblock@ietf.org>; Sun, 8 Oct 2017 06:11:31 -0700 (PDT)
Received: by mail-lf0-x233.google.com with SMTP id l23so17787147lfk.10 for <xrblock@ietf.org>; Sun, 08 Oct 2017 06:11:31 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=callstats.io; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=Lfe8DyFg05RL/W7rNX2K6wUb6Ck36MZlXzFgjobwdYU=; b=ej51b/H+idy86KOw4mCqkS6YYELbpQr8s73yTPHWni67+9Xmkiq8sx/t1DWThFnnRi prpuWnr/JnsLclvud9WcrToJ7qk2u5nM839HXl8LgSahs3pfsh/UlgCgpOZV/NazEwtJ ZbN7Yd953Mgm5hj8lpgedcH6Asoq6WyO40tCQ=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=Lfe8DyFg05RL/W7rNX2K6wUb6Ck36MZlXzFgjobwdYU=; b=h1bTZDY1c/cGm7mMpPbzRCHNtRriifz6/BLhDfE81xMSZQ8OggYPij6DDV+b7Pb19y fySYczdF44DsV+ht1ONktlTVudFtNmazUAD+s1KtGbJQS16HFYNWQhzcv1RaZLu4MxyR dNKNI6eLyrmh3TypYRo4iQo+YZ35OsAIhtQdy+hlnlD829Wl9j/rYRf/bKVOqaZDGra9 rkkj947XpQaOmXug2Ge1MjE8AkoJFmXxD0fjgjiv2m/qDBy0nVMBiO8JKnRyEuXkwVDU 4zQJcArobqUoo3XQR17gmRgcuieuiDy/VpVAaFGfoAxOwrq0qAl2cUKNaYSmY0pR2md4 Ff/w==
X-Gm-Message-State: AMCzsaWJtIpMUBujectMQjzT0cPeYg9H/I1tTfY1oX0QHcuN+98PHj2y IzM0OHcQz5bMPj8OuZEzO8FjD1/lsVLYhdHkdnmncw==
X-Google-Smtp-Source: AOwi7QCHxC5muOlIOvjwMkbl4RlpFCU5M39RejAyAO565MaV+9rXq4l4qw1PJpIOnEttHvturA9lDHkNvGy+Ae1FzIM=
X-Received: by 10.46.4.153 with SMTP id a25mr3390939ljf.4.1507468289315; Sun, 08 Oct 2017 06:11:29 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.25.33.10 with HTTP; Sun, 8 Oct 2017 06:11:08 -0700 (PDT)
In-Reply-To: <99303AB6-D5EE-44EC-B515-DCB7966DADA6@nostrum.com>
References: <99303AB6-D5EE-44EC-B515-DCB7966DADA6@nostrum.com>
From: Varun Singh <varun@callstats.io>
Date: Sun, 08 Oct 2017 06:11:08 -0700
Message-ID: <CACHXSv7E+NhU_dvd63k57RfrVOAPoSFuOK8+-bRwsJTAcZ_ixQ@mail.gmail.com>
To: Ben Campbell <ben@nostrum.com>
Cc: draft-ietf-xrblock-rtcweb-rtcp-xr-metrics.all@ietf.org, xrblock <xrblock@ietf.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: <https://mailarchive.ietf.org/arch/msg/xrblock/uXMwz8XDVjy21VCcCTxBqOFQ6fM>
Subject: Re: [xrblock] AD Evaluation of draft-ietf-xrblock-rtcweb-rtcp-xr-metrics-06
X-BeenThere: xrblock@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Metric Blocks for use with RTCP's Extended Report Framework working group discussion list <xrblock.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xrblock>, <mailto:xrblock-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/xrblock/>
List-Post: <mailto:xrblock@ietf.org>
List-Help: <mailto:xrblock-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xrblock>, <mailto:xrblock-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 08 Oct 2017 13:11:34 -0000

Hi Ben,

See inline.

On Tue, Oct 3, 2017 at 12:28 AM, Ben Campbell <ben@nostrum.com> wrote:
> Hi,
>
> This is my AD Evaluation of draft-ietf-xrblock-rtcweb-rtcp-xr-metrics-06. I would like to resolve at least the substantive comments prior to IETF LC.
>
> Thanks!
>
> Ben.
> —————————
>
> Substantive:
>
> - General: If I understand correctly, this document lists and describes XR metrics that a WebRTC application might choose to negotiate and expose via the WebRTC API. It does not define any new XR metrics. That brings up two questions:
>
> 1) Why is this specific to WebRTC? For the most parts, all the arguments here would apply to any sort of RTP endpoint.
>

This draft was created initially as an input to RTCWEB and later as an
input to WebRTC Statistics API. Hence the use of WebRTC in the title
and the introduction. We could add to the introduction: "In general,
the metrics listed in this document can be exposed by any real-time
communications endpoint." Or something along those lines


> 2) Why is this standards track? This sort of material is typically informational, or occasionally a BCP. There are a small number of 2119 keywords, but I’m not sure they are needed or appropriate. (Specifics below.) My initial instinct is that this should be informational.
>

The reason until recently (perhaps still exist) is that this was an
input from the IETF to W3C, I am not sure if there was an official
liaison statements sent to them? nonetheless, the W3C Statistics API
document needed a specification needed (a specification in any
standards body would suffice) for metrics to be accepted into the W3C
document.

In practice, it helped that I was the co-author of both the IETF and
W3C document and hence was able to make the case for the metrics in
W3C.

> - General: This needs an IANA considerations section, even if it just contains the statement to the effect of “This document makes no requests for IANA”.
>
> - 1, last paragraph: “ The document also creates a registry containing identifiers from the metrics reported in the RTCP Sender, Receiver, and Extended Reports.”

This should be removed. Thanks for pointing this out.

>
> It doesn’t actually do that. I understand from the shepherd’s report that this was intentionally removed.
>
> — “All identifiers proposed in this document are RECOMMENDED to be implemented by an endpoint.  An endpoint MAY choose not to expose an identifier if it does not implement the corresponding RTCP Report. “
>
> Does the “RECOMMENDED” apply to all endpoints or just WebRTC endpoints? If the latter, doesn’t that requirement belong (or need to update) some requirement from an RTCWEB (maybe rtp-usage) document, or even the API itself? (I suspect that this draft does not have standing to state this normatively.) What is meant by “MAY choose not to expose”. Is that talking about via the WebRTC API? If so, isn’t that up to the API definition? (That is, it shouldn’t be normative here.)
>

It should be applicable to any endpoint, although it is pertinent or
timely for the WebRTC endpoint to expose these.
The purpose of the statement was to highlight that if the
middlebox/endpoint sends RTCP XRs then it should expose the data
available via the API.

I am open to changing to a non-normative lower case guidance if that
would be more suitable, although if this document is making
recommendations to the W3C document -- wouldn't we keep the uppercase?

co-authors, what do you think?

> -2: If this document keeps the normative keywords, please use the updated boilerplate from RFC 8174. (I note that there are at least some uncapitalized “may”s that do not seem normative.)
>

depending on the above, we should fix these to uppercase.

> - 5.2.2, last paragraph: “The following metrics can also be considered…”
> Be considered by whom? Implementors? API designers?
>

Both.

> - 6, first paragraph: “In practice the application MUST be able to query the statistic identifiers on both an incoming (remote) and outgoing (local) media stream.”
> What does the MUST requirement apply to? The WebRTC API? This seems more like a statement of fact that “ the application needs to be able…”
>

correct, "needs to" is better.

> -8: "Therefore encryption procedures, such as the ones suggested for a Secure RTCP (SRTCP), need to be used.”
> The text should describe the reasons encryption is needed. Also, is this a new normative requirement, or a restatement of an existing requirement?
>

I believe it is restatement alluding to the guidance in the
corresponding RTCP XRs.

> Editorial:
>
> -1, paragraph 1:" If sufficient information (metrics or statistics) are provided to the applications, it can attempt to improve the media quality. “
>
> s / “are provided” / “is provided”
> s / applications / application
>
> -3, 2nd paragraph: It would help to clarify that the references to section 5 and 6 are to this document, not RFC 3611.
>
> — 3rd paragraph: "At the moment…”
> Please clarify that is at the time of writing (not reading)
>
> -5, 2nd paragraph: “ Application impact metrics mainly collect the information in the viewpoint of application … “
> s / in / from
> Also, please expand “FEC” on first mention.
>
> - 5.1.1, first paragraph: “ Duplicate packets may be a result of network delays, which causes the sender to retransmit the original packets.”
> s/ :delays, which” / “delays that”
>
> — last paragraph: "For those RTCWEB services with jitter buffer…”
> s/buffer/buffers
>
> - 5.1.2, first paragraph:
> First sentence is a comma splice.
>  — “some transitory nature of the impairments”
> Should this say “the transitory nature of some impairments”?
> — “ Distributed burst provides a higher subjective quality”
> “Burst distribution …”?
> — Last paragraph: “ Hence, if WebRTC application”
> Missing article (or should application be plural?)
>
> - 5.2.1, title: Should “Discard” be “Discarded”?
>
> -7: Please clarify that this is at the time of this writing.
>

Thanks for your feedback and suggestions, we will fix these.

Regards,
Varun


-- 
Founder, CEO, callstats.io
http://www.callstats.io

Interested in networking, media quality, and diagnostics.
We are hiring!: www.callstats.io/jobs/