[pm-dir] 答复: RFC6390 review of draft-ietf-xrblock-rtcp-xr-decodability

Qin Wu <bill.wu@huawei.com> Thu, 11 April 2013 02:14 UTC

Return-Path: <bill.wu@huawei.com>
X-Original-To: pm-dir@ietfa.amsl.com
Delivered-To: pm-dir@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C7EBE21F8B16 for <pm-dir@ietfa.amsl.com>; Wed, 10 Apr 2013 19:14:16 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.112
X-Spam-Level:
X-Spam-Status: No, score=-3.112 tagged_above=-999 required=5 tests=[AWL=3.035, BAYES_00=-2.599, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_MED=-4, SARE_SUB_ENC_UTF8=0.152]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xefzBP6MGVgV for <pm-dir@ietfa.amsl.com>; Wed, 10 Apr 2013 19:14:15 -0700 (PDT)
Received: from lhrrgout.huawei.com (lhrrgout.huawei.com [194.213.3.17]) by ietfa.amsl.com (Postfix) with ESMTP id F2D4C21F8B11 for <pm-dir@ietf.org>; Wed, 10 Apr 2013 19:14:12 -0700 (PDT)
Received: from 172.18.7.190 (EHLO lhreml204-edg.china.huawei.com) ([172.18.7.190]) by lhrrg01-dlp.huawei.com (MOS 4.3.5-GA FastPath queued) with ESMTP id ARR72303; Thu, 11 Apr 2013 02:14:12 +0000 (GMT)
Received: from LHREML402-HUB.china.huawei.com (10.201.5.241) by lhreml204-edg.china.huawei.com (172.18.7.223) with Microsoft SMTP Server (TLS) id 14.1.323.7; Thu, 11 Apr 2013 03:13:40 +0100
Received: from nkgeml405-hub.china.huawei.com (10.98.56.36) by lhreml402-hub.china.huawei.com (10.201.5.241) with Microsoft SMTP Server (TLS) id 14.1.323.7; Thu, 11 Apr 2013 03:14:11 +0100
Received: from NKGEML501-MBS.china.huawei.com ([169.254.2.126]) by nkgeml405-hub.china.huawei.com ([10.98.56.36]) with mapi id 14.01.0323.007; Thu, 11 Apr 2013 10:14:01 +0800
From: Qin Wu <bill.wu@huawei.com>
To: Benoit Claise <bclaise@cisco.com>
Thread-Topic: RFC6390 review of draft-ietf-xrblock-rtcp-xr-decodability
Thread-Index: Ac4yMTL0UA8uv4ley0awPHDnGGdR4wDwe9DVABmpCEA=
Date: Thu, 11 Apr 2013 02:14:00 +0000
Message-ID: <B8F9A780D330094D99AF023C5877DABA43A3C121@nkgeml501-mbs.china.huawei.com>
References: <CD8499D5.4FA30%alan.d.clark@telchemy.com> <A64E8EB6A56342CB8423D1532A94709C@china.huawei.com> <51656EB3.9060300@cisco.com>
In-Reply-To: <51656EB3.9060300@cisco.com>
Accept-Language: zh-CN, en-US
Content-Language: zh-CN
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [10.138.41.149]
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-CFilter-Loop: Reflected
X-Mailman-Approved-At: Thu, 11 Apr 2013 04:39:59 -0700
Cc: "Huangyihong (Rachel)" <rachel.huang@huawei.com>, Gonzalo Camarillo <Gonzalo.Camarillo@ericsson.com>, "Dan (Dan)" <dromasca@avaya.com>, "asaeda@nict.go.jp" <asaeda@nict.go.jp>, Alan Clark <alan.d.clark@telchemy.com>, "glenzorn@gmail.com" <glenzorn@gmail.com>, Shida Schubert <shida@ntt-at.com>, "pm-dir@ietf.org" <pm-dir@ietf.org>, Al Morton <acmorton@att.com>
Subject: [pm-dir] 答复: RFC6390 review of draft-ietf-xrblock-rtcp-xr-decodability
X-BeenThere: pm-dir@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Performance Metrics Directorate Discussion list <pm-dir.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/pm-dir>, <mailto:pm-dir-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/pm-dir>
List-Post: <mailto:pm-dir@ietf.org>
List-Help: <mailto:pm-dir-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/pm-dir>, <mailto:pm-dir-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 11 Apr 2013 02:14:17 -0000

Hi,Benoit:
As Alan observed in PM-DIR review, this draft does not define new metrics but refers to metrics that are
clearly defined in a normative reference.
I think we can skip RFC6390 template usage just like PDV draft(RFC6798) did, can't we?

Regards!
-Qin
-----邮件原件-----
发件人: Benoit Claise [mailto:bclaise@cisco.com] 
发送时间: 2013年4月10日 21:53
收件人: Qin Wu
抄送: Alan Clark; Gonzalo Camarillo; pm-dir@ietf.org; Dan (Dan); Shida Schubert; Huangyihong (Rachel); asaeda@nict.go.jp; glenzorn@gmail.com; Al Morton
主题: Re: RFC6390 review of draft-ietf-xrblock-rtcp-xr-decodability

Hi Qin,

And don't forget the RFC 6390 template usage.

Regards, Benoit
> Hi, Alan:
> Thank for your valuable comments.
> We have updated the draft to incorporate your comments in the new version (-v11).
> The diff is:
> http://www.ietf.org/rfcdiff?url2=draft-ietf-xrblock-rtcp-xr-decodability-11
> Please also see my reply below.
>
> Regards!
> -Qin
> ----- Original Message -----
> From: "Alan Clark" <alan.d.clark@telchemy.com>
> To: "Gonzalo Camarillo" <Gonzalo.Camarillo@ericsson.com>; <pm-dir@ietf.org>; "Benoit Claise" <bclaise@cisco.com>; "Dan (Dan)" <dromasca@avaya.com>; "Shida Schubert" <shida@ntt-at.com>; <rachel.huang@huawei.com>; <bill.wu@huawei.com>; <asaeda@nict.go.jp>; <glenzorn@gmail.com>; "Al Morton" <acmorton@att.com>
> Sent: Saturday, April 06, 2013 3:10 AM
> Subject: RFC6390 review of draft-ietf-xrblock-rtcp-xr-decodability
>
>
> There are quite a few issues with the draft - I can re-review as soon as
> these are addressed.
>
> Alan Clark
>
>
>
> A. General Comments
>   
> This draft does not define new metrics but refers to metrics that are
> clearly defined in a normative reference.  The normative reference (ETSI
> TR101290) predates RFC6390 however does contain a fairly clear description
> of the metrics with explanation of their usage. It is not recommended that
> this draft redefines the metrics in RFC6390 template form
>
> [Qin]: Exactly.
>
> however there is
> considerable scope for improvement in the clarity of definition of how these
> metrics are used.
>
> [Qin]: Agree.
>   
> B. Applicability Section
>   
> 1.4 Applicability
> Metrics only measure transport stream quality not content stream quality.
> Also the metrics are not defined in this draft but are encodings of the
> metrics defined in ETSI TS 101290.
>   
> Suggest
>   
> ³This block type allows a counts of MPEG Transport Stream quality metrics
> that are measured in accordance with ETSI TR 101290 [ETSI] to be reported by
> an endpoint.  These metrics are useful for identifying bitstream
> packetization and transport stream encoding problems that may affect the
> user¹s perception of a video service delivered over RTP.²
>
> [Qin]: Okay. Your proposed text have been incorporated in (-v11).
>   
> C. Metrics Definitions
>   
> C.1 General
>   
> For clarity the draft should preface the metrics definitions with a general
> explanation of how these metrics relate to ETSI TR101290. TR101290 generally
> defines error events and this draft contains counts of those metrics.
>
>   
> If there are any ³edge² cases where a problem in one measurement interval
> would be reflected in the count in the next measurement interval then this
> should be articulated in the general description and also in the specific
> metric.  For example, a sync byte error is defined as multiple consecutive
> errored sync bytes and if this was reported in an interval it may have
> occurred at the end of the preceding interval or at some time during the
> present interval - hence the description should state that the count may
> reflect a problem in the current or previous interval. This would also be
> the case for PCR errors and even continuity count errors.
>
> [Qin]: Okay, I have added some text in the 2nd paragraph of section 3
> and incorporated your suggested text in (v-11).
>   
> C.2  Sequence numbers
>   
> begin_seq and end_seq
>   
> These definitions simply say ³As defined inS² which requires the reader to
> refer to another document. It is good practice to at least mention what the
> definition refers to and then to include a reference that contains the
> normative definition.
>   
> SoS..
>   
> ³begin_seq: 16 bits
>
> The RTP sequence number corresponding to the start of the measurement
> period, as defined in Section 4.1 of RFC 3611²
>
> [Qin]: Fixed in (-v11).
>   
> C.3 Metrics definitions
> The metrics definitions should contain a firmer statement of what is being
> measured and, if the normative definition is in another standard, then
> clearly state ³as defined in Section X.Y of NNNNN². This applies to all the
> metrics definitions and the example below can be used as a template for
>   
> For example
>   
> Existing language S..
>   
> TS_sync_loss_count: 32 bits
>   
> Number of TS_sync_loss errors in the above sequence number interval.  It is
> calculated based on the occurrence of errors for "TS_sync_loss"parameter
> defined in the section 5.2.1 of [ETSI] (Also see section 5.5.1 of [ETSI]).
>   
> This is very vague language and it is unclear why the ³Also see² reference
> is there.  A better approach is:
>   
> Replacement language (use this format for each of the metrics)
>   
> TS_sync_loss_count: 32 bits
>   
> A count of the number of TS_sync_loss errors that occurred in the above
> sequence number interval.  A TS_sync_loss error occurs when there are two or
> more consecutive incorrect sync bytes within the MPEG TS stream, as defined
> in section 5.2.1 of [ETSI]. This parameter may be used as part of a Service
> Availability calculation, as defined in section 5.5.1 of [ETSI].
>
> [Qin]: Fixed in (-v11).
>   
> C.4 Service Availability
>   
> Following on from the previous comment,  section 5.5.1 of TR101290 describes
> a service availability error as a combination of TS_sync_loss, PAT_error and
> PMT_error whereas draft-ietf-xrblock-rtcp-xr-decodability-10 does not
> contain the PAT and PMT error metrics.  The resolution for this would either
> be to remove the reference to 5.5.1 or to add the metrics required to
> calculate the service availability.
>   
> [Qin]: Agree. I prefer to remove the reference to 5.5.1 since there was consensus in the past WGLC to this draft
> that having a second report block later to cover the other parameters and get inline with concept of RFC6792
> and letting this draft focus on PSI indpendent parameter reporting.
> See details for the WGLC discussion in the following link:
> http://www.ietf.org/mail-archive/web/xrblock/current/msg01032.html
>
> It is recommended that PAT_error , PAT_error_2,  PMT_error and PMT_error_2
> be included as metrics as these ³are² generally present in MPEG Transport
> streams and errors within these can prevent correct decoding of the stream.
>   
> C.5 PCR_error_count
>   
> PCR_error_count is defined twice - the second of these should be
> PCR_accuracy_error_count
>   
>   [Qin]: Good catch and have fixed in (-v11).
>
>
>