Re: [pm-dir] 答复: RFC6390 review of draft-ietf-xrblock-rtcp-xr-decodability

Gonzalo Camarillo <Gonzalo.Camarillo@ericsson.com> Wed, 15 May 2013 15:20 UTC

Return-Path: <gonzalo.camarillo@ericsson.com>
X-Original-To: pm-dir@ietfa.amsl.com
Delivered-To: pm-dir@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 56BF521F8F4F for <pm-dir@ietfa.amsl.com>; Wed, 15 May 2013 08:20:49 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -106.023
X-Spam-Level:
X-Spam-Status: No, score=-106.023 tagged_above=-999 required=5 tests=[AWL=-0.226, BAYES_00=-2.599, HELO_EQ_SE=0.35, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_MED=-4, SARE_SUB_ENC_UTF8=0.152, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id X-BHlMovI-Ox for <pm-dir@ietfa.amsl.com>; Wed, 15 May 2013 08:20:40 -0700 (PDT)
Received: from mailgw1.ericsson.se (mailgw1.ericsson.se [193.180.251.45]) by ietfa.amsl.com (Postfix) with ESMTP id EDE0021F8ECB for <pm-dir@ietf.org>; Wed, 15 May 2013 08:20:39 -0700 (PDT)
X-AuditID: c1b4fb2d-b7f536d000006e05-40-5193a7c599c5
Received: from esessmw0247.eemea.ericsson.se (Unknown_Domain [153.88.253.125]) by mailgw1.ericsson.se (Symantec Mail Security) with SMTP id 9C.F3.28165.5C7A3915; Wed, 15 May 2013 17:20:37 +0200 (CEST)
Received: from [131.160.126.54] (153.88.115.8) by esessmw0247.eemea.ericsson.se (153.88.115.94) with Microsoft SMTP Server id 8.3.279.1; Wed, 15 May 2013 17:20:37 +0200
Message-ID: <5193A7C3.40906@ericsson.com>
Date: Wed, 15 May 2013 18:20:35 +0300
From: Gonzalo Camarillo <Gonzalo.Camarillo@ericsson.com>
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/20130328 Thunderbird/17.0.5
MIME-Version: 1.0
To: Qin Wu <bill.wu@huawei.com>
References: <CD8499D5.4FA30%alan.d.clark@telchemy.com> <A64E8EB6A56342CB8423D1532A94709C@china.huawei.com> <51656EB3.9060300@cisco.com> <B8F9A780D330094D99AF023C5877DABA43A3C121@nkgeml501-mbs.china.huawei.com>
In-Reply-To: <B8F9A780D330094D99AF023C5877DABA43A3C121@nkgeml501-mbs.china.huawei.com>
X-Enigmail-Version: 1.4.6
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 8bit
X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFrrDLMWRmVeSWpSXmKPExsUyM+Jvre7R5ZMDDdbd17bYemwio8XEN8wW c6ZfZLU4+ljC4vHcBawWX3/+YLVYP/kSi8XRD5YWSztPsVv8PjSP1YHL42X/HEaPgyvnsHtM +b2R1WPnrLvsHi1H3rJ6LFnyk8njxdHt7B49l2Yzehybf44xgDOKyyYlNSezLLVI3y6BK+Pl 1vXsBW+tKlpXrmRpYFyp38XIySEhYCJxZvlFdghbTOLCvfVsXYxcHEICpxglOu41sUM4axgl 7v3ayQhSxSugKXF0429WEJtFQFXiZecxsDibgIXEllv3WUBsUYEoiX9vd0PVC0qcnPkELC4i IC/RsPkuI8hQZoFXTBK/r59lBnGEBRoYJRpXz2eCWHeRUWLi4VtgKzgFwiQOL/vHCHGgpMSi aZ1go5iBzmjd/psdwpaXaN46mxnEFhLQllj+rIVlAqPQLCTbZyFpmYWkZQEj8ypG9tzEzJz0 csNNjMAYOrjlt+4OxlPnRA4xSnOwKInzJnE1BgoJpCeWpGanphakFsUXleakFh9iZOLglGpg zNknu5lj38OHtaJXn3VW3TT9V/qunqV8Q2vjmltSFg8SelKr5oTPe3J4QaL904Osx4IsJzT/ zOg4kmG0W/7e3i9uZs353AUzmNYs59xYmNHgudZk7uXAE1dubjJtW/uA4dFMhaQT914xXPrH uf2E4ucCa8Gl7+p8k5zu/b0ntGJPi95PIfcd95RYijMSDbWYi4oTAeZ3IQpvAgAA
Cc: "Huangyihong (Rachel)" <rachel.huang@huawei.com>, Shida Schubert <shida@ntt-at.com>, "Dan (Dan)" <dromasca@avaya.com>, "asaeda@nict.go.jp" <asaeda@nict.go.jp>, Alan Clark <alan.d.clark@telchemy.com>, "glenzorn@gmail.com" <glenzorn@gmail.com>, Benoit Claise <bclaise@cisco.com>, "pm-dir@ietf.org" <pm-dir@ietf.org>, Al Morton <acmorton@att.com>
Subject: Re: [pm-dir] 答复: RFC6390 review of draft-ietf-xrblock-rtcp-xr-decodability
X-BeenThere: pm-dir@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Performance Metrics Directorate Discussion list <pm-dir.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/pm-dir>, <mailto:pm-dir-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/pm-dir>
List-Post: <mailto:pm-dir@ietf.org>
List-Help: <mailto:pm-dir-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/pm-dir>, <mailto:pm-dir-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 15 May 2013 15:20:49 -0000

Hi Benoit,

what is the status of this? Can I progress this draft at this point?

Thanks,

Gonzalo

On 11/04/2013 5:14 AM, Qin Wu wrote:
> Hi,Benoit:
> As Alan observed in PM-DIR review, this draft does not define new metrics but refers to metrics that are
> clearly defined in a normative reference.
> I think we can skip RFC6390 template usage just like PDV draft(RFC6798) did, can't we?
> 
> Regards!
> -Qin
> -----邮件原件-----
> 发件人: Benoit Claise [mailto:bclaise@cisco.com] 
> 发送时间: 2013年4月10日 21:53
> 收件人: Qin Wu
> 抄送: Alan Clark; Gonzalo Camarillo; pm-dir@ietf.org; Dan (Dan); Shida Schubert; Huangyihong (Rachel); asaeda@nict.go.jp; glenzorn@gmail.com; Al Morton
> 主题: Re: RFC6390 review of draft-ietf-xrblock-rtcp-xr-decodability
> 
> Hi Qin,
> 
> And don't forget the RFC 6390 template usage.
> 
> Regards, Benoit
>> Hi, Alan:
>> Thank for your valuable comments.
>> We have updated the draft to incorporate your comments in the new version (-v11).
>> The diff is:
>> http://www.ietf.org/rfcdiff?url2=draft-ietf-xrblock-rtcp-xr-decodability-11
>> Please also see my reply below.
>>
>> Regards!
>> -Qin
>> ----- Original Message -----
>> From: "Alan Clark" <alan.d.clark@telchemy.com>
>> To: "Gonzalo Camarillo" <Gonzalo.Camarillo@ericsson.com>; <pm-dir@ietf.org>; "Benoit Claise" <bclaise@cisco.com>; "Dan (Dan)" <dromasca@avaya.com>; "Shida Schubert" <shida@ntt-at.com>; <rachel.huang@huawei.com>; <bill.wu@huawei.com>; <asaeda@nict.go.jp>; <glenzorn@gmail.com>; "Al Morton" <acmorton@att.com>
>> Sent: Saturday, April 06, 2013 3:10 AM
>> Subject: RFC6390 review of draft-ietf-xrblock-rtcp-xr-decodability
>>
>>
>> There are quite a few issues with the draft - I can re-review as soon as
>> these are addressed.
>>
>> Alan Clark
>>
>>
>>
>> A. General Comments
>>   
>> This draft does not define new metrics but refers to metrics that are
>> clearly defined in a normative reference.  The normative reference (ETSI
>> TR101290) predates RFC6390 however does contain a fairly clear description
>> of the metrics with explanation of their usage. It is not recommended that
>> this draft redefines the metrics in RFC6390 template form
>>
>> [Qin]: Exactly.
>>
>> however there is
>> considerable scope for improvement in the clarity of definition of how these
>> metrics are used.
>>
>> [Qin]: Agree.
>>   
>> B. Applicability Section
>>   
>> 1.4 Applicability
>> Metrics only measure transport stream quality not content stream quality.
>> Also the metrics are not defined in this draft but are encodings of the
>> metrics defined in ETSI TS 101290.
>>   
>> Suggest
>>   
>> ³This block type allows a counts of MPEG Transport Stream quality metrics
>> that are measured in accordance with ETSI TR 101290 [ETSI] to be reported by
>> an endpoint.  These metrics are useful for identifying bitstream
>> packetization and transport stream encoding problems that may affect the
>> user¹s perception of a video service delivered over RTP.²
>>
>> [Qin]: Okay. Your proposed text have been incorporated in (-v11).
>>   
>> C. Metrics Definitions
>>   
>> C.1 General
>>   
>> For clarity the draft should preface the metrics definitions with a general
>> explanation of how these metrics relate to ETSI TR101290. TR101290 generally
>> defines error events and this draft contains counts of those metrics.
>>
>>   
>> If there are any ³edge² cases where a problem in one measurement interval
>> would be reflected in the count in the next measurement interval then this
>> should be articulated in the general description and also in the specific
>> metric.  For example, a sync byte error is defined as multiple consecutive
>> errored sync bytes and if this was reported in an interval it may have
>> occurred at the end of the preceding interval or at some time during the
>> present interval - hence the description should state that the count may
>> reflect a problem in the current or previous interval. This would also be
>> the case for PCR errors and even continuity count errors.
>>
>> [Qin]: Okay, I have added some text in the 2nd paragraph of section 3
>> and incorporated your suggested text in (v-11).
>>   
>> C.2  Sequence numbers
>>   
>> begin_seq and end_seq
>>   
>> These definitions simply say ³As defined inS² which requires the reader to
>> refer to another document. It is good practice to at least mention what the
>> definition refers to and then to include a reference that contains the
>> normative definition.
>>   
>> SoS..
>>   
>> ³begin_seq: 16 bits
>>
>> The RTP sequence number corresponding to the start of the measurement
>> period, as defined in Section 4.1 of RFC 3611²
>>
>> [Qin]: Fixed in (-v11).
>>   
>> C.3 Metrics definitions
>> The metrics definitions should contain a firmer statement of what is being
>> measured and, if the normative definition is in another standard, then
>> clearly state ³as defined in Section X.Y of NNNNN². This applies to all the
>> metrics definitions and the example below can be used as a template for
>>   
>> For example
>>   
>> Existing language S..
>>   
>> TS_sync_loss_count: 32 bits
>>   
>> Number of TS_sync_loss errors in the above sequence number interval.  It is
>> calculated based on the occurrence of errors for "TS_sync_loss"parameter
>> defined in the section 5.2.1 of [ETSI] (Also see section 5.5.1 of [ETSI]).
>>   
>> This is very vague language and it is unclear why the ³Also see² reference
>> is there.  A better approach is:
>>   
>> Replacement language (use this format for each of the metrics)
>>   
>> TS_sync_loss_count: 32 bits
>>   
>> A count of the number of TS_sync_loss errors that occurred in the above
>> sequence number interval.  A TS_sync_loss error occurs when there are two or
>> more consecutive incorrect sync bytes within the MPEG TS stream, as defined
>> in section 5.2.1 of [ETSI]. This parameter may be used as part of a Service
>> Availability calculation, as defined in section 5.5.1 of [ETSI].
>>
>> [Qin]: Fixed in (-v11).
>>   
>> C.4 Service Availability
>>   
>> Following on from the previous comment,  section 5.5.1 of TR101290 describes
>> a service availability error as a combination of TS_sync_loss, PAT_error and
>> PMT_error whereas draft-ietf-xrblock-rtcp-xr-decodability-10 does not
>> contain the PAT and PMT error metrics.  The resolution for this would either
>> be to remove the reference to 5.5.1 or to add the metrics required to
>> calculate the service availability.
>>   
>> [Qin]: Agree. I prefer to remove the reference to 5.5.1 since there was consensus in the past WGLC to this draft
>> that having a second report block later to cover the other parameters and get inline with concept of RFC6792
>> and letting this draft focus on PSI indpendent parameter reporting.
>> See details for the WGLC discussion in the following link:
>> http://www.ietf.org/mail-archive/web/xrblock/current/msg01032.html
>>
>> It is recommended that PAT_error , PAT_error_2,  PMT_error and PMT_error_2
>> be included as metrics as these ³are² generally present in MPEG Transport
>> streams and errors within these can prevent correct decoding of the stream.
>>   
>> C.5 PCR_error_count
>>   
>> PCR_error_count is defined twice - the second of these should be
>> PCR_accuracy_error_count
>>   
>>   [Qin]: Good catch and have fixed in (-v11).
>>
>>
>>
>