Re: [pm-dir] 答复: RFC6390 review of draft-ietf-xrblock-rtcp-xr-decodability

Gonzalo Camarillo <Gonzalo.Camarillo@ericsson.com> Mon, 27 May 2013 06:38 UTC

Return-Path: <gonzalo.camarillo@ericsson.com>
X-Original-To: pm-dir@ietfa.amsl.com
Delivered-To: pm-dir@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3F9E221F942B for <pm-dir@ietfa.amsl.com>; Sun, 26 May 2013 23:38:10 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -103.198
X-Spam-Level:
X-Spam-Status: No, score=-103.198 tagged_above=-999 required=5 tests=[HELO_EQ_SE=0.35, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_MED=-4, SARE_SUB_ENC_UTF8=0.152, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id mgqmpYsbf2fO for <pm-dir@ietfa.amsl.com>; Sun, 26 May 2013 23:38:05 -0700 (PDT)
Received: from mailgw7.ericsson.se (mailgw7.ericsson.se [193.180.251.48]) by ietfa.amsl.com (Postfix) with ESMTP id 7860821F920B for <pm-dir@ietf.org>; Sun, 26 May 2013 23:38:04 -0700 (PDT)
X-AuditID: c1b4fb30-b7f8a6d000001a2d-9e-51a2ff4a453b
Received: from esessmw0237.eemea.ericsson.se (Unknown_Domain [153.88.253.125]) by mailgw7.ericsson.se (Symantec Mail Security) with SMTP id C7.87.06701.A4FF2A15; Mon, 27 May 2013 08:38:03 +0200 (CEST)
Received: from [131.160.126.70] (153.88.115.8) by esessmw0237.eemea.ericsson.se (153.88.115.91) with Microsoft SMTP Server id 8.3.279.1; Mon, 27 May 2013 08:37:58 +0200
Message-ID: <51A2FF45.1030609@ericsson.com>
Date: Mon, 27 May 2013 09:37:57 +0300
From: Gonzalo Camarillo <Gonzalo.Camarillo@ericsson.com>
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/20130509 Thunderbird/17.0.6
MIME-Version: 1.0
To: Benoit Claise <bclaise@cisco.com>
References: <CD8499D5.4FA30%alan.d.clark@telchemy.com> <A64E8EB6A56342CB8423D1532A94709C@china.huawei.com> <51656EB3.9060300@cisco.com> <B8F9A780D330094D99AF023C5877DABA43A3C121@nkgeml501-mbs.china.huawei.com> <519F81F9.5070903@cisco.com>
In-Reply-To: <519F81F9.5070903@cisco.com>
X-Enigmail-Version: 1.5.1
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 8bit
X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFrrNLMWRmVeSWpSXmKPExsUyM+Jvra73/0WBBt/eM1lsPTaR0WLiG2aL OdMvslocfSxh8XjuAlaLrz9/sFqsn3yJxeLoB0uLpZ2n2C1+H5rH6sDl8bJ/DqPHwZVz2D2m /N7I6rFz1l12j5Yjb1k9liz5yeTx4uh2do+eS7MZPY7NP8cYwBnFZZOSmpNZllqkb5fAlTHr wR+Wgu92Fbeeb2JqYLxn1MXIwSEhYCJx/551FyMnkCkmceHeerYuRi4OIYFTjBKfpzczQzhr GCV+3ZnHClLFK6AtsebeOjYQm0VAVeJK/28WEJtNwEJiy637YLaoQJTEnHUP2CDqBSVOznwC FhcBqu/fuoUFZCizwBMmiemdyxlBHGGBBkaJxtXzmSDWvQNat+Yl2DpOAU2Jkxs/skEcKCmx 5UU7O4jNDBRv3f4bypaXaN46mxnEFgI6b/mzFpYJjEKzkGyfhaRlFpKWBYzMqxjZcxMzc9LL zTcxAiPo4JbfBjsYN90XO8QozcGiJM7bpz01UEggPbEkNTs1tSC1KL6oNCe1+BAjEwenVAPj vKNCjrGt1jVbVPTqkufNC9qzOy/XfneJzUYF2UVf61zthS5Oci4W/dJvvCR52Y9rd8VDF7/I 02m+ELouuqTyWIZkl8q330uuOAtOK2aeIO7ixn5Lh+XehYbCw58ush2btlyy1To7cbvRUxuj n0pXWufUvvToXeQZyBRwcGpxxJxf619Jf7BXYinOSDTUYi4qTgQAEAW1AG4CAAA=
Cc: "Huangyihong (Rachel)" <rachel.huang@huawei.com>, "Dan (Dan)" <dromasca@avaya.com>, "asaeda@nict.go.jp" <asaeda@nict.go.jp>, Alan Clark <alan.d.clark@telchemy.com>, "glenzorn@gmail.com" <glenzorn@gmail.com>, Shida Schubert <shida@ntt-at.com>, "pm-dir@ietf.org" <pm-dir@ietf.org>, Qin Wu <bill.wu@huawei.com>, Al Morton <acmorton@att.com>
Subject: Re: [pm-dir] 答复: RFC6390 review of draft-ietf-xrblock-rtcp-xr-decodability
X-BeenThere: pm-dir@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Performance Metrics Directorate Discussion list <pm-dir.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/pm-dir>, <mailto:pm-dir-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/pm-dir>
List-Post: <mailto:pm-dir@ietf.org>
List-Help: <mailto:pm-dir-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/pm-dir>, <mailto:pm-dir-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 27 May 2013 06:38:10 -0000

Thanks for your note, Benoit :-)

Gonzalo

On 24/05/2013 6:06 PM, Benoit Claise wrote:
> Hi Qin,
>> Hi,Benoit:
>> As Alan observed in PM-DIR review, this draft does not define new
>> metrics but refers to metrics that are
>> clearly defined in a normative reference.
>> I think we can skip RFC6390 template usage just like PDV
>> draft(RFC6798) did, can't we?
> I finally had to the time to review this document, which is on the IESG
> telechat on Thursday.
> Basically, Alan is right, the answer is "yes, you can skip RFC6390"
> And I'm balloting "no objection".
> For once, I don't have any DISCUSS on your document. I thought I would
> let you know. ;-)
> 
> Regards, Benoit
>>
>> Regards!
>> -Qin
>> -----邮件原件-----
>> 发件人: Benoit Claise [mailto:bclaise@cisco.com]
>> 发送时间: 2013年4月10日 21:53
>> 收件人: Qin Wu
>> 抄送: Alan Clark; Gonzalo Camarillo; pm-dir@ietf.org; Dan (Dan); Shida
>> Schubert; Huangyihong (Rachel); asaeda@nict.go.jp; glenzorn@gmail.com;
>> Al Morton
>> 主题: Re: RFC6390 review of draft-ietf-xrblock-rtcp-xr-decodability
>>
>> Hi Qin,
>>
>> And don't forget the RFC 6390 template usage.
>>
>> Regards, Benoit
>>> Hi, Alan:
>>> Thank for your valuable comments.
>>> We have updated the draft to incorporate your comments in the new
>>> version (-v11).
>>> The diff is:
>>> http://www.ietf.org/rfcdiff?url2=draft-ietf-xrblock-rtcp-xr-decodability-11
>>>
>>> Please also see my reply below.
>>>
>>> Regards!
>>> -Qin
>>> ----- Original Message -----
>>> From: "Alan Clark" <alan.d.clark@telchemy.com>
>>> To: "Gonzalo Camarillo" <Gonzalo.Camarillo@ericsson.com>;
>>> <pm-dir@ietf.org>; "Benoit Claise" <bclaise@cisco.com>; "Dan (Dan)"
>>> <dromasca@avaya.com>; "Shida Schubert" <shida@ntt-at.com>;
>>> <rachel.huang@huawei.com>; <bill.wu@huawei.com>; <asaeda@nict.go.jp>;
>>> <glenzorn@gmail.com>; "Al Morton" <acmorton@att.com>
>>> Sent: Saturday, April 06, 2013 3:10 AM
>>> Subject: RFC6390 review of draft-ietf-xrblock-rtcp-xr-decodability
>>>
>>>
>>> There are quite a few issues with the draft - I can re-review as soon as
>>> these are addressed.
>>>
>>> Alan Clark
>>>
>>>
>>>
>>> A. General Comments
>>>    This draft does not define new metrics but refers to metrics that are
>>> clearly defined in a normative reference.  The normative reference (ETSI
>>> TR101290) predates RFC6390 however does contain a fairly clear
>>> description
>>> of the metrics with explanation of their usage. It is not recommended
>>> that
>>> this draft redefines the metrics in RFC6390 template form
>>>
>>> [Qin]: Exactly.
>>>
>>> however there is
>>> considerable scope for improvement in the clarity of definition of
>>> how these
>>> metrics are used.
>>>
>>> [Qin]: Agree.
>>>    B. Applicability Section
>>>    1.4 Applicability
>>> Metrics only measure transport stream quality not content stream
>>> quality.
>>> Also the metrics are not defined in this draft but are encodings of the
>>> metrics defined in ETSI TS 101290.
>>>    Suggest
>>>    ³This block type allows a counts of MPEG Transport Stream quality
>>> metrics
>>> that are measured in accordance with ETSI TR 101290 [ETSI] to be
>>> reported by
>>> an endpoint.  These metrics are useful for identifying bitstream
>>> packetization and transport stream encoding problems that may affect the
>>> user¹s perception of a video service delivered over RTP.²
>>>
>>> [Qin]: Okay. Your proposed text have been incorporated in (-v11).
>>>    C. Metrics Definitions
>>>    C.1 General
>>>    For clarity the draft should preface the metrics definitions with
>>> a general
>>> explanation of how these metrics relate to ETSI TR101290. TR101290
>>> generally
>>> defines error events and this draft contains counts of those metrics.
>>>
>>>    If there are any ³edge² cases where a problem in one measurement
>>> interval
>>> would be reflected in the count in the next measurement interval then
>>> this
>>> should be articulated in the general description and also in the
>>> specific
>>> metric.  For example, a sync byte error is defined as multiple
>>> consecutive
>>> errored sync bytes and if this was reported in an interval it may have
>>> occurred at the end of the preceding interval or at some time during the
>>> present interval - hence the description should state that the count may
>>> reflect a problem in the current or previous interval. This would
>>> also be
>>> the case for PCR errors and even continuity count errors.
>>>
>>> [Qin]: Okay, I have added some text in the 2nd paragraph of section 3
>>> and incorporated your suggested text in (v-11).
>>>    C.2  Sequence numbers
>>>    begin_seq and end_seq
>>>    These definitions simply say ³As defined inS² which requires the
>>> reader to
>>> refer to another document. It is good practice to at least mention
>>> what the
>>> definition refers to and then to include a reference that contains the
>>> normative definition.
>>>    SoS..
>>>    ³begin_seq: 16 bits
>>>
>>> The RTP sequence number corresponding to the start of the measurement
>>> period, as defined in Section 4.1 of RFC 3611²
>>>
>>> [Qin]: Fixed in (-v11).
>>>    C.3 Metrics definitions
>>> The metrics definitions should contain a firmer statement of what is
>>> being
>>> measured and, if the normative definition is in another standard, then
>>> clearly state ³as defined in Section X.Y of NNNNN². This applies to
>>> all the
>>> metrics definitions and the example below can be used as a template for
>>>    For example
>>>    Existing language S..
>>>    TS_sync_loss_count: 32 bits
>>>    Number of TS_sync_loss errors in the above sequence number
>>> interval.  It is
>>> calculated based on the occurrence of errors for "TS_sync_loss"parameter
>>> defined in the section 5.2.1 of [ETSI] (Also see section 5.5.1 of
>>> [ETSI]).
>>>    This is very vague language and it is unclear why the ³Also see²
>>> reference
>>> is there.  A better approach is:
>>>    Replacement language (use this format for each of the metrics)
>>>    TS_sync_loss_count: 32 bits
>>>    A count of the number of TS_sync_loss errors that occurred in the
>>> above
>>> sequence number interval.  A TS_sync_loss error occurs when there are
>>> two or
>>> more consecutive incorrect sync bytes within the MPEG TS stream, as
>>> defined
>>> in section 5.2.1 of [ETSI]. This parameter may be used as part of a
>>> Service
>>> Availability calculation, as defined in section 5.5.1 of [ETSI].
>>>
>>> [Qin]: Fixed in (-v11).
>>>    C.4 Service Availability
>>>    Following on from the previous comment,  section 5.5.1 of TR101290
>>> describes
>>> a service availability error as a combination of TS_sync_loss,
>>> PAT_error and
>>> PMT_error whereas draft-ietf-xrblock-rtcp-xr-decodability-10 does not
>>> contain the PAT and PMT error metrics.  The resolution for this would
>>> either
>>> be to remove the reference to 5.5.1 or to add the metrics required to
>>> calculate the service availability.
>>>    [Qin]: Agree. I prefer to remove the reference to 5.5.1 since
>>> there was consensus in the past WGLC to this draft
>>> that having a second report block later to cover the other parameters
>>> and get inline with concept of RFC6792
>>> and letting this draft focus on PSI indpendent parameter reporting.
>>> See details for the WGLC discussion in the following link:
>>> http://www.ietf.org/mail-archive/web/xrblock/current/msg01032.html
>>>
>>> It is recommended that PAT_error , PAT_error_2,  PMT_error and
>>> PMT_error_2
>>> be included as metrics as these ³are² generally present in MPEG
>>> Transport
>>> streams and errors within these can prevent correct decoding of the
>>> stream.
>>>    C.5 PCR_error_count
>>>    PCR_error_count is defined twice - the second of these should be
>>> PCR_accuracy_error_count
>>>       [Qin]: Good catch and have fixed in (-v11).
>>>
>>>
>>>
>>
>>
>