Re: [xrblock] AD evaluation: draft-ietf-xrblock-rtcp-xr-psi-decodability-03

Alissa Cooper <alissa@cooperw.in> Thu, 05 June 2014 02:42 UTC

Return-Path: <alissa@cooperw.in>
X-Original-To: xrblock@ietfa.amsl.com
Delivered-To: xrblock@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0F78E1A011B for <xrblock@ietfa.amsl.com>; Wed, 4 Jun 2014 19:42:48 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.499
X-Spam-Level:
X-Spam-Status: No, score=-1.499 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, J_CHICKENPOX_32=0.6, J_CHICKENPOX_82=0.6, MIME_QP_LONG_LINE=0.001, RCVD_IN_DNSWL_LOW=-0.7] autolearn=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xOk_gmplILu8 for <xrblock@ietfa.amsl.com>; Wed, 4 Jun 2014 19:42:46 -0700 (PDT)
Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id CE06A1A00F2 for <xrblock@ietf.org>; Wed, 4 Jun 2014 19:42:45 -0700 (PDT)
Received: from compute1.internal (compute1.nyi.mail.srv.osa [10.202.2.41]) by gateway1.nyi.mail.srv.osa (Postfix) with ESMTP id 9771E21AB5; Wed, 4 Jun 2014 22:42:38 -0400 (EDT)
Received: from frontend2 ([10.202.2.161]) by compute1.internal (MEProxy); Wed, 04 Jun 2014 22:42:38 -0400
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=cooperw.in; h=date :subject:from:to:message-id:references:in-reply-to:mime-version :content-type:content-transfer-encoding; s=mesmtp; bh=Y/BUGT1DiO Bf1VddwpxjP6vCJKI=; b=OASUfNVxrtEh3WhMrACbIh40TosbW/8sNZgQYh/otJ b+9IMDQqwysh1Sshdn/0gWoqHuPi4vS2hhRIJL2XGmS0i4HQckeoDlNTVxSJlBSn M8ls2k6o5IVM08hgBEXgG6sZz1V3WcRYaNYLRUnmFVvs/FKqYbQBfPr8b1INFe8R 8=
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=date:subject:from:to:message-id :references:in-reply-to:mime-version:content-type :content-transfer-encoding; s=smtpout; bh=Y/BUGT1DiOBf1VddwpxjP6 vCJKI=; b=dtKZdshFZF9rqnbjGWqVkfS/zEJ5xbhXdI5TiNOOOm/SSMGBhjct1v ofs0nbnBn7+awawsrSOAVKzb5Lqe00cCyycrWJGdmSR6pv24aS4sb9EjtbuNTXiz kEu85GtZ6Etkmt/yDZuB8gFAByTP7G3v5it/Z4nzL0dzHizUOHmmk=
X-Sasl-enc: zyAvYBo93wb0fWO/ktK4hQqvgKKtW7zFUZsuMH8+Pqht 1401936155
Received: from [172.19.131.160] (unknown [12.130.116.70]) by mail.messagingengine.com (Postfix) with ESMTPA id 95B20680104; Wed, 4 Jun 2014 22:42:26 -0400 (EDT)
User-Agent: Microsoft-MacOutlook/14.3.9.131030
Date: Wed, 04 Jun 2014 19:42:11 -0700
From: Alissa Cooper <alissa@cooperw.in>
To: Qin Wu <bill.wu@huawei.com>, "xrblock@ietf.org" <xrblock@ietf.org>
Message-ID: <CFB52713.3E235%alissa@cooperw.in>
Thread-Topic: [xrblock] AD evaluation: draft-ietf-xrblock-rtcp-xr-psi-decodability-03
References: <CFB3955F.3DF4C%alissa@cooperw.in> <B8F9A780D330094D99AF023C5877DABA845479BD@nkgeml501-mbs.china.huawei.com>
In-Reply-To: <B8F9A780D330094D99AF023C5877DABA845479BD@nkgeml501-mbs.china.huawei.com>
Mime-version: 1.0
Content-type: text/plain; charset="UTF-8"
Content-transfer-encoding: quoted-printable
Archived-At: http://mailarchive.ietf.org/arch/msg/xrblock/FG3hs4NIW6h7AfmZ2LVsUNoZUGk
Subject: Re: [xrblock] AD evaluation: draft-ietf-xrblock-rtcp-xr-psi-decodability-03
X-BeenThere: xrblock@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Metric Blocks for use with RTCP's Extended Report Framework working group discussion list <xrblock.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xrblock>, <mailto:xrblock-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xrblock/>
List-Post: <mailto:xrblock@ietf.org>
List-Help: <mailto:xrblock-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xrblock>, <mailto:xrblock-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 05 Jun 2014 02:42:48 -0000

Hi Qin,

Thanks for your response. My comments are inline.

One note for the WG: I’m a little surprised that earlier reviews (e.g.,
during WGLC) did not catch some of these errors. For future documents of
this sort, it might be good to make sure that at least one reviewer or the
document shepherd does a comparison between what is specified in the I-D
and what is specified in other corresponding specs.

On 6/3/14, 10:33 PM, "Qin Wu" <bill.wu@huawei.com> wrote:

>Hi, Alissa:
>Thanks for valuable comments. We think not all implementations support
>scrambling and scrambling adds a lot of complexity for packet processing
>since it needs to support encryption and decryption.
>But you are right, to get consistent with ETSI TR 101 290, I am okay with
>adding scrambling feature.

I didn’t mean to take a position on the scrambling. But since it was not
addressed in the draft and references are made to the ETSI document, it
needs to be explained one way or the other. If the scrambling-based
conditions are not relevant, that should be explained; if they are part of
the logic that yields the errors, that should be explained.

>For your comments, please see my reply below.
>
>Regards!
>-Qin
>-----邮件原件-----
>发件人: xrblock [mailto:xrblock-bounces@ietf.org] 代表 Alissa Cooper
>发送时间: 2014年6月4日 5:08
>收件人: xrblock@ietf.org
>主题: [xrblock] AD evaluation:
>draft-ietf-xrblock-rtcp-xr-psi-decodability-03
>
>I have reviewed this draft in preparation for IETF LC and I have some
>questions before proceeding with the LC announcement.
>
>In Section 3, there seem to be some inconsistencies between the way that
>some of the fields are defined in the block and the way the corresponding
>metrics are described in ETSI TR 101 290 (assuming
>http://www.etsi.org/deliver/etsi_tr/101200_101299/101290/01.02.01_60/tr_10
>1
>290v010201p.pdf is the correct reference for that document):
>
>(1) PAT_error_count is defined in the draft as:
>
>"A count of the number of PAT errors that occurred in the above
>      sequence number interval.  The program association table (PAT) is
>      the only packet with packet ID (PID) 0x 0000.  A PAT error occurs
>      when it does not occur at least every 0.5s or the table has an ID
>      other than 0x 00, as defined in section 5.2.1 of [ETSI].  Every
>      program within the MPEG TS stream is listed in the PAT; if it is
>      missing, then no programs can be decoded."
>
>Whereas in the ETSI document, a PAT_error is defined as:
>
>"PID 0x0000 does not occur at least every 0,5 s a PID 0x0000 does not
>contain a table_id 0x00 ( i.e.
>a PAT)
>Scrambling_control_field is not 00 for PID 0x0000”
>
>Is the definition in the draft supposed to be equivalent to the first two
>conditions in the ETSI definition? If so, that is not quite clear from
>the draft. Why is the Scrambling_control_field condition not also part of
>the definition in the draft?
>
>[Qin]: I propose the following change:
>NEW TEXT:
>"
>   PAT_error_count: 16 bits
>
>      A count of the number of PAT errors that occurred in the above
>      sequence number interval.  The program association table (PAT) is
>      the only packet with packet ID (PID) 0x 0000.  A PAT error occurs
>      when it does not occur at least every 0.5s or the table has an ID
>      other than 0x00 or Scrambling_control_field in the TS packet header
>       is not 00 for PID 0x0000, as defined in section 5.2.1 of [ETSI].
>Every
>      program within the MPEG TS stream is listed in the PAT; if it is
>      missing, then no programs can be decoded.
>"

I think this would be clearer if you break out the conditions:

PAT_error_count: 16 bits

      A count of the number of PAT errors that occurred in the above
sequence number interval.  The program association table (PAT) is the only
packet with packet ID (PID) 0x0000.  A PAT error occurs when: (1) a packet
with PID 0x0000 does not occur at least every 0.5 seconds, or (2) a packet
with PID 0x0000 does not contain a table_id 0x00 (i.e., a PAT), or (3) the
Scrambling_control_field in the TS packet header is not 00 for a packet
with PID 0x0000. See section 5.2.1 of [ETSI]. Every program within the
MPEG TS stream is listed in the PAT; if it is missing, then no programs
can be decoded.


I would suggest making similar changes to all of the field definitions
that describe a list of multiple conditions that trigger the errors.
					
				
			
		
	



>
>I have the same questions about PAT_error_2_count.
>
>[Qin]:How about the following change:
>NEW TEXT:
>"
>   PAT_error_2_count: 16 bits
>
>      A count of the number of PAT2 errors that occurred in the above
>      sequence number interval.  A PAT2 error occurs when it does not
>      occur at least every 0.5s or the table has an ID other than 0x00
>      or there is more than one table ID 0x 00 inside the packet with
>      the PAT PID or Scrambling_control_field in the TS packet header
>      is not 00 for PID 0x0000, as defined in section 5.2.1 of [ETSI].
>"
>
>(2) In the draft, PMT_error_count and PMT_error_2_count have the exact
>same definition. But in the ETSI document, a PMT_error is different from
>a PMT_error_2. Here are the definitions from the ETSI document:
>
>PMT_error:
>"Sections with table_id 0x02, ( i. e. a PMT), do not occur at least every
>0,5 s on the PID which is referred to in the PAT Scrambling_control_field
>is not 00 for all PIDs containing sections with table_id 0x02 (i.e. a
>PMT)”
>
>PMT_error_2:
>"Sections with table_id 0x02, (i.e. a PMT), do not occur at least every
>0,5 s on each program_map_PID which is referred to in the PAT
>Scrambling_control_field is not 00 for all packets containing information
>of sections with table_id
>0x02 (i.e. a PMT) on each program_map_PID which is referred to in the PAT"
>
>Are the equivalent definitions of PMT_error_count and PMT_error_2_count
>in the draft intentional? If so, why define the same metric twice, and
>why make PMT_error_2_count different from the way PMT_error_2 is defined
>in the ETSI document?
>
>[Qin]: Good catch, without scrambling, definitions of PMT_error_count and
>PMT_error_2_count in the draft are equivalent.
>But in ETSI document, PMT_error_2_count is different from PMT_error_count
>since the former excludes specifically network_PID.
>I propose the following changes to definitions of PMT_error_count and
>PMT_error_2_count in the draft:
>NEW TEXT:
>"
>   PMT_error_count: 16 bits
>
>      A count of the number of PMT_errors that occurred in the above
>      sequence number interval.  A PMT_error occurs when the program map
>      table (PMT) does not come up at least every 0.5s on the PID that
>      is referred to in the PAT or Scrambling_control_field in the TS
>packet header is not 00 for all PIDs
>      containing sections with table_id 0x02 (i.e. a PMT), as defined in
>the section 5.2.1 of
>      [ETSI].
>
>      The measured value is unsigned value.  If the measurement is
>      unavailable, the value 0xFFFF MUST be reported.  Note that
>      PMT_error_count and PMT_error_2_count MUST NOT be reported at the
>      same time in the same metric block.  If PMT_error_count is
>      reported, PMT_error_2_count MUST be set to 0xFFFF.
>
>   PMT_error_2_count: 16 bits
>
>      A count of the number of PMT2 errors that occurred in the above
>      sequence number interval.  A PMT2_error occurs when the program
>      map table (PMT) does not come up at least every 0.5s on the PID
>      that is referred to in the PAT or Scrambling_control_field in the
>TS packet header is not 00 for all packets
>      containing information of sections with table_id
>      0x02 (i.e. a PMT) on each program_map_PID
>      which is referred to in the PAT, as defined in the section 5.2.1 of
>      [ETSI].
>
>      The measured value is unsigned value.  If the measurement is
>      unavailable, the value 0xFFFF MUST be reported.  Note that
>      PMT_error_count and PMT_error_2_count MUST NOT be reported at the
>      same time in the same metric block.  If PMT_error_2_count is
>      reported, PMT_error_count MUST be set to 0xFFFF.
>"

If you can list the conditions as I suggest above, I think these are okay.

>
>(3) The draft defines PID_error_count as:
>
>"A count of the number of PID_errors that occurred in the above
>      sequence number interval.  A PID_error occurs when MPEG TS streams
>      are remultiplexed and any PID doesn't refer to an actual data
>      stream, as defined in the section 5.2.2 of [ETSI]."
>
>
>PID_error is defined in 5.2.1 of the ETSI draft, not 5.2.2. Is the
>definition in 5.2.1 what this field in the block is supposed to
>correspond to, or is it something else?
>
>[Qin]:Good catch, it should be 5.2.1.
>
>(4) CAT_error_count is defined in the draft as:
>
>"A count of the number of CAT_errors that occurred in the above
>      sequence number interval.  A CAT_error occurs when the table has
>      an ID other than 0x 01,as defined in the section 5.2.2 of [ETSI].”
>
>CAT_error is defined in the ETSI document as:
>
>"Packets with transport_scrambling_control not 00 present, but no section
>with table_id = 0x01 (i.e. a
>CAT) present
>Section with table_id other than 0x01
>(i.e. not a CAT) found on PID 0x0001"
>
>[Qin]: How about the following change:
>NEW TEXT:
>"
>   CAT_error_count: 16 bits
>
>      A count of the number of CAT_errors that occurred in the above
>      sequence number interval.  A CAT_error occurs when the table has
>      an ID other than 0x 01 or section with table_id = 0x01 (i.e. a
>      CAT)is not present when scrambling is employed,as defined in the
>section 5.2.2 of [ETSI].
>"

In re-reading this, I’m actually not sure I understand the first condition
in the ETSI document and how it maps onto the error count being defined
here. Does a CAT_error occur when *any* packet has
transport_scrambling_control != 00 and no section with table_id==0x01? Is
CAT_error_count supposed to reflect the number of such packets that occur
within the (begin_seq, end_seq) interval?

Thanks,
Alissa


>
>Again I’m curious why the definition in the draft seems to have only one
>portion of one of the conditions that appear in the ETSI document.
>
>[Qin]: Addressed with the above proposed changes. Thanks.
>
>Thanks,
>Alissa
>
>
>_______________________________________________
>xrblock mailing list
>xrblock@ietf.org
>https://www.ietf.org/mailman/listinfo/xrblock