Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr-discardandxrblock-rtcp-xr-discard-rle-metrics

Varun Singh <vsingh.ietf@gmail.com> Fri, 06 July 2012 11:34 UTC

Return-Path: <vsingh.ietf@gmail.com>
X-Original-To: xrblock@ietfa.amsl.com
Delivered-To: xrblock@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 674EC21F8781 for <xrblock@ietfa.amsl.com>; Fri, 6 Jul 2012 04:34:41 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.299
X-Spam-Level:
X-Spam-Status: No, score=-3.299 tagged_above=-999 required=5 tests=[AWL=-0.300, BAYES_00=-2.599, J_CHICKENPOX_64=0.6, RCVD_IN_DNSWL_LOW=-1]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7Cbo7Mk2sKG1 for <xrblock@ietfa.amsl.com>; Fri, 6 Jul 2012 04:34:40 -0700 (PDT)
Received: from mail-yw0-f44.google.com (mail-yw0-f44.google.com [209.85.213.44]) by ietfa.amsl.com (Postfix) with ESMTP id D4C1421F8779 for <xrblock@ietf.org>; Fri, 6 Jul 2012 04:34:39 -0700 (PDT)
Received: by yhq56 with SMTP id 56so10875137yhq.31 for <xrblock@ietf.org>; Fri, 06 Jul 2012 04:34:55 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=IRx/CYOSjcyXpOSfv/LWxCaN9b5MLO4XeeBR9aDgsec=; b=NPvMGsIGQvmijcz8gZPFr+dXOyqZWNTiVEa6IoCYcqXMCPhc73+9iMlYMbGtd17TCD Dl4XuPhXJao33Ll3FCm+2iZSM3VVNgNQXlYs8IZ6mOTmlzSLvWzlya8OP0vjWDZMbNCQ Wp7yDriuljbJnGuCwx4Ycb6NqPCMBwcOBBbxjW209FEH/4/OIxcwKgFKbTAW6NwfMRPB sf1bdO6aF/GDPu9Wz91DFf2V5G/YynbDjbizbMmIYBTwYGFWPfYOu5zQ5laF6/yWaPGo gXuNbgNrX6tcJsqoetdVO9D8j9TjigiWm6e3a9Gbtp2i8TRr+PAl4p1bGYLqCxbz+qVK 4TjA==
Received: by 10.66.88.230 with SMTP id bj6mr44726285pab.43.1341574495145; Fri, 06 Jul 2012 04:34:55 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.68.129.98 with HTTP; Fri, 6 Jul 2012 04:34:35 -0700 (PDT)
In-Reply-To: <CC1C3B7E.4775C%alan.d.clark@telchemy.com>
References: <FE289044-1933-420F-BFA6-A38B0B089D4A@ntt-at.com> <CC1C3B7E.4775C%alan.d.clark@telchemy.com>
From: Varun Singh <vsingh.ietf@gmail.com>
Date: Fri, 06 Jul 2012 14:34:35 +0300
Message-ID: <CAEbPqryfOTjAcuVDU=LJX5amAQ0yjTzz48akH_DJ+xcTHN8JnQ@mail.gmail.com>
To: Alan Clark <alan.d.clark@telchemy.com>
Content-Type: text/plain; charset="ISO-8859-1"
Cc: xrblock <xrblock@ietf.org>
Subject: Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr-discardandxrblock-rtcp-xr-discard-rle-metrics
X-BeenThere: xrblock@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Metric Blocks for use with RTCP's Extended Report Framework working group discussion list <xrblock.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xrblock>, <mailto:xrblock-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xrblock>
List-Post: <mailto:xrblock@ietf.org>
List-Help: <mailto:xrblock-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xrblock>, <mailto:xrblock-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 06 Jul 2012 11:34:41 -0000

On Fri, Jul 6, 2012 at 1:51 PM, Alan Clark <alan.d.clark@telchemy.com> wrote:
> Shida
>
> You could have all three types of discard occurring within a single stream.
> For example - if RTP replication is used for resilience then every interval
> would have the same number of duplicate/other packets as data packets and if
> there is a high level of jitter then there would also be late packets, early
> packets or both.
>

I agree that one of early, late or others or any combination of the
three is a valid reporting case.
Perhaps there needs to be only a clarification on when to use early
and late or combined early and late.

Regards,
Varun

> Best Regards
>
> Alan
>
>
> On 7/6/12 5:07 AM, "Shida Schubert" <shida@ntt-at.com> wrote:
>
>>
>> (as contributor)
>>
>>   So does that mean that in a single report block, early and late can co-exist
>> when it is described as type "both" but you can't have "other" + early,
>> "other" + late or "other" + both?
>>
>>  Thus, for the same reporting period, you would have separate reporting
>> block for the above discarded packets combination? If that is the case,
>> I think this should be explicitly stated in the section where the type is
>> described.
>>
>>  Also, the draft reads like it is dependent on Measurement Identity based
>> on the sub-section "number of packets discarded". If that is the case, the
>> Mesurement Identity should become a Normative Reference.
>>
>>  Regards
>>   Shida
>>
>> On Jul 3, 2012, at 11:09 AM, Qin Wu wrote:
>>
>>> That's what I think, thank for your clarification.
>>>
>>> Regards!
>>> -Qin
>>> ----- Original Message -----
>>> From: "Alan Clark" <alan.d.clark@telchemy.com>
>>> To: "Dan (Dan)" <dromasca@avaya.com>; "Qin Wu" <bill.wu@huawei.com>; "Shida
>>> Schubert" <shida@ntt-at.com>; "xrblock" <xrblock@ietf.org>
>>> Cc: <draft-ietf-xrblock-rtcp-xr-discard@ietf.org>
>>> Sent: Monday, July 02, 2012 7:49 PM
>>> Subject: Re: [xrblock] WGLC for
>>> draft-ietf-xrblock-rtcp-xr-discardandxrblock-rtcp-xr-discard-rle-metrics
>>>
>>>
>>>> Hi Dan
>>>>
>>>> There are some implementations of RTP that send duplicate packets (in some
>>>> cases every packet) in order to provide a simple form of FEC. Reporting
>>>> duplicate packets as "duplicates" can allow the user to determine what
>>>> proportion of lost packets are being concealed by the process.  For example,
>>>> if I send 1000 packets but duplicate these in order to provide FEC - then
>>>> knowing that 900 duplicate packets were discarded tells me that the network
>>>> packet loss rate was 10%.
>>>>
>>>> The reason that RFC3611 excluded duplicates was that the discard count was
>>>> intended to show what effect late/early arriving packets were having on the
>>>> quality perceived by the user.  Discarded duplicates have no effect whereas
>>>> a discarded late packet causes a "hole" in the decoded stream that has to be
>>>> repaired by PLC
>>>>
>>>> It is useful to report discards of duplicate packets "separately from" the
>>>> early/late arrival discard count. They should not be combined into the same
>>>> counter.  This means that the early/late arrival discard count would be
>>>> consistent with RFC3611 but there is an additional count of discarded
>>>> duplicate packets
>>>>
>>>> Best Regards
>>>>
>>>> Alan
>>>>
>>>>
>>>> On 7/2/12 6:52 AM, "Dan (Dan)" <dromasca@avaya.com> wrote:
>>>>
>>>>> Hi Qin,
>>>>>
>>>>> Thank you for your response.
>>>>>
>>>>> I am fine with your proposed resolutions with the exception of item 3.
>>>>> The resolution proposed by you suggests including packets 'thrown away
>>>>> before playout (e.g., packet duplication or redundancy)' in the discard
>>>>> count metric. This would make the discard count metric inconsistent to
>>>>> the discard rate metric defined in section 4.7.1 of RFC 3611 which
>>>>> explicitly excludes duplicate packet discards.
>>>>>
>>>>> Am I the only one (exaggeratedly) concerned by this inconsistency? I
>>>>> would love to hear other opinions.
>>>>>
>>>>> Dan
>>>>> (speaking as contributor)
>>>>>
>>>>>
>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Qin Wu [mailto:bill.wu@huawei.com]
>>>>>> Sent: Friday, June 29, 2012 6:33 AM
>>>>>> To: Romascanu, Dan (Dan); Shida Schubert; xrblock
>>>>>> Cc: draft-ietf-xrblock-rtcp-xr-discard@ietf.org
>>>>>> Subject: Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr-
>>>>>> discardandxrblock-rtcp-xr-discard-rle-metrics
>>>>>>
>>>>>> Hi,Dan:
>>>>>> Thank for your valuable review to draft-ietf-xrblock-rtcp-xr-discard.
>>>>>> Please see my replies inline.
>>>>>>
>>>>>> Regards!
>>>>>> -Qin
>>>>>> ----- Original Message -----
>>>>>> From: "Romascanu, Dan (Dan)" <dromasca@avaya.com>
>>>>>> To: "Shida Schubert" <shida@ntt-at.com>; "xrblock" <xrblock@ietf.org>
>>>>>> Cc: <draft-ietf-xrblock-rtcp-xr-discard@ietf.org>;
>>>>> <draft-ietf-xrblock-
>>>>>> rtcp-xr-discard-rle-metrics@ietf.org>
>>>>>> Sent: Thursday, June 28, 2012 8:02 PM
>>>>>> Subject: Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr-
>>>>>> discardandxrblock-rtcp-xr-discard-rle-metrics
>>>>>>
>>>>>>
>>>>>>> (as contributor)
>>>>>>>
>>>>>>> I read the documents and they look almost ready for submission to
>>>>> the
>>>>>>> IESG.
>>>>>>>
>>>>>>> Here are a few comments on draft-ietf-xrblock-rtcp-xr-discard:
>>>>>>>
>>>>>>> 1. It would be useful I think to say more about the relation between
>>>>>>> this metric and the discard rate metric defined in section 4.7.1 of
>>>>>> RFC
>>>>>>> 3611. Maybe calling the metric here Discarded Packets metric would
>>>>>> help,
>>>>>>> as both RFC 3611 and this document refer to 'discard metric' but the
>>>>>> two
>>>>>>> are different (one is rate, the other packets).
>>>>>>
>>>>>> [Qin]: Good point, I propose to change 'discard metric' in this
>>>>> document
>>>>>> into 'discard count  metric' since
>>>>>> abstract in this draft also uses 'discard count metric'.
>>>>>>
>>>>>> To make this consistent with SDP parameter defined in this document, I
>>>>>> also like to propose to do the following change
>>>>>> OLD TEXT:
>>>>>> "
>>>>>>   xr-format =/ xr-pd-block
>>>>>>
>>>>>>    xr-pd-block = "pkt-dscrd"
>>>>>>
>>>>>> "
>>>>>> NEW TEXT:
>>>>>> "
>>>>>>   xr-format =/ xr-pdc-block
>>>>>>
>>>>>>    xr-pdc-block = "pkt-dscrd-count"
>>>>>>
>>>>>>
>>>>>> "
>>>>>>
>>>>>>> 2. In Section 3.1 diagram we use NBGD for Block Type, while the text
>>>>>> in
>>>>>>> Section 3.2 refers to the ND constant. We should get to a consistent
>>>>>>> representation
>>>>>>
>>>>>> [Qin]: It is a typo and will fix this by changing NBGD into ND.
>>>>>>>
>>>>>>> 3.
>>>>>>>
>>>>>>> Section 2.1:
>>>>>>>
>>>>>>>     A packet that arrives within
>>>>>>>     this time window but is too early or late to be played out
>>>>> shall
>>>>>>>     be regarded as discarded.  A packet shall be classified as one
>>>>> of
>>>>>>>     received (or OK), discarded or lost.  The Discard Metric counts
>>>>>>>     only discarded packets.
>>>>>>>
>>>>>>> Section 3.1 however includes:
>>>>>>>
>>>>>>>        00: packets are discarded due to other reasons than late
>>>>>>>        arrival, early arrival, or both (e.g., duplicate, redundant
>>>>>>>        packets).
>>>>>>>
>>>>>>> This seems inconsistent.
>>>>>>
>>>>>> [Qin]: Good question. To make them consistent, I propose do the
>>>>>> following change to Section 2.1
>>>>>> OLD TEXT:
>>>>>> "
>>>>>>     A packet that arrives within
>>>>>>      this time window but is too early or late to be played out shall
>>>>>>      be regarded as discarded.  A packet shall be classified as one
>>>>> of
>>>>>>      received (or OK), discarded or lost.  The Discard Metric counts
>>>>>>     only discarded packets.
>>>>>>
>>>>>> "
>>>>>> NEW TEXT:
>>>>>> "
>>>>>> A packet that arrives within
>>>>>>
>>>>>> this time window but is too early or late to be played out
>>>>>>
>>>>>> or is thrown away before playout (e.g., packet duplication or
>>>>>> redundancy)
>>>>>>
>>>>>> shall be regarded as discarded.  A packet shall be classified as one
>>>>> of
>>>>>>
>>>>>> received (or OK), discarded or lost.  The Discard Count Metric counts
>>>>>>
>>>>>> only discarded packets.
>>>>>> "
>>>>>>
>>>>>>> 4. Is there any reasons for the Interval Metric flag (I) to be 2
>>>>> bits,
>>>>>>> rather than one bit, with the other one reserved?
>>>>>>
>>>>>> [Qin]: Good question, I remembered we got a suggestion on the list
>>>>>> before from Kevin Gross which suggested to
>>>>>> remove Sampled metric related description from the definition of
>>>>>> Interval Metric flag. Since Sampled metric is
>>>>>> measured only at a particular time instant however metrics defined in
>>>>>> this document is
>>>>>> measured over one or several reporting intervals.To get in line with
>>>>> the
>>>>>> defintion
>>>>>> of the Interval Metric flag in other XR BLOCK drafts and address your
>>>>>> comment,
>>>>>> I propose the following change to the defintion of the interval metric
>>>>>> flag:
>>>>>>
>>>>>> OLD TEXT:
>>>>>> "
>>>>>>   Interval Metric flag (I): 2 bits
>>>>>>
>>>>>>      This field is used to indicate whether the Discard metric is an
>>>>>>      Interval or Cumulative metric, that is, whether the reported
>>>>>>      values applies to the most recent measurement interval duration
>>>>>>      between successive metrics reports (I=10) (the Interval
>>>>> Duration)
>>>>>>      or to the accumulation period characteristic of cumulative
>>>>>>      measurements (I=11) (the Cumulative Duration).
>>>>>>
>>>>>> "
>>>>>> NEW TEXT:
>>>>>> "
>>>>>>   Interval Metric flag (I): 2 bits
>>>>>>
>>>>>>
>>>>>>
>>>>>>      This field is used to indicate whether the Discard Count Metric
>>>>> is
>>>>>> an
>>>>>>
>>>>>>      Interval or Cumulative metric, Sample metric,that is, whether
>>>>> the
>>>>>> reported
>>>>>>
>>>>>>      values applies to the most recent measurement interval duration
>>>>>>
>>>>>>      between successive metrics reports (I=10) (the Interval
>>>>> Duration)
>>>>>>
>>>>>>      or to the accumulation period characteristic of cumulative
>>>>>>
>>>>>>      measurements (I=11) (the Cumulative Duration) or is a
>>>>>>
>>>>>>      sampled instantaneous value (I=01) (Sampled Value). In this
>>>>>> document,
>>>>>>
>>>>>>      Discard Count Metric is not measured at a particular time
>>>>> instant
>>>>>> but over
>>>>>>
>>>>>>      one or several reporting intervals. Therefore Discard Count
>>>>> Metric
>>>>>> MUST not
>>>>>>
>>>>>>      be chosen as Sampled Metric.
>>>>>>
>>>>>> "
>>>>>>
>>>>>>
>>>>>>> 5. number of packets discarded:
>>>>>>>
>>>>>>>> If the measured value exceeds 0xFFFFFFFD, the value 0xFFFFFFFE
>>>>>>>     SHOULD be reported to indicate an over-range measurement.
>>>>>>
>>>>>>> Why is this a SHOULD and not a MUST? Are there any exceptions?
>>>>>>
>>>>>> [Qin]: No,  I will use MUST based on your comment.
>>>>>>
>>>>>>> 6. In the IANA Considerations section:
>>>>>>>
>>>>>>> s/ The contact information for the registrations is/ The following
>>>>>>> contact information is provided for all registrations in this
>>>>>> document/
>>>>>>
>>>>>> [Qin]: Okay.
>>>>>>
>>>>>>>
>>>>> _______________________________________________
>>>>> xrblock mailing list
>>>>> xrblock@ietf.org
>>>>> https://www.ietf.org/mailman/listinfo/xrblock
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> xrblock mailing list
>>>> xrblock@ietf.org
>>>> https://www.ietf.org/mailman/listinfo/xrblock
>>
>
>
>
> _______________________________________________
> xrblock mailing list
> xrblock@ietf.org
> https://www.ietf.org/mailman/listinfo/xrblock



-- 
http://www.netlab.tkk.fi/~varun/