Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr-discardandxrblock-rtcp-xr-discard-rle-metrics
Shida Schubert <shida@ntt-at.com> Sat, 07 July 2012 00:13 UTC
Return-Path: <shida@ntt-at.com>
X-Original-To: xrblock@ietfa.amsl.com
Delivered-To: xrblock@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4E6EE21F85FF for <xrblock@ietfa.amsl.com>; Fri, 6 Jul 2012 17:13:34 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -101.317
X-Spam-Level:
X-Spam-Status: No, score=-101.317 tagged_above=-999 required=5 tests=[AWL=0.348, BAYES_00=-2.599, IP_NOT_FRIENDLY=0.334, J_CHICKENPOX_64=0.6, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id QRBLHK4AKOlG for <xrblock@ietfa.amsl.com>; Fri, 6 Jul 2012 17:13:33 -0700 (PDT)
Received: from gator465.hostgator.com (gator465.hostgator.com [69.56.174.130]) by ietfa.amsl.com (Postfix) with ESMTP id EB3A521F85FD for <xrblock@ietf.org>; Fri, 6 Jul 2012 17:13:32 -0700 (PDT)
Received: from [211.13.69.210] (port=65464 helo=[192.168.1.14]) by gator465.hostgator.com with esmtpa (Exim 4.77) (envelope-from <shida@ntt-at.com>) id 1SnIeh-00014y-LZ; Fri, 06 Jul 2012 19:13:48 -0500
Mime-Version: 1.0 (Apple Message framework v1280)
Content-Type: text/plain; charset="iso-8859-1"
From: Shida Schubert <shida@ntt-at.com>
In-Reply-To: <CAEbPqryfOTjAcuVDU=LJX5amAQ0yjTzz48akH_DJ+xcTHN8JnQ@mail.gmail.com>
Date: Sat, 07 Jul 2012 09:13:45 +0900
Content-Transfer-Encoding: quoted-printable
Message-Id: <BC82FF35-26B4-4E11-873C-7C0424AD8C28@ntt-at.com>
References: <FE289044-1933-420F-BFA6-A38B0B089D4A@ntt-at.com> <CC1C3B7E.4775C%alan.d.clark@telchemy.com> <CAEbPqryfOTjAcuVDU=LJX5amAQ0yjTzz48akH_DJ+xcTHN8JnQ@mail.gmail.com>
To: Varun Singh <vsingh.ietf@gmail.com>
X-Mailer: Apple Mail (2.1280)
X-AntiAbuse: This header was added to track abuse, please include it with any abuse report
X-AntiAbuse: Primary Hostname - gator465.hostgator.com
X-AntiAbuse: Original Domain - ietf.org
X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12]
X-AntiAbuse: Sender Address Domain - ntt-at.com
X-BWhitelist: no
X-Source:
X-Source-Args:
X-Source-Dir:
X-Source-Sender: ([192.168.1.14]) [211.13.69.210]:65464
X-Source-Auth: shida.schubert+tingle.jp
X-Email-Count: 1
X-Source-Cap: c3NoaWRhO3NzaGlkYTtnYXRvcjQ2NS5ob3N0Z2F0b3IuY29t
Cc: xrblock <xrblock@ietf.org>
Subject: Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr-discardandxrblock-rtcp-xr-discard-rle-metrics
X-BeenThere: xrblock@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Metric Blocks for use with RTCP's Extended Report Framework working group discussion list <xrblock.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xrblock>, <mailto:xrblock-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xrblock>
List-Post: <mailto:xrblock@ietf.org>
List-Help: <mailto:xrblock-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xrblock>, <mailto:xrblock-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 07 Jul 2012 00:13:34 -0000
So my question was.. From what I can read, currently we have four types. 1. early ony 2. late only 3. both (late / early) 4. other (discarded to duplicate etc.) According to my understanding based on Qin's response. When there is an occurrence of 4 along with 1,2 or 3, you need to have 2 report blocks. 1 and 4, 2 and 4 or 3 and 4.. since we don't have a way to express these combination currently.. This is based on my assumption that other is distinguished from early or late Or is it used when duplicate packet arrives early or late? Regards Shida On Jul 6, 2012, at 8:34 PM, Varun Singh wrote: > On Fri, Jul 6, 2012 at 1:51 PM, Alan Clark <alan.d.clark@telchemy.com> wrote: >> Shida >> >> You could have all three types of discard occurring within a single stream. >> For example - if RTP replication is used for resilience then every interval >> would have the same number of duplicate/other packets as data packets and if >> there is a high level of jitter then there would also be late packets, early >> packets or both. >> > > I agree that one of early, late or others or any combination of the > three is a valid reporting case. > Perhaps there needs to be only a clarification on when to use early > and late or combined early and late. > > Regards, > Varun > >> Best Regards >> >> Alan >> >> >> On 7/6/12 5:07 AM, "Shida Schubert" <shida@ntt-at.com> wrote: >> >>> >>> (as contributor) >>> >>> So does that mean that in a single report block, early and late can co-exist >>> when it is described as type "both" but you can't have "other" + early, >>> "other" + late or "other" + both? >>> >>> Thus, for the same reporting period, you would have separate reporting >>> block for the above discarded packets combination? If that is the case, >>> I think this should be explicitly stated in the section where the type is >>> described. >>> >>> Also, the draft reads like it is dependent on Measurement Identity based >>> on the sub-section "number of packets discarded". If that is the case, the >>> Mesurement Identity should become a Normative Reference. >>> >>> Regards >>> Shida >>> >>> On Jul 3, 2012, at 11:09 AM, Qin Wu wrote: >>> >>>> That's what I think, thank for your clarification. >>>> >>>> Regards! >>>> -Qin >>>> ----- Original Message ----- >>>> From: "Alan Clark" <alan.d.clark@telchemy.com> >>>> To: "Dan (Dan)" <dromasca@avaya.com>; "Qin Wu" <bill.wu@huawei.com>; "Shida >>>> Schubert" <shida@ntt-at.com>; "xrblock" <xrblock@ietf.org> >>>> Cc: <draft-ietf-xrblock-rtcp-xr-discard@ietf.org> >>>> Sent: Monday, July 02, 2012 7:49 PM >>>> Subject: Re: [xrblock] WGLC for >>>> draft-ietf-xrblock-rtcp-xr-discardandxrblock-rtcp-xr-discard-rle-metrics >>>> >>>> >>>>> Hi Dan >>>>> >>>>> There are some implementations of RTP that send duplicate packets (in some >>>>> cases every packet) in order to provide a simple form of FEC. Reporting >>>>> duplicate packets as "duplicates" can allow the user to determine what >>>>> proportion of lost packets are being concealed by the process. For example, >>>>> if I send 1000 packets but duplicate these in order to provide FEC - then >>>>> knowing that 900 duplicate packets were discarded tells me that the network >>>>> packet loss rate was 10%. >>>>> >>>>> The reason that RFC3611 excluded duplicates was that the discard count was >>>>> intended to show what effect late/early arriving packets were having on the >>>>> quality perceived by the user. Discarded duplicates have no effect whereas >>>>> a discarded late packet causes a "hole" in the decoded stream that has to be >>>>> repaired by PLC >>>>> >>>>> It is useful to report discards of duplicate packets "separately from" the >>>>> early/late arrival discard count. They should not be combined into the same >>>>> counter. This means that the early/late arrival discard count would be >>>>> consistent with RFC3611 but there is an additional count of discarded >>>>> duplicate packets >>>>> >>>>> Best Regards >>>>> >>>>> Alan >>>>> >>>>> >>>>> On 7/2/12 6:52 AM, "Dan (Dan)" <dromasca@avaya.com> wrote: >>>>> >>>>>> Hi Qin, >>>>>> >>>>>> Thank you for your response. >>>>>> >>>>>> I am fine with your proposed resolutions with the exception of item 3. >>>>>> The resolution proposed by you suggests including packets 'thrown away >>>>>> before playout (e.g., packet duplication or redundancy)' in the discard >>>>>> count metric. This would make the discard count metric inconsistent to >>>>>> the discard rate metric defined in section 4.7.1 of RFC 3611 which >>>>>> explicitly excludes duplicate packet discards. >>>>>> >>>>>> Am I the only one (exaggeratedly) concerned by this inconsistency? I >>>>>> would love to hear other opinions. >>>>>> >>>>>> Dan >>>>>> (speaking as contributor) >>>>>> >>>>>> >>>>>> >>>>>>> -----Original Message----- >>>>>>> From: Qin Wu [mailto:bill.wu@huawei.com] >>>>>>> Sent: Friday, June 29, 2012 6:33 AM >>>>>>> To: Romascanu, Dan (Dan); Shida Schubert; xrblock >>>>>>> Cc: draft-ietf-xrblock-rtcp-xr-discard@ietf.org >>>>>>> Subject: Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr- >>>>>>> discardandxrblock-rtcp-xr-discard-rle-metrics >>>>>>> >>>>>>> Hi,Dan: >>>>>>> Thank for your valuable review to draft-ietf-xrblock-rtcp-xr-discard. >>>>>>> Please see my replies inline. >>>>>>> >>>>>>> Regards! >>>>>>> -Qin >>>>>>> ----- Original Message ----- >>>>>>> From: "Romascanu, Dan (Dan)" <dromasca@avaya.com> >>>>>>> To: "Shida Schubert" <shida@ntt-at.com>; "xrblock" <xrblock@ietf.org> >>>>>>> Cc: <draft-ietf-xrblock-rtcp-xr-discard@ietf.org>; >>>>>> <draft-ietf-xrblock- >>>>>>> rtcp-xr-discard-rle-metrics@ietf.org> >>>>>>> Sent: Thursday, June 28, 2012 8:02 PM >>>>>>> Subject: Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr- >>>>>>> discardandxrblock-rtcp-xr-discard-rle-metrics >>>>>>> >>>>>>> >>>>>>>> (as contributor) >>>>>>>> >>>>>>>> I read the documents and they look almost ready for submission to >>>>>> the >>>>>>>> IESG. >>>>>>>> >>>>>>>> Here are a few comments on draft-ietf-xrblock-rtcp-xr-discard: >>>>>>>> >>>>>>>> 1. It would be useful I think to say more about the relation between >>>>>>>> this metric and the discard rate metric defined in section 4.7.1 of >>>>>>> RFC >>>>>>>> 3611. Maybe calling the metric here Discarded Packets metric would >>>>>>> help, >>>>>>>> as both RFC 3611 and this document refer to 'discard metric' but the >>>>>>> two >>>>>>>> are different (one is rate, the other packets). >>>>>>> >>>>>>> [Qin]: Good point, I propose to change 'discard metric' in this >>>>>> document >>>>>>> into 'discard count metric' since >>>>>>> abstract in this draft also uses 'discard count metric'. >>>>>>> >>>>>>> To make this consistent with SDP parameter defined in this document, I >>>>>>> also like to propose to do the following change >>>>>>> OLD TEXT: >>>>>>> " >>>>>>> xr-format =/ xr-pd-block >>>>>>> >>>>>>> xr-pd-block = "pkt-dscrd" >>>>>>> >>>>>>> " >>>>>>> NEW TEXT: >>>>>>> " >>>>>>> xr-format =/ xr-pdc-block >>>>>>> >>>>>>> xr-pdc-block = "pkt-dscrd-count" >>>>>>> >>>>>>> >>>>>>> " >>>>>>> >>>>>>>> 2. In Section 3.1 diagram we use NBGD for Block Type, while the text >>>>>>> in >>>>>>>> Section 3.2 refers to the ND constant. We should get to a consistent >>>>>>>> representation >>>>>>> >>>>>>> [Qin]: It is a typo and will fix this by changing NBGD into ND. >>>>>>>> >>>>>>>> 3. >>>>>>>> >>>>>>>> Section 2.1: >>>>>>>> >>>>>>>> A packet that arrives within >>>>>>>> this time window but is too early or late to be played out >>>>>> shall >>>>>>>> be regarded as discarded. A packet shall be classified as one >>>>>> of >>>>>>>> received (or OK), discarded or lost. The Discard Metric counts >>>>>>>> only discarded packets. >>>>>>>> >>>>>>>> Section 3.1 however includes: >>>>>>>> >>>>>>>> 00: packets are discarded due to other reasons than late >>>>>>>> arrival, early arrival, or both (e.g., duplicate, redundant >>>>>>>> packets). >>>>>>>> >>>>>>>> This seems inconsistent. >>>>>>> >>>>>>> [Qin]: Good question. To make them consistent, I propose do the >>>>>>> following change to Section 2.1 >>>>>>> OLD TEXT: >>>>>>> " >>>>>>> A packet that arrives within >>>>>>> this time window but is too early or late to be played out shall >>>>>>> be regarded as discarded. A packet shall be classified as one >>>>>> of >>>>>>> received (or OK), discarded or lost. The Discard Metric counts >>>>>>> only discarded packets. >>>>>>> >>>>>>> " >>>>>>> NEW TEXT: >>>>>>> " >>>>>>> A packet that arrives within >>>>>>> >>>>>>> this time window but is too early or late to be played out >>>>>>> >>>>>>> or is thrown away before playout (e.g., packet duplication or >>>>>>> redundancy) >>>>>>> >>>>>>> shall be regarded as discarded. A packet shall be classified as one >>>>>> of >>>>>>> >>>>>>> received (or OK), discarded or lost. The Discard Count Metric counts >>>>>>> >>>>>>> only discarded packets. >>>>>>> " >>>>>>> >>>>>>>> 4. Is there any reasons for the Interval Metric flag (I) to be 2 >>>>>> bits, >>>>>>>> rather than one bit, with the other one reserved? >>>>>>> >>>>>>> [Qin]: Good question, I remembered we got a suggestion on the list >>>>>>> before from Kevin Gross which suggested to >>>>>>> remove Sampled metric related description from the definition of >>>>>>> Interval Metric flag. Since Sampled metric is >>>>>>> measured only at a particular time instant however metrics defined in >>>>>>> this document is >>>>>>> measured over one or several reporting intervals.To get in line with >>>>>> the >>>>>>> defintion >>>>>>> of the Interval Metric flag in other XR BLOCK drafts and address your >>>>>>> comment, >>>>>>> I propose the following change to the defintion of the interval metric >>>>>>> flag: >>>>>>> >>>>>>> OLD TEXT: >>>>>>> " >>>>>>> Interval Metric flag (I): 2 bits >>>>>>> >>>>>>> This field is used to indicate whether the Discard metric is an >>>>>>> Interval or Cumulative metric, that is, whether the reported >>>>>>> values applies to the most recent measurement interval duration >>>>>>> between successive metrics reports (I=10) (the Interval >>>>>> Duration) >>>>>>> or to the accumulation period characteristic of cumulative >>>>>>> measurements (I=11) (the Cumulative Duration). >>>>>>> >>>>>>> " >>>>>>> NEW TEXT: >>>>>>> " >>>>>>> Interval Metric flag (I): 2 bits >>>>>>> >>>>>>> >>>>>>> >>>>>>> This field is used to indicate whether the Discard Count Metric >>>>>> is >>>>>>> an >>>>>>> >>>>>>> Interval or Cumulative metric, Sample metric,that is, whether >>>>>> the >>>>>>> reported >>>>>>> >>>>>>> values applies to the most recent measurement interval duration >>>>>>> >>>>>>> between successive metrics reports (I=10) (the Interval >>>>>> Duration) >>>>>>> >>>>>>> or to the accumulation period characteristic of cumulative >>>>>>> >>>>>>> measurements (I=11) (the Cumulative Duration) or is a >>>>>>> >>>>>>> sampled instantaneous value (I=01) (Sampled Value). In this >>>>>>> document, >>>>>>> >>>>>>> Discard Count Metric is not measured at a particular time >>>>>> instant >>>>>>> but over >>>>>>> >>>>>>> one or several reporting intervals. Therefore Discard Count >>>>>> Metric >>>>>>> MUST not >>>>>>> >>>>>>> be chosen as Sampled Metric. >>>>>>> >>>>>>> " >>>>>>> >>>>>>> >>>>>>>> 5. number of packets discarded: >>>>>>>> >>>>>>>>> If the measured value exceeds 0xFFFFFFFD, the value 0xFFFFFFFE >>>>>>>> SHOULD be reported to indicate an over-range measurement. >>>>>>> >>>>>>>> Why is this a SHOULD and not a MUST? Are there any exceptions? >>>>>>> >>>>>>> [Qin]: No, I will use MUST based on your comment. >>>>>>> >>>>>>>> 6. In the IANA Considerations section: >>>>>>>> >>>>>>>> s/ The contact information for the registrations is/ The following >>>>>>>> contact information is provided for all registrations in this >>>>>>> document/ >>>>>>> >>>>>>> [Qin]: Okay. >>>>>>> >>>>>>>> >>>>>> _______________________________________________ >>>>>> xrblock mailing list >>>>>> xrblock@ietf.org >>>>>> https://www.ietf.org/mailman/listinfo/xrblock >>>>> >>>>> >>>>> >>>>> _______________________________________________ >>>>> xrblock mailing list >>>>> xrblock@ietf.org >>>>> https://www.ietf.org/mailman/listinfo/xrblock >>> >> >> >> >> _______________________________________________ >> xrblock mailing list >> xrblock@ietf.org >> https://www.ietf.org/mailman/listinfo/xrblock > > > > -- > http://www.netlab.tkk.fi/~varun/
- [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr-dis… Shida Schubert
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Roni Even
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Shida Schubert
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Romascanu, Dan (Dan)
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Romascanu, Dan (Dan)
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Alan Clark
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Romascanu, Dan (Dan)
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Varun Singh
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Varun Singh
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Varun Singh
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Varun Singh
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Shida Schubert
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Alan Clark
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Varun Singh
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Varun Singh
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Shida Schubert
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Shida Schubert
- Re: [xrblock] WGLC fordraft-ietf-xrblock-rtcp-xr-… Romascanu, Dan (Dan)
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC fordraft-ietf-xrblock-rtcp-xr-… Romascanu, Dan (Dan)
- Re: [xrblock] WGLC fordraft-ietf-xrblock-rtcp-xr-… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Varun Singh
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Shida Schubert
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Alan Clark
- Re: [xrblock] WGLC fordraft-ietf-xrblock-rtcp-xr-… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Varun Singh
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Varun Singh
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Varun Singh
- Re: [xrblock] WGLC for draft-ietf-xrblock-rtcp-xr… Qin Wu