[Fwd: comments on draft-morton-ippm-delay-var-as-03 [was: [ippm] comments on draft-ietf-ippm-framework-compagg-04]]

Benoit Claise <bclaise@cisco.com> Tue, 21 August 2007 10:33 UTC

Return-path: <ippm-bounces@ietf.org>
Received: from [127.0.0.1] (helo=stiedprmman1.va.neustar.com) by megatron.ietf.org with esmtp (Exim 4.43) id 1INR38-0007oX-9X; Tue, 21 Aug 2007 06:33:26 -0400
Received: from [10.90.34.44] (helo=chiedprmail1.ietf.org) by megatron.ietf.org with esmtp (Exim 4.43) id 1INR36-0007lD-I6 for ippm@ietf.org; Tue, 21 Aug 2007 06:33:24 -0400
Received: from weird-brew.cisco.com ([144.254.15.118] helo=av-tac-bru.cisco.com) by chiedprmail1.ietf.org with esmtp (Exim 4.43) id 1INR35-0000mt-Nw for ippm@ietf.org; Tue, 21 Aug 2007 06:33:24 -0400
X-TACSUNS: Virus Scanned
Received: from strange-brew.cisco.com (localhost [127.0.0.1]) by av-tac-bru.cisco.com (8.11.7p3+Sun/8.11.7) with ESMTP id l7LAXMb05616; Tue, 21 Aug 2007 12:33:22 +0200 (CEST)
Received: from [10.61.65.81] (ams3-vpn-dhcp337.cisco.com [10.61.65.81]) by strange-brew.cisco.com (8.11.7p3+Sun/8.11.7) with ESMTP id l7LAWjQ12389; Tue, 21 Aug 2007 12:33:22 +0200 (CEST)
Message-ID: <46CABF4D.6050604@cisco.com>
Date: Tue, 21 Aug 2007 12:32:45 +0200
From: Benoit Claise <bclaise@cisco.com>
User-Agent: Thunderbird 1.5.0.12 (Windows/20070509)
MIME-Version: 1.0
To: Loki Jorgenson <ljorgenson@apparentnetworks.com>
Subject: [Fwd: comments on draft-morton-ippm-delay-var-as-03 [was: [ippm] comments on draft-ietf-ippm-framework-compagg-04]]
References: <E1IFBBb-0006DV-Me@megatron.ietf.org> <F09324DCDD2F5D488EAC603D6B299DC703B4527E@jsrvr8.jaalam.net>
In-Reply-To: <F09324DCDD2F5D488EAC603D6B299DC703B4527E@jsrvr8.jaalam.net>
Content-Type: text/plain; charset="ISO-8859-1"; format="flowed"
Content-Transfer-Encoding: 7bit
X-Spam-Score: 0.0 (/)
X-Scan-Signature: 5d7a7e767f20255fce80fa0b77fb2433
Cc: ippm@ietf.org
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org >
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org ?subject=unsubscribe>
List-Post: <mailto:ippm@ietf.org >
List-Help: <mailto:ippm-request@ietf.org ?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org ?subject=subscribe>
Errors-To: ippm-bounces@ietf.org

Loki,

Thanks for your comment.
See inline for one specific point.
We will try to address the other points in the next version of the draft.
> Al - some comments on draft-ietf-ippm-framework-compagg-04
>
> Alan Clark's comments from last week are very relevant - in particular
> w.r.t. appropriate statement of assumptions related to implicit models
> and methodologies.
>
> In addition (and somewhat redundantly since I had already written the
> notes):
>
> General:
>   o of course, choice of PDV and IPDV as relevant implementations seems
> valid - however, there are implicit assumptions that should be made more
> explicit.  E.g. the values for reference time embody particular choices
> related to methodology and model:
>           o PDV assumes minimum delay knowable and difference optimally
> significant (transmission distribution is not relevant)
>           o IPDV assumes, or is typical within the context of, periodic
> transmission (or some context wherein packet separation is significant)
> and that the regularity of the period represents an optimal reference
> (and propagation time is not specifically relevant)
>   
That's a good point.
This also implies that Poisson makes more sense with PDV.

Regards, Benoit.

> Of course these descriptions are intended to be considerably more
> generic but in doing so they look past the obvious implementations
> (which is part of the intention of this draft, yes?).  Some of the
> descriptions of RFC 3933 include references to other timing
> distributions (e.g. Poisson).  The choices of minimum and delta are
> specific and motivated (by application requirements).
>
>   o references to "optimizing de-jitter buffer" are a relevant example
> of application design references that motivate the choice of jitter
> definition - is that related to the (anticipated) mandate of PMOL/APM?
>
>   o There should be more discussion of the typical implementation
> requirements - there is only passing mention of:
>            o optional statistical approaches
>                    - holding and post-processing all data in a
> measurement interval
>                    - not holding (much) data and maintaining running
> measures
>                    - holding a sliding window of data and maintaining
> sliding measures
>            o memory requirements (based on each case above)
>            o implications for reference values (based on each case
> above)
>                    - e.g. D(min) as running value for whole set or
> absolute for windowed set
>            o issues and complication possible in various instances of
> each case
>                    - e.g. quantiles are not available as running measure
>          ** many of these issues may be adequately addressed by simply
> emphasizing the MAPDV2/G.1020 document.  There is some mention of these
> issues in Appendix 13.
>
>   o "quick variation" seems an unfortunate turn of phrase
>            o however, it has been defined as being on the order of
> inter-packet separation so that seems adequate
>            o an alternative might be "short timescale variation"
>
>    o in the definition of IPDV, why is there no consideration of the
> practical context wherein packet arrival times are known but not
> transmission times for the periodic case.  Is that to suggest that there
> is no meaningful implementation of IPDV without transmission times?
>           
>    o in Sec. 8.1 referring to Measurement Stream Characteristics, there
> should be some description of the impact of sampling methodology for the
> cases wherein not all the packet D(i) are sampled.  This should include
> some suggestion for methodology references.
>             o for example: 
> The implication of short-range dependency on delay variation measurement
> Qiong Li; Mills, D.L.
> Network Computing and Applications, 2003
> Volume , Issue , 16-18 April 2003 Page(s): 374 - 380
> 	o for example
> Fisher Information of Sampled Packets: an Application to Flow Size
> Estimation
> Bruno Ribeiro, University of Masachusetts at Amherst; Don Towsley,
> University of Masachusetts at Amherst; Tao Ye, Sprint Advanced
> Technology Laboratories; Jean Bolot, Sprint Advanced Technology
> Laboratories
>
>    o in Sec. 8.3 Test Duration, some references to stability of networks
> would be useful.  Although changes are possible on almost any time
> scale, there are some reasonable rules of thumb to be considered.
> Typical networks are stable on the order of minutes.  However there are
> also long timescale variations associated with daily cycles.
>            o for example
> On the Constancy of Internet Path Properties. 
> Yin Zhang, Nick Duffield, Vern Paxson, and Scott Shenker -- AT&T Labs
> Research, Florham Park NJ; AT&T Center for Internet Research at ICSI,
> Berkeley CA.
>
>    o in Sec. 8.5, there is reference to distinguishing long delays from
> loss - as mentioned elsewhere, a reasonable threshold should be applied.
> Naturally, discards should be accounted for distinct from loss.
>
>   o in Appendix 12, also include various forms of equipment and
> configuration dysfunction as a separate cause.  For example, consider
> re-transmission effects in WiFi or slow-path processing in a router that
> has been sub-optimally employed for edge filtering.
>
>   o in Appendix 13, consider including code fragments for the described
> method.  This may be a special case of temporal composition (associating
> sets of data segmented intervals from a single testing period).
>
> -- Loki 
>
> _______________________________________________
> ippm mailing list
> ippm@ietf.org 
> https://www1.ietf.org/mailman/listinfo/ippm
>   


_______________________________________________
ippm mailing list
ippm@ietf.org 
https://www1.ietf.org/mailman/listinfo/ippm