Re: [PMOL] RMCAT

"Eggert, Lars" <lars@netapp.com> Sun, 11 November 2012 14:41 UTC

Return-Path: <lars@netapp.com>
X-Original-To: pmol@ietfa.amsl.com
Delivered-To: pmol@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0438421F8555 for <pmol@ietfa.amsl.com>; Sun, 11 Nov 2012 06:41:10 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -10.278
X-Spam-Level:
X-Spam-Status: No, score=-10.278 tagged_above=-999 required=5 tests=[AWL=0.321, BAYES_00=-2.599, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id t8IlKpvMdelh for <pmol@ietfa.amsl.com>; Sun, 11 Nov 2012 06:41:09 -0800 (PST)
Received: from mx2.netapp.com (mx2.netapp.com [216.240.18.37]) by ietfa.amsl.com (Postfix) with ESMTP id 5F84B21F8422 for <pmol@ietf.org>; Sun, 11 Nov 2012 06:41:09 -0800 (PST)
X-IronPort-AV: E=Sophos; i="4.80,757,1344236400"; d="p7s'?scan'208"; a="709177936"
Received: from smtp1.corp.netapp.com ([10.57.156.124]) by mx2-out.netapp.com with ESMTP; 11 Nov 2012 06:41:09 -0800
Received: from vmwexceht03-prd.hq.netapp.com (vmwexceht03-prd.hq.netapp.com [10.106.76.241]) by smtp1.corp.netapp.com (8.13.1/8.13.1/NTAP-1.6) with ESMTP id qABEf8Bp024098; Sun, 11 Nov 2012 06:41:08 -0800 (PST)
Received: from SACEXCMBX01-PRD.hq.netapp.com ([169.254.2.216]) by vmwexceht03-prd.hq.netapp.com ([10.106.76.241]) with mapi id 14.02.0318.001; Sun, 11 Nov 2012 06:41:07 -0800
From: "Eggert, Lars" <lars@netapp.com>
To: Vinayak Hegde <vinayakh@gmail.com>
Thread-Topic: [PMOL] RMCAT
Thread-Index: AQHNwBqVgMCleJmIEkOHmuL3oBevLg==
Date: Sun, 11 Nov 2012 14:39:51 +0000
Message-ID: <D4D47BCFFE5A004F95D707546AC0D7E9185F04CF@SACEXCMBX01-PRD.hq.netapp.com>
References: <7.0.1.0.0.20121106110532.04dd2568@att.com> <CAKe6YvM6GqgJwdCE1DLVW2hv4myoCE-wDcSihXqsw3_dDXhfsA@mail.gmail.com> <7.0.1.0.0.20121108093854.04bdf6b8@att.com> <CAKe6YvOOpF=OmxJPXUxNS0sp+T7aQYgzrknsg4CAAXQ4nPhCpg@mail.gmail.com>
In-Reply-To: <CAKe6YvOOpF=OmxJPXUxNS0sp+T7aQYgzrknsg4CAAXQ4nPhCpg@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-originating-ip: [10.104.60.114]
Content-Type: multipart/signed; boundary="Apple-Mail=_82A35839-066E-4D55-8DCF-CE0CD8D1DAB4"; protocol="application/pkcs7-signature"; micalg="sha1"
MIME-Version: 1.0
X-Mailman-Approved-At: Sun, 11 Nov 2012 14:15:37 -0800
Cc: Varun Singh <varun.singh@gmail.com>, Mirja Kühlewind <mirja.kuehlewind@ikr.uni-stuttgart.de>, "pmol@ietf.org" <pmol@ietf.org>
Subject: Re: [PMOL] RMCAT
X-BeenThere: pmol@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Performance Metrics Directorate list <pmol.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/pmol>, <mailto:pmol-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/pmol>
List-Post: <mailto:pmol@ietf.org>
List-Help: <mailto:pmol-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/pmol>, <mailto:pmol-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 11 Nov 2012 14:41:10 -0000

Thanks for the detailed comments!

Lars

On Nov 11, 2012, at 7:33, Vinayak Hegde <vinayakh@gmail.com> wrote:

> Draft comments for draft-singh-rmcat-cc-eval follow:
> 
> Draft Section 3 - Metrics
> 
> 1. Can you please explain why each metric is relevant for congestion ?
> For example
> 
> Delay can be caused due to buffer bloat or due to the underlying
> (suboptimal) path that is taken. Both have different remedies.
> Possibly add ways of finding out root cause for this.
> 
> 2. Also how do you account for burstiness. Lots of packets arriving at
> once with some having expired (arrived late) by the time of arrival.
> How does this interplay with the User's experience of quality
> (blockiness and jitter depending on how the codec works).
> 
> 3. Also some of the metrics are interdependent. Packet loss and
> discard rate can be made to approximate User's experience if we know
> how the codec works (such as amount of robustness under packet loss)
> and delay characteristics of the underlying streams (Such as busty
> arrival of packets).
> 
> 4. In the statistical measures - Standard deviation and variance might
> also be useful in the context of interactive streams possibly to
> measure possibility of interruptions in play (Directly correlates to
> User's quality of experience).
> 
> 4. Guidelines
> Section 4.4 Diverse Environments
> 1. A minimum list of environment or simulations in which the algorithm
> is recommended to be tested could be useful. Even more useful could be
> setting min/max range limits for tests (such as delay/bandwidth). This
> could closely model real network characteristics.
> 
> Section 4.8 Impact on Cross Traffic
> How will you measure the impact of the RTP flows on competing TCP
> flows. A list of metrics and/or examples would be useful.
> 
> General comments:
> 1. If any simulation/real world tests are carried out by network
> equipment what are the standards that they should adhere to in terms
> of delay (sensitivity) in counting / measuring.
> 
> Regards
> Vinayak
> 
> On Thu, Nov 8, 2012 at 8:09 PM, Al Morton <acmorton@att.com> wrote:
>> Thanks Vin, there is at least one proposal
>> identified in my first message.
>> 
>> Al
>> 
>> 
>> At 02:39 AM 11/8/2012, Vinayak Hegde wrote:
>>> 
>>> On Tue, Nov 6, 2012 at 9:46 PM, Al Morton <acmorton@att.com> wrote:
>>>> 2- Do we have a volunteer to review this work on an on-going basis?
>>>> 
>>>> I will look in on this myself too, but I plan to return home
>>>> to the "more-Sandy-than-usual" Jersey Shore on Thursday morning
>>>> to deal with additional issues there, so I'll miss rmcat this time.
>>> 
>>> I am not attending this meeting and the next one in person but I can
>>> help review the drafts if they forward it to this list.
>>> 
>>> Regards
>>> Vinayak
>> 
>>