Re: [lmap] Which performance metrics for LMAP?
"MORTON JR., ALFRED (AL)" <acmorton@att.com> Thu, 07 March 2013 15:53 UTC
Return-Path: <acmorton@att.com>
X-Original-To: lmap@ietfa.amsl.com
Delivered-To: lmap@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 61D4421F8D08 for <lmap@ietfa.amsl.com>; Thu, 7 Mar 2013 07:53:33 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -106.598
X-Spam-Level:
X-Spam-Status: No, score=-106.598 tagged_above=-999 required=5 tests=[AWL=-0.000, BAYES_00=-2.599, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id tg0dGUHy4xzk for <lmap@ietfa.amsl.com>; Thu, 7 Mar 2013 07:53:32 -0800 (PST)
Received: from mail-pink.research.att.com (mail-pink.research.att.com [192.20.225.111]) by ietfa.amsl.com (Postfix) with ESMTP id EB69521F8D12 for <lmap@ietf.org>; Thu, 7 Mar 2013 07:53:31 -0800 (PST)
Received: from mail-green.research.att.com (unknown [135.207.178.10]) by mail-pink.research.att.com (Postfix) with ESMTP id 331D41203F9; Thu, 7 Mar 2013 10:56:21 -0500 (EST)
Received: from njfpsrvexg7.research.att.com (njfpsrvexg7.research.att.com [135.207.177.33]) by mail-green.research.att.com (Postfix) with ESMTP id 0FD42E36E6; Thu, 7 Mar 2013 10:46:32 -0500 (EST)
Received: from njfpsrvexg7.research.att.com ([fe80::3598:75fe:b400:9299]) by njfpsrvexg7.research.att.com ([fe80::3598:75fe:b400:9299%11]) with mapi; Thu, 7 Mar 2013 10:53:30 -0500
From: "MORTON JR., ALFRED (AL)" <acmorton@att.com>
To: Benoit Claise <bclaise@cisco.com>, "lmap@ietf.org" <lmap@ietf.org>
Date: Thu, 07 Mar 2013 10:53:28 -0500
Thread-Topic: [lmap] Which performance metrics for LMAP?
Thread-Index: Ac4bJt9eZa0x1RKdTJWhqiJod+BeiQAH94Dw
Message-ID: <F1312FAF1A1E624DA0972D1C9A91379A1BF8C3B275@njfpsrvexg7.research.att.com>
References: <513879B5.8030609@cisco.com>
In-Reply-To: <513879B5.8030609@cisco.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: multipart/alternative; boundary="_000_F1312FAF1A1E624DA0972D1C9A91379A1BF8C3B275njfpsrvexg7re_"
MIME-Version: 1.0
Subject: Re: [lmap] Which performance metrics for LMAP?
X-BeenThere: lmap@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Large Scale Measurement of Access network Performance <lmap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/lmap>, <mailto:lmap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/lmap>
List-Post: <mailto:lmap@ietf.org>
List-Help: <mailto:lmap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/lmap>, <mailto:lmap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 07 Mar 2013 15:53:33 -0000
Hi Benoit, You've asked four good questions today, I'll take a stab at this one. IMO, the metrics chosen need to serve two purposes, at least. One set of metrics describe the packet transfer service (at the service layers). Another (somewhat overlapping) set help subscribers understand how well their applications will perform on the service (inferred from measurements at the service layer). These two points of view (POV) and their implications on metric selection/parameter settings/reporting for IP packet transfer were investigated in http://tools.ietf.org/html/rfc6703 IPPM's scope has always included transport layer, so your 5-tuple with DSCP is covered there: these have all been part of the notion "packets of Type-P" since the beginning, see http://tools.ietf.org/html/rfc2330#section-13 and these aspects are more important now than ever. As a limit on "layer 3 and up", I would suggest that limited exceptions for metrics at +transport layers would be useful, such as the DNS response time metric constructed in http://tools.ietf.org/html/draft-bagnulo-ippm-new-registry-independent-00#section-8 So IMO, LMAP infrastructure would support measurement at IP and transport layers with a few notable exceptions, and look to others (IPPM WG) to select the best metrics (and develop new ones, as necessary) for each POV that LMAP serves. my 2cents, Al From: lmap-bounces@ietf.org [mailto:lmap-bounces@ietf.org] On Behalf Of Benoit Claise Sent: Thursday, March 07, 2013 6:28 AM To: lmap@ietf.org Subject: [lmap] Which performance metrics for LMAP? Dear all, Another clarifying question: I'm not too sure which performance metric types LMAP targets. draft-linsner-lmap-use-cases-00 mentions: It is assumed that measurement tests run by OTT providers would only include the metrics associated with layer 3 and up The different drafts use different terms: service, end user experience, quality of experience. Does Quality of Experience imply performance metrics per application, per 5 tuple (IP addresses, ports, protocol), per DCSP? Or do we want to stay at layer 3 performance metrics, typically IPPM type of metrics? If the latter, then LMAP is about large scale deployment of IPPM, right? While I fully understand the business needs for "and up" in "include the metrics associated with layer 3 and up", let's not boil the ocean. Performance Metrics at Other Layer (PMOL<http://datatracker.ietf.org/wg/pmol/charter/>), a concluded WG, tried and it proved to be difficult. Some more discussions, on the mailing list or during the BoF, on this topic would be appreciated. Regards, Benoit
- [lmap] Which performance metrics for LMAP? Benoit Claise
- Re: [lmap] Which performance metrics for LMAP? MORTON JR., ALFRED (AL)
- Re: [lmap] Which performance metrics for LMAP? Bugenhagen, Michael K
- Re: [lmap] Which performance metrics for LMAP? philip.eardley