[lmap] Which performance metrics for LMAP?

Benoit Claise <bclaise@cisco.com> Thu, 07 March 2013 11:28 UTC

Return-Path: <bclaise@cisco.com>
X-Original-To: lmap@ietfa.amsl.com
Delivered-To: lmap@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2E5FB21F8CFB for <lmap@ietfa.amsl.com>; Thu, 7 Mar 2013 03:28:07 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -10.666
X-Spam-Level:
X-Spam-Status: No, score=-10.666 tagged_above=-999 required=5 tests=[AWL=-0.068, BAYES_00=-2.599, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3Kgp33G8pZ1N for <lmap@ietfa.amsl.com>; Thu, 7 Mar 2013 03:28:06 -0800 (PST)
Received: from av-tac-bru.cisco.com (weird-brew.cisco.com [144.254.15.118]) by ietfa.amsl.com (Postfix) with ESMTP id 62A2421F8CD8 for <lmap@ietf.org>; Thu, 7 Mar 2013 03:28:06 -0800 (PST)
X-TACSUNS: Virus Scanned
Received: from strange-brew.cisco.com (localhost.cisco.com [127.0.0.1]) by av-tac-bru.cisco.com (8.13.8+Sun/8.13.8) with ESMTP id r27BS5YC001624 for <lmap@ietf.org>; Thu, 7 Mar 2013 12:28:05 +0100 (CET)
Received: from [10.60.67.84] (ams-bclaise-8913.cisco.com [10.60.67.84]) by strange-brew.cisco.com (8.13.8+Sun/8.13.8) with ESMTP id r27BRnk6025427 for <lmap@ietf.org>; Thu, 7 Mar 2013 12:27:59 +0100 (CET)
Message-ID: <513879B5.8030609@cisco.com>
Date: Thu, 07 Mar 2013 12:27:49 +0100
From: Benoit Claise <bclaise@cisco.com>
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/20130215 Thunderbird/17.0.3
MIME-Version: 1.0
To: "lmap@ietf.org" <lmap@ietf.org>
Content-Type: multipart/alternative; boundary="------------040607050609070803020001"
Subject: [lmap] Which performance metrics for LMAP?
X-BeenThere: lmap@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Large Scale Measurement of Access network Performance <lmap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/lmap>, <mailto:lmap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/lmap>
List-Post: <mailto:lmap@ietf.org>
List-Help: <mailto:lmap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/lmap>, <mailto:lmap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 07 Mar 2013 11:28:07 -0000

Dear all,

Another clarifying question: I'm not too sure which performance metric 
types LMAP targets.
draft-linsner-lmap-use-cases-00 mentions:

    It is assumed that measurement
    tests run by OTT providers would only include the metrics associated
    with layer 3 and up


The different drafts use different terms: service, end user experience, 
quality of experience.
Does Quality of Experience imply performance metrics per application, 
per 5 tuple (IP addresses, ports, protocol), per DCSP?
Or do we want to stay at layer 3 performance metrics, typically IPPM 
type of metrics?
If the latter, then LMAP is about large scale deployment of IPPM, right?

While I fully understand the business needs for "and up" in "include the 
metrics associated with layer 3 and up", let's not boil the ocean.
Performance Metrics at Other Layer (PMOL 
<http://datatracker.ietf.org/wg/pmol/charter/>), a concluded WG, tried 
and it proved to be difficult.

Some more discussions, on the mailing list or during the BoF, on this 
topic would be appreciated.

Regards, Benoit