Re: [lmap] lmap framework and IPPM registries.

"Bugenhagen, Michael K" <Michael.K.Bugenhagen@centurylink.com> Tue, 15 April 2014 14:55 UTC

Return-Path: <Michael.K.Bugenhagen@centurylink.com>
X-Original-To: lmap@ietfa.amsl.com
Delivered-To: lmap@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2F5AC1A03E5 for <lmap@ietfa.amsl.com>; Tue, 15 Apr 2014 07:55:46 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level:
X-Spam-Status: No, score=-1.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id BOb-xwPPDOLA for <lmap@ietfa.amsl.com>; Tue, 15 Apr 2014 07:55:44 -0700 (PDT)
Received: from suomp64i.qwest.com (suomp64i.qwest.com [155.70.16.237]) by ietfa.amsl.com (Postfix) with ESMTP id E3BCF1A02CB for <lmap@ietf.org>; Tue, 15 Apr 2014 07:55:43 -0700 (PDT)
Received: from lxdenvmpc030.qintra.com (lxdenvmpc030.qintra.com [10.1.51.30]) by suomp64i.qwest.com (8.14.4/8.14.4) with ESMTP id s3FEtcc5001254 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 15 Apr 2014 09:55:38 -0500 (CDT)
Received: from lxdenvmpc030.qintra.com (unknown [127.0.0.1]) by IMSA (Postfix) with ESMTP id D95A21E0086; Tue, 15 Apr 2014 08:55:32 -0600 (MDT)
Received: from suomp60i.qintra.com (unknown [151.119.91.93]) by lxdenvmpc030.qintra.com (Postfix) with ESMTP id A208D1E0076; Tue, 15 Apr 2014 08:55:32 -0600 (MDT)
Received: from suomp60i.qintra.com (localhost [127.0.0.1]) by suomp60i.qintra.com (8.14.4/8.14.4) with ESMTP id s3FEtVbP022385; Tue, 15 Apr 2014 09:55:31 -0500 (CDT)
Received: from vodcwhubex501.ctl.intranet (vodcwhubex501.ctl.intranet [151.117.206.27]) by suomp60i.qintra.com (8.14.4/8.14.4) with ESMTP id s3FEtUAt022281 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=FAIL); Tue, 15 Apr 2014 09:55:30 -0500 (CDT)
Received: from PODCWMBXEX505.ctl.intranet ([fe80::f87e:fe44:ad72:b610]) by vodcwhubex501.ctl.intranet ([151.117.206.27]) with mapi id 14.03.0158.001; Tue, 15 Apr 2014 09:55:29 -0500
From: "Bugenhagen, Michael K" <Michael.K.Bugenhagen@centurylink.com>
To: "'MORTON, ALFRED C (AL)'" <acmorton@att.com>, 'MARCELO BAGNULO BRAUN' <marcelo@it.uc3m.es>, 'Juergen Schoenwaelder' <j.schoenwaelder@jacobs-university.de>
Thread-Topic: [lmap] lmap framework and IPPM registries.
Thread-Index: AQHPV/EOB5WK3snlxk28YEUSrOuMq5sRugWAgAAMHoCAAPYfwIAAA0kAgAAEyAA=
Date: Tue, 15 Apr 2014 14:55:28 +0000
Message-ID: <A68F3CAC468B2E48BB775ACE2DD99B5E04AEFBF5@podcwmbxex505.ctl.intranet>
References: <20140414165014.2yrfm9hptwkcog0w@webcartero01.uc3m.es> <20140414175747.GA8673@elstar.local> <20140414204109.3p5s75qggoc4scc8@webcartero01.uc3m.es> <A68F3CAC468B2E48BB775ACE2DD99B5E04AEFA3A@podcwmbxex505.ctl.intranet> <2845723087023D4CB5114223779FA9C8017944A468@njfpsrvexg8.research.att.com>
In-Reply-To: <2845723087023D4CB5114223779FA9C8017944A468@njfpsrvexg8.research.att.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [151.117.206.7]
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-CFilter-Loop: Reflected
Archived-At: http://mailarchive.ietf.org/arch/msg/lmap/O3CkDhlxg6FqcoYft210XOBN1M8
Cc: "'lmap@ietf.org'" <lmap@ietf.org>
Subject: Re: [lmap] lmap framework and IPPM registries.
X-BeenThere: lmap@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Large Scale Measurement of Access network Performance <lmap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/lmap>, <mailto:lmap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/lmap/>
List-Post: <mailto:lmap@ietf.org>
List-Help: <mailto:lmap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/lmap>, <mailto:lmap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 15 Apr 2014 14:55:46 -0000

Al - 

   Thanks!
  
In the BBF meeting we were discussing how to move forward with documenting the tests for some of the U.S. based tests that are currently being reported so we had some apples to apples reference tests.

   We agreed that going through the IETF IPPM / registry group was the way to go- so I wanted to make sure what that process might look like.
I thought it would require new RFC work for defining a special test without ambiguity.... as you indicate.

  So we'll point anyone wanting to standardize tests to the IPPM - Excellent.

BTW - The BBF has some WT-143 broadband tests already defined on throughput testing, I'll discuss getting those converted to RFC's with the original editors of those tests.. that seems a logical first step.

Cheers,
Mike 



-----Original Message-----
From: lmap [mailto:lmap-bounces@ietf.org] On Behalf Of MORTON, ALFRED C (AL)
Sent: Tuesday, April 15, 2014 9:45 AM
To: Bugenhagen, Michael K; 'MARCELO BAGNULO BRAUN'; 'Juergen Schoenwaelder'
Cc: 'lmap@ietf.org'
Subject: Re: [lmap] lmap framework and IPPM registries.

Mike,  I won't be able to expand on details with you, but see my reply below:

> -----Original Message-----
> From: Bugenhagen, Michael K 
> [mailto:Michael.K.Bugenhagen@centurylink.com]
> Sent: Tuesday, April 15, 2014 10:28 AM
...
> 
> Marcelo, Juergen, Al
> 
>     Just for clarity - and my making sure I'm tracking this correctly 
> - and we're all on the same page -
> 

We are not, we have yet to achieve that state in many cases, unfortunately.


> 
> The tests conducted by most of the regulators (the one's they are
> reporting) are modifications of the standard testing methods.
> i.e. - the Throughput test results use a delay window or stability window
> to negate the influence of "burst" or buffering - and report the stable
> throughput after x seconds, or y seconds of stability.

Real bad example, because IPPM does not yet have a solid metric and method RFC
for Throughput or Capacity. Work is in-progress here, of course.

> 
> Question -  Given the Registry method we've described requires a Standard
> test MIB to become a registry entry
> Assumption - Does it follow that we need to write a standalone test
> standard (RFC) for each unique test method...
> 
> I think this is true, if not please correct me.

We considered this possibility, but practicality caused us to choose the
alternative where one or more existing RFCs are references for a Registered Metric,
and the registry entry itself MUST provide all the details to specify the metric 
and methods *exactly*, without ambiguity.

So, not true about lots of new RFCs. We simply don't see this happening
to support the registry - there's barely enough review energy to get the 
the registry design memos adopted and to consensus.  This is clearly overhead
work and though essential to LMAP, not exciting == few volunteers.

Some RFCs are needed (Throughput) and many very good Registry Entries are needed.

Al


> 
> At the moment we have very few tests that use that modified method, which
> infers we have more work to do on the IPPM side with new test RFC's?
> 
> Thanks,
> Mike
> 
> 
> 
> 
> 
> 
> 
> 
> -----Original Message-----
> From: lmap [mailto:lmap-bounces@ietf.org] On Behalf Of MARCELO BAGNULO
> BRAUN
> Sent: Monday, April 14, 2014 1:41 PM
> To: Juergen Schoenwaelder
> Cc: lmap@ietf.org
> Subject: Re: [lmap] lmap framework and IPPM registries.
> 
> Juergen Schoenwaelder <j.schoenwaelder@jacobs-university.de> dijo:
> 
> > On Mon, Apr 14, 2014 at 04:50:14PM +0200, MARCELO BAGNULO BRAUN wrote:
> >> Hi,
> >>
> >> One issue i realized is that the current lmap framework states the
> >> the measurement method is specified as a URN to a registry entry,
> >> while the current IPPM registry draft do not have a URN as metric
> >> identifier but a name and a metric identifier.
> >
> > So according to IPPM, which one is the "native" unique thing to refer
> > to, the name or the metric identifier (a 16-bit number if I understand
> > right)?
> 
> the identifier is the unique identifier
> 
> metrics names should be unique, but not must be
> 
> 
> >
> >> I think it is very important that these two efforts are aligned so i
> >> suggest that we discuss whether a URN is the proper way to go or the
> >> current flat identifier proposed in the ippm registry drafts.
> >>
> >> I am uncertain what is the benefit of an URN versus a flat
> >> identifier. Regards, marcelo
> >
> > It should be a URI.
> >
> > Standard metrics can have their own URN space, e.g., derived from
> > their unique "thing" (the name or the metric, I can't tell). Or IPPM
> > even makes their native "identifier" simply a URN. Making this
> > reference a URI within LMAP makes things easily extensible without
> > requiring to go through a central registry or to work with potential
> > clashes in number spaces reserved for private use. Using URIs also
> > seems rather natural in a web-based world.
> >
> 
> It is perfectrly possible to reserve a range of identifiers for private
> use so a manager of a measurement domain can locally assign values for
> metrics without going through the registry.
> 
> I still dont understand how does the IANA manages a well know set of
> metric identifiers using URN/URIs. I am not saying this is not feasible,
> just that i fail to understand it yet.
> 
> Regards, marcelo
> 
> 
> 
> > /js
> >
> > --
> > Juergen Schoenwaelder           Jacobs University Bremen gGmbH
> > Phone: +49 421 200 3587         Campus Ring 1, 28759 Bremen, Germany
> > Fax:   +49 421 200 3103         <http://www.jacobs-university.de/>
> >
> 
> 
> 
> --
> ----
> MARCELO BAGNULO BRAUN
> WebCartero
> Universidad Carlos III de Madrid
> 
> _______________________________________________
> lmap mailing list
> lmap@ietf.org
> https://www.ietf.org/mailman/listinfo/lmap

_______________________________________________
lmap mailing list
lmap@ietf.org
https://www.ietf.org/mailman/listinfo/lmap