Re: [ippm] Advancement of metrics to standards draft

<Ruediger.Geib@telekom.de> Tue, 07 July 2009 07:37 UTC

Return-Path: <Ruediger.Geib@telekom.de>
X-Original-To: ippm@core3.amsl.com
Delivered-To: ippm@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id D7CA228C2ED for <ippm@core3.amsl.com>; Tue, 7 Jul 2009 00:37:42 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.249
X-Spam-Level:
X-Spam-Status: No, score=-3.249 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, HELO_EQ_DE=0.35, RCVD_IN_DNSWL_LOW=-1]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id STlScSYJeapm for <ippm@core3.amsl.com>; Tue, 7 Jul 2009 00:37:41 -0700 (PDT)
Received: from tcmail73.telekom.de (tcmail73.telekom.de [217.243.239.135]) by core3.amsl.com (Postfix) with ESMTP id 3A87328C2AF for <ippm@ietf.org>; Tue, 7 Jul 2009 00:37:40 -0700 (PDT)
Received: from s4de8psaans.blf.telekom.de (HELO s4de8psaans.mitte.t-com.de) ([10.151.180.168]) by tcmail71.telekom.de with ESMTP; 07 Jul 2009 09:30:40 +0200
Received: from S4DE8PSAAQA.mitte.t-com.de ([10.151.229.12]) by s4de8psaans.mitte.t-com.de with Microsoft SMTPSVC(6.0.3790.3959); Tue, 7 Jul 2009 09:30:40 +0200
X-MimeOLE: Produced By Microsoft Exchange V6.5
Content-class: urn:content-classes:message
MIME-Version: 1.0
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Date: Tue, 07 Jul 2009 09:30:38 +0200
Message-ID: <151C164FE2E066418D8D44D0801543A50193ED15@S4DE8PSAAQA.mitte.t-com.de>
In-Reply-To: <200907061909.n66J9CLi014495@alph001.aldc.att.com>
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
Thread-Topic: [ippm] Advancement of metrics to standards draft
Thread-Index: Acn+bU0xx4rIY7C0QTm/ekqj2kaX9gAY01Aw
References: <49EED274.6040107@ripe.net> <151C164FE2E066418D8D44D0801543A50193E815@S4DE8PSAAQA.mitte.t-com.de> <4A51F258.6020608@ripe.net> <200907061909.n66J9CLi014495@alph001.aldc.att.com>
From: Ruediger.Geib@telekom.de
To: acmorton@att.com
X-OriginalArrivalTime: 07 Jul 2009 07:30:40.0622 (UTC) FILETIME=[D45DF8E0:01C9FED4]
Cc: henk@ripe.net, matt@internet2.edu, ippm@ietf.org
Subject: Re: [ippm] Advancement of metrics to standards draft
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/ippm>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 07 Jul 2009 07:37:42 -0000

Al,

thanks for your work. At least the two of us read each others 
documents.

I think it is good to work out general principles and 
carefully go to details later on. Your draft contains a bit 
of both.

The really bad thing is, that as soon we go to a detailed 
description, we face issues. That's why I would suggest 
to start by the general approach.

I however prefer a sufficiently defined statistical test, 
if our purpose is to avoid "everything" to be IPPM 
compliant. But may have overlooked other possibilities 
to reach this aim.

Regards,

Ruediger

-----Original Message-----
From: Al Morton [mailto:acmorton@att.com] 
Sent: Monday, July 06, 2009 9:09 PM
To: Henk Uijterwaal; Geib, Rüdiger
Cc: matt@internet2.edu; ippm@ietf.org
Subject: Re: [ippm] Advancement of metrics to standards draft

Ruediger and all,

Rather that write a long e-mail on this topic
(that few people will read), I wrote a short memo
(that few people will read). This memo is intended
as a background for discussion of some of the issues
Ruediger touched-on, and several new issues that occurred to me.
It is intended to help advance (not replace)
either the geib or bradner versions of the metrictest memos.

Whenever the advancing metrics topic comes up,
I've made a taken a position at the microphone that
may not have been fully understood. So, I've given-up
some of my holiday weekend and included details of my rant
in this short memo.  I hope it will be useful
to IPPM as we seek a way *up* the standards track that works.

Al

A New Internet-Draft is available from the on-line Internet-Drafts directories.

         Title           : Problems and Possible 
Solutions for Advancing Metrics on the Standards Track
         Author(s)       : A. Morton
         Filename        : draft-morton-ippm-advance-metrics-00.txt
         Pages           : 11
         Date            : 2009-07-06

This memo identifies some issues with the process of progressing
performance metric RFCs along the standards track.  This memo takes
the position that the metric definitions themselves should be the
primary focus, rather than the implementations of metrics.  This
appears to allow some simplification of the task at hand and
subsequently leads to solutions for the issues raised.

A URL for this Internet-Draft is:
http://www.ietf.org/internet-drafts/draft-morton-ippm-advance-metrics-00.txt


At 08:47 AM 7/6/2009, Henk Uijterwaal wrote:
>Ruediger et al,
>
>Thanks for all the work so-far, we'll discuss the
>document in Stockholm and let you know about next steps.
>
>Henk
>
>
>>the submitted draft on the advancement of 
>>metrics to standards hopefully is clear enough 
>>on the suggested methodology and its execution.
>>I won't participate in the Stockholm meeting. 
>>If the WG welcomes continuation of the work on 
>>this document, then the areas requiring more input I'm aware of are:
>>- statistical tests on time series producing 
>>verifyable results with the desired 
>>confidence   (suggested default 95%). And a 
>>review by a statistician in general.
>>- Measurement and networking expert to define 
>>what are sufficiently "identical 
>>network   conditions", as that's a basic 
>>assumption for the suggested metric test.
>>As a detailed comment, a reference and code for 
>>the Anderson Darling k test is required.
>>I hope, the draft may be found here:
>>http://www.ietf.org/internet-drafts/draft-geib-ippm-metrictest-00.txt
>>Regards,
>>Ruediger
>>
>>
>>
>>Deutsche Telekom Netzproduktion GmbH Zentrum 
>>Technik Einführung Technik Internet Backbone, TE142-19
>>Rüdiger Geib
>>Heinrich Hertz Str. 3-7
>>64297 Darmstadt
>>Tel.: 06151/6282747
>>Fax: 0251/7985109
>>
>>Deutsche Telekom Netzproduktion (DT NP) GmbH
>>Aufsichtsrat: Timotheus Höttges (Vorsitzender)
>>Geschäftsführung: Dr. Bruno Jacobfeuerborn 
>>(Vorsitzender), Albert Matheis, Klaus Peren
>>Handelsregister: Amtsgericht Bonn HRB 14190
>>Sitz der Gesellschaft: Bonn
>>USt-IdNr.: DE 814645262
>>
>>
>
>
>--
>------------------------------------------------------------------------------
>Henk Uijterwaal                           Email: henk.uijterwaal(at)ripe.net
>RIPE Network Coordination Centre          http://www.xs4all.nl/~henku
>P.O.Box 10096          Singel 258         Phone: +31.20.5354414
>1001 EB Amsterdam      1016 AB Amsterdam  Fax: +31.20.5354445
>The Netherlands        The Netherlands    Mobile: +31.6.55861746
>------------------------------------------------------------------------------
>
>Belgium: an unsolvable problem, discussed in endless meetings, with no
>          hope for a solution, where everybody still lives happily.
>_______________________________________________
>ippm mailing list
>ippm@ietf.org
>https://www.ietf.org/mailman/listinfo/ippm