Re: [PSAMP] PSAMP-INFO IE realtiveError: Open Points

Paul Aitken <paitken@cisco.com> Thu, 18 September 2008 14:14 UTC

Return-Path: <psamp-bounces@ietf.org>
X-Original-To: psamp-archive@lists.ietf.org
Delivered-To: ietfarch-psamp-archive@core3.amsl.com
Received: from [127.0.0.1] (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 940DD3A696D; Thu, 18 Sep 2008 07:14:44 -0700 (PDT)
X-Original-To: psamp@core3.amsl.com
Delivered-To: psamp@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id DFC4C3A696D for <psamp@core3.amsl.com>; Thu, 18 Sep 2008 07:14:43 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.599
X-Spam-Level:
X-Spam-Status: No, score=-6.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id GQ8uV+6xfb55 for <psamp@core3.amsl.com>; Thu, 18 Sep 2008 07:14:37 -0700 (PDT)
Received: from ams-iport-1.cisco.com (ams-iport-1.cisco.com [144.254.224.140]) by core3.amsl.com (Postfix) with ESMTP id C9CA63A6895 for <psamp@ietf.org>; Thu, 18 Sep 2008 07:14:36 -0700 (PDT)
X-IronPort-AV: E=Sophos;i="4.32,422,1217808000"; d="scan'208";a="20172650"
Received: from ams-dkim-2.cisco.com ([144.254.224.139]) by ams-iport-1.cisco.com with ESMTP; 18 Sep 2008 14:14:29 +0000
Received: from ams-core-1.cisco.com (ams-core-1.cisco.com [144.254.224.150]) by ams-dkim-2.cisco.com (8.12.11/8.12.11) with ESMTP id m8IEETMX012467; Thu, 18 Sep 2008 16:14:29 +0200
Received: from cisco.com (mrwint.cisco.com [64.103.71.48]) by ams-core-1.cisco.com (8.13.8/8.13.8) with ESMTP id m8IEESsS012090; Thu, 18 Sep 2008 14:14:28 GMT
Received: from [10.61.103.50] (dhcp-10-61-103-50.cisco.com [10.61.103.50]) by cisco.com (8.11.7p3+Sun/8.8.8) with ESMTP id m8IEEN127836; Thu, 18 Sep 2008 15:14:23 +0100 (BST)
Message-ID: <48D26242.6050404@cisco.com>
Date: Thu, 18 Sep 2008 15:14:26 +0100
From: Paul Aitken <paitken@cisco.com>
User-Agent: Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-GB; rv:1.8.1.16) Gecko/20080702 SeaMonkey/1.1.11
MIME-Version: 1.0
To: Thomas Dietz <Thomas.Dietz@nw.neclab.eu>
References: <804B13F8F3D94A4AB18B9B01ACB68FA101F5A5F9@EXCHSRV.fokus.fraunhofer.de> <489AB8F2.2050800@cisco.com> <547F018265F92642B577B986577D671C31737D@VENUS.office>
In-Reply-To: <547F018265F92642B577B986577D671C31737D@VENUS.office>
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; l=3348; t=1221747269; x=1222611269; c=relaxed/simple; s=amsdkim2001; h=Content-Type:From:Subject:Content-Transfer-Encoding:MIME-Version; d=cisco.com; i=paitken@cisco.com; z=From:=20Paul=20Aitken=20<paitken@cisco.com> |Subject:=20Re=3A=20[PSAMP]=20PSAMP-INFO=20IE=20realtiveErr or=3A=20Open=20Points |Sender:=20; bh=3RTsw8Hqge0GKa10I9pBUu+GSPJws2GHKVeksbUhJCs=; b=qxRj0vzJC4pVX/pWArWpLxzfaQQfyEilBRbDvmJjnTm0Qx9nAUq13E8EXC cFOcKtHmcqnMq+fXRq2K5+9OU8pDp7jhAwWAq3E0AMQevDsQlhJRkKWFsJTj oGicby28Rp;
Authentication-Results: ams-dkim-2; header.From=paitken@cisco.com; dkim=pass ( sig from cisco.com/amsdkim2001 verified; );
Cc: psamp <psamp@ietf.org>, Juergen Quittek <Quittek@nw.neclab.eu>, psamp-chairs@tools.ietf.org, "Zseby, Tanja" <Tanja.Zseby@fokus.fraunhofer.de>
Subject: Re: [PSAMP] PSAMP-INFO IE realtiveError: Open Points
X-BeenThere: psamp@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: "This mailing list is used for discussion within the IETF packet sampling \(PSAMP\) WG" <psamp.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/psamp>, <mailto:psamp-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/pipermail/psamp>
List-Post: <mailto:psamp@ietf.org>
List-Help: <mailto:psamp-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/psamp>, <mailto:psamp-request@ietf.org?subject=subscribe>
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Sender: psamp-bounces@ietf.org
Errors-To: psamp-bounces@ietf.org

Thomas, all,

> as you may have noticed I just posted a new version of the draft. The
> only open points I see are your concerns expressed in the attached
> mail...
> 
> If you'd like to have those issues included in the draft then please
> suggest text for it.


Thanks. See inline:


>>>> absoluteError
>>>> 
>>>> This Information Element specifies the maximum possible
>>>> measurement error of the reported value for a given Information
>>>> Element. The
>> 
>> We should indicate how to connect the *Error values to specific
>> fields, eg by using an option with the specific field as scope.
>> Else, someone may put the *Error elements adjacent to the relative
>> fields in the data record - which could work, but is open to
>> misinterpretation.

"absoluteError should be used in an option template scoped to the
observation to which it refers.  See section 3.4.2.1 of RFC 5102."



>>>> absoluteError has the same unit as the information element it
>>>> is associated to. The real value of the metric can differ by absoluteError
>> 
>> "with" ------^^

ie, "has the same unit as the information element it is associated with".


>>>> (positive or negative) from the measured value. This
>>>> information element
>>>> provides only the error for measured values. If an information element
>>>> contains an estimated values (from sampling) the confidence boundaries
>>>> and confidence level have to be provided instead.
>> 
>> I would name the IEs: "the confidence boundaries and confidence
>> level have to be provided instead (with the upperCILimit,
>> lowerCILimit and confidenceLevel).

Use the text provided above ^^^^


>>>> relativeError
>>>> 
>>>> This Information Element specifies the maximum possible
>>>> measurement error of the reported value for a given Information
>>>> Element as percentage of the measured value. The real value of
>>>> the metric can differ by relativeError percent (positive or
>>>> negative) from the measured
>>>> value. This information element provides only the error for
>>>> measured values. If an information element contains an
>>>> estimated values (from sampling) the confidence boundaries and
>>>> confidence level have to be provided instead.
>> 
>> Again, as above, I would specifically name the IEs for this.

Use the same text as above.



>> We should specify that upperCILimit, lowerCILimit and
>> confidenceLevel are all required, and what to do if too few of them
>> are provided.

In these sections:

   8.6.5. upperCILimit
   8.6.6. lowerCILimit
   8.6.7. confidenceLevel

Add

   Note that the upperCILimit, lowerCILimit and confidenceLevel are all
   required to specify confidence, and should be disregarded unless all
   three are specified.



>>>> The accuracy for an estimated information element (from
>>>> sampling) SHOULD
>>>> be reported with confidence limits and confidence
>>>> level.[PSAMP-INFO]
>> 
>> Agreed. I'd also like to add something indicating how this can be
>> done, eg by using an option with the correct scope.

"upperCILimit, lowerCILimit and confidenceLevel should all be used in an
option template scoped to the observation to which they refer.   See
section 3.4.2.1 of RFC 5102."



Cheers.
-- 
Paul Aitken
Cisco Systems Ltd, Edinburgh, Scotland.

_______________________________________________
PSAMP mailing list
PSAMP@ietf.org
https://www.ietf.org/mailman/listinfo/psamp