Re: [PSAMP] PSAMP-INFO IE realtiveError

Andrew Johnson <andrjohn@cisco.com> Wed, 13 August 2008 22:13 UTC

Return-Path: <psamp-bounces@ietf.org>
X-Original-To: psamp-archive@lists.ietf.org
Delivered-To: ietfarch-psamp-archive@core3.amsl.com
Received: from [127.0.0.1] (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 4FF6D3A6B05; Wed, 13 Aug 2008 15:13:06 -0700 (PDT)
X-Original-To: psamp@core3.amsl.com
Delivered-To: psamp@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id EC3543A6AFC for <psamp@core3.amsl.com>; Wed, 13 Aug 2008 15:13:04 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.599
X-Spam-Level:
X-Spam-Status: No, score=-6.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Q1-5s-K65Slz for <psamp@core3.amsl.com>; Wed, 13 Aug 2008 15:13:03 -0700 (PDT)
Received: from ams-iport-1.cisco.com (ams-iport-1.cisco.com [144.254.224.140]) by core3.amsl.com (Postfix) with ESMTP id 2505B3A6AEF for <psamp@ietf.org>; Wed, 13 Aug 2008 15:13:02 -0700 (PDT)
X-IronPort-AV: E=Sophos;i="4.32,203,1217808000"; d="asc'?scan'208";a="17090050"
Received: from ams-dkim-2.cisco.com ([144.254.224.139]) by ams-iport-1.cisco.com with ESMTP; 13 Aug 2008 22:13:05 +0000
Received: from ams-core-1.cisco.com (ams-core-1.cisco.com [144.254.224.150]) by ams-dkim-2.cisco.com (8.12.11/8.12.11) with ESMTP id m7DMD6Bt004248; Thu, 14 Aug 2008 00:13:06 +0200
Received: from cisco.com (mrwint.cisco.com [64.103.71.48]) by ams-core-1.cisco.com (8.13.8/8.13.8) with ESMTP id m7DMD571016604; Wed, 13 Aug 2008 22:13:05 GMT
Received: from [10.55.163.35] (ams-andrjohn-8712.cisco.com [10.55.163.35]) by cisco.com (8.11.7p3+Sun/8.8.8) with ESMTP id m7DMCwY29501; Wed, 13 Aug 2008 23:13:04 +0100 (BST)
From: Andrew Johnson <andrjohn@cisco.com>
To: "Zseby, Tanja" <Tanja.Zseby@fokus.fraunhofer.de>
In-Reply-To: <804B13F8F3D94A4AB18B9B01ACB68FA101F5A821@EXCHSRV.fokus.fraunhofer.de>
References: <804B13F8F3D94A4AB18B9B01ACB68FA101F5A5F9@EXCHSRV.fokus.fraunhofer.de> <489AB8F2.2050800@cisco.com> <804B13F8F3D94A4AB18B9B01ACB68FA101F5A810@EXCHSRV.fokus.fraunhofer.de> <489C52A7.6050907@cisco.com> <804B13F8F3D94A4AB18B9B01ACB68FA101F5A819@EXCHSRV.fokus.fraunhofer.de> <1218208442.9068.45.camel@localhost> <804B13F8F3D94A4AB18B9B01ACB68FA101F5A81C@EXCHSRV.fokus.fraunhofer.de> <1218221293.9068.61.camel@localhost> <804B13F8F3D94A4AB18B9B01ACB68FA101F5A821@EXCHSRV.fokus.fraunhofer.de>
Date: Wed, 13 Aug 2008 23:12:58 +0100
Message-Id: <1218665578.9426.10.camel@localhost>
Mime-Version: 1.0
X-Mailer: Evolution 2.12.3-1.2mdv2008.0
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; l=7359; t=1218665586; x=1219529586; c=relaxed/simple; s=amsdkim2001; h=Content-Type:From:Subject:Content-Transfer-Encoding:MIME-Version; d=cisco.com; i=andrjohn@cisco.com; z=From:=20Andrew=20Johnson=20<andrjohn@cisco.com> |Subject:=20RE=3A=20[PSAMP]=20PSAMP-INFO=20IE=20realtiveErr or |Sender:=20; bh=DpABeNqui9OWDB7v5Rq7TH/e+EYLYvU6qoVj/nCXBFo=; b=XnChdvtp9kPpNs2lDaTqZ27V5JzruqO3IL0AK2CHMMrU2T2eFTLSUomTlm luWTsvrlO++AFRNHg/qW1Z6xiMnmflB5iUbuRt6hQdNb0SO9RHgtdKyYjWjV hb2PWXHsY4;
Authentication-Results: ams-dkim-2; header.From=andrjohn@cisco.com; dkim=pass ( sig from cisco.com/amsdkim2001 verified; );
Cc: psamp <psamp@ietf.org>, Juergen Quittek <Quittek@nw.neclab.eu>
Subject: Re: [PSAMP] PSAMP-INFO IE realtiveError
X-BeenThere: psamp@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: "This mailing list is used for discussion within the IETF packet sampling \(PSAMP\) WG" <psamp.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/psamp>, <mailto:psamp-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/pipermail/psamp>
List-Post: <mailto:psamp@ietf.org>
List-Help: <mailto:psamp-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/psamp>, <mailto:psamp-request@ietf.org?subject=subscribe>
Content-Type: multipart/mixed; boundary="===============0178750903=="
Sender: psamp-bounces@ietf.org
Errors-To: psamp-bounces@ietf.org

Hi Tanja


On Sat, 2008-08-09 at 01:19 +0200, Zseby, Tanja wrote:
> Hi Andrew,
> 
> > -----Original Message-----
> > From: psamp-bounces@ietf.org [mailto:psamp-bounces@ietf.org] On Behalf
> > Of Andrew Johnson
> > Sent: Friday, August 08, 2008 8:48 PM
> > To: Zseby, Tanja
> > Cc: psamp; Juergen Quittek
> > Subject: Re: [PSAMP] PSAMP-INFO IE realtiveError
> > 
> > 
> > On Fri, 2008-08-08 at 18:07 +0200, Zseby, Tanja wrote:
> > > Hi Andrew,
> > >
> > > lets first forget about the fixed error and say we agree that we
> need
> > > something like an absolute error that defines the maximum error that
> > > can happen at each measurement (given the real error is unknown).
> > > Then it was unclear for me why you report this together with a
> > > relative error which provides exactly the same information but only
> > as
> > > percentage of the measured value. It is only for convenience that we
> > > can report either format.
> > >
> > > relError=abserror/measured value
> > >
> > >
> > > e.g. you can e.g. say: The absolute error is +/- 0.2 kg:
> > > Person:   80.50kg +/- 0.2kg
> > > Mouse:     0.50 kg +/- 0.2kg
> > >
> > > That corresponds to the relative errors:
> > > Person:   0.249 %
> > > Mouse:   40%
> > 
> > In the Accuracy Report Interpretation you only provide one accuracy
> for
> > the field, you don't report the accuracy per measurement.  The idea is
> > to provide the margin of error for all measurements of a certain type.
> > 
> > The only use of the error field types that was originally intended was
> > in the Accuracy Report Interpretation, where the error is scoped to
> the
> > field (and optionally template).  Unless you use a new template per
> > record I'm not sure how you would scope the error value to an
> > individual measurement.
> 
> But this is absolutely in-line with the above. You can provide one
> absolute error for all timestamps or all byte measurements (or all
> weight measurements). With this you say what is the maximum error when
> measuring the timestamp or bytes. This maximum error usually depends on
> the measurement method and therefore the absolute error (= the maximum
> possible error) is usually the same for all of the values measured with
> this method. I think this is exactly the same that you want to express,
> correct? 

Ah I see what you mean now.  In general I think that only one type of
error will be reported at once and that most of the time that will be an
absolute error.

I think there is still value in providing a way to express a relative
error though.  For example, clocks tend to drift over time so the larger
the time measurement the larger the error, i.e. accurate to within 1
second per day is 0.0011574%.

Cheers

Andrew


> > 
> > 
> > > Or you could say: The relative error is +/- 10 %. Then you get the
> > > corresponding absolute errors:
> > > Person:   80.50kg +/- 8.05 kg
> > > Mouse:     0.50 kg +/ 0.05 kg
> > >
> > > If this is o.k., the second question would be:  do we need something
> > > like an offset/fixed error ?
> > > e.g. Offset: 0.25
> > > Person (real value):   80.50kg
> > > Person (measured):     80.75kg
> > >
> > > Mouse (real value):   0.50 kg
> > > Mouse (measured):     0.75 kg
> > >
> > > The only thing that might be confusing is if you have an offset and
> > > report it together with a relative error, since the  relative error
> > > should still refer to the real value (without offset). But we
> > probably
> > > do not need the offset value.
> > 
> > I don't think we have any need for an offset.
> 
> o.k. I agree.
> 
> > 
> > > Hope this was not even more confusing...
> > 
> > I think I understand how you may have misunderstood how the error IEs
> > were intended to be used.  I hope I'm making things clearer... perhaps
> > the draft needs some clarification.
> 
> I think we have the same understanding (see above). The absoluteError
> gives the maximum value from which a measured value can differ from the
> real value. The error is usually bound to the measurement method or
> system (i.e. the same for subsequent values).
> 
> Kind regards,
> Tanja
> 
> > 
> > Cheers
> > 
> > Andrew
> > 
> > 
> > > Kind regards
> > > Tanja (starting to see white mice)
> > >
> > >
> > > > -----Original Message-----
> > > > From: Andrew Johnson [mailto:andrjohn@cisco.com]
> > > > Sent: Friday, August 08, 2008 5:14 PM
> > > > To: Zseby, Tanja
> > > > Cc: Paul Aitken; psamp; Juergen Quittek
> > > > Subject: Re: [PSAMP] PSAMP-INFO IE realtiveError
> > > >
> > > > [SNIP]
> > > > > > >> The intention was to say that the clock is 5 minutes slow,
> > > > > > >> +/-
> > > > 10
> > > > > > >> seconds - so there's both an absolute error and a relative
> > > > error.
> > > > > > >>
> > > > > > >
> > > > > > > NOW I finally understand what you meant by fixedError
> > > > > > > initially
> > > > !!
> > > > > > > This I would not consider as error. Any fixed deviation I
> > > > > > > would
> > > > > > rather
> > > > > > > name "offset"...
> > > > > > > If it is known couldn't you add it to the value and report
> > the
> > > > > > correct
> > > > > > > time?
> > > > > >
> > > > > > In that case there would be no need to ever report
> > "absoluteError"
> > > > -
> > > > > > because all the original measurements can be corrected before
> > > being
> > > > > > exported.
> > > > >
> > > > > Maybe for clarification:
> > > > > The absoluteError that I propose is different from what you
> > > > > intended by fixedError. absoluteError is a maximum error that
> you
> > > > > would
> > > expect
> > > > > due to the inaccurate measurement (e.g. the timestamp may vary
> by
> > > +/-
> > > > 5 ms).
> > > > > The real error that you make during measurements is unknown and
> > > > > can vary. Your fixedError is different. It is a fixed and known
> > > > > offset
> > > > for
> > > > > the measured values, correct?
> > > >
> > > > I think the absoluteError is the same as the originally
> fixedError.
> > > In
> > > > Paul's example above the fixedError was +/- 10 seconds.  I'm not
> > > > sure how you would communicate the "5 minutes slow" part...
> > > >
> > > > The original idea was fixedError would say this is accurate to
> > > > within
> > > X
> > > > units.  Both the fixed and the absolute error can be used
> together,
> > > but
> > > > you just have to go with the least accurate one.  For example, if
> > my
> > > > bathroom scales have a fixed error of 0.25kg and a relative error
> > of
> > > > 0.5%, then they can weigh a person very accurate, but are rubbish
> > > > for weighing mice:
> > > >   Person1:   81.50kg +/- 0.4kg
> > > >   Mouse1:     0.25kg +/ 0.25kg
> > > >
> > > > Cheers
> > > >
> > > > Andrew
> > >
> 
_______________________________________________
PSAMP mailing list
PSAMP@ietf.org
https://www.ietf.org/mailman/listinfo/psamp