Re: [PSAMP] PSAMP-INFO IE realtiveError

Andrew Johnson <andrjohn@cisco.com> Thu, 14 August 2008 13:37 UTC

Return-Path: <psamp-bounces@ietf.org>
X-Original-To: psamp-archive@lists.ietf.org
Delivered-To: ietfarch-psamp-archive@core3.amsl.com
Received: from [127.0.0.1] (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 26D7F3A6DC6; Thu, 14 Aug 2008 06:37:54 -0700 (PDT)
X-Original-To: psamp@core3.amsl.com
Delivered-To: psamp@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 656A43A6DB8 for <psamp@core3.amsl.com>; Thu, 14 Aug 2008 06:37:52 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.599
X-Spam-Level:
X-Spam-Status: No, score=-6.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id LQevRD92YvIE for <psamp@core3.amsl.com>; Thu, 14 Aug 2008 06:37:46 -0700 (PDT)
Received: from ams-iport-1.cisco.com (ams-iport-1.cisco.com [144.254.224.140]) by core3.amsl.com (Postfix) with ESMTP id 80D233A6DC6 for <psamp@ietf.org>; Thu, 14 Aug 2008 06:37:45 -0700 (PDT)
X-IronPort-AV: E=Sophos;i="4.32,210,1217808000"; d="asc'?scan'208";a="17165279"
Received: from ams-dkim-2.cisco.com ([144.254.224.139]) by ams-iport-1.cisco.com with ESMTP; 14 Aug 2008 13:37:09 +0000
Received: from ams-core-1.cisco.com (ams-core-1.cisco.com [144.254.224.150]) by ams-dkim-2.cisco.com (8.12.11/8.12.11) with ESMTP id m7EDb9DG027965; Thu, 14 Aug 2008 15:37:09 +0200
Received: from cisco.com (mrwint.cisco.com [64.103.71.48]) by ams-core-1.cisco.com (8.13.8/8.13.8) with ESMTP id m7EDb9gi025050; Thu, 14 Aug 2008 13:37:09 GMT
Received: from [10.55.163.35] (ams-andrjohn-8712.cisco.com [10.55.163.35]) by cisco.com (8.11.7p3+Sun/8.8.8) with ESMTP id m7EDb2p13711; Thu, 14 Aug 2008 14:37:02 +0100 (BST)
From: Andrew Johnson <andrjohn@cisco.com>
To: Thomas Dietz <Thomas.Dietz@nw.neclab.eu>
In-Reply-To: <547F018265F92642B577B986577D671C2A5471@VENUS.office>
References: DEFANGED[22027]:<804B13F8F3D94A4AB18B9B01ACB68FA101F5A5F9@EXCHSRV.fokus.fraunhofer.de> <489AB8F2.2050800@cisco.com> <804B13F8F3D94A4AB18B9B01ACB68FA101F5A810@EXCHSRV.fokus.fraunhofer.de> <489C52A7.6050907@cisco.com> <804B13F8F3D94A4AB18B9B01ACB68FA101F5A819@EXCHSRV.fokus.frau " " nhofer.de> <1218208442.9068.45.camel@localhost> <804B13F8F3D94A4AB18B9B01ACB68FA101F5A81C@EXCHSRV.fokus.fraunhofer.de> <1218221293.9068.61.camel@localhost> <804B13F8F3D94A4AB18B9B01ACB68FA101F5A821@EXCHSRV.fokus.fraunhofer.de> <1218665578.9426.10.camel@localhost> <804B13F8F3D94A4AB18B9B01ACB68FA101F5AA39@EXCHSRV.fokus.fraunhofer.de> <547F018265F92642B577B986577D671C2A5471@VENUS.office>
Date: Thu, 14 Aug 2008 14:37:01 +0100
Message-Id: <1218721021.9426.57.camel@localhost>
Mime-Version: 1.0
X-Mailer: Evolution 2.12.3-1.2mdv2008.0
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; l=11420; t=1218721029; x=1219585029; c=relaxed/simple; s=amsdkim2001; h=Content-Type:From:Subject:Content-Transfer-Encoding:MIME-Version; d=cisco.com; i=andrjohn@cisco.com; z=From:=20Andrew=20Johnson=20<andrjohn@cisco.com> |Subject:=20RE=3A=20[PSAMP]=20PSAMP-INFO=20IE=20realtiveErr or |Sender:=20; bh=ZvvL2ayRM/1o8AbRND92n3VvbQ0tDS64A53fneweDQ8=; b=Pos4B+QNpqf/TSNLO5MdRgtE0Hjdl0i+PaM58rUkxwxQU7lhJazlAByofh He/GdccsUoSe360qvyPwtAwXQeZncvSud5rACJuhaCBSBnHfFXECSuw1KMXg hJyeGzYxmE;
Authentication-Results: ams-dkim-2; header.From=andrjohn@cisco.com; dkim=pass ( sig from cisco.com/amsdkim2001 verified; );
Cc: psamp <psamp@ietf.org>, "Zseby, Tanja" <Tanja.Zseby@fokus.fraunhofer.de>, Juergen Quittek <Quittek@nw.neclab.eu>
Subject: Re: [PSAMP] PSAMP-INFO IE realtiveError
X-BeenThere: psamp@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: "This mailing list is used for discussion within the IETF packet sampling \(PSAMP\) WG" <psamp.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/psamp>, <mailto:psamp-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/pipermail/psamp>
List-Post: <mailto:psamp@ietf.org>
List-Help: <mailto:psamp-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/psamp>, <mailto:psamp-request@ietf.org?subject=subscribe>
Content-Type: multipart/mixed; boundary="===============0828277547=="
Sender: psamp-bounces@ietf.org
Errors-To: psamp-bounces@ietf.org

Hi Thomas

I don't think much has changed.  If I filter out the misunderstandings I
think you get something like this:

Tanja:    What's this fixedError thing for?
Paul:     It's the uncertainty of the measurement expressed as a fixed
          amount of the measured units.
Tanja:    That's a confusing name, let's call it absoluteError.
Everyone: OK.
Tanja:    Why do we even need relativeError then?
Andrew:   I think it might be useful for certain measurement devices.
Tanja:    OK, well keep it if you want.


In conclusion, fixedError is now called absoluteError and we'll keep
relativeError in case it's needed.

For those who followed the thread, does that sound fair?


Cheers

Andrew


On Thu, 2008-08-14 at 15:25 +0200, Thomas Dietz wrote:
> Hi Tanja, Andrew, Paul,
> 
> since the topic seems to be settled now can you please summarize your
> discussion in this thread? I would like to know what to put into an updated
> version of the draft so that it can get published asap.
> 
> Best Regards,
> 
> Thomas
> 
> -- 
> Thomas Dietz                 E-mail: Thomas.Dietz@nw.neclab.eu
> NEC Europe Ltd.              Phone:  +49 6221 4342-128
> NEC Laboratories Europe      Fax:    +49 6221 4342-155
> Network Research Division
> Kurfuersten-Anlage 36
> 69115 Heidelberg, Germany    http://www.nw.neclab.eu
> 
> NEC Europe Limited           Registered in England 2832014
> Registered Office: NEC House, 1 Victoria Road, London W3 6BL
> 
> > -----Original Message-----
> > From: psamp-bounces@ietf.org [mailto:psamp-bounces@ietf.org] On Behalf
> > Of Zseby, Tanja
> > Sent: Donnerstag, 14. August 2008 15:03
> > To: Andrew Johnson
> > Cc: psamp; Juergen Quittek
> > Subject: Re: [PSAMP] PSAMP-INFO IE realtiveError
> > 
> > Hi Andrew,
> > 
> > great. So it seems that after a lot of mice stepping on and off the
> > scale we have a common understanding of the terms :-)
> > So to summarize:
> > - we don't need an offset IE
> > - we definitely include the absoluteError IE
> > - we can also include the relativeError IE (maybe you as authors
> > decide?)
> > 
> > Kind regards
> > Tanja
> > 
> > > -----Original Message-----
> > > From: psamp-bounces@ietf.org [mailto:psamp-bounces@ietf.org] On
> > Behalf
> > > Of Andrew Johnson
> > > Sent: Thursday, August 14, 2008 12:13 AM
> > > To: Zseby, Tanja
> > > Cc: psamp; Juergen Quittek
> > > Subject: Re: [PSAMP] PSAMP-INFO IE realtiveError
> > >
> > > Hi Tanja
> > >
> > >
> > > On Sat, 2008-08-09 at 01:19 +0200, Zseby, Tanja wrote:
> > > > Hi Andrew,
> > > >
> > > > > -----Original Message-----
> > > > > From: psamp-bounces@ietf.org [mailto:psamp-bounces@ietf.org] On
> > > > > Behalf Of Andrew Johnson
> > > > > Sent: Friday, August 08, 2008 8:48 PM
> > > > > To: Zseby, Tanja
> > > > > Cc: psamp; Juergen Quittek
> > > > > Subject: Re: [PSAMP] PSAMP-INFO IE realtiveError
> > > > >
> > > > >
> > > > > On Fri, 2008-08-08 at 18:07 +0200, Zseby, Tanja wrote:
> > > > > > Hi Andrew,
> > > > > >
> > > > > > lets first forget about the fixed error and say we agree that
> > we
> > > > need
> > > > > > something like an absolute error that defines the maximum error
> > > > > > that can happen at each measurement (given the real error is
> > > unknown).
> > > > > > Then it was unclear for me why you report this together with a
> > > > > > relative error which provides exactly the same information but
> > > > > > only
> > > > > as
> > > > > > percentage of the measured value. It is only for convenience
> > that
> > > > > > we can report either format.
> > > > > >
> > > > > > relError=abserror/measured value
> > > > > >
> > > > > >
> > > > > > e.g. you can e.g. say: The absolute error is +/- 0.2 kg:
> > > > > > Person:   80.50kg +/- 0.2kg
> > > > > > Mouse:     0.50 kg +/- 0.2kg
> > > > > >
> > > > > > That corresponds to the relative errors:
> > > > > > Person:   0.249 %
> > > > > > Mouse:   40%
> > > > >
> > > > > In the Accuracy Report Interpretation you only provide one
> > accuracy
> > > > for
> > > > > the field, you don't report the accuracy per measurement.  The
> > idea
> > > > > is to provide the margin of error for all measurements of a
> > certain
> > > type.
> > > > >
> > > > > The only use of the error field types that was originally
> > intended
> > > > > was in the Accuracy Report Interpretation, where the error is
> > > scoped
> > > > > to
> > > > the
> > > > > field (and optionally template).  Unless you use a new template
> > per
> > > > > record I'm not sure how you would scope the error value to an
> > > > > individual measurement.
> > > >
> > > > But this is absolutely in-line with the above. You can provide one
> > > > absolute error for all timestamps or all byte measurements (or all
> > > > weight measurements). With this you say what is the maximum error
> > > when
> > > > measuring the timestamp or bytes. This maximum error usually
> > depends
> > > > on the measurement method and therefore the absolute error (= the
> > > > maximum possible error) is usually the same for all of the values
> > > > measured with this method. I think this is exactly the same that
> > you
> > > > want to express, correct?
> > >
> > > Ah I see what you mean now.  In general I think that only one type of
> > > error will be reported at once and that most of the time that will be
> > > an absolute error.
> > >
> > > I think there is still value in providing a way to express a relative
> > > error though.  For example, clocks tend to drift over time so the
> > > larger the time measurement the larger the error, i.e. accurate to
> > > within 1 second per day is 0.0011574%.
> > >
> > > Cheers
> > >
> > > Andrew
> > >
> > >
> > > > >
> > > > >
> > > > > > Or you could say: The relative error is +/- 10 %. Then you get
> > > the
> > > > > > corresponding absolute errors:
> > > > > > Person:   80.50kg +/- 8.05 kg
> > > > > > Mouse:     0.50 kg +/ 0.05 kg
> > > > > >
> > > > > > If this is o.k., the second question would be:  do we need
> > > > > > something like an offset/fixed error ?
> > > > > > e.g. Offset: 0.25
> > > > > > Person (real value):   80.50kg
> > > > > > Person (measured):     80.75kg
> > > > > >
> > > > > > Mouse (real value):   0.50 kg
> > > > > > Mouse (measured):     0.75 kg
> > > > > >
> > > > > > The only thing that might be confusing is if you have an offset
> > > > > > and report it together with a relative error, since the
> > relative
> > > > > > error should still refer to the real value (without offset).
> > But
> > > > > > we
> > > > > probably
> > > > > > do not need the offset value.
> > > > >
> > > > > I don't think we have any need for an offset.
> > > >
> > > > o.k. I agree.
> > > >
> > > > >
> > > > > > Hope this was not even more confusing...
> > > > >
> > > > > I think I understand how you may have misunderstood how the error
> > > > > IEs were intended to be used.  I hope I'm making things
> > clearer...
> > > > > perhaps the draft needs some clarification.
> > > >
> > > > I think we have the same understanding (see above). The
> > absoluteError
> > > > gives the maximum value from which a measured value can differ from
> > > > the real value. The error is usually bound to the measurement
> > method
> > > > or system (i.e. the same for subsequent values).
> > > >
> > > > Kind regards,
> > > > Tanja
> > > >
> > > > >
> > > > > Cheers
> > > > >
> > > > > Andrew
> > > > >
> > > > >
> > > > > > Kind regards
> > > > > > Tanja (starting to see white mice)
> > > > > >
> > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Andrew Johnson [mailto:andrjohn@cisco.com]
> > > > > > > Sent: Friday, August 08, 2008 5:14 PM
> > > > > > > To: Zseby, Tanja
> > > > > > > Cc: Paul Aitken; psamp; Juergen Quittek
> > > > > > > Subject: Re: [PSAMP] PSAMP-INFO IE realtiveError
> > > > > > >
> > > > > > > [SNIP]
> > > > > > > > > >> The intention was to say that the clock is 5 minutes
> > > > > > > > > >> slow,
> > > > > > > > > >> +/-
> > > > > > > 10
> > > > > > > > > >> seconds - so there's both an absolute error and a
> > > > > > > > > >> relative
> > > > > > > error.
> > > > > > > > > >>
> > > > > > > > > >
> > > > > > > > > > NOW I finally understand what you meant by fixedError
> > > > > > > > > > initially
> > > > > > > !!
> > > > > > > > > > This I would not consider as error. Any fixed deviation
> > I
> > > > > > > > > > would
> > > > > > > > > rather
> > > > > > > > > > name "offset"...
> > > > > > > > > > If it is known couldn't you add it to the value and
> > > report
> > > > > the
> > > > > > > > > correct
> > > > > > > > > > time?
> > > > > > > > >
> > > > > > > > > In that case there would be no need to ever report
> > > > > "absoluteError"
> > > > > > > -
> > > > > > > > > because all the original measurements can be corrected
> > > > > > > > > before
> > > > > > being
> > > > > > > > > exported.
> > > > > > > >
> > > > > > > > Maybe for clarification:
> > > > > > > > The absoluteError that I propose is different from what you
> > > > > > > > intended by fixedError. absoluteError is a maximum error
> > that
> > > > you
> > > > > > > > would
> > > > > > expect
> > > > > > > > due to the inaccurate measurement (e.g. the timestamp may
> > > vary
> > > > by
> > > > > > +/-
> > > > > > > 5 ms).
> > > > > > > > The real error that you make during measurements is unknown
> > > > > > > > and can vary. Your fixedError is different. It is a fixed
> > and
> > > > > > > > known offset
> > > > > > > for
> > > > > > > > the measured values, correct?
> > > > > > >
> > > > > > > I think the absoluteError is the same as the originally
> > > > fixedError.
> > > > > > In
> > > > > > > Paul's example above the fixedError was +/- 10 seconds.  I'm
> > > not
> > > > > > > sure how you would communicate the "5 minutes slow" part...
> > > > > > >
> > > > > > > The original idea was fixedError would say this is accurate
> > to
> > > > > > > within
> > > > > > X
> > > > > > > units.  Both the fixed and the absolute error can be used
> > > > together,
> > > > > > but
> > > > > > > you just have to go with the least accurate one.  For
> > example,
> > > > > > > if
> > > > > my
> > > > > > > bathroom scales have a fixed error of 0.25kg and a relative
> > > > > > > error
> > > > > of
> > > > > > > 0.5%, then they can weigh a person very accurate, but are
> > > > > > > rubbish for weighing mice:
> > > > > > >   Person1:   81.50kg +/- 0.4kg
> > > > > > >   Mouse1:     0.25kg +/ 0.25kg
> > > > > > >
> > > > > > > Cheers
> > > > > > >
> > > > > > > Andrew
> > > > > >
> > > >
> > _______________________________________________
> > PSAMP mailing list
> > PSAMP@ietf.org
> > https://www.ietf.org/mailman/listinfo/psamp
_______________________________________________
PSAMP mailing list
PSAMP@ietf.org
https://www.ietf.org/mailman/listinfo/psamp