Re: [lmap] Missing concept from draft-eardley-lmap-terminology-01.txt

Matt Mathis <mattmathis@google.com> Wed, 15 May 2013 15:32 UTC

Return-Path: <mattmathis@google.com>
X-Original-To: lmap@ietfa.amsl.com
Delivered-To: lmap@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 25CD521F908B for <lmap@ietfa.amsl.com>; Wed, 15 May 2013 08:32:02 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -100.777
X-Spam-Level:
X-Spam-Status: No, score=-100.777 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, FM_FORGED_GMAIL=0.622, HTML_MESSAGE=0.001, J_CHICKENPOX_72=0.6, J_CHICKENPOX_91=0.6, NO_RELAYS=-0.001, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id B1FhnjXx6f+W for <lmap@ietfa.amsl.com>; Wed, 15 May 2013 08:32:01 -0700 (PDT)
Received: from mail-ia0-x230.google.com (mail-ia0-x230.google.com [IPv6:2607:f8b0:4001:c02::230]) by ietfa.amsl.com (Postfix) with ESMTP id 13A4621F905C for <lmap@ietf.org>; Wed, 15 May 2013 08:31:59 -0700 (PDT)
Received: by mail-ia0-f176.google.com with SMTP id m19so2027150iah.7 for <lmap@ietf.org>; Wed, 15 May 2013 08:31:59 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=mtjLAcmzQOyQO/D3JZieBKhVT2YJNz4v1Cm7USxmqpc=; b=ZG2gAM/iCQvYvWEcTGJC2vs0X2oKy7jpnL+9mf/SWEzMa1MOviDONOHoWVYNmr6WN5 L4aOu+MFbjXhh5lD+H3iSp+XypvKgHvPugq2LVsPr0cfnVD6wWv+Yr4DeLsoZR8dqSPw NeSRf0L+aGfSuBia5BvTkpii4x3mihzZeRfEN7JMcpoqu3jujrYxIKm4WruC2GRn+oVX tY0LAibJT4+OcJM3a4Jx7PgqYJn45Osx4ViFhn+rk/rqSb4N/OTmVBCA97oomVA+WMbM 8w/oG1SDEQk+kBHOy2zLja8Lq/g/B+K1ZbK4gJQd8bqMpVC7EHiqL/K8D6nDZQTLSNW4 ehBQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:cc:content-type:x-gm-message-state; bh=mtjLAcmzQOyQO/D3JZieBKhVT2YJNz4v1Cm7USxmqpc=; b=mHh/EUnqU3+HRy8iHttPW0rHmso7U1MNDnDuqYcv0OleatbbqUdFOo7DhFqAmOSCub jE8MfismkJdc1+OBDyBjyzRpN6LQoRySPcXJsK07nh29uM/+0pR3m338AazR7KT6qHzu litfQHBmEcjNw6AkCyoGXbC1+1iYNizLAVmsK9nvBnCF5r+YIrBMyvg9OcLHgeCccv+8 EvtpxQRwXY04DsQi+vggjSSB7yVPZH/fPn8OaVfZrdO/vaiEywxAfgYYeICN8wAxewWT 1Onjj7FWqyGrOk/rxVfY4o4JxKzdpEwS+rXvUzjVHcUetEKlAi1kPTtMNIhaIfjrMJAB 6ZdQ==
MIME-Version: 1.0
X-Received: by 10.50.66.197 with SMTP id h5mr5747471igt.63.1368631919555; Wed, 15 May 2013 08:31:59 -0700 (PDT)
Received: by 10.64.44.201 with HTTP; Wed, 15 May 2013 08:31:59 -0700 (PDT)
In-Reply-To: <9510D26531EF184D9017DF24659BB87F347540758F@EMV65-UKRD.domain1.systemhost.net>
References: <CAH56bmBOycc9FuyDF4h3Fw-9OW3NH--+6SY=OEZoo_EcxnUe0Q@mail.gmail.com> <9510D26531EF184D9017DF24659BB87F347540758F@EMV65-UKRD.domain1.systemhost.net>
Date: Wed, 15 May 2013 08:31:59 -0700
Message-ID: <CAH56bmB4URH2D4pLFFzdoYoQO+b=sD5MfNgqiWXRhYaJMx1gYg@mail.gmail.com>
From: Matt Mathis <mattmathis@google.com>
To: "EARDLEY, Phil" <philip.eardley@bt.com>
Content-Type: multipart/alternative; boundary="047d7bd6be0e64d66504dcc37345"
X-Gm-Message-State: ALoCoQmKz5XEjRTCX+aOYUZ6S6PwNEINOy12ZL6cSgFGvZcsjKZc1VuBHoTUHwhR/lAm7y5NDo0HrjFkZYqEuCUe047rPByWinDAlY7DLbZBdqKbIcQdgf1QvIEXVL/2hKAfauvNrhxnQ12qpSFg84JUeFaCqGLKqrk07yR+PSoqUy4TaqD4Y5pKP/vwppvQPU5+BANQ6PRX
Cc: "lmap@ietf.org" <lmap@ietf.org>
Subject: Re: [lmap] Missing concept from draft-eardley-lmap-terminology-01.txt
X-BeenThere: lmap@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Large Scale Measurement of Access network Performance <lmap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/lmap>, <mailto:lmap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/lmap>
List-Post: <mailto:lmap@ietf.org>
List-Help: <mailto:lmap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/lmap>, <mailto:lmap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 15 May 2013 15:32:02 -0000

Oops, You are correct, I was looking at -ippm-lmap-path-, and not
-terminology.  My bad

I am not as interested in comparisons between ISPs using
different technologies as I am in having methodology that most accurately
portrays each portion of the path.

Consider issues of cross traffic: for the unshared portion of the path it
is important to test when the user is not using their service, so I can
measure the raw capacity of their access link.   For the shared portion of
the path, I am typically more interested in precisely the opposite
question - does the ISP have sufficient capacity to carry their aggregate
load under normal conditions.   My measurement strategy is to somehow place
a real or virtual MP at the aggregation point, and measure the performance
between an external MP and the aggregation point, under actual load.

For the shared portion of the path, excluding data points due to load
is precisely the wrong thing to do, and raises questions about sampling
bias if the virtual MP is actually placed on a subscriber's premise, and
data has to be discarded when the subscriber is active.

Thanks,
--MM--
The best way to predict the future is to create it.  - Alan Kay

Privacy matters!  We know from recent events that people are using our
services to speak in defiance of unjust governments.   We treat privacy and
security as matters of life and death, because for some users, they are.


On Wed, May 15, 2013 at 1:10 AM, <philip.eardley@bt.com> wrote:

> << I would like to have precise but technology independent terms for the
> boundary between shared and unshared access resources>>****
>
> This seems a nice idea to me****
>
> ** **
>
> As you say, different technologies have the shared/unshared boundary at
> different distances from the customer. This means that great care is needed
> if comparing results to the “sharing point” in two different networks****
>
> ** **
>
> I also agree that having a virtualised example would be good.****
>
> ** **
>
> Ps think you’re referring to
> http://tools.ietf.org/html/draft-morton-ippm-lmap-path-01 ? - though an
> open question whether any of the terms from there should be migrated into
> http://tools.ietf.org/html/draft-eardley-lmap-terminology-01 – might be
> nice to have them all in one place? Although organisationally one draft
> sits in ippm and the other in lmap ****
>
> ** **
>
> Thanks!
> phil****
>
> ** **
>
> *From:* Matt Mathis [mailto:mattmathis@google.com]
> *Sent:* 13 May 2013 00:49
> *To:* Eardley,PL,Philip,TUB8 R
> *Cc:* lmap@ietf.org
> *Subject:* Missing concept from draft-eardley-lmap-terminology-01.txt****
>
> ** **
>
> Most of the terminology in this draft defined by routing and addressing
> concepts.   For measurement, it is also important to have terminology to
> describe traffic aggregation.  Especially important is over which subpaths
> might one customer's traffic be subject to resource contention with other
> customers?****
>
> ** **
>
> I would like to have precise but technology independent terms for the
> boundary between shared and unshared access resources.   Note that for many
> technologies (mobile service, DOCSIS) this is very close to the service
> demarc at the customer.  For others, such as FTTH and DSL it typically
> occurs in centralized location.****
>
> ** **
>
> The measurement problems on either side of this boundary are extremely
> different, and we need to be able to unambiguously make this dichotomy.***
> *
>
> ** **
>
> I use "unshared access", "shared access", and "sharing point."   Note that
> for many technologies the sharing point is L2 or lower, so there might not
> a natural way to connect a MP at the sharing point.****
>
> ** **
>
> There is also the risk that addressing and routing are going to become
> progressively less relevant as more and more of the network becomes
> virtualized through such technologies as software defined networks.    I
> consider ownership (responsibility), traffic aggregation and resource
> contention to be far more important than addressing.****
>
> ** **
>
> Also, "Destination host" is a rather odd choice for a content provider.
> Perhaps "core service provider."****
>
>
> ****
>
> Thanks,****
>
> --MM--
> The best way to predict the future is to create it.  - Alan Kay
>
> Privacy matters!  We know from recent events that people are using our
> services to speak in defiance of unjust governments.   We treat privacy and
> security as matters of life and death, because for some users, they are.**
> **
>
> ** **
>
> On Thu, May 2, 2013 at 2:52 AM, <philip.eardley@bt.com> wrote:****
>
> I updated the draft
> http://tools.ietf.org/html/draft-eardley-lmap-terminology
> Thank-you for all the comments!
>
> (the draft is a possible starting point for terminology for the
> prospective lmap wg)
>
> Best wishes
> phil
>
> -----Original Message-----
> From: internet-drafts@ietf.org [mailto:internet-drafts@ietf.org]
> Sent: 02 May 2013 09:40
> To: Al Morton; Eardley,PL,Philip,TUB8 R; Burbridge,T,Trevor,TUB8 R; Al
> C.Morton; Marcelo Bagnulo
> Subject: New Version Notification for draft-eardley-lmap-terminology-01.txt
>
>
> A new version of I-D, draft-eardley-lmap-terminology-01.txt
> has been successfully submitted by Philip Eardley and posted to the IETF
> repository.
>
> Filename:        draft-eardley-lmap-terminology
> Revision:        01
> Title:           Terminology for Large MeAsurement Platforms (LMAP)
> Creation date:   2013-05-02
> Group:           Individual Submission
> Number of pages: 10
> URL:
> http://www.ietf.org/internet-drafts/draft-eardley-lmap-terminology-01.txt
> Status:
> http://datatracker.ietf.org/doc/draft-eardley-lmap-terminology
> Htmlized:
> http://tools.ietf.org/html/draft-eardley-lmap-terminology-01
> Diff:
> http://www.ietf.org/rfcdiff?url2=draft-eardley-lmap-terminology-01
>
> Abstract:
>    This documents defines terminology for Large Scale Measurement
>    Platforms.
>
>
>
>
> The IETF Secretariat
>
> _______________________________________________
> lmap mailing list
> lmap@ietf.org
> https://www.ietf.org/mailman/listinfo/lmap****
>
> ** **
>