Re: [hops] Fwd: measurement platforms and their capabilities (previously was HOPS bar bof notes)

Joachim Fabini <Joachim.Fabini@tuwien.ac.at> Thu, 06 August 2015 12:16 UTC

Return-Path: <Joachim.Fabini@tuwien.ac.at>
X-Original-To: hops@ietfa.amsl.com
Delivered-To: hops@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3C5521B2E4A for <hops@ietfa.amsl.com>; Thu, 6 Aug 2015 05:16:58 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.041
X-Spam-Level:
X-Spam-Status: No, score=-3.041 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HELO_EQ_AT=0.424, HOST_EQ_AT=0.745, RCVD_IN_DNSWL_MED=-2.3, T_RP_MATCHES_RCVD=-0.01] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ZRrSeMdpSuwi for <hops@ietfa.amsl.com>; Thu, 6 Aug 2015 05:16:55 -0700 (PDT)
Received: from mail1.zserv.tuwien.ac.at (mail1.zserv.tuwien.ac.at [128.130.35.37]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 013841B2E49 for <hops@ietf.org>; Thu, 6 Aug 2015 05:16:54 -0700 (PDT)
Received: from [128.131.67.239] (jason.nt.tuwien.ac.at [128.131.67.239]) (authenticated bits=0) by mail1.zserv.tuwien.ac.at (8.13.8/8.13.8) with ESMTP id t76CGqZU013052 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Thu, 6 Aug 2015 14:16:52 +0200
To: hops@ietf.org
References: <A81C28A3-2D71-4A81-9E84-538B34660FCA@jacobs-university.de> <F1F93AC3-B9DA-427E-B14B-42BF9AA7CB1D@tik.ee.ethz.ch>
From: Joachim Fabini <Joachim.Fabini@tuwien.ac.at>
X-Enigmail-Draft-Status: N1110
Message-ID: <55C35019.3010306@tuwien.ac.at>
Date: Thu, 06 Aug 2015 14:16:25 +0200
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.1.0
MIME-Version: 1.0
In-Reply-To: <F1F93AC3-B9DA-427E-B14B-42BF9AA7CB1D@tik.ee.ethz.ch>
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 8bit
Archived-At: <http://mailarchive.ietf.org/arch/msg/hops/h1b57M_JduEjzfiFX4CBhRvGPHE>
Subject: Re: [hops] Fwd: measurement platforms and their capabilities (previously was HOPS bar bof notes)
X-BeenThere: hops@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Measuring deployability of new transport protocols <hops.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hops>, <mailto:hops-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/hops/>
List-Post: <mailto:hops@ietf.org>
List-Help: <mailto:hops-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hops>, <mailto:hops-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 06 Aug 2015 12:16:58 -0000

Hi Mirja, all

we can contribute some methodological findings and advances in one-way
delay measurements.

Background: Today's networks have evolved to complex, stateful systems
(at layers below IP). It's time to question the stateless copper wire
model, the main abstraction on which our algorithms, applications, and
measurements rely. We can improve measurement methodologies to better
capture the behavior of networks and to find out where the limits of
measurements are.

Concerning the hops charter: from an end-to-end perspective it's very
hard to differentiate if systematic impairments have been caused by a)
network operation and coding at lower layers and b) middlebox actions
(unless these middleboxes modify network, transport- or application
header values). In other words, it is difficult to draw a line between
network scheduling, policing and middlebox behavior that directly
affects the extensibility of the Internet. Aggregation and interaction
of subsequent links in a path complicate matters even more.
The main point is that accurate delay measurements can detect (some?)
network elements on the path that maintain state. And these are
potential/ideal candidates for substantially touching other layers, too.

If there is interest in hops I can present some slides at the next
meeting @ IETF94 (online or offline, depending on travel/time budget).
My feeling is that the findings can support some of the ongoing projects
(RIPE, Monroe).

Some related publications (please drop me a note if you need a personal
copy):
http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6553584
http://dl.acm.org/citation.cfm?id=2747654
http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7151564
and, of course: https://tools.ietf.org/html/rfc7312

Joachim

On 06.08.2015 11:47, Mirja Kühlewind wrote:
> Hi all,
> 
> there was a request for an overview/survey paper on measurement platforms in the meeting. I just realized that this pointer was already posted on the hops list a while ago (see below).
> 
> We, as chairs, will start a Wiki (soon) to collect information about measurement platforms as well as measurement tools (and take this as a starting point). 
> 
> Let us as well as the group know if you have further knowledge about this kind of overview papers or similar things by posting a pointer on the list!
> 
> Mirja
> 
> 
>> Anfang der weitergeleiteten Nachricht:
>>
>> Von: "Bajpai, Vaibhav" <v.bajpai@jacobs-university.de>
>> Betreff: [hops] measurement platforms and their capabilities (previously was HOPS bar bof notes)
>> Datum: 7. April 2015 09:30:59 MESZ
>> An: "hops@ietf.org" <hops@ietf.org>
>> Kopie: "Bajpai, Vaibhav" <v.bajpai@jacobs-university.de>, Aaron Falk <aaron.falk@gmail.com>
>>
>> Dear hops,
>>
>>> On 23 Mar 2015, at 18:51, Aaron Falk <aaron.falk@gmail.com> wrote:
>>
>> [...]
>>
>>> Test infrastructure
>>> 	• AI: group to share on the list what measurement (platforms) exists and what capabilities they have
>>
>> Early discussions within LMAP [1] also often lead to folks asking for feature
>> sets and possibilities of each contemporary performance measurement platform.
>> So we started digging literature work in this space and found that although
>> there were surveys on topology-based measurement platforms (such CAIDA Ark
>> and DIMES); literature work on performance measurement platforms (such RIPE
>> Atlas, SamKnows and BISmark) was missing.
>>
>> Therefore, we started writing such a survey in 2013 to plug this gap. This
>> work got published this week. Thought would share this with you.
>>
>> Hope it helps.
>>
>> ----------------8<-----------------8<-----------------8<-----------------8<
>> A Survey on Internet Performance Measurement Platforms and Related Standardization Efforts
>> Vaibhav Bajpai, Jürgen Schönwälder
>> IEEE Communications Surveys & Tutorials
>> April, 2015
>>
>> A number of Internet measurement platforms have emerged in the last few years.
>> These platforms have deployed thousands of probes at strategic locations
>> within access and backbone networks and behind residential gateways. In this
>> paper we provide a taxonomy of these measurement platforms on the basis of
>> their deployment use-case. We describe these platforms in detail by exploring
>> their coverage, scale, lifetime, deployed metrics and measurement tools,
>> architecture and overall research impact. We conclude the survey by describing
>> current standardization efforts to make large-scale performance measurement
>> platforms interoperable.
>>
>> DOI: http://dx.doi.org/10.1109/COMST.2015.2418435
>> Author Copy: http://vaibhavbajpai.com/documents/papers/proceedings/lsmp-comst-2015.pdf
>> ----------------8<-----------------8<-----------------8<-----------------8<
>>
>> Thanks!
>>
>> [1] https://datatracker.ietf.org/wg/lmap
>>
>> Best, Vaibhav
>>
>> =====================================================
>> Vaibhav Bajpai
>>
>> Research I, Room 91
>> Computer Networks and Distributed Systems (CNDS) Lab
>> School of Engineering and Sciences
>> Jacobs University Bremen, Germany
>>
>> www.vaibhavbajpai.com
>> =====================================================
>> _______________________________________________
>> hops mailing list
>> hops@ietf.org
>> https://www.ietf.org/mailman/listinfo/hops
> 
> _______________________________________________
> hops mailing list
> hops@ietf.org
> https://www.ietf.org/mailman/listinfo/hops
> 
>