[hops] lessons learned from using ripe atlas

"Bajpai, Vaibhav" <v.bajpai@jacobs-university.de> Thu, 06 August 2015 10:14 UTC

Return-Path: <v.bajpai@jacobs-university.de>
X-Original-To: hops@ietfa.amsl.com
Delivered-To: hops@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B1CD91B2C04 for <hops@ietfa.amsl.com>; Thu, 6 Aug 2015 03:14:10 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.961
X-Spam-Level:
X-Spam-Status: No, score=-1.961 tagged_above=-999 required=5 tests=[BAYES_20=-0.001, HELO_EQ_DE=0.35, RCVD_IN_DNSWL_MED=-2.3, T_RP_MATCHES_RCVD=-0.01] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id TjAzepXRk6ss for <hops@ietfa.amsl.com>; Thu, 6 Aug 2015 03:14:08 -0700 (PDT)
Received: from atlas3.jacobs-university.de (atlas3.jacobs-university.de [212.201.44.18]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id ED6DB1B2C0B for <hops@ietf.org>; Thu, 6 Aug 2015 03:14:07 -0700 (PDT)
Received: from localhost (demetrius5.irc-it.jacobs-university.de [10.70.0.222]) by atlas3.jacobs-university.de (Postfix) with ESMTP id C96BEEA3 for <hops@ietf.org>; Thu, 6 Aug 2015 12:14:05 +0200 (CEST)
X-Virus-Scanned: amavisd-new at jacobs-university.de
Received: from atlas3.jacobs-university.de ([10.70.0.220]) by localhost (demetrius5.jacobs-university.de [10.70.0.222]) (amavisd-new, port 10030) with ESMTP id Sy8k-0oEvIF8 for <hops@ietf.org>; Thu, 6 Aug 2015 12:14:04 +0200 (CEST)
Received: from hermes.jacobs-university.de (hermes.jacobs-university.de [212.201.44.23]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hermes.jacobs-university.de", Issuer "Jacobs University CA - G01" (verified OK)) by atlas3.jacobs-university.de (Postfix) with ESMTPS for <hops@ietf.org>; Thu, 6 Aug 2015 12:14:04 +0200 (CEST)
Received: from localhost (demetrius2.jacobs-university.de [212.201.44.47]) by hermes.jacobs-university.de (Postfix) with ESMTP id 7C52420048 for <hops@ietf.org>; Thu, 6 Aug 2015 12:14:04 +0200 (CEST)
X-Virus-Scanned: amavisd-new at jacobs-university.de
Received: from hermes.jacobs-university.de ([212.201.44.23]) by localhost (demetrius2.jacobs-university.de [212.201.44.32]) (amavisd-new, port 10024) with ESMTP id 3IzEFOCTlhUO for <hops@ietf.org>; Thu, 6 Aug 2015 12:14:03 +0200 (CEST)
Received: from exchange.jacobs-university.de (shubcas02.jacobs.jacobs-university.de [10.70.0.123]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "exchange.jacobs-university.de", Issuer "Jacobs University CA - G01" (verified OK)) by hermes.jacobs-university.de (Postfix) with ESMTPS id 28F1A2004E for <hops@ietf.org>; Thu, 6 Aug 2015 12:14:03 +0200 (CEST)
Received: from SXCHMB01.jacobs.jacobs-university.de ([fe80::c1f:c30f:99ac:df0c]) by SHUBCAS02.jacobs.jacobs-university.de ([::1]) with mapi id 14.03.0248.002; Thu, 6 Aug 2015 12:14:02 +0200
From: "Bajpai, Vaibhav" <v.bajpai@jacobs-university.de>
To: "hops@ietf.org" <hops@ietf.org>
Thread-Topic: lessons learned from using ripe atlas
Thread-Index: AQHQ0DCe9VgjkWLOHEaGCiewW0aaUg==
Date: Thu, 06 Aug 2015 10:14:02 +0000
Message-ID: <23F04F25-026F-4538-A9A5-E37703EA0072@jacobs-university.de>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-originating-ip: [10.50.203.30]
Content-Type: multipart/signed; boundary="Apple-Mail=_CDA61337-F2E9-4C8C-94E4-B4A7CC6E53C9"; protocol="application/pgp-signature"; micalg="pgp-sha512"
MIME-Version: 1.0
Archived-At: <http://mailarchive.ietf.org/arch/msg/hops/K7ZcYhUDXVpPWvttQ7H1T50Dohc>
Cc: "Bajpai, Vaibhav" <v.bajpai@jacobs-university.de>
Subject: [hops] lessons learned from using ripe atlas
X-BeenThere: hops@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Measuring deployability of new transport protocols <hops.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hops>, <mailto:hops-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/hops/>
List-Post: <mailto:hops@ietf.org>
List-Help: <mailto:hops-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hops>, <mailto:hops-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 06 Aug 2015 10:14:10 -0000

Dear hops,

[...]

>     We, as chairs, will start a Wiki (soon) to collect information about
>     measurement platforms as well as measurement tools (and take this as a
>     starting point). Let us as well as the group know if you have further
>     knowledge about this kind of overview papers or similar things by posting a
>     pointer on the list!

Perhaps one more that might interest folks:

As you know RIPE Atlas was initially designed to measure reachability and
connectivity of the Internet. With the deployment of 14K probes, there is
seen trend to use the platform for performance-based measurements
(such as comparing v4/v6 latency on the Internet).

Given, we have been in a position to have close collaboration (through
the LEONE project) with SamKnows (a dedicated performance-measurement
platform), we decided to share our experiences in using the RIPE Atlas
platform from this lens. This work recently got accepted to ACM CCR
July 2015 issue and came online (PDF link below) today. Thought folks
might find it interesting so sharing it along:

----------------8<-----------------8<-----------------8<-----------------8<
Lessons Learned from using the RIPE Atlas Platform for Measurement Research
Vaibhav Bajpai, Steffie Jacob Eravuchira, Jürgen Schönwälder
ACM Computer Communication Review (CCR),
July, 2015

We reflect upon our experience in using the RIPE Atlas platform for
measurement-based research. We show how in addition to credits, control checks
using rate limits are in place to ensure that the platform does not get
overloaded with measurements. We show how the Autonomous System (AS)-based
distribution of RIPE Atlas probes is heavily skewed which limits possibilities
of measurements sourced from a specific origin-AS. We discuss the significance
of probe calibration and how we leverage it to identify load issues in older
hardware versions (38.6% overall as of Sep 2014) of probes. We show how
performance measurement platforms (such as RIPE Atlas, SamKnows, BISmark and
Dasu) can benefit from each other by demonstrating two example use-cases. We
also open discussion on how RIPE Atlas deployment can be made more useful by
relaying more probe metadata information back to the scientific community and
by strategically deploying probes to reduce the inherent sampling bias
embedded in probe-based measurement platforms.

Paper: http://dx.doi.org/10.1145/2805789.2805796
Mirror: http://vaibhavbajpai.com/documents/papers/proceedings/ripeatlas-ccr-2015.pdf
----------------8<-----------------8<-----------------8<-----------------8<

Best, Vaibhav

=====================================================
Vaibhav Bajpai

Room 91, Research I
School of Engineering and Sciences
Jacobs University Bremen, Germany

www.vaibhavbajpai.com
=====================================================