[Maprg] challenges with reproducibility
"Bajpai, Vaibhav" <vaibhav.bajpai@tum.de> Sun, 28 May 2017 13:13 UTC
Return-Path: <vaibhav.bajpai@tum.de>
X-Original-To: maprg@ietfa.amsl.com
Delivered-To: maprg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 55D31126CE8 for <maprg@ietfa.amsl.com>; Sun, 28 May 2017 06:13:52 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.599
X-Spam-Level:
X-Spam-Status: No, score=-1.599 tagged_above=-999 required=5 tests=[BAYES_50=0.8, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_MED=-2.3, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=tum.de
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id SVn9YP7MkPQ3 for <maprg@ietfa.amsl.com>; Sun, 28 May 2017 06:13:50 -0700 (PDT)
Received: from postout2.mail.lrz.de (postout2.mail.lrz.de [IPv6:2001:4ca0:0:103::81bb:ff8a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id F051F126B71 for <maprg@irtf.org>; Sun, 28 May 2017 06:13:49 -0700 (PDT)
Received: from lxmhs52.srv.lrz.de (localhost [127.0.0.1]) by postout2.mail.lrz.de (Postfix) with ESMTP id 3wbL0r0sRSzySt for <maprg@irtf.org>; Sun, 28 May 2017 15:13:48 +0200 (CEST)
Authentication-Results: postout.lrz.de (amavisd-new); dkim=pass (2048-bit key) reason="pass (just generated, assumed good)" header.d=tum.de
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=tum.de; h= mime-version:content-transfer-encoding:content-id:content-type :content-type:content-language:accept-language:message-id:date :date:subject:subject:from:from:received:received:received :received; s=postout; t=1495977227; bh=vImorewv2zd3AaBnXZ2JF0PUF puaLMVhVhAVo8xbVLE=; b=UJFW4UDsk6RBKjBlYH9Xk00bKwTmoIZdWertlO2P7 t0djLH/z4icolqOy7ZKjt7CFcL68YKoZEHJHn7NkJ43N7Y9wFyO+CacVVsNeZ/CE WOFKX3qGf/pyFpVyy2OwfQdQR4lXHEyowganoPZqbPpGFDVpbaHuE6E6J5KSuk+k m2k/6twoXDCfniahRrBA8IbpvcKBrrhohBQgAIHy7t16082YfGgmWjP83SAPacS1 T21PMH21vWgACVX/iL61ob1BGNDwrLslzsY2IlBXt44jifRqAYKPWt77Bbt9HlVl FTwNsgYUtVHJn9PrwSE/YphBvlUGYhnjJRJXQkoGd8MRw==
X-Virus-Scanned: by amavisd-new at lrz.de in lxmhs52.srv.lrz.de
Received: from postout2.mail.lrz.de ([127.0.0.1]) by lxmhs52.srv.lrz.de (lxmhs52.srv.lrz.de [127.0.0.1]) (amavisd-new, port 20024) with LMTP id v5a_dJEFYccA for <maprg@irtf.org>; Sun, 28 May 2017 15:13:47 +0200 (CEST)
Received: from BADWLRZ-SWMBX06.ads.mwn.de (unknown [IPv6:2001:4ca0:0:108::162]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "BADWLRZ-SWMBX06", Issuer "BADWLRZ-SWMBX06" (not verified)) by postout2.mail.lrz.de (Postfix) with ESMTPS id 3wbL0q5lHVzySn for <maprg@irtf.org>; Sun, 28 May 2017 15:13:47 +0200 (CEST)
Received: from BADWLRZ-SWMBX01.ads.mwn.de (2001:4ca0:0:108::157) by BADWLRZ-SWMBX06.ads.mwn.de (2001:4ca0:0:108::162) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.1.845.34; Sun, 28 May 2017 15:13:45 +0200
Received: from BADWLRZ-SWMBX01.ads.mwn.de ([fe80::7d02:f283:edbd:b19c]) by BADWLRZ-SWMBX01.ads.mwn.de ([fe80::7d02:f283:edbd:b19c%12]) with mapi id 15.01.0845.034; Sun, 28 May 2017 15:13:45 +0200
From: "Bajpai, Vaibhav" <vaibhav.bajpai@tum.de>
To: "maprg@irtf.org" <maprg@irtf.org>
CC: "Bajpai, Vaibhav" <vaibhav.bajpai@tum.de>
Thread-Topic: challenges with reproducibility
Thread-Index: AQHS17Q8jPp/R3kmqEKKOdlW4ROn5w==
Date: Sun, 28 May 2017 13:13:45 +0000
Message-ID: <331f58ea-0bb1-4c17-b6ab-dd6990aa4183@BADWLRZ-SWMBX06.ads.mwn.de>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-exchange-messagesentrepresentingtype: 1
x-originating-ip: [131.159.24.54]
Content-Type: text/plain; charset="utf-8"
Content-ID: <57B18AC67298424BA0CC8D2EBFB13F9D@ads.mwn.de>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
Archived-At: <https://mailarchive.ietf.org/arch/msg/maprg/xWqfENiEp6ZKti0Zxiw4IbVSXGA>
Subject: [Maprg] challenges with reproducibility
X-BeenThere: maprg@irtf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: "Measurement and Analysis for Protocols \(MAP\) \(Proposed\) RG mailing list" <maprg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/maprg>, <mailto:maprg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/maprg/>
List-Post: <mailto:maprg@irtf.org>
List-Help: <mailto:maprg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/maprg>, <mailto:maprg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Sun, 28 May 2017 13:13:52 -0000
Dear MAPRG WG, A few of us wrote a paper discussing challenges with ‘reproducibility’ of research and certain steps we can take to initiate a cultural change. This paper will appear at the SIGCOMM reproducibility workshop [b]; the paper is now available online [a]. Thought to share it along: [a] http://vaibhavbajpai.com/documents/papers/proceedings/reproducibility-sigcomm-workshop-2017.pdf [b] http://conferences.sigcomm.org/sigcomm/2017/workshop-reproducibility.html -- Vaibhav -------------------------- Vaibhav Bajpai www.vaibhavbajpai.com Postdoctoral Researcher TU Munich, Germany --------------------------
- [Maprg] challenges with reproducibility Bajpai, Vaibhav