Re: [Pearg] [Maprg] Guidelines for Performing Safe Measurement on the Internet

Kevin Borgolte <kevin@iseclab.org> Thu, 13 December 2018 22:51 UTC

Return-Path: <kevin@iseclab.org>
X-Original-To: pearg@ietfa.amsl.com
Delivered-To: pearg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 099B3130EB1 for <pearg@ietfa.amsl.com>; Thu, 13 Dec 2018 14:51:06 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: YES
X-Spam-Score: 18.099
X-Spam-Level: ******************
X-Spam-Status: Yes, score=18.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_SBL=20, URIBL_SBL_A=0.1] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=iseclab.org
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id wCXQcDDhJHE2 for <pearg@ietfa.amsl.com>; Thu, 13 Dec 2018 14:51:03 -0800 (PST)
Received: from mail-qt1-x82c.google.com (mail-qt1-x82c.google.com [IPv6:2607:f8b0:4864:20::82c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id AE109130EAB for <pearg@irtf.org>; Thu, 13 Dec 2018 14:51:03 -0800 (PST)
Received: by mail-qt1-x82c.google.com with SMTP id t33so1451599qtt.4 for <pearg@irtf.org>; Thu, 13 Dec 2018 14:51:03 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iseclab.org; s=mail; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=5F24E1a4hKzTbtIdX4+xES6SRu911O4ZUP1VAn1egr8=; b=bU2dbUyT6sCifpqEY5fdG1TAwCBQTJ0E7iOwSnKpWNXMKRXoGaiont5Sw48GJBhSt1 QH45s0XQG6Qkk+OUa2elyN1X2O0CXgXFnAOjc6ANIkOMiHnszcb1C34NQtbUbtgefwB3 74VLE61TjheIZOENBpSy8HNNRBoEPhicp/p76YGKWHvb1j7vzFCkQv55Z+4vm51fXLIm i6I/EuF2n6QkadGQG6oAQRupQKPu16r5Xk/8Cpy3KCLK3lA2agtVJ9JbmBMkhCrltIG+ T3xvQyCMbPFFDu1FwHKDj2Yl540OR0mEuF/dblVzKCtB7hC8+VFTO7ixezau74a1WzPV /G1w==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=5F24E1a4hKzTbtIdX4+xES6SRu911O4ZUP1VAn1egr8=; b=RHi9jIQuMU6Apudn+f4psnLkSKZtQSAOuhePIginfpaB3GbyTGuxFg9OnHCK23nnpt MZaYZVpVgo4SnY1W+k4vjFWRP0ff0VcqbKlOZk9R7JLRKVmEH0gbmXrvRKNNtIULMGQA d7+s0j7G/DRiGE6G6/Uj9gAyWM6oE3ov5jdqw4OkbKmWwm0JngR+NcaC47cVorzjtKcO FDs0JntniSb0msiNobbFyeCa1DyLAFAGBcyeXsClT9MFmimtZmlGGaHMbKF9XchVJXNn HZYNkGTh45TfQ5VH/QsPzkGk/B+AlF/2L096CnGwT2sn1uLvMW8JKSz31dQRRRIGzkah dwYA==
X-Gm-Message-State: AA+aEWZERb/XwE8vv/eIj2EXU/p7Qd3b3GQEr2ii+ZIPnl8++qg4PPiA pP0SEN/3QyRsJ90l8ySCx4pguA==
X-Google-Smtp-Source: AFSGD/UWCKWcVx+6cNVx+SmKXMMRuw1zp/1rR9s2avMIp626YUOlj7Ft0VqYK7KUtG/xk7Uaq4NsSw==
X-Received: by 2002:a0c:8b64:: with SMTP id d36mr605085qvc.233.1544741462529; Thu, 13 Dec 2018 14:51:02 -0800 (PST)
Received: from nat-oitwireless-inside-vapornet100-c-18555.princeton.edu (nat-oitwireless-outside-vapornet3-h-147.princeton.edu. [140.180.247.159]) by smtp.gmail.com with ESMTPSA id u16sm2854574qkg.14.2018.12.13.14.51.01 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 13 Dec 2018 14:51:02 -0800 (PST)
Content-Type: text/plain; charset="us-ascii"
Mime-Version: 1.0 (Mac OS X Mail 12.1 \(3445.101.1\))
From: Kevin Borgolte <kevin@iseclab.org>
In-Reply-To: <1a6bbe96-b5ba-232c-5eb0-faa494a89a21@torproject.org>
Date: Thu, 13 Dec 2018 17:51:01 -0500
Cc: pearg@irtf.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <1D9088B0-4E19-4C35-BED1-DE9E27C3FA42@iseclab.org>
References: <fb1405de-8944-654a-0292-783aa14769eb@torproject.org> <E3C71B6B-1942-4168-8BE7-765AF98C6665@eggert.org> <1a6bbe96-b5ba-232c-5eb0-faa494a89a21@torproject.org>
To: Iain Learmonth <irl@torproject.org>
X-Mailer: Apple Mail (2.3445.101.1)
Archived-At: <https://mailarchive.ietf.org/arch/msg/pearg/WYfxCbX00zYTDkWiojP-NgGeggo>
Subject: Re: [Pearg] [Maprg] Guidelines for Performing Safe Measurement on the Internet
X-BeenThere: pearg@irtf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Privacy Enhancements and Assessment Proposed RG <pearg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/pearg>, <mailto:pearg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/pearg/>
List-Post: <mailto:pearg@irtf.org>
List-Help: <mailto:pearg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/pearg>, <mailto:pearg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Thu, 13 Dec 2018 22:51:06 -0000

Hi Iain,

I agree with Lars that there is a ton of prior work that needs to be included. To me, the current draft reads a bit obvious for folks involved in the area already, but does not provide enough detail for novice researchers. Particular for novices, an Informational RFC detailing best practices for active and passive measurements would certainly be useful, so that digging through tens of existing documents (of which some may not be available anymore) isn't strictly necessary (effectively a systemization of knowledge).

A resource that should be included is the Menlo report [1] and its companion [2].

I'm not a fan of the current active/passive split with the note that "some parts may apply to both." For this kind of RFC, I expect people to only read what they think is applicable, e.g., concerning passive measurements, thus possibly missing out on crucial information that is in the active measurements section. I recommend to restructure it with a "general considerations" section upfront.

The current draft is still a bit too bare-bones for me to provide more in-depth feedback. It should be broader and provide more detail and references in multiple sections that are currently just one sentence long each. I'm sure some of the references Lars mentioned will help to expand the sections. Please keep us posted for major updates!

Best,
Kevin

[1] https://en.wikipedia.org/wiki/Menlo_Report
[2] https://www.impactcybertrust.org/link_docs/Menlo-Report-Companion.pdf


> On Dec 11, 2018, at 09:13, Iain Learmonth <irl@torproject.org> wrote:
> 
> Hi Lars,
> 
> On 11/12/2018 14:03, Lars Eggert wrote:
>> there is a ton of prior work in this space. See http://conferences.sigcomm.org/sigcomm/2015/netethics.php for starters. I am sure there are other PAM or IMC keynotes or presentations on this. It would be useful to build on this prior work.
> 
> Thanks for the pointer! I've added an issue [0] to my GitHub repo and
> will be sure to look through these.
> 
> Another resource I'm planning to draw on would be CAIDA's  Promotion of
> Data Sharing [1] webpage, and the references there, which contains a lot
> of discussion regarding passive measurement.
> 
> Thanks,
> Iain.
> 
> [0]: https://github.com/irl/draft-safe-internet-measurement/issues/1
> [1]: https://www.caida.org/data/sharing/
> 
> -- 
> Pearg mailing list
> Pearg@irtf.org
> https://www.irtf.org/mailman/listinfo/pearg