Re: [hops] Proposed Charter for Measurement and Analysis for Protocols (MAP) Research Group

Dave Plonka <plonka@akamai.com> Sat, 28 November 2015 18:01 UTC

Return-Path: <plonka@akamai.com>
X-Original-To: hops@ietfa.amsl.com
Delivered-To: hops@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2C6B31B334D for <hops@ietfa.amsl.com>; Sat, 28 Nov 2015 10:01:56 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.334
X-Spam-Level:
X-Spam-Status: No, score=-1.334 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RP_MATCHES_RCVD=-0.585, SPF_PASS=-0.001, UNRESOLVED_TEMPLATE=1.252] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id WxBQxRcVmuUK for <hops@ietfa.amsl.com>; Sat, 28 Nov 2015 10:01:53 -0800 (PST)
Received: from prod-mail-xrelay07.akamai.com (prod-mail-xrelay07.akamai.com [23.79.238.175]) by ietfa.amsl.com (Postfix) with ESMTP id 6E0A11B334C for <hops@ietf.org>; Sat, 28 Nov 2015 10:01:52 -0800 (PST)
Received: from prod-mail-xrelay07.akamai.com (localhost.localdomain [127.0.0.1]) by postfix.imss70 (Postfix) with ESMTP id 1978B433431; Sat, 28 Nov 2015 18:01:51 +0000 (GMT)
Received: from prod-mail-relay10.akamai.com (prod-mail-relay10.akamai.com [172.27.118.251]) by prod-mail-xrelay07.akamai.com (Postfix) with ESMTP id D4430433414; Sat, 28 Nov 2015 18:01:50 +0000 (GMT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=akamai.com; s=a1; t=1448733710; bh=uzUxOnHtjehq3XHR715BcS6IInwxhgM6f59LYBjNe8w=; l=7966; h=Date:From:To:Cc:References:In-Reply-To:From; b=salfb+DnMG+y2o6alFzZ88yA3Fonbupn1D5603H01ar3UCqmO/kGjUW/ccu/qpeIv L2O5XQYIrXZXYsq/Z/Xn3Lc4pxzroTxRjuqRESax7viOhqlFBCiKpNILsBVhDnlvHO qoblsCDYgNxC2jnIFiO7IaZt8XSsHV7nmFFshEO4=
Received: from bos-lpbwe.kendall.corp.akamai.com (bos-lpbwe.kendall.corp.akamai.com [172.28.9.166]) by prod-mail-relay10.akamai.com (Postfix) with ESMTP id C2AA9204E; Sat, 28 Nov 2015 18:01:50 +0000 (GMT)
Received: from dplonka by bos-lpbwe.kendall.corp.akamai.com with local (Exim 4.82) (envelope-from <plonka@akamai.com>) id 1a2jok-0000Wx-Jk; Sat, 28 Nov 2015 13:01:50 -0500
Date: Sat, 28 Nov 2015 13:01:50 -0500
From: Dave Plonka <plonka@akamai.com>
To: "hops@ietf.org" <hops@ietf.org>
Message-ID: <20151128180150.GA1378@akamai.com>
References: <26DB4818-9DFA-4484-88B6-A48C24EF3CC0@trammell.ch> <82AB329A76E2484D934BBCA77E9F5249A67B47F5@PALLENE.office.hd>
MIME-Version: 1.0
Content-Type: text/plain; charset="iso-8859-1"
Content-Disposition: inline
Content-Transfer-Encoding: 8bit
In-Reply-To: <82AB329A76E2484D934BBCA77E9F5249A67B47F5@PALLENE.office.hd>
X-URL: http://www.cs.wisc.edu/~plonka/
X-VMS-Error: %SYSTEM-E-COMPAT, compatibility mode fault (code 0) at PC=00000428, PS=7FED6580
X-Shakespearean-Insult: Thou currish weather-bitten foot-licker
User-Agent: Mutt/1.5.21 (2010-09-15)
Archived-At: <http://mailarchive.ietf.org/arch/msg/hops/crAhXOx146-OJTMz3H850IxbGks>
Cc: Brian Trammell <ietf@trammell.ch>, Dirk Kutscher <Dirk.Kutscher@neclab.eu>
Subject: Re: [hops] Proposed Charter for Measurement and Analysis for Protocols (MAP) Research Group
X-BeenThere: hops@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Measuring deployability of new transport protocols <hops.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hops>, <mailto:hops-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/hops/>
List-Post: <mailto:hops@ietf.org>
List-Help: <mailto:hops-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hops>, <mailto:hops-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 28 Nov 2015 18:01:56 -0000

Hi Dirk and others,

[Speaking only for myself below, but along the lines of why I am
 willing to co-chair the propsed RG.]

On Fri, Nov 27, 2015 at 06:29:49PM +0000, Dirk Kutscher wrote:
> Hi Brian and all,
> 
> first off, I welcome everyone who wants to do work in the IRTF.
> 
> With the very general scope as it is described now, I wonder a bit
> how this relates to the IRTF's objective of " creating focused,
> long-term Research Groups working on topics related to Internet
> protocols, applications, architecture and technology."

The broadening of the scope beyond HOPS was intentional.
I too am interested in focused work, and we intend to have individual
items be focused, but from a RG perspective, something broad enough
to accept yet-to-be proposed topics was desired; so that the RG
can span multiple efforts potentially without rechartering, i.e.,
administrative work.

> Measurements, in my view, are a tool for networking research and
> development, and in fact most of us are doing measurements in
> different forms for validating assumptions, assessing performance
> etc. Research groups such as ICCRG are often discussing measurement
> results.
> 
> So in that sense, it's a meta topic that is daily business for IRTF
> RGs. I am fully aware of the fact that measurement methodology is
> itself a research topic, but it's not quite clear to me what we
> want to achieve.
> 
> - are we trying to do/promote constructive work towards advancing
>   Internet measurement tools and infrastructure?

No, neither tools nor infrastructure (are inherently in scope),
but rather measurement techniques and discovery of how the Internet
exists and is "playing out" in ways that directly affect IETF goals
re: standards and BCP.

The charter as proposed specifically mentions towards advancing
(only) protocol design and operation.

> - are we planning to discuss middlebox issues?

Yes. We expect to transition this and continue this effort from the
non-RG-forming HOPS meetings, to the degree that there are people
to do the work.

In my mind, the effect iddlebox's have on protocol performance is
the "poster child" topic for our proposed MAP RG; if successful,
it will demonstrate how discovering substrate characteristics can
inform protocol development and operation/practice.

> - do we want offer discussion platform for general measurement topics?

No. There are other forums for that, e.g., the IPPM Working Group and
the Internet Measurement Conference.

Building measurement infrastructures, e.g., databases, is also
something we currently consider out of scope.

> I am bit skeptical with respect to creating an RG for general
> measurement discussions. There are existing conferences and workshops
> that are doing that already. Also, it's unclear how that would
> contribute to the IRTF objectives.

It might help if I offer some example topics (that Brian or I considered
as strawmen) that I find would be in scope:

- A survey of the IPv6 WWW, to inform practice with respect to privacy,
  e.g. service address assignment, virtual hosting, and SNI.
  Basically, "Are we building an IPv6 web that we want?"

- Large scale examination of IPv4 address utilization or "churn",
  and how it's changing in cooperation with IPv6.

- For operational purposes such as DoS mitigation, how should
  "IP reputation" likely need to change for IPv6.
  What needs to be measured (differently)?

These are use (semi-imaginary) examples, but I know of researchers
working on each of these that might benefit from bringing them to
an IRTF forum such as the proposed MAP RG.

> Please enlighten me. :-)

You be the judge. If you find that the charter doesn't jibe with
my comments above, please offer your suggested change(s).

Thanks Dirk!

Dave

<snip>
> > -----Original Message-----
> > From: hops [mailto:hops-bounces@ietf.org] On Behalf Of Brian Trammell
> > Sent: Donnerstag, 26. November 2015 12:35
> > To: hops@ietf.org
> > Subject: [hops] Proposed Charter for Measurement and Analysis for Protocols
> > (MAP) Research Group
> > 
> > Greetings, all,
> > 
> > Following discussions at the HOPS proposed RG meetings in Prague and
> > Yokohama, as well as at the RAIM workshop before Yokohama, we've revised
> > the charter to reflect what we think the community wants out of such an RG.
> > Note that given the slightly expanded scope of this charter, though, we've
> > decided to rename the proposed RG to Measurement and Analysis for Protocols
> > (MAP).
> > 
> > 
> > Comments on the proposed charter below are welcome at hops@ietf.org:
> > 
> > 
> > Measurement and Analysis for Protocols (MAP) RG
> > ===============================================
> > 
> > Our Internet has grown into something that differs from what was envisioned.
> > Its protocols sometimes operate in an environment other than than that for
> > which they were designed. For instance, some network elements treat some
> > protocols differently than others and those protocols themselves are sometimes
> > reused and abused in ways initially unforseen. The Measurement and Analysis
> > for Protocols (MAP) Research Group (RG) explores such phenomena by
> > measurement with the aim to inform protocol engineering and practice.
> > 
> > Many protocol engineering efforts in a standards development context, as well
> > as best practices for the operation of IETF-defined protocols, can benefit from
> > insight provided by Internet measurements of various kinds. Likewise, Internet
> > measurement research efforts can stand to gain from contacts with the IETF.
> > The Measurement and Analysis for Protocol Engineering (MAP) Research Group
> > aims to provide a forum for interchange between these two communities,
> > supporting:
> > 
> > - exchange of measurement-derived insight,
> > - discussion of techniques for measurement relevant for protocol engineering
> >   and network operations,
> > - collaborations to share data supporting these measurements, and
> > - a "landing pad" in general for the Internet measurement community to
> >   introduce its efforts to the IETF
> > 
> > Measurements of any layer of the Internet protocol stack or aspect of Internet
> > operations are in-scope for the RG, provided they are relevant to protocol
> > engineering work within the IETF, or the operation of IETF protocols.
> > 
> > Membership
> > ----------
> > 
> > Membership in the MAP RG is open to all interested parties.
> > 
> > Meetings
> > --------
> > 
> > The MAP RG will meet one to three times per year, as deemed necessary by the
> > chairs and according to demand. At least one MAP RG meeting will be co-
> > located with an IETF meeting per year. Given the MAP RG's charter to bridge the
> > gap between Internet standards and measurement communities, the MAP RG
> > may also meet colocated with relevant academic conferences or network
> > operator forums, as appopriate.
> > 
> > Meetings are by default open with open attendance and published proceedings,
> > with remote participation and recording as provided by the meeting venue,
> > according to the IRTF's IPR policy. This is always the case with at least one MAP
> > RG meeting co-located with an IETF meeting noted above. However, as deemed
> > necessary, the chairs may hold virtual or physical meetings with restricted
> > attendance to discuss observations which cannot be shared openly, provided
> > that some outcome of such a meeting may be openly shared with the
> > community.
> > 
> > Chairs
> > ------
> > 
> > Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch> Dave Plonka
> > <plonka@akamai.com>
> > 
> > 
> > Many thanks,
> > 
> > Brian
> _______________________________________________
> hops mailing list
> hops@ietf.org
> https://www.ietf.org/mailman/listinfo/hops

-- 
plonka@akamai.com  http://www.cs.wisc.edu/~plonka/  Cambridge, MA