Re: [Roll] draft-roux-roll-mpl-eval-00.txt

ROUX Pierre <pierre.roux@cea.fr> Mon, 13 January 2014 11:00 UTC

Return-Path: <pierre.roux@cea.fr>
X-Original-To: roll@ietfa.amsl.com
Delivered-To: roll@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5CE0B1AE109 for <roll@ietfa.amsl.com>; Mon, 13 Jan 2014 03:00:58 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.089
X-Spam-Level:
X-Spam-Status: No, score=-7.089 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HELO_EQ_FR=0.35, RCVD_IN_DNSWL_HI=-5, RP_MATCHES_RCVD=-0.538, SPF_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id OzJQzJarRw0e for <roll@ietfa.amsl.com>; Mon, 13 Jan 2014 03:00:55 -0800 (PST)
Received: from oxalide-out.extra.cea.fr (oxalide-out.extra.cea.fr [132.168.224.8]) by ietfa.amsl.com (Postfix) with ESMTP id 4AF2F1AE05C for <roll@ietf.org>; Mon, 13 Jan 2014 03:00:54 -0800 (PST)
Received: from pisaure.intra.cea.fr (pisaure.intra.cea.fr [132.166.88.21]) by oxalide.extra.cea.fr (8.14.2/8.14.2/CEAnet-Internet-out-2.3) with ESMTP id s0DB0gOt026696; Mon, 13 Jan 2014 12:00:42 +0100
Received: from pisaure.intra.cea.fr (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id EA88B2073CF; Mon, 13 Jan 2014 12:01:48 +0100 (CET)
Received: from muguet1.intra.cea.fr (muguet1.intra.cea.fr [132.166.192.6]) by pisaure.intra.cea.fr (Postfix) with ESMTP id DAAC420763D; Mon, 13 Jan 2014 12:01:48 +0100 (CET)
Received: from EXCAH-A0.intra.cea.fr (excah-a0.intra.cea.fr [132.166.88.74]) by muguet1.intra.cea.fr (8.13.8/8.13.8/CEAnet-Intranet-out-1.2) with ESMTP id s0DB0fQ7010016; Mon, 13 Jan 2014 12:00:41 +0100
Received: from EXDAG0-B1.intra.cea.fr ([fe80::c18e:d8e8:9a27:5b84]) by EXCAH-A0.intra.cea.fr ([fe80::446e:fe1a:2892:9de1%10]) with mapi id 14.02.0387.000; Mon, 13 Jan 2014 12:00:41 +0100
From: ROUX Pierre <pierre.roux@cea.fr>
To: Michael Richardson <mcr+ietf@sandelman.ca>
Thread-Topic: [Roll] draft-roux-roll-mpl-eval-00.txt
Thread-Index: AQHPAN8vHleayCjs60m9whfy9w8NC5qChAyg
Date: Mon, 13 Jan 2014 11:00:41 +0000
Message-ID: <734BA99AFA6E0040A82152C6794C6D7D2ECA21DA@EXDAG0-B1.intra.cea.fr>
References: <23888.1387913651@sandelman.ca>
In-Reply-To: <23888.1387913651@sandelman.ca>
Accept-Language: fr-FR, en-US
Content-Language: fr-FR
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [132.166.88.105]
x-tm-as-product-ver: SMEX-10.2.0.1135-7.000.1014-20428.003
x-tm-as-result: No--61.599500-0.000000-31
x-tm-as-user-approved-sender: Yes
x-tm-as-user-blocked-sender: No
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Cc: "roll@ietf.org" <roll@ietf.org>
Subject: Re: [Roll] draft-roux-roll-mpl-eval-00.txt
X-BeenThere: roll@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: Routing Over Low power and Lossy networks <roll@ietf.org>
List-Id: Routing Over Low power and Lossy networks <roll.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/roll>, <mailto:roll-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/roll/>
List-Post: <mailto:roll@ietf.org>
List-Help: <mailto:roll-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/roll>, <mailto:roll-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 13 Jan 2014 11:00:58 -0000

Dear Michael,

Sorry for being slow in answering. We did not catch your message when you sent it.
And thanks for this feedback.

>It would be interesting to have feedback from deployments about how accurate the random placement matches real life: 
>I think that real life won't be random at all!

Yes. 
Random placements inside open field area with no obstacle is not real life.
However it provides some "neutral" ground to compare different algorithms.

> Do you think that the additional work will occur prior to IETF90, and might be feedback into possible re-chartering of ROLL?

This ID was just collecting preliminary results indeed. 
Some additional results will be presented in a second version of this draft for IETF90. A presentation could also be proposed depending on the time schedule and need.
Unfortunately it will remain far from an exhaustive evaluation at this date.

>Is the software used in this simulation available for others to play with?

Currently it is just an internal java tool.
However we don't expect issues in making the jar executable available.
It may be a good way to obtain feedback, as the simulator provides graphical insight into algorithm behavior.
We have to clarify that internally, as it should be provided with some kind of license.

>I'm concerned that this is a particularly academic paper, and might not get the kind of peer review that I think it deserves as an ID (vs a submission to a journal).

Yes we understand your concern. This work may eventually be proposed to a journal as well. Still, feedback is very welcome in this group.

Regards,

  Pierre

-----Message d'origine-----
De : Roll [mailto:roll-bounces@ietf.org] De la part de Michael Richardson
Envoyé : mardi 24 décembre 2013 20:34
À : draft-roux-roll-mpl-eval@tools.ietf.org
Cc : 
Objet : [Roll] draft-roux-roll-mpl-eval-00.txt


http://datatracker.ietf.org/doc/draft-roux-roll-mpl-eval/
was recently posted, with the abstract:

Abstract

   This draft presents simulation work and first results related to MPL
   performance evaluation.  The simulation makes it possible to evaluate
   MPL performances in the context of a large network.  The simulated
   network introduces 500 nodes.  The general principles of the
   simulator are described.  Then reference settings are introduced, and
   evaluation indicators are proposed.  Finally preliminary results are
   presented under the form of a few tables, that show the proposed
   indicator values depending on some specific parameter which is used
   as a variable argument.  Among various results, the advantage of
   using reactive mode for MPL is shown in terms of the capability to
   maintain loss free diffusion in harsh radio conditions.

====

I've read the document, and I like the direction which it is going.
It would be interesting to have feedback from deployments about how accurate the random placement matches real life: I think that real life won't be random at all!

The ROLL charter hardly mentions MPL at all; so having an experience draft on it, is neither here nor there.

** May I ask what the authors intend for this document?

Do you think that the additional work will occur prior to IETF90, and might be feedback into possible re-chartering of ROLL?

I think that it is very useful for the technology to have a rigorous analysis of MPL like this, and very useful for standardization to have some clear advice on setting the parameters.

Is the software used in this simulation available for others to play with?

I'm concerned that this is a particularly academic paper, and might get the kind of peer review that I think it deserves as an ID (vs a submission to a journal).

--
Michael Richardson <mcr+IETF@sandelman.ca>, Sandelman Software Works
IETF ROLL WG co-chair.    http://datatracker.ietf.org/wg/roll/charter/