Re: [Roll] Fwd: New Version Notification for draft-tripathi-roll-rpl-simulation-04

Philip Levis <pal@cs.stanford.edu> Mon, 14 June 2010 21:03 UTC

Return-Path: <pal@cs.stanford.edu>
X-Original-To: roll@core3.amsl.com
Delivered-To: roll@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 637FE3A69A6 for <roll@core3.amsl.com>; Mon, 14 Jun 2010 14:03:58 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.422
X-Spam-Level:
X-Spam-Status: No, score=-4.422 tagged_above=-999 required=5 tests=[AWL=-0.423, BAYES_50=0.001, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id cLRL5QMW1PIK for <roll@core3.amsl.com>; Mon, 14 Jun 2010 14:03:57 -0700 (PDT)
Received: from cs-smtp-1.Stanford.EDU (cs-smtp-1.Stanford.EDU [171.64.64.25]) by core3.amsl.com (Postfix) with ESMTP id 8DF7A3A6993 for <roll@ietf.org>; Mon, 14 Jun 2010 14:03:57 -0700 (PDT)
Received: from dnab4046bc.stanford.edu ([171.64.70.188]) by cs-smtp-1.Stanford.EDU with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.60) (envelope-from <pal@cs.stanford.edu>) id 1OOGp7-0006W7-Jv; Mon, 14 Jun 2010 14:04:01 -0700
Mime-Version: 1.0 (Apple Message framework v1078)
Content-Type: text/plain; charset="us-ascii"
From: Philip Levis <pal@cs.stanford.edu>
In-Reply-To: <AANLkTimjwhA-h0TzYQ7JxZEdrWXzKcHHIt3Er6VX3Yp8@mail.gmail.com>
Date: Mon, 14 Jun 2010 14:04:01 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <4CB67BA4-8F95-4F2E-8A3D-A9E76EE520F9@cs.stanford.edu>
References: <33e91433fe1f.33fe1f33e914@drexel.edu> <AANLkTimjwhA-h0TzYQ7JxZEdrWXzKcHHIt3Er6VX3Yp8@mail.gmail.com>
To: Joydeep Tripathi <joydeep.tripathi@gmail.com>
X-Mailer: Apple Mail (2.1078)
X-Scan-Signature: bd70d0bdda1312c8b25f7b39d1e2fb7f
Cc: ROLL WG <roll@ietf.org>
Subject: Re: [Roll] Fwd: New Version Notification for draft-tripathi-roll-rpl-simulation-04
X-BeenThere: roll@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: Routing Over Low power and Lossy networks <roll.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/roll>, <mailto:roll-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/roll>
List-Post: <mailto:roll@ietf.org>
List-Help: <mailto:roll-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/roll>, <mailto:roll-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 14 Jun 2010 21:03:58 -0000

On Jun 14, 2010, at 1:53 PM, Joydeep Tripathi wrote:

> Hi,
> 
> We have published the fourth revision of the simulation document. This
> time, we have simulated a large scale network (2442 nodes), whose data
> have been gathered from a chunk of a huge smart meter network. To show
> the scalability of RPL, it includes the relevant metrics such as path
> stretch, delay and control overhead. Please let us know your feedback.

Joydeep,

1) My concerns with the methodology remain; assuming independent packet losses over 10-minute intervals can have significant effects on how a protocol reacts (e.g., NUD). It makes me unable to make strong conclusions from any of the rest of the results.

2) "To simulate a more realistic scenario, 20% of the generated packets by each node are destined to the root, and the remaining 80% of the packets are uniformly assigned as destined to nodes other than the root." Can you provide some insight into why this is more "realistic?" Networks rarely follow uniform distributions, and using one can make you reach the wrong conclusion (e.g., algorithm X scales when it doesn't in real patterns).

Note that these are basic concerns with the methodology to obtain the results.

Phil