Re: [6lo-fragmentation-dt] Performance report for fragment forwarding

"Pascal Thubert (pthubert)" <pthubert@cisco.com> Wed, 19 September 2018 05:38 UTC

Return-Path: <pthubert@cisco.com>
X-Original-To: 6lo-fragmentation-dt@ietfa.amsl.com
Delivered-To: 6lo-fragmentation-dt@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 43310130F65 for <6lo-fragmentation-dt@ietfa.amsl.com>; Tue, 18 Sep 2018 22:38:44 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.509
X-Spam-Level:
X-Spam-Status: No, score=-14.509 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, T_DKIMWL_WL_HIGH=-0.01, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0PxgTFgxD4PG for <6lo-fragmentation-dt@ietfa.amsl.com>; Tue, 18 Sep 2018 22:38:41 -0700 (PDT)
Received: from rcdn-iport-2.cisco.com (rcdn-iport-2.cisco.com [173.37.86.73]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7CE72130DEF for <6lo-fragmentation-dt@ietf.org>; Tue, 18 Sep 2018 22:38:41 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=13394; q=dns/txt; s=iport; t=1537335521; x=1538545121; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=uJIpyCln0UaE9d6RSwHLaCmTN88Ql/hI0qxJefPC1RU=; b=KyjkXALBj+5OVjJveuUVh9hvPT9vdkSuyTLRF4wKLiWUsS56poMtkyGi pdG3DzHNbUZTmVsshEVhEAC11fRHwSob617E0UQR+/d6QE32N5w8gcHfs Bb+MB64Z5OJDExBa2QfX1VZEYYJMgoT+ahtpPujbL49BE5p/WwHBLUlNf k=;
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0ATAACm4KFb/4YNJK1cGQEBAQEBAQEBAQEBAQcBAQEBAYFQgghlfyiDc4gVjDKCDYheiDOFO4F6CxgBDIRHAheDEiE0GAEDAQECAQECbRwMhTgBAQEBAgEBASFLCwULAgEGAhgnAwICAh8GCxQRAgQOBYMhAYEdTAMNCA+IMZtMgS6ELASDBQ2CSgWKbReBQT+BOR+CTIEmgTBFAQGBQQEBgx8xgiYCjVeOUywJAoZAhkmDFxeBQ4ROiQeLbm2HbAIRFIElHTiBVXAVOyoBgkGGAYUUhT5viw8NFweCHwEB
X-IronPort-AV: E=Sophos;i="5.53,392,1531785600"; d="scan'208,217";a="457397920"
Received: from alln-core-12.cisco.com ([173.36.13.134]) by rcdn-iport-2.cisco.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 19 Sep 2018 05:38:20 +0000
Received: from XCH-RCD-004.cisco.com (xch-rcd-004.cisco.com [173.37.102.14]) by alln-core-12.cisco.com (8.15.2/8.15.2) with ESMTPS id w8J5cKTX008220 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Wed, 19 Sep 2018 05:38:20 GMT
Received: from xch-rcd-001.cisco.com (173.37.102.11) by XCH-RCD-004.cisco.com (173.37.102.14) with Microsoft SMTP Server (TLS) id 15.0.1395.4; Wed, 19 Sep 2018 00:38:20 -0500
Received: from xch-rcd-001.cisco.com ([173.37.102.11]) by XCH-RCD-001.cisco.com ([173.37.102.11]) with mapi id 15.00.1395.000; Wed, 19 Sep 2018 00:38:20 -0500
From: "Pascal Thubert (pthubert)" <pthubert@cisco.com>
To: Rahul Jadhav <rahul.ietf@gmail.com>
CC: Carsten Bormann <cabo@tzi.org>, "rabinarayans@huawei.com" <rabinarayans@huawei.com>, "6lo-fragmentation-dt@ietf.org" <6lo-fragmentation-dt@ietf.org>, "yasuyuki.tanaka@inria.fr" <yasuyuki.tanaka@inria.fr>
Thread-Topic: [6lo-fragmentation-dt] Performance report for fragment forwarding
Thread-Index: AQHUT2lvdrEYlBd9b0+UYF3V1708sqT2yRmAgACNbQCAABRoAA==
Date: Wed, 19 Sep 2018 05:38:19 +0000
Message-ID: <B340B396-A1C0-49D6-BCBF-A8C04D98F8C9@cisco.com>
References: <CAO0Djp2EKyiZK5-b+_R4c557mXSktPCEtYxOQjQb4vreTVOX9g@mail.gmail.com> <C3A37ED0-C93B-4D1B-9E6D-857B14253874@tzi.org> <CAO0Djp37FHUaoLPEhfLMX2dmEb+=DY0XdYLUDvq1AOuT9to8ZQ@mail.gmail.com>
In-Reply-To: <CAO0Djp37FHUaoLPEhfLMX2dmEb+=DY0XdYLUDvq1AOuT9to8ZQ@mail.gmail.com>
Accept-Language: fr-FR, en-US
Content-Language: fr-FR
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-exchange-transport-fromentityheader: Hosted
Content-Type: multipart/alternative; boundary="_000_B340B396A1C049D6BCBFA8C04D98F8C9ciscocom_"
MIME-Version: 1.0
X-Outbound-SMTP-Client: 173.37.102.14, xch-rcd-004.cisco.com
X-Outbound-Node: alln-core-12.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/6lo-fragmentation-dt/ki7_csB0rVJrASIBu6eXWOOI0Zk>
Subject: Re: [6lo-fragmentation-dt] Performance report for fragment forwarding
X-BeenThere: 6lo-fragmentation-dt@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: 6lo Fragmentation Design Team <6lo-fragmentation-dt.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/6lo-fragmentation-dt>, <mailto:6lo-fragmentation-dt-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/6lo-fragmentation-dt/>
List-Post: <mailto:6lo-fragmentation-dt@ietf.org>
List-Help: <mailto:6lo-fragmentation-dt-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/6lo-fragmentation-dt>, <mailto:6lo-fragmentation-dt-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 19 Sep 2018 05:38:44 -0000

Hello Rahul

Pacing is another word for introducing delay between fragments and yes thus locks the buffers for a longer time. Having to do retries because a fragment interferes with the next also introduces delay, and possibly longer if you keep at it.

The key message in my talk was that this problem simply goes away with 6TiSCH. I think that should be the key message of your writing...

Take care,

Pascal

Le 19 sept. 2018 à 06:25, Rahul Jadhav <rahul.ietf@gmail.com<mailto:rahul.ietf@gmail.com>> a écrit :

Thanks Pascal, Carsten for the comments.

Pascal, Introducing delay is easy but it has further complications with regards to buffering requirement. Holding the fragment with a delay while receiving more fragments from the downstream would mean keeping additional buffers.
Carsten also mentioned a pacing mechanism .. while it might improve fwding efficiency it will add to buffer requirement. Also such a scheme might be non-trivial to be implemented.

Also Carsten, the PDR we reported takes into consideration all factors,, buffering as well (we use contiki and have single 1280B buffer on each node). While the transmission scheme we chose results in much less impact on buffering, it is much closer to our traffic pattern expectation.

Regarding keeping higher mac-retry, ... We have chosen mac-retry of 3 after some experimentation (considering expected node densities and tx frequency). increasing mac-retry might not necessarily help, in fact it may backfire in terms of both PDR as well as mean latency. Would you still suggest to give it a try and what mac-retry do you think makes sense ?

Based on your comment, we will document the fragments dropped on nodes in both scenarios, just to be clear.

Thanks,
Rahul

On Wed, 19 Sep 2018 at 01:29, Carsten Bormann <cabo@tzi.org<mailto:cabo@tzi.org>> wrote:
Hi Rahul,

the memory issues in forwarders discussed during IETF101 are real, and they would need to enter the calculations about PDR differences.

Is a max-retry of 3 something that people are actually choosing? Sounds low to me.

More importantly, it seems we neglected to discuss pacing in both draft-watteyne-6lo-minimal-fragment-02.txt and draft-ietf-lwig-6lowpan-virtual-reassembly-00.txt.  Pacing is essential for fragment forwarding (as it is for any application that sends more than one datagram in a row).  If the original sender does not pace, there will always be a collision between the forwarding of fragment N and the origination of fragment N+1.

Unfortunately, pacing is another knob that needs to be tuned, and I’m not aware of good research that tells us what  the right setting for that knob is.  Ideally, we’d want it to be self-tuning.

Grüße, Carsten


> On 18. Sep 2018, at 18:05, Rahul Jadhav <rahul.ietf@gmail.com<mailto:rahul.ietf@gmail.com>> wrote:
>
> << turns out my earlier mail didn't reach the ML; trying again >>
>
> Hello all,
>
> We experimented with Fragment Forwarding and tried to understand the performance implications vis-a-vis per-hop reassembly.
>
> Following is the detailed report:
> https://github.com/nyrahul/ietf-data/blob/master/6lo-fragfwd-perf-report.md
>
> To summarize, we found that fragment forwarding has some practical issues when it comes to forwarding efficiency or PDR "on single channel 802.15.4". While similar concerns were been raised previously during IETF meetings, we tried to validate it with data.
>
> Please let us know if any comments.
>
> Regards,
> Rahul
>
> _______________________________________________
> 6lo-fragmentation-dt mailing list
> 6lo-fragmentation-dt@ietf.org<mailto:6lo-fragmentation-dt@ietf.org>
> https://www.ietf.org/mailman/listinfo/6lo-fragmentation-dt

_______________________________________________
6lo-fragmentation-dt mailing list
6lo-fragmentation-dt@ietf.org<mailto:6lo-fragmentation-dt@ietf.org>
https://www.ietf.org/mailman/listinfo/6lo-fragmentation-dt