Re: [Lwip] [E] [6lo] fragment forwarding implementation and performance report

"Chakrabarti, Samita" <samita.chakrabarti@verizon.com> Tue, 09 October 2018 15:09 UTC

Return-Path: <samita.chakrabarti@verizon.com>
X-Original-To: lwip@ietfa.amsl.com
Delivered-To: lwip@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3797213133D for <lwip@ietfa.amsl.com>; Tue, 9 Oct 2018 08:09:32 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 0.27
X-Spam-Level:
X-Spam-Status: No, score=0.27 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_FONT_FACE_BAD=0.981, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=1.989, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=verizon.com header.b=AYSlbr/o; dkim=pass (2048-bit key) header.d=verizon-com.20150623.gappssmtp.com header.b=gYHdYm0x
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id f9YyztajlRhL for <lwip@ietfa.amsl.com>; Tue, 9 Oct 2018 08:09:29 -0700 (PDT)
Received: from mx0b-0024a201.pphosted.com (mx0b-0024a201.pphosted.com [148.163.153.92]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9A725131338 for <lwip@ietf.org>; Tue, 9 Oct 2018 08:09:29 -0700 (PDT)
Received: from pps.filterd (m0112646.ppops.net [127.0.0.1]) by mx0b-0024a201.pphosted.com (8.16.0.22/8.16.0.22) with SMTP id w99F8e7h015313 for <lwip@ietf.org>; Tue, 9 Oct 2018 11:09:28 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=verizon.com; h=mime-version : references : in-reply-to : from : date : message-id : subject : to : cc : content-type; s=corp; bh=J5MHNbOBW3lanYL6dZ8rRJFacSo5t4c5THP2boc9ybA=; b=AYSlbr/oo8PwN/JeQcD/+t40YxTp2deAW+9dp1KkWSnYyNV1eSNIxUhHLemEGj9TTx51 8ZuoLPKZSOkFU/c0ueL+lnxpISUcbhcuyUbDwwivCMgZJe4xoLgw6mrN16Zeq7DGnfuL jCo5TIpTIFgb4pTQ6/8X0mMHFbgWed6NmCQ=
Received: from mail-ot1-f70.google.com (mail-ot1-f70.google.com [209.85.210.70]) by mx0b-0024a201.pphosted.com with ESMTP id 2n0dfc75wy-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for <lwip@ietf.org>; Tue, 09 Oct 2018 11:09:28 -0400
Received: by mail-ot1-f70.google.com with SMTP id 34so1281379otj.2 for <lwip@ietf.org>; Tue, 09 Oct 2018 08:09:28 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=verizon-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=J5MHNbOBW3lanYL6dZ8rRJFacSo5t4c5THP2boc9ybA=; b=gYHdYm0xjgWeP9ncGOBsGIIUjcfhHtDzkCcWiDlxTIzGZ9r2zmjnOz2EQdQ56ABX3F fyxgPVmJsqv3wQKdLjtMVfbeLVRBpnyu2pxYm3dD8zPCA55CN0XZ5m+99rCLNgAZ0B6S v66bLT4aqQ6hLDwM+FwvkZPHdCg2JsvLmgtrHnblJ8xTlv3fiUQWDNuv7/IGrVSjPXPZ feuYP8UaF843KL1TS9UCgxcx9fC2Ao2uNNF5FWR7SYqdMV92NGUus3by/MkT0xEk9DXx YThkffeS9enV+Ostq3P+eaOY2RNH94szL7e8nGUZSUQnHbgRNQKvXIkidms4e25Epvht UUXQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=J5MHNbOBW3lanYL6dZ8rRJFacSo5t4c5THP2boc9ybA=; b=XZo8aJmJmLxFWteTCcwDTCzxGTt5xtMAX7dREb9as/b6hhQ8AgoTyMQvFex60m65I8 hse4jS5DflBuv87XlDkYwmmP7NXkrhzy+Y+wXdY5qIx4nUOBxEVCOVbfQZ7bITh5U0Ab Dzx57NspryONKw7Zo63rardP6552m/A8DGdJgNHfxkYtVHgBBNQHlBit1PxUqVRYsiBh bmkoGrwaonzrbmxWrLlapmddE2JPfbX1+Dbrysi1sgABLo7j8tMK605vxdPrwmhqkoCV w0MLWacORCrcHVme6Aa/bDzx7bifJql2gNIdli6PqV9ufodgdrdNrVAbgQNi4QjEsrsV 2/8A==
X-Gm-Message-State: ABuFfoi/HcoNNCipDN24eUTdtbiGMfYJze0H7Ny2ynj82nAnlvs5iG2C li1Qqn01Qzxztxxe6gx/sOJCqSbsHuSoEwlMypAewm0zB1YVPqxCUh4GHYS9obyhPQw7rw6r/Pr BuQuVC56kpxdKot+WswuW
X-Received: by 2002:a9d:3605:: with SMTP id w5-v6mr988959otb.133.1539097767436; Tue, 09 Oct 2018 08:09:27 -0700 (PDT)
X-Google-Smtp-Source: ACcGV61somyhU8m/p5/T8zxB7sghwqyAxws710xa158JRW1l6vqAKxcTSbY3h3cElk7YNjCb3ywn0cYwstl7RzxeENQ=
X-Received: by 2002:a9d:3605:: with SMTP id w5-v6mr988950otb.133.1539097767217; Tue, 09 Oct 2018 08:09:27 -0700 (PDT)
MIME-Version: 1.0
References: <CAO0Djp0UM+iKdH+ibkyo7RSZ5a1TSDPCi6U5Sk6_-+pSvKduLg@mail.gmail.com> <CAHYRG6OG8yT-fJ=WEm5B3LVZePhnFBsudGtN1Ldbrxog0dNamQ@mail.gmail.com> <CAO0Djp2qd_bfy7uXNiPCsiB+kH2Zu84jBhvzUuKv4+ZGz+oFqQ@mail.gmail.com>
In-Reply-To: <CAO0Djp2qd_bfy7uXNiPCsiB+kH2Zu84jBhvzUuKv4+ZGz+oFqQ@mail.gmail.com>
From: "Chakrabarti, Samita" <samita.chakrabarti@verizon.com>
Date: Tue, 09 Oct 2018 11:09:15 -0400
Message-ID: <CAHYRG6Mpf9n0KUjKLdn0iQhAqtBeLtxawLWiJrvDOt1YePxd4Q@mail.gmail.com>
To: rahul.ietf@gmail.com
Cc: 6lo@ietf.org, lwip@ietf.org
Content-Type: multipart/alternative; boundary="000000000000b09f300577cd1f91"
X-mailroute: internal
X-Proofpoint-Spam-Details: rule=out_spam_notspam policy=out_spam score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1807170000 definitions=main-1810090148
Archived-At: <https://mailarchive.ietf.org/arch/msg/lwip/rnOU-oI0nAmRNkoosRMtjLq2BX0>
Subject: Re: [Lwip] [E] [6lo] fragment forwarding implementation and performance report
X-BeenThere: lwip@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Lightweight IP stack. Official mailing list for IETF LWIG Working Group." <lwip.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/lwip>, <mailto:lwip-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/lwip/>
List-Post: <mailto:lwip@ietf.org>
List-Help: <mailto:lwip-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/lwip>, <mailto:lwip-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Oct 2018 15:09:32 -0000

Hi Rahul,

Thanks for the clarification points.  If convenient, an analysis of optimum
payload recommendation for minimal fragment forwarding draft will be great!
In that case, the draft can recommend  that value or at least throw the
information in the appendix section for a guidance.

Great work! We  should do more such collaboration with lwip wg!

Cheers,
-Samita

On Tue, Oct 9, 2018 at 5:20 AM Rahul Jadhav <rahul.ietf@gmail.com> wrote:

> Thank you Samita for the feedback.
> Please find my response inline.
>
> Regards,
> Rahul
>
>
>> From the results, I noticed an observation that send rate 80s, and 40s
>> are doing better than the 160s  send rate with 50s forwarding fragment
>> spacing. Send rate Xs means sending fragmented packets at X sec interval -
>> right?
>>
>
> The payload size before fragmentation is different for 40s, 80s, 160s,
> which is 256B, 512B and 1024B respectively. So at 160s the payload size is
> 1024B which will result in more fragments per payload. Thus any loss of a
> single fragment increases the failure rate of the complete payload.
> There is no 50s fragment forwarding spacing .. There is __50ms & 100ms__
> inter fragment spacing in case of fragment forwarding that was introduced
> on the original sender (not forwarders).
>
> The send logic is, we wait for 40s/80s/160s time duration and then
> randomly choose a timer within 1-10s to start sending the UDP payload.
> After that in case of fragment forwarding, we wait 50ms (pacing delay)
> before every fragment is sent on the original sender.
>
>
>> I thought, the performance would improve with higher X value,  but that
>> is not true - perhaps due to increased payload size.
>>
>
> Yes, the increased payload size causes higher number of fragments per
> payload which increases payload loss probability since a single fragment
> loss will cause complete payload failure.
>
>
>> A graph or tabular result with same payload size with increased send
>> interval rate might be useful to figure out the optimal pacing time for
>> that payload - just a thought.
>>
>
> Yes this can be attempted. But as of current observations it seems that
> unless you have smart pacing algorithm the use of fragment forwarding can
> backfire considering that under the same conditions the per hop reassembly
> works much better. We tried pacing with 50ms and 100ms delay ... with 100ms
> the PDR of fragment forwarding is almost same as per hop reassembly but
> with much higher end to end latency.
>
>
>>
>> In general, very interesting results!
>>
>> Also, it shows that by controlling the pacing of forwarding the fragments
>> the performance can be improved to a great degree in a medium to small size
>> mesh. ( in this example, 50 nodes).
>>
>> What happens when you increase the mesh size ( aka number of nodes)?
>>
>
> Yes we can increase the mesh size but then i do not think it will change
> the inferrences much. We also wanted to try different (higher) node
> densities which i feel might further cause problems for fragment
> forwarding. Among other things we also want to experiment with fragment
> acknowledgement mechanism. But we havent really validated all these points.
>
>
>>
>> Cheers,
>> -Samita
>>
>> On Mon, Oct 8, 2018 at 7:17 AM Rahul Jadhav <rahul.ietf@gmail.com> wrote:
>>
>>> <sending to 6lo, lwig WGs because both have relevant drafts>
>>>
>>>
>>>
>>> Hello All,
>>>
>>>
>>> We tried experimenting with the virtual reassembly buffer and fragment
>>> forwarding drafts.
>>>
>>> One fundamental characteristic that has major implications on fragment
>>> forwarding performance is its behavior with realistic 802.15.4 RF
>>> (especially when a train of fragments are simultaneously received and
>>> transmitted). This is something which was not evaluated in any other
>>> experiment.
>>>
>>>
>>>
>>> You ll find the details of the implementation, test setup details and
>>> performance result here:
>>>
>>> https://github.com/nyrahul/ietf-data/blob/rst/6lo-fragfwd-perf-report.rst
>>> <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_nyrahul_ietf-2Ddata_blob_rst_6lo-2Dfragfwd-2Dperf-2Dreport.rst&d=DwMFaQ&c=udBTRvFvXC5Dhqg7UHpJlPps3mZ3LRxpb6__0PomBTQ&r=pWMzx7FsqijEJPyfMBfn-HJss-wVVTf0K5y-cxCTXL8&m=PeFHI-ltr748QRhWwqigY8iNFPw9EcyFDwOeSrv6KQc&s=Rtytc7AFwMLDcwFQOSojZZZ3hiXl-j78GKTwYRi8Nw0&e=>
>>>
>>>
>>>
>>> Results are quite interesting: Simultaneous send/recv of fragments with
>>> fragment forwarding has major implications on PDR/Latency.
>>>
>>>
>>>
>>> Feedback most welcome.
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Rahul
>>> _______________________________________________
>>> 6lo mailing list
>>> 6lo@ietf.org
>>>
>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ietf.org_mailman_listinfo_6lo&d=DwICAg&c=udBTRvFvXC5Dhqg7UHpJlPps3mZ3LRxpb6__0PomBTQ&r=pWMzx7FsqijEJPyfMBfn-HJss-wVVTf0K5y-cxCTXL8&m=PeFHI-ltr748QRhWwqigY8iNFPw9EcyFDwOeSrv6KQc&s=ebzWBVEJyovVUcFHM2mByigGnDBv0aoTSm21fmwa5vU&e=
>>>
>>