Re: [dtn] AMA question and DTN Data Mules

"Nordgren, Bryce -FS" <bryce.l.nordgren@usda.gov> Wed, 14 April 2021 17:17 UTC

Return-Path: <bryce.l.nordgren@usda.gov>
X-Original-To: dtn@ietfa.amsl.com
Delivered-To: dtn@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 17C043A1813 for <dtn@ietfa.amsl.com>; Wed, 14 Apr 2021 10:17:52 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.702
X-Spam-Level:
X-Spam-Status: No, score=-2.702 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FROM_GOV_DKIM_AU=-0.001, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=usda.gov
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ImtxVRypvcnM for <dtn@ietfa.amsl.com>; Wed, 14 Apr 2021 10:17:46 -0700 (PDT)
Received: from GCC02-BL0-obe.outbound.protection.outlook.com (mail-bl2gcc02on2067.outbound.protection.outlook.com [40.107.89.67]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 73C1A3A1810 for <dtn@ietf.org>; Wed, 14 Apr 2021 10:17:46 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=fA16xbwrQOglpQoUYUXq2M09hiIlh7Bv8R4llhsBh3oM8TGlXGOt1ADx8xwlRuZvlI2qf6HKGtNsmO4pyd7XLA0GAxAaK0Ep1SEW+8s6XdhGkq0cJbEQkaayVAPP4u3aH8NjQ7tCjLDkk71i+3cryvGYylWb4cf8NS6MfDeMeF06bMrJPxbBj6xcizmtQr7Kdzi315h4Q6Kh1hbs6Oa9JrmXde9xyjd3CSB8bgLmUm1+OAF+BSWS+cpcnfqJgWNiY0o2/BM5J5fXETR20nECi55OjuPobwU10xNhrG1LkwcYj0mSht1vUktpJiYQ7HkdZAcaeg2Bv+8dsI8DQT2Rvw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Aw5/u9tbMGUgpLkrpSrewgXDh6Pdt9yw1Y9ePCyRSL4=; b=JcxwFGdPFiLRNOM+D+989UBqoaMHGsASlawHRn7qTWbauKy9zxlJiMjCVenCp4cXbE4mbIh9ofuD//olaNr4ry0YKRCt3RaJ9lVXoERGUK+lGQsvGWVeYhIbQLdwikBsZPRsqVfcLAeC/bppRFsmpxQN1KNba8uVO3xjUyD0YnuWf27Gi9JG5jtd0/l1H3H0b7gW+mVuvLMHjq+BwtQUOjWvdLAoDndEeZttkehBmm0L5H5bVkgToKQ7om8uWNJJF9k63rzlMni0EIElgLNzFLXqC44xE8f9GLGYYLWKyLmctjZhrGdYj5K+hp9vMwmJB/GaU+PApcHKfofXL7ckhg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=usda.gov; dmarc=pass action=none header.from=usda.gov; dkim=pass header.d=usda.gov; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=usda.gov; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Aw5/u9tbMGUgpLkrpSrewgXDh6Pdt9yw1Y9ePCyRSL4=; b=s8+ZLg43VaXlq4AQxup+PPszf4rT+26dlQ0irKhdOtgCLvihILVL8ykU8OGafJDiFzDD2lI9GK0Wzr4GG0ruyNwsLMlGX2N29Ajtt4DSTOMBQdCjQFbqA5Qyzj5pwe/ib9/XDVQmSOqaYb3mKtckYtgMJ3IRSj/LAJpWlwnHfrM=
Received: from CO6PR09MB8133.namprd09.prod.outlook.com (2603:10b6:303:cb::17) by CO6PR09MB8117.namprd09.prod.outlook.com (2603:10b6:303:c6::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4020.18; Wed, 14 Apr 2021 17:17:43 +0000
Received: from CO6PR09MB8133.namprd09.prod.outlook.com ([fe80::6088:604:8b30:4e8d]) by CO6PR09MB8133.namprd09.prod.outlook.com ([fe80::6088:604:8b30:4e8d%7]) with mapi id 15.20.4042.016; Wed, 14 Apr 2021 17:17:43 +0000
From: "Nordgren, Bryce -FS" <bryce.l.nordgren@usda.gov>
To: Wesley Eddy <wes@mti-systems.com>, "dtn@ietf.org" <dtn@ietf.org>
Thread-Topic: [dtn] AMA question and DTN Data Mules
Thread-Index: AQHXMJ2l7lhhGZ380UGtLvbbrwsItqqz+QSAgAAmxy8=
Date: Wed, 14 Apr 2021 17:17:43 +0000
Message-ID: <CO6PR09MB8133137FF999485F7EA185C2A34E9@CO6PR09MB8133.namprd09.prod.outlook.com>
References: <CO6PR09MB8133BD0756911E025DF1D325A34F9@CO6PR09MB8133.namprd09.prod.outlook.com>, <b5431127-1025-8a06-8058-187822cbca5f@mti-systems.com>
In-Reply-To: <b5431127-1025-8a06-8058-187822cbca5f@mti-systems.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: mti-systems.com; dkim=none (message not signed) header.d=none;mti-systems.com; dmarc=none action=none header.from=usda.gov;
x-originating-ip: [216.47.56.129]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: a717772a-69eb-4748-83f7-08d8ff69372e
x-ms-traffictypediagnostic: CO6PR09MB8117:
x-microsoft-antispam-prvs: <CO6PR09MB8117060E25631DD4DB842937A34E9@CO6PR09MB8117.namprd09.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:1013;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: +2aggJXTi8nod+kFCCWQcKbKF8wzXxVuR5TKOc83I7LtWIS8NDoPgqjUjlOPZSsOdH2+sxxDctEQYHanUQ/mqb1A7IADhTb7+T6IXckQ/UdmUC/MjlN1OofdCplBKSd9mpaRTA1S1mkEJIhaB48iGxuLyJj8HTUnFGKGj1LF/T0sQo0l46cQp9TqIWdYN9syTMqkUkmNDef+c/+M9wnck03OIQIbT0xL21bBGOugwwL5hfomrLi/28POjt3IoMs5gnqZjhB/72K6nXI36vEr3gJD83zI090KHitMGy7a2dKASzgFIEmwSITNga0YGvmbshZBMp88P7BsEh5s/rXdujnm9atbbZTS4atLaS5RTO82dC346JmOrvbZbZ3YvHsjy2B7YW/Y/a/beSimdf9t6smGO5MfYE6ByGxb1yjZGq8gQOnbC5c5JmjHY4xvYt5Xy4OeT64N9RDhO7ihtiTO4Yn1uJMSvR60llPETfeSoqHRnThCNiD2qqaGJZH+iwe1jf6302exK5ZG6RWokBnVEZayK95MooX7PpsU2rws50Be/yni4EjoiWaJuMu5r19q9fzn5VK7mVcEC46yv3SFaIzYXEwH6rrmSCsMoPXwq/owNd9Q0d8S/+mpC0gssbgJ9vwsplL1FNIrAePQsnfvTZIM++3QrEp5R0eAOGc8C5kWM8Szm77UshCbOXIv0Wzk
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CO6PR09MB8133.namprd09.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(396003)(136003)(39860400002)(346002)(366004)(376002)(19627405001)(55016002)(2906002)(966005)(18074004)(33656002)(86362001)(53546011)(66476007)(9686003)(110136005)(66556008)(83380400001)(6506007)(478600001)(76116006)(66946007)(8676002)(64756008)(122000001)(316002)(66446008)(8936002)(166002)(7696005)(52536014)(38100700002)(66574015)(5660300002)(186003)(71200400001)(26005); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata: uPtSldNB28bRUCkytj/Oftk0Xhbgzz6/Uas/5vBk/QUUGA7f0BtaLm3dMYVSrNpbZWhxUnd1DIyJmUS4mK5TTr/EB03XB3mS5kefCAkrrwHIUKhOAHujNmKND1sUsccAR4ugRSXt2tybHL7aIbBacCYK7IX/82tuQNgRcF12klMNNuLiOMaLLWfv5JbAdQQ6WfbGFQTx4zYBCzYI75tqTkRjx63s2tNZqIFEAYYZNiRH6hypEJiQyweXo7/gC59rPxcFmbVDdyXQ+pqjnFtLbdV2J8/j+L6V3/hV9fVDao8V3qXTcz4t28V8FsWZLuwOcNEa3Ed0zblgQbGJC5rX6RPDomCcOLiUbr6lJExXMpTBFHHfhNnGg9cUv0hPtiGsvyIUMXQPj45lc6iYXsGLeRO9JGNuL8z8pJc5iDZgp4Ck6tdR/YWZxQZDG2dTTj0EJFyB6FaAmL10YaM2K2uYc41W03ryxE6huPaCyiZsYPRhODasindyeZ4Sc5Q9rI+WFckd8hErf9e8zEExQiGi6HdXuRxrInqln8b7DLjWU2+D2Y6AUFcP2XrCelfrqoEbCKa+aY30KoA20AkneeOWQmj/RzDmD7CI0SnFg1SRL/Iiig9pQMWbvWtHNhtMjaJ6vdp6O+VFdeMdNosJRKPDjgpGRI2Jw3ZS2ZnAy7BTrhaaVye7mdPmgTmQKPNUOb6Rnc73IW4ikk6VF4vRDhFwR7LfAfW64N96LGQ45id1BOZ1OrTbNgzgdI/oGJhVpqB2ANfp2V6JkbOVQuz2/CZr2QPkWjFa2lKLwdDBXbk0D/qYwLkxMy7Q8znJNl6oD0BtyXk7yr3MBYV+x77sbKY/2Y4yyIO7XUz4b207egQZc0s4TNvKeNibRFD5iYgxo0px5tvit8P/ZMmMdhRlABce99osY/1cpm7cOAGp+lG91R7lvXRyoLaEjUaZH4Zx46gQ1aJlhBBDfd/KhQy5vtIiLRCLxHJYBZPVYd3ugbfzvFoDNwJMpIkzgY018iYliRWjYodWRM2TYqWDJcDSkvWEmpVVcxag4ISzeodC8bR+ysftXM9nmr7uLojPG/6q53ri8ii353FvxQPKgUKADsNZf8hU9addOeFapVgcXcOc9Q5l3gDG5UxYKYjho5nvBJ+Pg/ZU5RF/cn1I9jA7mE5Cu6Xqw4sA+/w37juQqKuEb+HTz36z1HWrUv0/0CcustXFLjbZb5NbAP9zOYh+62VPVn3kxjIvNw8eReOTZCYnCGIal1wQ8gKz1ZPRayrE7fcqORgW62obIMMIbdnadDtX+HsacHgHf0f3oRGQpYKxi70YsG1sQ8MQ28PYGk/3mY54
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_CO6PR09MB8133137FF999485F7EA185C2A34E9CO6PR09MB8133namp_"
MIME-Version: 1.0
X-OriginatorOrg: usda.gov
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: CO6PR09MB8133.namprd09.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: a717772a-69eb-4748-83f7-08d8ff69372e
X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Apr 2021 17:17:43.3099 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: ed5b36e7-01ee-4ebc-867e-e03cfa0d4697
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO6PR09MB8117
Archived-At: <https://mailarchive.ietf.org/arch/msg/dtn/nelQPO82AsKLC7IX1SnNWSWpBjs>
Subject: Re: [dtn] AMA question and DTN Data Mules
X-BeenThere: dtn@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Delay Tolerant Networking \(DTN\) discussion list at the IETF." <dtn.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/dtn>, <mailto:dtn-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/dtn/>
List-Post: <mailto:dtn@ietf.org>
List-Help: <mailto:dtn-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/dtn>, <mailto:dtn-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 14 Apr 2021 17:17:52 -0000

I believe my monologue was unclear on at least one point. I was not thinking to use USB sticks to manually sync directories. I envisioned the task of sync'ing directories being implemented as the BP application "DTNbox" (https://ieeexplore.ieee.org/abstract/document/8734214), (https://gitlab.com/dtnsuite/dtnbox).

The task of moving BP bundles via a mass storage convergence layer apparently has (an old, unmaintained) implementation. Wesley told me DTN2 had a file convergence layer but it is marked as "do not use" since either 2009 or 2012, depending on date formatting. It does seem to me that in terrestrial challenged networks, USB sticks and smart phones will probably be the most common link between sites not having internet connectivity. Hence worth standardizing.

A closer read of draft-ietf-dtn-bpbis v 31 leaves me a bit confused as to what happens:

  *   ...when a DTN node/BP agent receives a "bundle status report" destined for itself. It shouldn't get delivered, so does it just eat it? Does it notify the requesting app of bundle delivery (or more importantly, failure to deliver the bundle?) Does it try to retransmit on failures...or certain failures (relay N ran out of storage space)? Some of these actions can be configuration items, but some things really should be consistent. ("Hey App, your last message didn't get thru...")
  *   ...when a DTN node/BP agent receives a "bundle status report" (delivery receipt/reason code "no additional information") destined for someone else, but referring to a bundle it is currently storing. Can it/must it/should it delete the copy of the bundle it is storing?
  *   ...when a DTN node/BP agent receives a duplicate bundle. Is it even required to check whether it's received the bundle before? How can the app differentiate between duplicate delivery and the same message actually sent twice?
  *   ...when loops form...

A common architecture pattern potentially worth expressing "informationally" for terrestrial challenged networks may be that mobile relays (DTN nodes) travel between disconnected LANs. This suggests to me a couple of things:

  *   The option to be chattier should exist. Mobile nodes should be able to sync up with each other and with fixed nodes when there's N of them connected on a LAN and none of them knows which will travel to a different LAN next. Talk on a LAN or bluetooth link is cheap. Storage is also pretty cheap.
  *   Perhaps an XMPP or PEP convergence layer is the more natural way to handle "mobile nodes popping up on a LAN to deliver bundles to whatever other nodes are connected." Also handles the situation where a mobile node squats on a LAN for most of the day till it's human needs to travel to a different LAN-supported-area.--The phone is always "ready to go, fully loaded with current bundles".

I'm sorry if some of this is just stuff I haven't wrapped my head around yet. Please point out incomplete or erroneous thinking to me.

Thanks,
Bryce



________________________________
From: Wesley Eddy <wes@mti-systems.com>
Sent: Wednesday, April 14, 2021 6:53 AM
To: Nordgren, Bryce -FS <bryce.l.nordgren@usda.gov>
Subject: Re: [dtn] AMA question and DTN Data Mules


It's been a long time (like 15 years), but the file-based convergence layer adapter in the DTN2 software has been used to do something similar to what you say with removable USB-stick storage.


I think there are interesting distinctions though (and don't know about your use case) between sync'ing distributed copies of file stores or sync'ing or importing updated data tables in a distributed database that partitions frequently, versus sending bundles between DTN applications.  I think the bundle sending/receiving is a more primitive operation, and still requires other significant application intelligence above to satisfy the use case, as I understand it.



On 4/13/2021 5:23 PM, Nordgren, Bryce -FS wrote:
Tangent: on cursory inspection, draft-ietf-dtn-ama-01 seems unnecessarily limited to "network management", since nearly all the concepts seem applicable to management of any distributed application operating across challenged links. The draft would seem to describe the case of an "Autonomous Parameterized Procedure Call" commanding a remote Kubernetes cluster to roll out a new deployment of some app to a local network on the other end of a challenged link--except it seems to be focused on network management.

A conceptual piece that may be missing from AMA is synchronized data, or data that should be eventually consistent across application instances present at multiple nodes, where each serves users local to their own node (to offer better response times or conserve bandwidth). Data such as the collection of "users" of the app (Who Are The Actors? Who Are The Managers? Did Someone Get Fired? Is There A New Guy? Did User A Change Her Password?). It may not be appropriate to specify a particular method to pursue consistency, but defining the syncronized data type and its binding to a set of endpoints may be useful. Also, and I haven't read closely enough to understand if this is a problem...Actors and Managers in terrestrial networks may access the network from different nodes, and user generated content (even if it's just a state change due to their interaction) may be supplied from any node. The draft doesn't actually define permissible management operations on individual DTN nodes, so is there a reason to limit these generic concepts to "network management"?

The meat: during the development of the DTN concept, has there been any thought to the use of "dumb media" to connect isolated network islands?

Use Case: An Incident Management Team (IMT) splits some of its essential functions between an Incident Command Post (ICP), chosen for connectivity reasons; and a Forward Operating Base (FOB), chosen for proximity to the fire/earthquake/disaster. The current communication flows between locations may include paper forms or electronic files shared via flash drives.

Deployment scenario: Two "fixed" DTN nodes are set up, one at each location, running a DTN app like 'DTNbox' to sync one or more directories between the two. They also participate on a local network at each facility (where the FOB does not have internet connectivity) and run a webserver. The webserver allows end users to view or download published data (such as the day's Incident Action Plan or maps), as well as upload admin info, like electronic time cards and COVID screenings.

Writing an app to make a smartphone into a "mobile" node (data mule) seems a conceptually straightforward thing to do. This is because a smartphone is smart, and can act like a DTN node that's doggedly trying to join WiFi and pester whatever "fixed" nodes it finds. However, it requires that users install something on their phone, which is likely forbidden if it's an agency phone.

My question is: Is there a spec or a strategy regarding how to dump bundles which need to be moved between nodes to "dumb" media, like a flash drive or a USB hard drive? Someone then carries the dumb media from place to place, plugging it into the DTN node when they arrive. Seems like an on-media structure would need to be developed so nodes could add what they need to transmit and consume bundles destined for them. And since there's no guarantee that two nodes are running the same DTN implementation, it seems that the structure (and allowable operations on said structure) would need to be standardized. Would this be a "mass storage" convergence layer in your parlance?

Has this come up before, and is it dumb?

Thanks,
Bryce




This electronic message contains information generated by the USDA solely for the intended recipients. Any unauthorized interception of this message or the use or disclosure of the information it contains may violate the law and subject the violator to civil or criminal penalties. If you believe you have received this message in error, please notify the sender and delete the email immediately.


_______________________________________________
dtn mailing list
dtn@ietf.org<mailto:dtn@ietf.org>
https://www.ietf.org/mailman/listinfo/dtn<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ietf.org%2Fmailman%2Flistinfo%2Fdtn&data=04%7C01%7C%7C69e4c719f98947d32c0c08d8ff444c30%7Ced5b36e701ee4ebc867ee03cfa0d4697%7C0%7C1%7C637540016090763975%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=QKnAA%2FfD2qHT2AHNOaa1gKgBoImkWm6AmBr4zK6oG78%3D&reserved=0>