Re: [dtn] draft-blanchet-dtn-email-over-bp-00.txt

Marc Blanchet <marc.blanchet@viagenie.ca> Fri, 20 January 2023 17:32 UTC

Return-Path: <marc.blanchet@viagenie.ca>
X-Original-To: dtn@ietfa.amsl.com
Delivered-To: dtn@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9E2F6C14CF01 for <dtn@ietfa.amsl.com>; Fri, 20 Jan 2023 09:32:15 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.896
X-Spam-Level:
X-Spam-Status: No, score=-1.896 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=viagenie-ca.20210112.gappssmtp.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id JjGbQvFhopdL for <dtn@ietfa.amsl.com>; Fri, 20 Jan 2023 09:32:12 -0800 (PST)
Received: from mail-oi1-x22b.google.com (mail-oi1-x22b.google.com [IPv6:2607:f8b0:4864:20::22b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 0ABC6C14F727 for <dtn@ietf.org>; Fri, 20 Jan 2023 09:32:11 -0800 (PST)
Received: by mail-oi1-x22b.google.com with SMTP id d188so5014406oia.3 for <dtn@ietf.org>; Fri, 20 Jan 2023 09:32:11 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=viagenie-ca.20210112.gappssmtp.com; s=20210112; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=sdkVmJtIy15gzTkBKhoLDpW5GrYeLhZC3BAvUAkv7qs=; b=w8JqiB60nJ578OCTorgwc/Zj64qbK+Xo80GOMZTT9zRTdndBnJK23zyQIdpoHtMnDq EJGza8ztc3wzf347oAm+Xthzp3puAX2PrsDnS8fcTZwMX9ge7FUhO2B6fD9KQviiiD24 Fe+Nl8MKyqAtWKWJZuJkk02qSHfmfRsVxFgpn/pqnHuMaTQkI0mqusueNEHvxxN1aPVG vrsK1u4qwowfRyRlutC326emqFz7pM3b30C8bZ+PuJvhSmH0XdhUKUvnKzobZJqkguoV 7riEM9oSgqJAL/R7feOGOUAuhEd6z/N/EMQyc0UBFpDqZqateWh1l3INuhGl9FE/RwSW d3OQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=sdkVmJtIy15gzTkBKhoLDpW5GrYeLhZC3BAvUAkv7qs=; b=EFn8mTeEXbF9ZLrueGtHsKZwmuy6yNqohlDIbRHjkB/hwM/e/DlSygZPQQ/Z2LrkXR rU9L2F5vA2Pny8G2TMvap8D+3+GMpyQlxbPahUEBGG8R/Qlwi4woJlreWSzxpWZXOtDd XRVZOK01/UNRCyVVn8xwqRoXqCftoF7746SUg2kGi0keaKQHXsIX0m7zbSdsds6z8LGR 4gxq7h145UJuR8YnnXcA8m1iUC6pJCje1zGISrtxY/d8QEHYc57/DabZuKP/8+b9F/RY kB2P1kfNCOo2UE00wqW8yRVIb4BDIeu2jZhv4oWS5iRWvouyal+Asj9IcZnKbEESypo/ 12Hg==
X-Gm-Message-State: AFqh2kq/IC9sx1F5xrns8g6h6lBEKQKDpc5WZc29xGK5d04x4rqRF88B zDgWgYVOiCnnJyfpiQAH8Bw8XA==
X-Google-Smtp-Source: AMrXdXte64e3MH/9cYzib/J7DrcZwuregMLrEyu6mDcFmY9Lxz3HTMa7Z5n2hfmx12X4LhMqmQAH/A==
X-Received: by 2002:a05:6808:1885:b0:36b:82fc:dbc4 with SMTP id bi5-20020a056808188500b0036b82fcdbc4mr7047272oib.47.1674235926024; Fri, 20 Jan 2023 09:32:06 -0800 (PST)
Received: from smtpclient.apple (modemcable161.124-162-184.mc.videotron.ca. [184.162.124.161]) by smtp.gmail.com with ESMTPSA id r18-20020a05620a299200b006cebda00630sm26625545qkp.60.2023.01.20.09.32.05 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 20 Jan 2023 09:32:05 -0800 (PST)
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.300.101.1.3\))
From: Marc Blanchet <marc.blanchet@viagenie.ca>
In-Reply-To: <9dbca394-dabc-da7c-3f28-68d96224a074@critical.com>
Date: Fri, 20 Jan 2023 12:31:54 -0500
Cc: Jorge Amodio <jmamodio@gmail.com>, DTN WG <dtn@ietf.org>
Content-Transfer-Encoding: quoted-printable
Message-Id: <60A8D640-6DA5-43ED-B2E5-17F3417D3517@viagenie.ca>
References: <9cecd3fb-a4e9-4a73-0670-ac564e0330e3@cs.tcd.ie> <7FC6B70D-6A81-45AE-9462-F9CCE201D70E@gmail.com> <C7DADA37-99E9-424E-A1BF-2E388A13503A@viagenie.ca> <9dbca394-dabc-da7c-3f28-68d96224a074@critical.com>
To: "Stuart W. Card" <stu.card@critical.com>
X-Mailer: Apple Mail (2.3731.300.101.1.3)
Archived-At: <https://mailarchive.ietf.org/arch/msg/dtn/R2522LVNqEEMIWK_-9m5bg4KOyA>
Subject: Re: [dtn] draft-blanchet-dtn-email-over-bp-00.txt
X-BeenThere: dtn@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: "Delay Tolerant Networking \(DTN\) discussion list at the IETF." <dtn.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/dtn>, <mailto:dtn-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/dtn/>
List-Post: <mailto:dtn@ietf.org>
List-Help: <mailto:dtn-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/dtn>, <mailto:dtn-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 20 Jan 2023 17:32:15 -0000

> Le 20 janv. 2023 à 12:14, Stuart W. Card <stu.card@critical.com> a écrit :
> 
> Marc et al --
> 
> Yes please, pursue email/BP!
> 
> I am a big fan of these 3 related but distinct things:
> 
> - email encapsulation over BP;
> - BP encapsulation over email;
> - email <-> BP translational gateways.
> 
> Before BP, we developed a mostly transparent gateway that provided DTN services to legacy applications for the U.S. Navy submarine force.

Thanks for the papers. Will read thoroughly.  Have a question, for BSMTP, you were encapsulating RFC2442? Which implementation have you used for BSMTP?

Regards, Marc.


> I tried to summarize that work in a post 2004 JAN 22 to what was then the DTN Research Group mailing list, with subject line
> 'lurker describes related work (was: DTN "Community Rapporteurs"?)',
> which can be found in the archive at
> https://mailarchive.ietf.org/arch/browse/dtn-interest/
> I am amused to see that the day after tomorrow, it will have been exactly 19 years since I posted that. ;-/
> Attached are 2 papers we presented at MILCOM later in 2004 and a PowerPoint presentation from 2003 when we were still working on automatic rule-based prioritization of traffic (I will have to ask our marketing guy to look for a block diagram of its final configuration).
> 
> Our [non-real-time web browsing proxy over] email stack on the SATCOM segment was something like this (from my hazy memory):
> 
> [HTTP]
> PBS
> BSMTP
> bzip2
> GnuPG
> MDPv2
> UDP
> IPv4 multicast
> 
> I can't find GnuPG/OpenPGP in the block diagram but am sure it was there (eventually, in some version), between compression and bundle transport.
> 
> Of course, later we replaced the Naval Research Lab (NRL) Multicast Dissemination Protocol (MDPv2) with the NACK Oriented Reliable Multicast (NORM) transport protocol, which I believe remains the _only_ IETF standards track reliable multicast transport protocol that uses Type II hybrid ARQ/FEC to efficiently provide reliable delivery by adapting to widely dynamically varying error rates on network paths. Last I knew, somebody had a BP convergence layer for NORM, and I have long owed the DTN WG a draft on it. :-/
> 
> We used stack variants for different traffic types, e.g. SCPS-TP for TCP connections of applications for which we lacked an app layer proxy.
> 
> PBS was the Portable Batch System. This was an "active network" where each bundle we transported contained a shell script that invoked the necessary service on the DTN destination Internet to do the appropriate thing for the encapsulated payload type.
> 
> The ability of Postfix to deliver mail to a process was a big help. We just hand-whacked the Postfix transport database to use our homegrown DTN stack for specific domains that we knew were on the other end of the SATCOM segment.
> 
> BSMTP (Batch SMTP) enabled us to use actual SMTP (then RFC2821) envelope information ("MAIL FROM" and "RCPT TO") rather than Internet Message Format (IMF, then RFC 2822) content header information. Inferring the former from the latter has long been known to be dangerous, so please look at some of what has been written on that subject before deciding. Sadly I can't remember any specific references but do remember reading about mail routing loops and other problems.
> 
> Sorry for the huge and poorly referenced data dump. Also, to be clear, I am not trying to claim priority or anything like that, just trying to provide some potentially helpful information based on our experience. Happy to chat if you like. Now back to nominally paying work...
> 
> On 1/17/2023 7:32 PM, Marc Blanchet wrote:
>>> Le 17 janv. 2023 à 19:14, Jorge Amodio <jmamodio@gmail.com> a écrit :
>>> 
>>> Why not BSMTP using CFDP ?
>> I looked at that too... Having a raw RFC822 payload is as simple as it can be. I like things simple...
> 
> -- 
> Stuart W. Card, PhD: VP & Chief Scientist, Critical Technologies Inc.
> * Creativity * Diversity * Expertise * Flexibility * Integrity *
> Suite 400 Technology Center, 4th Floor 1001 Broad St, Utica NY 13501
> 315-793-0248 x141 FAX -9710 <Stu.Card@critical.com> www.critical.com
> <MILCOM_Paper_910_V3.doc><MILCOM_Paper_1024.doc><SWC-CTI-ATC.ppt>