Re: Protocol design: the Gemini project

Keith Moore <moore@network-heretics.com> Tue, 01 December 2020 17:40 UTC

Return-Path: <moore@network-heretics.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C46B03A0EE4 for <ietf@ietfa.amsl.com>; Tue, 1 Dec 2020 09:40:18 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level:
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, NICE_REPLY_A=-0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=messagingengine.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id u902TXRedgPn for <ietf@ietfa.amsl.com>; Tue, 1 Dec 2020 09:40:17 -0800 (PST)
Received: from wout5-smtp.messagingengine.com (wout5-smtp.messagingengine.com [64.147.123.21]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4DBA13A0EBF for <ietf@ietf.org>; Tue, 1 Dec 2020 09:40:17 -0800 (PST)
Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 760F1EC9 for <ietf@ietf.org>; Tue, 1 Dec 2020 12:40:16 -0500 (EST)
Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Tue, 01 Dec 2020 12:40:16 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=SHvxXe rHcEHna5Mzop8h14P5KTWlmkAoDSxKqdcdtuQ=; b=PaQNJTfg4vfRqJDtCEBwuu MC7EN7xwsJFD2LRXal444daikDX3BOnWVRuGYH+P25bZUxwTxkiKOqBUwYe099Zg EbEG6m2ZONoPknRzic37D++/B80HpemwBUevoLgGl8lt61iBS+px/XRH+D5UDr7M AQbRmaTw9U9Wn3Mc98Cg1YfKw6BIPEUlQnidkky+qXSQtUGfqtJ09mWihhS55WN2 fY1yDdRlWbZGEESnKOSJ2sW7hfRwjtoXs/ixj/hPE8tWfsM1tWr4An4drZSXp07H hMzqeG7LPntvu+8xKto6rvZeHJ5EmZ1k6mwF5KKy0I45r2jiGkHJQ18m84Dv65GA ==
X-ME-Sender: <xms:_3_GX9V9rjzmIZRgLMczBzlinu6sU5oJXfqy4nJMT_WvGES1BXIqqg> <xme:_3_GX9kNq5nAcLeBPxos6ZwP1iDgisvjGezn8ktZMmHdfUekcdfcrI6HHC6HeknbM vp4Yazfe3Ig1g>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedujedrudeivddguddthecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepuffvfhfhkffffgggjggtsegrtd erredtfeejnecuhfhrohhmpefmvghithhhucfoohhorhgvuceomhhoohhrvgesnhgvthif ohhrkhdqhhgvrhgvthhitghsrdgtohhmqeenucggtffrrghtthgvrhhnpeevfeetudeige dtledvvddtudefjeejffdvfeetjeeiueelgfdtgfegtdffkeetudenucfkphepuddtkedr vddvuddrudektddrudehnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrg hilhhfrhhomhepmhhoohhrvgesnhgvthifohhrkhdqhhgvrhgvthhitghsrdgtohhm
X-ME-Proxy: <xmx:_3_GX5YzsgVYFsmY9IFTolsMqsqs-Tp-jaekjpZLmTYFgWsySzbHpQ> <xmx:_3_GXwUnZG7i8LpVazqDszi4Eo5WHk-H5QtPAkZoSDbwz2_Y_j7Avw> <xmx:_3_GX3nfkoYoidez1TvXN4cD9-jQb3XgmE9OwAxt3GDfGXGJpx-YaA> <xmx:AIDGXxkdKpJOg04g2sRRPBVGBu1W8EwChz7di7wOsfWsmTXz0x_wZg>
Received: from [192.168.1.85] (108-221-180-15.lightspeed.knvltn.sbcglobal.net [108.221.180.15]) by mail.messagingengine.com (Postfix) with ESMTPA id 600FE3280060 for <ietf@ietf.org>; Tue, 1 Dec 2020 12:40:15 -0500 (EST)
Subject: Re: Protocol design: the Gemini project
To: ietf@ietf.org
References: <20201130173714.GA15548@sources.org> <4B1B8D0E-52A6-4368-8964-43645ADD754A@strayalpha.com> <CAMm+Lwj9ecWvdjbPBwtuYYSEWLnracXgOKjTbFar8PGueRtfug@mail.gmail.com>
From: Keith Moore <moore@network-heretics.com>
Message-ID: <ebaa56f5-5c31-b65b-45d2-720349b31916@network-heretics.com>
Date: Tue, 01 Dec 2020 12:40:14 -0500
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0
MIME-Version: 1.0
In-Reply-To: <CAMm+Lwj9ecWvdjbPBwtuYYSEWLnracXgOKjTbFar8PGueRtfug@mail.gmail.com>
Content-Type: multipart/alternative; boundary="------------BA3E4F9A8586BD38EC6505E8"
Content-Language: en-US
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/CcFSciH9D5cd65bIeAmewtUprCE>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 01 Dec 2020 17:40:19 -0000

On 12/1/20 11:40 AM, Phillip Hallam-Baker wrote:

> Of course we could have stuck to vinyl. But FTP is more like grandad's 
> 78s. There is absolutely nothing to recommend FTP over HTTP. Rsync is 
> vastly superior for file transfer.

False, on multiple levels.

The biggest flaw of HTTP for file transfer (if one wants to transfer 
more than one file) is that HTTP doesn't have a built-in way to list 
files, distinguish files from directories from other kinds of nodes, and 
walk a file system.
Rsync, certainly at the time that HTTP was designed (it may have 
improved since then) had a LOT of overhead because it tried to analyze 
each file for changes within the file, minimizing bandwidth used (which 
to be fair, was quite scarce) at a cost of CPU time and latency.  Circa 
1993 I looked at using rsync to replicate a web site to multiple 
locations (early CDN I suppose) and found it completely inadequate.

Of course FTP was designed for file transfer, including between 
dissimilar systems (which were very common in ARPAnet days), and HTTP 
wasn't designed for that purpose.  There was nothing wrong with 
designing a new protocol for the web especially since the web had 
different needs, different assumptions, and operated under different 
conditions.

But the web has NEVER been a good way to do file transfer. Wasn't in 
1991, and isn't today.   And the protocol designed for the web isn't 
either without adding some additional features.

Keith