Re: Resumable Upload draft updates

Lucas Pardue <lucas@lucaspardue.com> Thu, 25 July 2024 19:59 UTC

Received: by ietfa.amsl.com (Postfix) id D1EBFC14F6FE; Thu, 25 Jul 2024 12:59:38 -0700 (PDT)
Delivered-To: ietfarch-httpbisa-archive-bis2juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D1230C14F6FD for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 25 Jul 2024 12:59:38 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.858
X-Spam-Level:
X-Spam-Status: No, score=-7.858 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.25, HTML_MESSAGE=0.001, MAILING_LIST_MULTI=-1, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=w3.org header.b="WmCMPM8s"; dkim=pass (2048-bit key) header.d=w3.org header.b="PLSukrxe"; dkim=pass (2048-bit key) header.d=lucaspardue.com header.b="v3ukh/i6"; dkim=pass (2048-bit key) header.d=messagingengine.com header.b="tR97w4Z0"
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 8drUGJvF_wim for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 25 Jul 2024 12:59:34 -0700 (PDT)
Received: from mab.w3.org (mab.w3.org [IPv6:2600:1f18:7d7a:2700:d091:4b25:8566:8113]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 86B0BC14F5FB for <httpbisa-archive-bis2Juki@ietf.org>; Thu, 25 Jul 2024 12:59:34 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=w3.org; s=s1; h=Subject:Content-Type:Cc:To:From:Date:References:In-Reply-To: Message-Id:MIME-Version:Reply-To; bh=xM+f9wXmmnq6PIiXN9rLWyB8mDXaFNIxfG51FbDd3qo=; b=WmCMPM8siRwjlaSylYRHmgF3AG +fYS/23pYgAwL5IGEHMPc0GNBjhvxB2cQVZ5f5lJVuUSr0Di2HZBWXu30LtH+WPAbvhEB+LjbqDu9 oYO8yBJPv2WHhZ6C61XVYrHtBFUeyCX3WedU7f8sY2fjjOHLtZCCKnNQtB74mwWRSpyOGz20oRY5b cZ+bLzOBGue7gySU1Xgr1MS/K9ifhXrdk5wBK2Pxm9/q4+y6jtS0Zzx2JQFmiGb1qfje7u8tbGUyr Yr3vnqrd8h7mZQukDkA/YOYGVis7vz/LCpL36O68WOPRWyL3TYv33SLLGGzrPw4hvBPVmuIeI9MHK Iy/QEtEw==;
Received: from lists by mab.w3.org with local (Exim 4.96) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1sX4bx-007ogC-0s for ietf-http-wg-dist@listhub.w3.org; Thu, 25 Jul 2024 19:58:49 +0000
Resent-Date: Thu, 25 Jul 2024 19:58:49 +0000
Resent-Message-Id: <E1sX4bx-007ogC-0s@mab.w3.org>
Received: from ip-10-0-0-144.ec2.internal ([10.0.0.144] helo=pan.w3.org) by mab.w3.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from <lucas@lucaspardue.com>) id 1sX4bv-007ofD-2W for ietf-http-wg@listhub.w3.internal; Thu, 25 Jul 2024 19:58:47 +0000
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=w3.org; s=s1; h=Content-Type:Subject:Cc:To:From:Date:References:In-Reply-To: Message-Id:MIME-Version:Reply-To; bh=xM+f9wXmmnq6PIiXN9rLWyB8mDXaFNIxfG51FbDd3qo=; t=1721937527; x=1722801527; b=PLSukrxe+qFMSa2XM5mRzr3nZJFfjxbjrkLr0ApEBADJ5308A6aKxZ2tHpM37ZmZ5PFaxZUvco0 pCY4c3KwfvaGLJis1tPiLTyQ8a4qXp0lg1/xDNcUazy35kni9sJM18fkUsCeJSAi4KcScav/gaYNh mDJqXgwoCSBS6t2/biVlNc4u8ipwDdwJqFzW5J2lzf8ykBa/1udkp/1HaTQtVXCe7nxu7KomcduOb Ewsf5ZjHXu4Zj8eTe2aCsdukPIMUpsE628x6tf4oAVKuxqKi/WIsG20QcHhMukbHLgsCgfTX6tbww 99LB/pOQYIpcTOr/PTV/xT+aV4ISqitnvaZA==;
Received-SPF: pass (pan.w3.org: domain of lucaspardue.com designates 103.168.172.136 as permitted sender) client-ip=103.168.172.136; envelope-from=lucas@lucaspardue.com; helo=flow1-smtp.messagingengine.com;
Received: from flow1-smtp.messagingengine.com ([103.168.172.136]) by pan.w3.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from <lucas@lucaspardue.com>) id 1sX4bu-00CwSm-37 for ietf-http-wg@w3.org; Thu, 25 Jul 2024 19:58:47 +0000
Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailflow.nyi.internal (Postfix) with ESMTP id AB5C5200267; Thu, 25 Jul 2024 15:58:43 -0400 (EDT)
Received: from wimap26 ([10.202.2.86]) by compute4.internal (MEProxy); Thu, 25 Jul 2024 15:58:43 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lucaspardue.com; h=cc:cc:content-type:content-type:date:date:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:subject:subject:to:to; s=fm1; t=1721937523; x= 1721944723; bh=xM+f9wXmmnq6PIiXN9rLWyB8mDXaFNIxfG51FbDd3qo=; b=v 3ukh/i6qnn7wt5HqXRSXYXiQ/9+fuUvYsEYpudzjTlzMl9cTvwlyeCo0GjxM7Cf5 5QbEE4qjR2LsaihLXAXpZbMjUFiRZMEklAziqwHWskXozYJRsIFi+nROkOifn8fR GXEj5+qxntffI0K2egzJQ59jJgiVYgvlL9py0gg/GJZ+ciDouzcq5rGofhNBBbcv ILNsRHaSchNRnmTZBidmzp7MHo4mZkJ+IKU9F6o83rhijefLkVcolG2KoHMTU/Xi RQ9Eszkyyrzvno9jo5HDpaB6HgDifTA7z1MzoPGmE61UQBfM32jAP2SHnI4A/HOn gDzRUCXRbdW4QosEykc0g==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= i23b94938.fm3; t=1721937523; x=1721944723; bh=xM+f9wXmmnq6PIiXN9 rLWyB8mDXaFNIxfG51FbDd3qo=; b=tR97w4Z0M8BsH3BH3arHj/bSsHV61Mn3hC ghPynBWDrQq0usZkLCyVcK8RnxBDM4R+EqUWM4AkPpTENix3TK81XCvCjPu9HSE+ J1SyUsUYYah7EnOy1PSpwZbcpOGkAPwPzWaMaX4W/nTC4gE5pV2h8ekhkW2j16Kb 1bwx4RrSgBSRZ/ItxWsBnREFboWLVhTYBsoayrFxQYX9oiS21pynK9F5Ab6jQk9r RMroDZQ63XDIgrdbYMPsqZ6/M3kR8iUOGtpeP9q8H1r3SbPMamejFMapxqvLrQwI zqx0gCrJsLltx2pSJqmAPkoEVrzPHdxy+Uo47O3wCbNCANvajJjw==
X-ME-Sender: <xms:c66iZuw3ikCMDc1X608kZTZqBZjcYaPOyKFSlrstlnpDGItxAPMp9w> <xme:c66iZqTznSYxCZCgoqmZbzcrq3GrLIswksu3V9gOs1XeojYPdtIeMoeIm9EaxrQzH 6TS6Q6iWA-9R4B-2W4>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeeftddrieefgddugeegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepofgfggfkjghffffhvfevufgtsegrtderreerreejnecuhfhrohhmpedfnfhu tggrshcurfgrrhguuhgvfdcuoehluhgtrghssehluhgtrghsphgrrhguuhgvrdgtohhmqe enucggtffrrghtthgvrhhnpeeuvefgkeettdevvdevgfegkeduffduveetueeiveeugfdv ffduffeileethfefueenucffohhmrghinhepihgvthhfrdhorhhgnecuvehluhhsthgvrh fuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomheplhhutggrsheslhhutggrshhp rghrughuvgdrtghomhdpnhgspghrtghpthhtoheptd
X-ME-Proxy: <xmx:c66iZgVttiTTa_FHvfvuaCyS-INbZ95guxeiJign0jXtcBj8iKND-g> <xmx:c66iZkhVHqOWlUoiWHl_c0YgjDgLDWknSFP-2nvAK5cePeH2Uxe9fQ> <xmx:c66iZgDELP9BDx44lhfVbSlkRyxCPMxLJ4-TfZhVaVAHbnmVkjfEcA> <xmx:c66iZlIQDg-HKLVkEXmqeTTWigLfZQ1cbx6p641mv5VZHRzlWtaZWw> <xmx:c66iZnAw3KVjkao6MY0RTZQMsI9SZUhJNkGI0i5ip2UlPVxiJyGcO8RR>
Feedback-ID: i23b94938:Fastmail
Received: by mailuser.nyi.internal (Postfix, from userid 501) id 7FEA119C0079; Thu, 25 Jul 2024 15:58:43 -0400 (EDT)
X-Mailer: MessagingEngine.com Webmail Interface
User-Agent: Cyrus-JMAP/3.11.0-alpha0-582-g5a02f8850-fm-20240719.002-g5a02f885
MIME-Version: 1.0
Message-Id: <08d10095-ba78-435a-852c-d5dd13a86f08@app.fastmail.com>
In-Reply-To: <CAChr6Swto1ZTU7vvCOEMHcqayHwVNZuwxGyBXTHmxbAZas_y3Q@mail.gmail.com>
References: <CAChr6Szm_5j1p9QKdTN3mjvEvQ-JwcPT1Y8XeOPqGu25DwBijQ@mail.gmail.com> <CANY19NsOhrTb6ZSKWyd-0Fo+Ac+1f_vH3y1BxTCCOPPAhYCDcA@mail.gmail.com> <CAChr6Swto1ZTU7vvCOEMHcqayHwVNZuwxGyBXTHmxbAZas_y3Q@mail.gmail.com>
Date: Thu, 25 Jul 2024 12:58:23 -0700
From: Lucas Pardue <lucas@lucaspardue.com>
To: Rob Sayre <sayrer@gmail.com>, Marius Kleidl <marius@transloadit.com>
Cc: HTTP Working Group <ietf-http-wg@w3.org>
Content-Type: multipart/alternative; boundary="2099b1ad22154edca45ead2d8f13d32e"
X-W3C-Hub-DKIM-Status: validation passed: (address=lucas@lucaspardue.com domain=lucaspardue.com), signature is good
X-W3C-Hub-DKIM-Status: validation passed: (address=lucas@lucaspardue.com domain=messagingengine.com), signature is good
X-W3C-Hub-Spam-Status: No, score=-4.1
X-W3C-Hub-Spam-Report: BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, DMARC_MISSING=0.001, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, W3C_AA=-1, W3C_WL=-1
X-W3C-Scan-Sig: pan.w3.org 1sX4bu-00CwSm-37 13d1320c55647702bbc49e142d806ba5
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Resumable Upload draft updates
Archived-At: <https://www.w3.org/mid/08d10095-ba78-435a-852c-d5dd13a86f08@app.fastmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/52139
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <https://www.w3.org/email/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>


On Thu, Jul 25, 2024, at 12:40, Rob Sayre wrote:
> On Thu, Jul 25, 2024 at 4:34 AM Marius Kleidl <marius@transloadit.com> wrote:
>> 
>> I wonder if it's helpful to include such a comparison in the draft.
> 
> I don't think a comparison in the draft would be helpful. I was wondering whether the draft differed from S3 et al in substantial ways, and if so, for what reason. The size limits on S3 aren't of interest to me (but fine for them).
> 
> If you're doing a mobile app, people have many bespoke implementations that are similar to this draft, just in smaller chunks, but the designs are all close. It sounds like your company does some of this stuff, so no pedantry intended. I did wonder why it is so different from S3 on the surface. Most designs I've seen also have checksums for each chunk as well as the whole. This is not for security reasons, it's just that the recombination happens after TLS termination, so people use that to ensure message integrity.
Integrity using standardized  HTTP digests is described in https://datatracker.ietf.org/doc/html/draft-ietf-httpbis-resumable-upload-04#name-integrity-digests. Integrity for parts, or whole is covered by the Content-Digest or Repr-Digest.

During the standardisation of RFC 9530, we did a survey and found many of these upload services tend to use the Content-MD5 field to some extent, which is sad because it was obsoleted by RFC 7231 due to implementation inconsistencies.

Cheers
Lucas
> 
> thanks,
> Rob
>