Re: Resumable Upload draft updates

Rob Sayre <sayrer@gmail.com> Thu, 25 July 2024 20:20 UTC

Received: by ietfa.amsl.com (Postfix) id 68EEAC14F738; Thu, 25 Jul 2024 13:20:45 -0700 (PDT)
Delivered-To: ietfarch-httpbisa-archive-bis2juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 681EEC14F70D for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 25 Jul 2024 13:20:45 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.857
X-Spam-Level:
X-Spam-Status: No, score=-2.857 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.25, HTML_MESSAGE=0.001, MAILING_LIST_MULTI=-1, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=w3.org header.b="A6wqkof8"; dkim=pass (2048-bit key) header.d=w3.org header.b="XH5eGZNk"; dkim=pass (2048-bit key) header.d=gmail.com header.b="XIs4GRSA"
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id WTIZcKJ8vTFJ for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 25 Jul 2024 13:20:41 -0700 (PDT)
Received: from mab.w3.org (mab.w3.org [IPv6:2600:1f18:7d7a:2700:d091:4b25:8566:8113]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 6F856C14F714 for <httpbisa-archive-bis2Juki@ietf.org>; Thu, 25 Jul 2024 13:20:41 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=w3.org; s=s1; h=Subject:Content-Type:Cc:To:Message-ID:Date:From:In-Reply-To: References:MIME-Version:Reply-To; bh=UKMPYcmaJuhwkqdLxEHWwKVKenOTX8C5rdJJLmVBrYI=; b=A6wqkof8oh35pLKtw59tLIPTmA vrmmt3yKXU3ka3mmGP768U+EjDMcFkunmJM3Wn0kRU7IUOzf9zAjaWeJwj8UjXyIHeWFioNnxUjKB GGqjj2xw/dJtUdwp5W8lRHDFD41RCoiPYJ4yxb4e0oMUtCfytaE3rTQ70y+lhrrqtqZZGfLHcfX/E yM9Uk9yOyAUoJuRpxrB/0ARA4YMX2jcIshEuvhhqEZ8WvdApBPGAcgxqCxW//TYhhhxpTK/aqIHlK YRnpjHrJhmaQLCLaKyDUaENyQlqk9gT1eMjv2d+M49neEaRaLAX0pmVM5A/+tjhWFo342lBQRnVMi wlGUWUVA==;
Received: from lists by mab.w3.org with local (Exim 4.96) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1sX4wR-007rNC-1V for ietf-http-wg-dist@listhub.w3.org; Thu, 25 Jul 2024 20:19:59 +0000
Resent-Date: Thu, 25 Jul 2024 20:19:59 +0000
Resent-Message-Id: <E1sX4wR-007rNC-1V@mab.w3.org>
Received: from ip-10-0-0-144.ec2.internal ([10.0.0.144] helo=pan.w3.org) by mab.w3.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from <sayrer@gmail.com>) id 1sX4wP-007rMC-0S for ietf-http-wg@listhub.w3.internal; Thu, 25 Jul 2024 20:19:57 +0000
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=w3.org; s=s1; h=Content-Type:Cc:To:Subject:Message-ID:Date:From:In-Reply-To: References:MIME-Version:Reply-To; bh=UKMPYcmaJuhwkqdLxEHWwKVKenOTX8C5rdJJLmVBrYI=; t=1721938797; x=1722802797; b=XH5eGZNkWui/9CLTlvFb/X32FE861yUJyMwqC1dMP6xRzFYsLfdjgxJr3h8KYvxLoK+RJToMrwu /7z7Hx8W/iDsqeHPHN+VlntEzms3zx7Ys/6/MZINsuIQaPToJlDq8JTcQQGYzLDNJUs2EzUnQw3Wa KIyN19iQt96FKWlMg3Y71S+sGLgL4bbzGgojFXCYsTS7UJQ3MmgRdq9ElmMm8dCUIKDpcJk5Skc+G Wo1yntKM3L7iiTuJJGS54IBjAxQkxs3g7T/V1DDWe7c8H8g3gORl9j9EfL6iHk6SsDO7Vf40tKKpS T3LX8pb/vxpXUkDWenEREWWRuRocmf6XKMyA==;
Received-SPF: pass (pan.w3.org: domain of gmail.com designates 2a00:1450:4864:20::12b as permitted sender) client-ip=2a00:1450:4864:20::12b; envelope-from=sayrer@gmail.com; helo=mail-lf1-x12b.google.com;
Received: from mail-lf1-x12b.google.com ([2a00:1450:4864:20::12b]) by pan.w3.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from <sayrer@gmail.com>) id 1sX4wO-00Cwm0-1W for ietf-http-wg@w3.org; Thu, 25 Jul 2024 20:19:57 +0000
Received: by mail-lf1-x12b.google.com with SMTP id 2adb3069b0e04-52f04c1e58eso876459e87.3 for <ietf-http-wg@w3.org>; Thu, 25 Jul 2024 13:19:56 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1721938792; x=1722543592; darn=w3.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=UKMPYcmaJuhwkqdLxEHWwKVKenOTX8C5rdJJLmVBrYI=; b=XIs4GRSAtcx7GSrl8fzMGCIKvUqCpn4NAWII+IgPp/RJbLGxqJ/FdwcyDLVqL75zY2 bIaBXQQut1byT2ghs0jlHlP7n5+gE5ygA6NmcGwqrcdwB8RCiXRPwVKFgUcMxhEcKJHM iXUXC6ke6Xx6UV/hLcSCuQS5slvqgFJAS1tMsib/A+lcmKT9Tgyiq89NKHDw+ld96uDO jzA/BNopH/FDPIj7/9gi+8FjZAD9a/e2VDXOocgcS5/hPzbDjowEvOmbMlh4JrJ7IQ71 BMJoVXisYv/DjkXXA6wgrFI1VP88RNgjRDRHxO4gQAcFHmMjyqbByTlNmsxekWXiUKAl a2qA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1721938792; x=1722543592; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=UKMPYcmaJuhwkqdLxEHWwKVKenOTX8C5rdJJLmVBrYI=; b=SEYKU49TCAWNcU7W80e/urhzENrip7DWEFOU4UD7JLSr1Juj+SNO75H6a7019t1hxO PSWasDSXD2MODjSSmDeij+kYnU4McS5zfJrEz0fICrxpw8dKcdFayJ/MA78gabevdFYl zCp46kuLy4UgpKl14iGR8ddHTkfQE0sr4ZuxTkh7ct/qoc1D7EQHIyNKz25dBulRYw2W 2wK+nLGzy6fkXmWmzSLQfdjR87e07x8HVvwp/QPXY0dbEw6sapi0/Ul0ruLaqgHW+Lby y/AQQeOsZYUecaVzthFP+Rm6bAubWJmdD95VzeKSrH4Qz0aJHGWAB8SxVnvPZWzI/F4m K66Q==
X-Forwarded-Encrypted: i=1; AJvYcCUtpzkbAdvSzOajuI03w9wjLXerVytVxw01+79vLATFIaENKKCwgkbKojFsCG+WyyioGaqhZcIr3bRKCA1TLwCaU9gr
X-Gm-Message-State: AOJu0YwrIBLPJrwadBfohDsi+TM8/8ZWqAS0cgG8UVI+c/390Kg8hEYQ 3b+NUIsVe+RDVfT4gzdHTDUQfIyrZrXf9lehaCGv5kOQ2eI4HssCqjlcHYha9Bib0E1rDq+nu+M PgVHtxfxjis6ZxAOfPaqfL1GGrSc=
X-Google-Smtp-Source: AGHT+IE2AN9J1Y+32khz/sSbBs78CMmzlxmRKnWhN95gXpoSefpYvfuKfmonjZZqoX7hwmLiAXElnHsx0DkahEnn8zs=
X-Received: by 2002:ac2:4ece:0:b0:52c:8342:6699 with SMTP id 2adb3069b0e04-52fd609278emr2299022e87.55.1721938791517; Thu, 25 Jul 2024 13:19:51 -0700 (PDT)
MIME-Version: 1.0
References: <CAChr6Szm_5j1p9QKdTN3mjvEvQ-JwcPT1Y8XeOPqGu25DwBijQ@mail.gmail.com> <CANY19NsOhrTb6ZSKWyd-0Fo+Ac+1f_vH3y1BxTCCOPPAhYCDcA@mail.gmail.com> <CAChr6Swto1ZTU7vvCOEMHcqayHwVNZuwxGyBXTHmxbAZas_y3Q@mail.gmail.com> <08d10095-ba78-435a-852c-d5dd13a86f08@app.fastmail.com>
In-Reply-To: <08d10095-ba78-435a-852c-d5dd13a86f08@app.fastmail.com>
From: Rob Sayre <sayrer@gmail.com>
Date: Thu, 25 Jul 2024 13:19:39 -0700
Message-ID: <CAChr6SyZ7TJQG3R==xUZ-r_TeC5EcDGUDLuE9sKjTcixJyPfGw@mail.gmail.com>
To: Lucas Pardue <lucas@lucaspardue.com>
Cc: Marius Kleidl <marius@transloadit.com>, HTTP Working Group <ietf-http-wg@w3.org>
Content-Type: multipart/alternative; boundary="000000000000fe5d56061e181dfe"
X-W3C-Hub-DKIM-Status: validation passed: (address=sayrer@gmail.com domain=gmail.com), signature is good
X-W3C-Hub-Spam-Status: No, score=-4.1
X-W3C-Hub-Spam-Report: BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, DMARC_PASS=-0.001, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, W3C_AA=-1, W3C_WL=-1
X-W3C-Scan-Sig: pan.w3.org 1sX4wO-00Cwm0-1W 21b6523c9715499d2b7b251a992abd7e
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Resumable Upload draft updates
Archived-At: <https://www.w3.org/mid/CAChr6SyZ7TJQG3R==xUZ-r_TeC5EcDGUDLuE9sKjTcixJyPfGw@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/52140
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <https://www.w3.org/email/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

On Thu, Jul 25, 2024 at 12:58 PM Lucas Pardue <lucas@lucaspardue.com> wrote:

> Integrity using standardized  HTTP digests is described in
> https://datatracker.ietf.org/doc/html/draft-ietf-httpbis-resumable-upload-04#name-integrity-digests.
> Integrity for parts, or whole is covered by the Content-Digest or
> Repr-Digest.
>
> During the standardisation of RFC 9530, we did a survey and found many of
> these upload services tend to use the Content-MD5 field to some extent,
> which is sad because it was obsoleted by RFC 7231 due to implementation
> inconsistencies.
>

Ah, ok. I didn't know that one got finished. This sounds like a fine
approach. Here's the Amazon way (for other readers, sounds like the authors
have made an informed decision):

https://docs.aws.amazon.com/AmazonS3/latest/userguide/checking-object-integrity.html

Not necessarily MD5, but it can be. I think a lot of those applications
don't really care about standardization, because they expect people to use
their client SDKs anyway.

thanks,
Rob