Re: Draft v1 Update for Resumable Uploads

Lucas Pardue <lucaspardue.24.7@gmail.com> Sun, 19 June 2022 15:56 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 667B3C14CF00 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Sun, 19 Jun 2022 08:56:45 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.759
X-Spam-Level:
X-Spam-Status: No, score=-2.759 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.25, HTML_MESSAGE=0.001, MAILING_LIST_MULTI=-1, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 5agSxWCHncPI for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Sun, 19 Jun 2022 08:56:41 -0700 (PDT)
Received: from lyra.w3.org (lyra.w3.org [128.30.52.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 14E31C14F72E for <httpbisa-archive-bis2Juki@lists.ietf.org>; Sun, 19 Jun 2022 08:56:40 -0700 (PDT)
Received: from lists by lyra.w3.org with local (Exim 4.92) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1o2xEq-0008Qk-OW for ietf-http-wg-dist@listhub.w3.org; Sun, 19 Jun 2022 15:53:24 +0000
Resent-Date: Sun, 19 Jun 2022 15:53:24 +0000
Resent-Message-Id: <E1o2xEq-0008Qk-OW@lyra.w3.org>
Received: from mimas.w3.org ([128.30.52.79]) by lyra.w3.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from <lucaspardue.24.7@gmail.com>) id 1o2xEp-0008Pq-2O for ietf-http-wg@listhub.w3.org; Sun, 19 Jun 2022 15:53:23 +0000
Received: from mail-qv1-xf29.google.com ([2607:f8b0:4864:20::f29]) by mimas.w3.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from <lucaspardue.24.7@gmail.com>) id 1o2xEo-000r0g-9G for ietf-http-wg@w3.org; Sun, 19 Jun 2022 15:53:22 +0000
Received: by mail-qv1-xf29.google.com with SMTP id t16so7998153qvh.1 for <ietf-http-wg@w3.org>; Sun, 19 Jun 2022 08:53:21 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=PyyVqmd+U2+bsHfqFlDE8UXxNg9xO9N+mqj7ZQWbSbY=; b=avWlaO+I3AbbGUb3dq/raGuNHNtZ7Kgvu9ancEgS3IJIQi6it/2DZgSbqgKFXsw8Uk ilPM2FRZZ2W0m1n0XhowJAz0WkypazplJgUqVIrLmxn0giEhVpTUG0hhz7wF/26V/SoQ qDk7+vRMEHNKK7bYqyW1AzotacwfgNoKUFwJRErFg0oiRZPdVR3KUZPpl8cV2rPXIe5j hXrHqpgSFATPFX1EsG6GBEoZA9CER4D5dbmJ4nr5gNxf3er0sia4l4CO6Mysn2TR55lT FS9uA6G3auBEF81hCMYAvTKz9FZFj4asczvbU4gY5J0cNpFEIn7RZio+nD1lYwUqk/37 7zcg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=PyyVqmd+U2+bsHfqFlDE8UXxNg9xO9N+mqj7ZQWbSbY=; b=V9BmOrmASMxO1jczxwucRW73TPidxfacwKISFEhmIl50z3Mc2GdGOXtYoswaheqfno nS3fOUlV7MSnlmZ6LapUeoYPAhoDZViQbXt71h0fY59H1++iFUeadQoz4o70DcrK9110 wL7iv2VLm+UZsCCTRXohy8Z/iph+O6vsptKCDBktpaduvLAY8qg7yljNJhramuFXKQhZ /zdiWilcCfh+8qfxRTlOQaBK39MaAy13mWrhhzNSQKi2OgeDlML1H2fSb7q53f5mFEix lp8V/uuwPOjxLHmWuDPwuDtDR6T1ZjLfcmsvjGMCDKWsHFKdjt+zU5tsH2hF6aDtw39/ rorQ==
X-Gm-Message-State: AJIora+r/n4ELizuicuxfl+8P5nIpZbsot+4/L3nJ6HTnUPKDtKIdCIn CNOozfWbQdIg2lTaX+UtUkfpg6FxDP3Dy+TxSJv1P5sHhRY=
X-Google-Smtp-Source: AGRyM1tNOm1yQpor69kfB9S/vFtY2WyCQh0b3GGYcDQvX/K3B6rWsknPu068Ut+hAz4fzqZx0agXcLQdVCIYa7XXCl8=
X-Received: by 2002:ad4:5f46:0:b0:46f:9da8:17cc with SMTP id p6-20020ad45f46000000b0046f9da817ccmr9910198qvg.72.1655653989958; Sun, 19 Jun 2022 08:53:09 -0700 (PDT)
MIME-Version: 1.0
References: <BED5A5BC-3F7F-47E2-815E-DC0483328DFD@apple.com> <Yq67WGkb0LtJIAP9@xps13>
In-Reply-To: <Yq67WGkb0LtJIAP9@xps13>
From: Lucas Pardue <lucaspardue.24.7@gmail.com>
Date: Sun, 19 Jun 2022 16:52:58 +0100
Message-ID: <CALGR9oa-zUTL4z_jrzvknBOoeYoksT-mPgz3m3ddUFzBZZ6khg@mail.gmail.com>
To: Glenn Strauss <gs-lists-ietf-http-wg@gluelogic.com>
Cc: Guoye Zhang <guoye_zhang@apple.com>, HTTP Working Group <ietf-http-wg@w3.org>
Content-Type: multipart/alternative; boundary="000000000000f14b4605e1cefba8"
Received-SPF: pass client-ip=2607:f8b0:4864:20::f29; envelope-from=lucaspardue.24.7@gmail.com; helo=mail-qv1-xf29.google.com
X-W3C-Hub-DKIM-Status: validation passed: (address=lucaspardue.24.7@gmail.com domain=gmail.com), signature is good
X-W3C-Hub-Spam-Status: No, score=-4.9
X-W3C-Hub-Spam-Report: BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, W3C_AA=-1, W3C_IRA=-1, W3C_WL=-1
X-W3C-Scan-Sig: mimas.w3.org 1o2xEo-000r0g-9G 4142de97ebfac1d83ea7fd709ddca0f7
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Draft v1 Update for Resumable Uploads
Archived-At: <https://www.w3.org/mid/CALGR9oa-zUTL4z_jrzvknBOoeYoksT-mPgz3m3ddUFzBZZ6khg@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/40164
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <https://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

Hi Glenn,

I'd like to respond to one aspectdirectly:

On Sun, Jun 19, 2022 at 7:04 AM <gs-lists-ietf-http-wg@gluelogic.com> wrote:

> On Thu, Jun 16, 2022 at 02:30:59PM -0700, Guoye Zhang wrote:
> > Our previous resumable upload draft generated a lot of discussions.
>
> At least in my case, I attempted to be polite after you submitted a
> draft without first doing a survey of existing RFCs.  You admitted no
> knowledge of WebDAV RFCs, which I deemed a large oversight considering
> the nature of the tus-v2 protocol.
>
> > I’m glad to announce that we have a new draft ready to address many
> feedbacks that suggested adopting the PATCH method.
>
> The draft abstract begins with unsubstantiated claims to justify itself,
> and I believe that almost all of those claims are also misleading.
>
> "HTTP clients often encounter interrupted data transfers as a result of
> canceled requests or dropped connections. [...] it is often desirable to
> issue subsequent requests that transfer only the remainder of the
> representation."
>
> The multiple uses of "often" are misrepresentations, IMHO.
>
> A large percentage of HTTP requests are GET/HEAD and have no body.
> A sizable percentage (if not more) of HTTP POST requests are small,
> e.g. using POST as an alternative to GET along with XSRF tokens.
>
> What data do you have to support the claims in the draft Abstract?
> What percentage of requests have request bodies, and further have
> request bodies that are sufficiently large that it is excessively
> wasteful to resend the entire representation? (and when safe to do so!)
>

The text you quote from the tus v2 draft is based on an almost verbatim
section of text from RFC 9110 Section 14 [1], which describes Range
Requests. Quote:

> Clients often encounter interrupted data transfers as a result of
canceled requests or dropped connections. When a client has stored a
partial representation, it is desirable to request the remainder of that
representation in a subsequent request rather than transfer the entire
representation.

I wrote the tus v2 text to explicity juxtapose resumable HTTP downloads
against uploads. To quote the abstract in full:

> HTTP clients often encounter interrupted data transfers as a result
   of canceled requests or dropped connections.  Prior to interruption,
   part of a representation may have been exchanged.  To complete the
   data transfer of the entire representation, it is often desirable to
   issue subsequent requests that transfer only the remainder of the
   representation.  HTTP range requests support this concept of
   resumable downloads from server to client.  This document describes a
   mechanism that supports resumable uploads from client to server using
   HTTP.

If you have concerns about the first instance of "often", I'd suggest
starting a separate thread against RFC 9110. I don't agree this document
has a requirement to justify that as you suggest.

If you have concerns about the second instance of "often", that is perhaps
where we have different readings causing some friction. RFC 9110 doesn't
have any qualification of the term "it is desirable", I used "often" to
dilute this i.e, "often but not always". A different reading is that,
having seen multiple HTTP-based custom resumable upload approaches from
different vendors, there is an unaddressed use case. Hence it is not seldom
that for applicaitons that feature uploads, resumption is desirable.
Either way, I am happy to remove that second "often" or do other
wordsmithing of this sentence that makes it clear why we think this is a
problem worth standardising in the HTTP WG.


Cheers,
Lucas