Re: Resumable Uploads

Carsten Bormann <cabo@tzi.org> Fri, 19 April 2013 20:10 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2827521F8FED for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Fri, 19 Apr 2013 13:10:08 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -8.274
X-Spam-Level:
X-Spam-Status: No, score=-8.274 tagged_above=-999 required=5 tests=[AWL=2.025, BAYES_00=-2.599, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id W6yYEcqrDFQV for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Fri, 19 Apr 2013 13:10:05 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id B60BB21F8FE3 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Fri, 19 Apr 2013 13:09:59 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1UTHco-0002iL-2I for ietf-http-wg-dist@listhub.w3.org; Fri, 19 Apr 2013 20:09:38 +0000
Resent-Date: Fri, 19 Apr 2013 20:09:38 +0000
Resent-Message-Id: <E1UTHco-0002iL-2I@frink.w3.org>
Received: from lisa.w3.org ([128.30.52.41]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <cabo@tzi.org>) id 1UTHce-0002eV-Fm for ietf-http-wg@listhub.w3.org; Fri, 19 Apr 2013 20:09:28 +0000
Received: from mailhost.informatik.uni-bremen.de ([134.102.201.18] helo=informatik.uni-bremen.de) by lisa.w3.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.72) (envelope-from <cabo@tzi.org>) id 1UTHcd-0000vg-A3 for ietf-http-wg@w3.org; Fri, 19 Apr 2013 20:09:28 +0000
X-Virus-Scanned: amavisd-new at informatik.uni-bremen.de
Received: from smtp-fb3.informatik.uni-bremen.de (smtp-fb3.informatik.uni-bremen.de [134.102.224.120]) by informatik.uni-bremen.de (8.14.4/8.14.4) with ESMTP id r3JK90Ln016875; Fri, 19 Apr 2013 22:09:00 +0200 (CEST)
Received: from [192.168.217.105] (p548909B4.dip0.t-ipconnect.de [84.137.9.180]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by smtp-fb3.informatik.uni-bremen.de (Postfix) with ESMTPSA id 13CB93803; Fri, 19 Apr 2013 22:09:00 +0200 (CEST)
Mime-Version: 1.0 (Mac OS X Mail 6.3 \(1503\))
Content-Type: text/plain; charset="iso-8859-1"
From: Carsten Bormann <cabo@tzi.org>
In-Reply-To: <CABkgnnVFW5zkH-0eY=iyDuFAF9Ua6+4NL26KMP5Nf-cqxmXLJw@mail.gmail.com>
Date: Fri, 19 Apr 2013 22:08:59 +0200
Cc: HTTP Working Group <ietf-http-wg@w3.org>
Content-Transfer-Encoding: quoted-printable
Message-Id: <6FD4A73D-08D9-428B-B15A-935691A32BF9@tzi.org>
References: <CADZbJ9dYFGyrceh03M3B0KdKto7160Dis_geh9um0BhVe1re0g@mail.gmail.com> <alpine.DEB.2.00.1304182006001.21288@tvnag.unkk.fr> <29DE6A70-E3B9-4DCE-8C7E-506F6A0ADC92@gmail.com> <51706F32.5030108@panix.com> <5170E2A3.6010706@gmx.de> <CADZbJ9dGEVq-fQmhjRsddYdcg459r_zLfrOddkzHLOprZM0dNg@mail.gmail.com> <51712A49.6000901@gmx.de> <alpine.DEB.2.00.1304191335410.3525@tvnag.unkk.fr> <CABkgnnVFW5zkH-0eY=iyDuFAF9Ua6+4NL26KMP5Nf-cqxmXLJw@mail.gmail.com>
To: Felix Geisendörfer <felix@transloadit.com>
X-Mailer: Apple Mail (2.1503)
Received-SPF: none client-ip=134.102.201.18; envelope-from=cabo@tzi.org; helo=informatik.uni-bremen.de
X-W3C-Hub-Spam-Status: No, score=-4.6
X-W3C-Hub-Spam-Report: AWL=-2.300, RCVD_IN_DNSWL_MED=-2.3, SPF_HELO_PASS=-0.001
X-W3C-Scan-Sig: lisa.w3.org 1UTHcd-0000vg-A3 7df4b6963e6dd55d36db1d5c07f85f12
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Resumable Uploads
Archived-At: <http://www.w3.org/mid/6FD4A73D-08D9-428B-B15A-935691A32BF9@tzi.org>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/17367
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

On Apr 19, 2013, at 20:09, Martin Thomson <martin.thomson@gmail.com> wrote:

> I find that HTTP uploads are too brittle.

I'd like to understand the failure model a bit better.

Your assumption seems to be that if an upload breaks, it breaks cleanly, i.e. all data that have been received by the server are fine up to the last byte.
That hasn't always been my experience, in particular with broken hotel NATs etc., but it may be good enough if there is some post-resumption check.

The other extreme is doing an HTTP version of rsync, which I think would solve a lot of problems at the same time.

Grüße, Carsten