Re: [ftpext] COMB command IETF draft proposal

Robert McMurray <robmcm@microsoft.com> Wed, 08 June 2011 19:11 UTC

Return-Path: <robmcm@microsoft.com>
X-Original-To: ftpext@ietfa.amsl.com
Delivered-To: ftpext@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 006EC11E8104 for <ftpext@ietfa.amsl.com>; Wed, 8 Jun 2011 12:11:24 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.467
X-Spam-Level:
X-Spam-Status: No, score=-7.467 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_HI=-8, UNRESOLVED_TEMPLATE=3.132]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id WoKe+fJktLrB for <ftpext@ietfa.amsl.com>; Wed, 8 Jun 2011 12:11:23 -0700 (PDT)
Received: from smtp.microsoft.com (smtp.microsoft.com [131.107.115.214]) by ietfa.amsl.com (Postfix) with ESMTP id B75E311E8124 for <ftpext@ietf.org>; Wed, 8 Jun 2011 12:11:23 -0700 (PDT)
Received: from TK5EX14MLTC103.redmond.corp.microsoft.com (157.54.79.174) by TK5-EXGWY-E803.partners.extranet.microsoft.com (10.251.56.169) with Microsoft SMTP Server (TLS) id 8.2.176.0; Wed, 8 Jun 2011 12:11:23 -0700
Received: from DB3EHSOBE006.bigfish.com (157.54.51.81) by mail.microsoft.com (157.54.79.174) with Microsoft SMTP Server (TLS) id 14.1.289.8; Wed, 8 Jun 2011 12:11:23 -0700
Received: from mail10-db3-R.bigfish.com (10.3.81.249) by DB3EHSOBE006.bigfish.com (10.3.84.26) with Microsoft SMTP Server id 14.1.225.22; Wed, 8 Jun 2011 19:11:12 +0000
Received: from mail10-db3 (localhost.localdomain [127.0.0.1]) by mail10-db3-R.bigfish.com (Postfix) with ESMTP id D02F74C0204 for <ftpext@ietf.org.FOPE.CONNECTOR.OVERRIDE>; Wed, 8 Jun 2011 19:11:12 +0000 (UTC)
X-SpamScore: -35
X-BigFish: PS-35(zz9371M111aL4015L103eMzz1202h1082kzz1033IL8275bh8275dhz31h2a8h668h839h61h)
X-Spam-TCS-SCL: 0:0
X-Forefront-Antispam-Report: CIP:157.55.61.146; KIP:(null); UIP:(null); IPV:SKI; H:CH1PRD0302HT006.namprd03.prod.outlook.com; R:internal; EFV:INT
Received-SPF: softfail (mail10-db3: transitioning domain of microsoft.com does not designate 157.55.61.146 as permitted sender) client-ip=157.55.61.146; envelope-from=robmcm@microsoft.com; helo=CH1PRD0302HT006.namprd03.prod.outlook.com ; .outlook.com ;
Received: from mail10-db3 (localhost.localdomain [127.0.0.1]) by mail10-db3 (MessageSwitch) id 1307560272664149_29719; Wed, 8 Jun 2011 19:11:12 +0000 (UTC)
Received: from DB3EHSMHS018.bigfish.com (unknown [10.3.81.244]) by mail10-db3.bigfish.com (Postfix) with ESMTP id 93AE8160004F; Wed, 8 Jun 2011 19:11:12 +0000 (UTC)
Received: from CH1PRD0302HT006.namprd03.prod.outlook.com (157.55.61.146) by DB3EHSMHS018.bigfish.com (10.3.87.118) with Microsoft SMTP Server (TLS) id 14.1.225.22; Wed, 8 Jun 2011 19:11:11 +0000
Received: from CH1PRD0302MB131.namprd03.prod.outlook.com ([169.254.11.42]) by CH1PRD0302HT006.namprd03.prod.outlook.com ([10.28.29.125]) with mapi id 14.01.0225.052; Wed, 8 Jun 2011 19:11:10 +0000
From: Robert McMurray <robmcm@microsoft.com>
To: Robert Oslin <rto@globalscape.com>, "ftpext@ietf.org" <ftpext@ietf.org>
Thread-Topic: [ftpext] COMB command IETF draft proposal
Thread-Index: AQHMJfeJg/z1R+i7P06/FZc6+arpxJSzzQBQ
Date: Wed, 08 Jun 2011 19:11:07 +0000
Message-ID: <01AA9EC92749BF4894AC2B3039EA4A2C1946D58A@CH1PRD0302MB131.namprd03.prod.outlook.com>
References: <F15941D3C8A2D54D92B341C20CACDF2311AC408AB1@exchange>
In-Reply-To: <F15941D3C8A2D54D92B341C20CACDF2311AC408AB1@exchange>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [10.28.29.69]
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OrganizationHeadersPreserved: CH1PRD0302HT006.namprd03.prod.outlook.com
X-FOPE-CONNECTOR: Id%0$Dn%*$RO%0$TLS%0$FQDN%$TlsDn%
X-FOPE-CONNECTOR: Id%59$Dn%GLOBALSCAPE.COM$RO%2$TLS%6$FQDN%131.107.125.5$TlsDn%
X-FOPE-CONNECTOR: Id%59$Dn%IETF.ORG$RO%2$TLS%6$FQDN%131.107.125.5$TlsDn%
X-OriginatorOrg: microsoft.com
X-CrossPremisesHeadersPromoted: TK5EX14MLTC103.redmond.corp.microsoft.com
X-CrossPremisesHeadersFiltered: TK5EX14MLTC103.redmond.corp.microsoft.com
Subject: Re: [ftpext] COMB command IETF draft proposal
X-BeenThere: ftpext@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: <ftpext.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ftpext>, <mailto:ftpext-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/ftpext>
List-Post: <mailto:ftpext@ietf.org>
List-Help: <mailto:ftpext-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ftpext>, <mailto:ftpext-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 08 Jun 2011 19:11:25 -0000

Thanks, Robert.

I like the idea behind the COMB command; I could see where this could be quite useful for transferring large files.

One consideration that I have in your draft is verbiage that "The server-FTP process SHOULD delete each of the parts identified by the COMB command once the target file is created." I would think that the cleanup behavior for partial files would be left to the client, since the remaining parts of the draft place the responsibility on the client for splitting the file and keeping track of the parts. For example:

      C> STOR foo.txt
      S> 226 Transfer complete.
      C> STOR bar.txt
      S> 226 Transfer complete.
      C> COMB foobar.txt foo.txt bar.txt
      S> 250 COMB command successful.
      C> DELE foo.txt
      S> 250 DELE command successful.
      C> DELE bar.txt
      S> 250 DELE command successful.

As you mentioned in your draft, it would be advantageous if COMB was used with the HASH command to verify data integrity before the client takes care of the deletion tasks. For example:

      C> OPTS HASH MD5
      S> 200 MD5
      C> STOR foo.txt
      S> 226 Transfer complete.
      C> STOR bar.txt
      S> 226 Transfer complete.
      C> COMB foobar.txt foo.txt bar.txt
      S> 250 COMB command successful.
      C> HASH foobar.txt
      S> 213 MD5 426f62526f636b73 foobar.txt
      C> DELE foo.txt
      S> 250 DELE command successful.
      C> DELE bar.txt
      S> 250 DELE command successful.

Thanks again.

Robert McMurray
robmcm@microsoft.com

------------------------------
From: Robert Oslin [mailto:rto@globalscape.com] 
Sent: Wednesday, June 08, 2011 9:15 AM
To: ftpext@ietf.org
Subject: [ftpext] COMB command IETF draft proposal

"Any submission to the IETF intended by the Contributor for publication as all or part of an IETF Internet-Draft or RFC and any statement made within the context of an IETF activity is considered an "IETF Contribution".

It only took me 10+ years, but here's my contribution the FTP ext community (attached).

Essentially an early draft to ratify the commonly used COMB command for support of multi-part (a.k.a accelerated) uploads. I welcome comments/questions from the community. Ideally redlining the document (or via comments in the doc). I will resubmit using formal IETF draft (in ASCII) once I've addressed all comments/questions in the MS Word version (hope that's ok and doesn't break and IETF rules). 

Thanks,

Robert Oslin
Director of Product Management
Tel: 1 (210) 293-7902
Fax: 1 (210) 690-8824
Send me large files securely

www.globalscape.com
    (NYSE Amex:GSB) *This communication, including attachments, is for the exclusive use of the addressee and may contain proprietary, confidential or privileged information. If you are not the intended recipient, any use, copying, disclosure, dissemination or distribution is strictly prohibited. If you are not the intended recipient, please notify the sender immediately by return email and delete this communication and destroy all copies.