Re: [ftpext] Question about draft-bryan-ftp-hash-07

Mat Berchtold <mb@smartftp.com> Fri, 26 November 2010 08:10 UTC

Return-Path: <mb@smartftp.com>
X-Original-To: ftpext@core3.amsl.com
Delivered-To: ftpext@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id C14E93A6A57 for <ftpext@core3.amsl.com>; Fri, 26 Nov 2010 00:10:50 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.299
X-Spam-Level:
X-Spam-Status: No, score=-2.299 tagged_above=-999 required=5 tests=[AWL=0.300, BAYES_00=-2.599]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id I5epe8KyZXDF for <ftpext@core3.amsl.com>; Fri, 26 Nov 2010 00:10:47 -0800 (PST)
Received: from mail.smartftp.com (mail.smartftp.com [75.126.59.172]) by core3.amsl.com (Postfix) with ESMTP id 3E5683A6988 for <ftpext@ietf.org>; Fri, 26 Nov 2010 00:10:46 -0800 (PST)
Received: from mx.smartsoft.local ([2002:4b7e:3bac::4b7e:3bac]) by mx.smartsoft.local ([2002:4b7e:3bac::4b7e:3bac]) with mapi; Fri, 26 Nov 2010 02:11:53 -0600
From: Mat Berchtold <mb@smartftp.com>
To: Anthony Bryan <anthonybryan@gmail.com>, Robert McMurray <robmcm@microsoft.com>
Date: Fri, 26 Nov 2010 02:11:42 -0600
Thread-Topic: [ftpext] Question about draft-bryan-ftp-hash-07
Thread-Index: Act7uBgiOrxcUhw5RhKMIKPLx+OxjARiPObg
Message-ID: <41871DBEA4CB724B93AC2D8CAADADBF41463C770CF@mx.smartsoft.local>
References: <A5FC996C3C37DC4DA5076F1046B5674C3D2B58B3@TK5EX14MBXC127.redmond.corp.microsoft.com> <AANLkTikG8XVKQ7pLq+bcGhAk=UrJiS05vbkib7jQde_Y@mail.gmail.com> <AANLkTi=kP7j1Q4JmWSeG-qsuCwGdWoAAGbujbpCjOERE@mail.gmail.com>
In-Reply-To: <AANLkTi=kP7j1Q4JmWSeG-qsuCwGdWoAAGbujbpCjOERE@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Cc: "ftpext@ietf.org" <ftpext@ietf.org>
Subject: Re: [ftpext] Question about draft-bryan-ftp-hash-07
X-BeenThere: ftpext@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: <ftpext.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/ftpext>, <mailto:ftpext-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/ftpext>
List-Post: <mailto:ftpext@ietf.org>
List-Help: <mailto:ftpext-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ftpext>, <mailto:ftpext-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 26 Nov 2010 08:10:51 -0000

> the newest HASH draft uses a new code: 556.
Good idea. I have updated the proftpd mod_digest module to use the same error code as well. I also plan to add support for the HASH command within the next couple of weeks.

Mat

-----Original Message-----
From: Anthony Bryan [mailto:anthonybryan@gmail.com] 
Sent: Thursday, 04 November, 2010 01:29
To: Robert McMurray; Mat Berchtold
Cc: ftpext@ietf.org
Subject: Re: [ftpext] Question about draft-bryan-ftp-hash-07

On Thu, Sep 16, 2010 at 1:28 AM, Anthony Bryan <anthonybryan@gmail.com> wrote:
> On Fri, Aug 20, 2010 at 6:01 PM, Robert McMurray <robmcm@microsoft.com> wrote:
>> With that in mind, I've been thinking through implementation scenarios in the wake of the denial-of-service discussion that took place before IETF 78. More specifically, I've thinking about a scenario where the maximum file size could be configured at the server, so HASH commands could be prevented from stealing too many server resources when larger files are involved. This is purely a server implementation detail that has nothing to do with the draft with the exception of considering which reply code to return.
>>
>> Looking at section "3.4. HASH Command Errors" in the draft it would seem that none of the 5yz errors that are listed would apply, but returning a 504 reply might seem to make sense in this scenario. If so, would it be worthwhile to add a statement like the following to the draft?
>>
>>   The server-PI SHOULD reply with a 504 reply if the HASH command is
>>   used on a file that cannot be processed for policy reasons. (For
>>   example, the file size exceeds the server's hashing policy.)
>>
>> Or would a 4yz reply be better since this is a configurable option at the server? Perhaps a 452 reply?
>
> revisiting this, Mathias Berchtold is an implementer (ProFTPD module 
> mod_digest, http://www.smartftp.com/oss/proftpd/mod_digest.html ) of 
> the alternate non-standard commands (XCRC, XMD5, XSHA1, SHA256) that 
> HASH is trying to standardize.
>
> mod_digest uses 550 reply code for the case that Robert mentioned of a 
> file not being allowed to be hashed because of a policy.
>
> "The DigestMaxSize directive configures the maximum number of bytes a 
> single hash command is allowed to read from a file. If the number of 
> bytes to be read from the file is greater than the configured limit 
> the server will return an error. If no DigestMaxSize directive is 
> configured, then there is no limit. It is stronly recommended to set 
> an upper limit."
>
> R_550, "%s: Length (%zu) greater than " CONFIG_DIGEST_MAXSIZE " (%zu) 
> config value", cmd->arg, lLength, lMaxSize);
>
> Mathias, any suggestions as an implementer?
>
> we use 550 already for file not found.
>
>      550 Requested action not taken.
>          File unavailable (e.g., file not found, no access).
>
> we don't seem to have a specific reply code that fits this case currently.
> should we mint a new reply code (55z since it's permanent & deals with 
> file system) or use another existing code that isn't an exact fit?

the newest HASH draft uses a new code: 556.

http://tools.ietf.org/html/draft-bryan-ftp-hash

comments? here's the new text.

 	   The server-PI SHOULD reply with a 556 reply if the HASH command is	
 	   used on a file that cannot be processed for policy reasons.  (For	
 	   example, if the file size exceeds the server's hashing policy.)

later:

 	   Server operators might wish to allow the HASH command but restrict	
 	   its use to certain files, for example, if the file size exceeds the	
 	   server's hashing policy.  A client MUST be able to understand that	
 	   refusal to process HASH commands may be permanent (if indicated by a	
 	   556 response) and will not be honoured later.

--
(( Anthony Bryan ... Metalink [ http://www.metalinker.org ]
  )) Easier, More Reliable, Self Healing Downloads