Re: [nfsv4] New Version Notification for draft-bhalevy-nfs-obj-00.txt

Benny Halevy <bhalevy@tonian.com> Thu, 11 October 2012 18:48 UTC

Return-Path: <bhalevy@tonian.com>
X-Original-To: nfsv4@ietfa.amsl.com
Delivered-To: nfsv4@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1061721F8513 for <nfsv4@ietfa.amsl.com>; Thu, 11 Oct 2012 11:48:55 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.599
X-Spam-Level:
X-Spam-Status: No, score=-3.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_LOW=-1]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id w3m9xeoYOIlP for <nfsv4@ietfa.amsl.com>; Thu, 11 Oct 2012 11:48:53 -0700 (PDT)
Received: from mail-wi0-f178.google.com (mail-wi0-f178.google.com [209.85.212.178]) by ietfa.amsl.com (Postfix) with ESMTP id 5926521F84DD for <nfsv4@ietf.org>; Thu, 11 Oct 2012 11:48:53 -0700 (PDT)
Received: by mail-wi0-f178.google.com with SMTP id hr7so2194909wib.13 for <nfsv4@ietf.org>; Thu, 11 Oct 2012 11:48:52 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding :x-gm-message-state; bh=5OieHgh3Y+F6Q5UVll7ZU7z/127SMwnKviL0id6wUNs=; b=LRozJlJv7iHtHf3vbkTVSfr/2G59yX+rimEHHpcvggscHposDpvzrSGxdafIN+x/KT yLXBWhCYb6PU2ntaAXTAJy4q5WobswyIIZxoNDR187uto9BNGeeQjdPw+4yX8FeB7LVt 8Xbv+UnSmJdnmgQNwanYvIb5+Aks6u+dDhtkksoe9BMancdJsxc4PLdqWxWh9b+EuJ4w VUrQHy7ec7/G3Y6pXjqKHEkyVcXj4PdAwq656SSBmxx7TAWNQbQvySa+gTQ5knUsZlhf 33iDsX1iDHqHfWeszBqf7c2Hs3JYuR3TKxUcFG2NnW4aCGwjPht3NRyz8u1268fRt74C uBkw==
Received: by 10.217.1.79 with SMTP id m57mr1017474wes.121.1349981332514; Thu, 11 Oct 2012 11:48:52 -0700 (PDT)
Received: from bhalevy-lt.il.tonian.com ([109.65.230.12]) by mx.google.com with ESMTPS id dt9sm36594453wib.1.2012.10.11.11.48.50 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 11 Oct 2012 11:48:51 -0700 (PDT)
Message-ID: <5077141F.2090109@tonian.com>
Date: Thu, 11 Oct 2012 20:46:55 +0200
From: Benny Halevy <bhalevy@tonian.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:15.0) Gecko/20120911 Thunderbird/15.0.1
MIME-Version: 1.0
To: "Haynes, Tom" <Tom.Haynes@netapp.com>
References: <937479903.24.1349656036910.JavaMail.root@thunderbeast.private.linuxbox.com> <1781310085.26.1349656631846.JavaMail.root@thunderbeast.private.linuxbox.com> <78txu43ffi.wl%aemerson@linuxbox.com> <D54C745FA96F75489B58FCBD8956AE8F0989CC82@SACEXCMBX04-PRD.hq.netapp.com>
In-Reply-To: <D54C745FA96F75489B58FCBD8956AE8F0989CC82@SACEXCMBX04-PRD.hq.netapp.com>
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: 7bit
X-Gm-Message-State: ALoCoQk2rOxSxJxsBogNhPGh9/a0JRluhWylJAOl73JrEWzDVMvr1zsag3y4VdRuui1zpfjsHh2L
Cc: nfsv4 list <nfsv4@ietf.org>
Subject: Re: [nfsv4] New Version Notification for draft-bhalevy-nfs-obj-00.txt
X-BeenThere: nfsv4@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/nfsv4>
List-Post: <mailto:nfsv4@ietf.org>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 11 Oct 2012 18:48:55 -0000

On 2012-10-08 22:46, Haynes, Tom wrote:
> Hi Adam!
> 
> 
> 
> On Oct 8, 2012, at 2:57 PM, Adam C. Emerson <aemerson@linuxbox.com> wrote:
> 
>> Salutations,
>>
>> At Sun, 7 Oct 2012 20:37:11 -0400 (EDT), Matt W. Benjamin wrote:
>>> ----- "Tom Haynes" <Tom.Haynes@netapp.com> wrote:
>> [snip]
>>>
>>>> By the way, fine with such a proposal does not mean I think it would
>>>> be wise to implement. These
>>>> NFS devices presented here have to be very dumb because of the lack of
>>>> a control protocol between
>>>> them and the MDS. I don't see how they handle locks, stateids, and any
>>>> state in general. Once we
>>>> throw in sparse files in NFSv4.2, I don't see how they would be
>>>> communicated.
>> [snip]
>>
>> As Matt mentioned, the draft as written certainly supports dumb NFS
>> servers with no knowledge that they are participating as data servers,
>> but does not seem to outlaw a control protocol.  As to sparse files,
>> the description of READ_PLUS in the NFSv4.2 draft says:
>>
>>   If the data to be returned is comprised entirely of zeros, then the
>>   server may elect to return that data as a hole.  The server
>>   differentiates this to the client by setting di_allocated to TRUE
>>   in this case.  Note that in such a scenario, the server is not
>>   required to determine the full extent of the "hole" - it does not
>>   need to determine where the zeros start and end.
>>
>> I read this to mean that even a relatively dumb data server that knows
>> it contains a sparse region can return this fact to the client without
>> having to worry about the content of other data servers, if the server
>> were to issue a layout with major version 4 and minor version 2.
> 
> 
> Lets pick something that needs more communication - say Labeled NFS.
> How does the MDS communicate the label to the DSes?
> 
> When it recalls the delegation, how is fencing supported against
> client ops?
> 
> 
>>
>> We believe this layout type could be productively expanded with a
>> transport type for NFSv4.1 that indicated it should be treated as a
>> data server, including the communication of the stateid.  This would
>> combine the improved data server semantics with the more capable
>> description of the object layout, giving the best of both worlds.
> 
> 
> I just don't see it right now in the draft as it is - not arguing against
> it, just have concerns it is not being explored well enough.
> 
> One thing that bugs me about the draft is in figuring out when READ
> means an OSD READ, a NFS READ, etc. This lack of clarity makes
> it difficult to follow the flow of interaction with the MDS, DS as an OSD,
> and DS as an NFS Server.
> 

I'll try to clarify that in the next version.

Benny

>>
>> We also believe that this layout type should be expanded with a
>> packing flag to allow it to support sparse as well as dense packing,
>> as sparse packing is superior for systems using irregular striping
>> patterns.
> 
> 
> Bring that up with Benny.
> 
> 
>>
>> Respectfully yours,
>>
>> Adam C. Emerson                                  <aemerson@linuxbox.com>
> 
> And I hope I was respectful back!
> Tom
> _______________________________________________
> nfsv4 mailing list
> nfsv4@ietf.org
> https://www.ietf.org/mailman/listinfo/nfsv4
>