Re: [nfsv4] LAYOUTCOMMTI clarifications (was Notes from Bakeathon (re-sending))

Benny Halevy <bhalevy@panasas.com> Thu, 21 October 2010 18:05 UTC

Return-Path: <bhalevy@panasas.com>
X-Original-To: nfsv4@core3.amsl.com
Delivered-To: nfsv4@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 275823A6A42 for <nfsv4@core3.amsl.com>; Thu, 21 Oct 2010 11:05:30 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.562
X-Spam-Level:
X-Spam-Status: No, score=-6.562 tagged_above=-999 required=5 tests=[AWL=0.038, BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id tRlpW2xCX6UL for <nfsv4@core3.amsl.com>; Thu, 21 Oct 2010 11:05:28 -0700 (PDT)
Received: from exprod5og114.obsmtp.com (exprod5og114.obsmtp.com [64.18.0.28]) by core3.amsl.com (Postfix) with SMTP id 7CCB03A6866 for <nfsv4@ietf.org>; Thu, 21 Oct 2010 11:05:28 -0700 (PDT)
Received: from source ([67.152.220.89]) by exprod5ob114.postini.com ([64.18.4.12]) with SMTP ID DSNKTMCBSMhtSqNlnhYy7JTFB18LcxuGi7kn@postini.com; Thu, 21 Oct 2010 11:07:04 PDT
Received: from fs1.bhalevy.com ([172.17.33.139]) by daytona.int.panasas.com with Microsoft SMTPSVC(6.0.3790.3959); Thu, 21 Oct 2010 14:07:03 -0400
Message-ID: <4CC08145.7090404@panasas.com>
Date: Thu, 21 Oct 2010 20:07:01 +0200
From: Benny Halevy <bhalevy@panasas.com>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.9) Gecko/20100921 Fedora/3.1.4-1.fc13 Thunderbird/3.1.4
MIME-Version: 1.0
To: Trond Myklebust <trond.myklebust@fys.uio.no>
References: <E043D9D8EE3B5743B8B174A814FD584F0D3F656C@TK5EX14MBXC124.redmond.corp.microsoft.com> <1287680041.9144.2.camel@heimdal.trondhjem.org>
In-Reply-To: <1287680041.9144.2.camel@heimdal.trondhjem.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 8bit
X-OriginalArrivalTime: 21 Oct 2010 18:07:03.0549 (UTC) FILETIME=[C3BA82D0:01CB714A]
Cc: nfsv4 list <nfsv4@ietf.org>
Subject: Re: [nfsv4] LAYOUTCOMMTI clarifications (was Notes from Bakeathon (re-sending))
X-BeenThere: nfsv4@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/nfsv4>
List-Post: <mailto:nfsv4@ietf.org>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 21 Oct 2010 18:05:30 -0000

On 2010-10-21 18:54, Trond Myklebust wrote:
> On Thu, 2010-10-21 at 16:40 +0000, Spencer Shepler wrote:
>> For the LAYOUTCOMMIT issues, at this point it seems some text
>> is needed to further discussion towards closure.  This doesn't 
>> need to be in the form of an I-D at this point given that,
>> as Dave points out, may be an errata for the RFCs.
> 
> I am planning to contribute some errata text for this. I'll notify the
> list as soon as I have a more or less final draft (hopefully in the next
> few days).

I agree that the existing text needs to be clarified, given
the level of discussions we had about it. Thanks!

Though, to me it was pretty clear that we roughly reached consensus (lower
case, not ietf ROUGH CONSENSUS ;-) that LAYOUTCOMMIT is always required for
maintaining stable storage semantics. So, for example the client should not
drop dirty data out of its cached until that data is stable at the DS
and a respective LAYOUTCOMMIT was successfully processed by the server.

It is true that for some server implementations of the files layout,
LAYOUTCOMMIT might be superfluous as they have a state coherent back-end
protocol allowing the MDS and DS to implicitly keep files' metadata in sync
but there could be files-based servers implementing loosely coupled DSs
that will still require LAYOUTCOMMIT from the client for efficient
operation.

I also mentioned Dave Noveck's unofficial proposal from long ago to
extend the WRITE operation response stable_how4 with a LAYOUT_SYNC4 value:

   enum stable_how4 {
           UNSTABLE4       = 0,
           DATA_SYNC4      = 1,
           FILE_SYNC4      = 2
+          LAYOUT_SYNC4    = 3
   };

LAYOUT_SYNC4 on the DS means that the DS data, local metadata, and layout
are on stable storage and so the client does not need to send COMMIT to the DS
nor LAYOUTCOMMIT to the MDS.

Benny

> 
> Cheers
>   Trond
> 
>> Spencer
>>
>>
>>> -----Original Message-----
>>> From: nfsv4-bounces@ietf.org [mailto:nfsv4-bounces@ietf.org] On Behalf Of
>>> sfaibish
>>> Sent: Thursday, October 21, 2010 8:56 AM
>>> To: nfsv4 list
>>> Subject: [nfsv4] Fwd: Notes from Bakeathon (re-sending)
>>>
>>>
>>>
>>> ------- Forwarded message -------
>>> From: sfaibish <sfaibish@emc.com>
>>> To: "nfsv4 list" <nfsv4@ietf.org>
>>> Cc:
>>> Subject: Notes from Bakeathon (re-sending)
>>> Date: Thu, 21 Oct 2010 11:46:17 -0400
>>>
>>>
>>>
>>> ------- Forwarded message -------
>>> From: sfaibish <sfaibish@emc.com>
>>> To: "nfsv4 list" <nfsv4@ietf.org>
>>> Cc:
>>> Subject: Notes from Bakeathon
>>> Date: Thu, 21 Oct 2010 10:11:13 -0400
>>>
>>> As I promissed I worked on the notes from the discussions at BAT.
>>> Attached please find some notes and presentations I want to post on the
>>> BAT web site. Please take a look and see if they are appropriate for
>>> posting. Also feel free to comment discuss in the list the notes and the
>>> discussions. Thank you all
>>>
>>> /Sorin
>>>
>>>
>>>
>>> --
>>> Best Regards
>>>
>>> Sorin Faibish
>>> Corporate Distinguished Engineer
>>> Unified Storage Division
>>>          EMC²
>>> where information lives
>>>
>>> Phone: 508-249-5745
>>> Cellphone: 617-510-0422
>>> Email : sfaibish@emc.com
>> _______________________________________________
>> nfsv4 mailing list
>> nfsv4@ietf.org
>> https://www.ietf.org/mailman/listinfo/nfsv4
> 
> 
> 
> _______________________________________________
> nfsv4 mailing list
> nfsv4@ietf.org
> https://www.ietf.org/mailman/listinfo/nfsv4