Re: [nfsv4] Write-behind caching

Thomas Haynes <thomas@netapp.com> Tue, 02 November 2010 16:50 UTC

Return-Path: <Thomas.Haynes@netapp.com>
X-Original-To: nfsv4@core3.amsl.com
Delivered-To: nfsv4@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 27EEC28C122 for <nfsv4@core3.amsl.com>; Tue, 2 Nov 2010 09:50:48 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.307
X-Spam-Level:
X-Spam-Status: No, score=-9.307 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, MISSING_HEADERS=1.292, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jXBEBcTg3Tka for <nfsv4@core3.amsl.com>; Tue, 2 Nov 2010 09:50:47 -0700 (PDT)
Received: from mx2.netapp.com (mx2.netapp.com [216.240.18.37]) by core3.amsl.com (Postfix) with ESMTP id 204BE28C105 for <nfsv4@ietf.org>; Tue, 2 Nov 2010 09:50:47 -0700 (PDT)
X-IronPort-AV: E=Sophos;i="4.58,283,1286175600"; d="scan'208";a="476566939"
Received: from smtp1.corp.netapp.com ([10.57.156.124]) by mx2-out.netapp.com with ESMTP; 02 Nov 2010 09:50:36 -0700
Received: from sacrsexc2-prd.hq.netapp.com (sacrsexc2-prd.hq.netapp.com [10.99.115.28]) by smtp1.corp.netapp.com (8.13.1/8.13.1/NTAP-1.6) with ESMTP id oA2GoXoM022569; Tue, 2 Nov 2010 09:50:36 -0700 (PDT)
Received: from rtprsexc2-prd.hq.netapp.com ([10.100.161.115]) by sacrsexc2-prd.hq.netapp.com with Microsoft SMTPSVC(6.0.3790.3959); Tue, 2 Nov 2010 09:50:32 -0700
Received: from RTPMVEXC1-PRD.hq.netapp.com ([10.100.161.111]) by rtprsexc2-prd.hq.netapp.com with Microsoft SMTPSVC(6.0.3790.3959); Tue, 2 Nov 2010 12:50:31 -0400
Received: from paresh-veeras-macbook-pro.local ([10.58.54.189]) by RTPMVEXC1-PRD.hq.netapp.com with Microsoft SMTPSVC(6.0.3790.3959); Tue, 2 Nov 2010 12:50:30 -0400
Mime-Version: 1.0 (Apple Message framework v1081)
Content-Type: text/plain; charset="us-ascii"
From: Thomas Haynes <thomas@netapp.com>
In-Reply-To: <1288707482.2925.44.camel@heimdal.trondhjem.org>
Date: Tue, 02 Nov 2010 11:47:59 -0500
Cc: nfsv4@ietf.org
Content-Transfer-Encoding: 7bit
Message-Id: <1F444758-2725-48E4-A56D-8BEB9AB4C154@netapp.com>
X-OriginalArrivalTime: 02 Nov 2010 16:50:31.0694 (UTC) FILETIME=[0FBA0AE0:01CB7AAE]
Subject: Re: [nfsv4] Write-behind caching
X-BeenThere: nfsv4@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/nfsv4>
List-Post: <mailto:nfsv4@ietf.org>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 02 Nov 2010 16:50:48 -0000

References: <BF3BB6D12298F54B89C8DCC1E4073D80028C76DB@CORPUSMX50A.corp.emc.com> <E043D9D8EE3B5743B8B174A814FD584F0D498D54@TK5EX14MBXC126.redmond.corp.microsoft.com> <BF3BB6D12298F54B89C8DCC1E4073D80028C76E0@CORPUSMX50A.corp.emc.com> <E043D9D8EE3B5743B8B174A814FD584F0D498E1D@TK5EX14MBXC126.redmond.corp.microsoft.com> <BF3BB6D12298F54B89C8DCC1E4073D80028C76EA@CORPUSMX50A.corp.emc.com> <4CC7B3AE.8000802@gmail.com> <AANLkTi=gD+qr-OhJuf19miV60w9t9TbJiopNS6y4-YVA@mail.gmail.com> <1288186821.8477.28.camel@heimdal.trondhjem.org> <BF3BB6D12298F54B89C8DCC1E4073D80028C7A3E@CORPUSMX50A.corp.emc.com> <op.vk8tpuc5unckof@usensfaibisl2e.eng.emc.com> <4CC857D5.5010104@panasas.com> <op.vk8vpbldunckof@usensfaibisl2e.eng.emc.com> <BF3BB6D12298F54B89C8DCC1E4073D80028C80AB@CORPUSMX50A.corp.emc.com> <1288373995.3701.35.camel@heimdal.trondhjem.org> <op.vlcwr1zqunckof@usensfaibisl2e.eng.emc.com> <1288388933.3701.47.camel@heimdal.trondhjem.org> <1288389823.3701.59.camel@heimdal.trondhjem.org> <BF3BB6!
 D12298F54B89C8DCC1E4073D80029446BC@CORPUSMX50A.corp.emc.com> <1288707482.2925.44.camel@heimdal.trondhjem.org>
To: Trond Myklebust <trond.myklebust@fys.uio.no>
X-Mailer: Apple Mail (2.1081)
Return-Path: thomas@netapp.com
X-OriginalArrivalTime: 02 Nov 2010 16:50:30.0913 (UTC) FILETIME=[0F42DF10:01CB7AAE]


On Nov 2, 2010, at 9:18 AM, Trond Myklebust wrote:

> 
> * While this may lead to layout bouncing between clients and/or
> the server, the clients do have the option of detecting this,
> and choosing write through MDS to improve efficiency. Grabbing
> the layout, and blocking others from accessing the data while
> you write is not a scalable solution even if you do believe
> there is a valid scenario for this behaviour.


With multi-segment layouts, this makes me think of a really coarse
grained locking mechanism where client A grabs layout segment 1
for writing and client B grabs layout segment 2 for writing. 

Hmm, even without multiple "physical" segments (i.e., different DSes
behind the layouts), client A could ask for a layout for the first 1G
and client B could ask for a layout on the second 1G. client A
SHOULD not assume anything about the layout outside of the
range it has grabbed.

BTW - yes I have hijacked this thread for my own amusement and no,
I am not advocating clients take this approach.