Re: [nfsv4] Write-behind caching

Trond Myklebust <trond.myklebust@fys.uio.no> Fri, 05 November 2010 14:07 UTC

Return-Path: <trond.myklebust@fys.uio.no>
X-Original-To: nfsv4@core3.amsl.com
Delivered-To: nfsv4@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id D5D663A6767 for <nfsv4@core3.amsl.com>; Fri, 5 Nov 2010 07:07:02 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.599
X-Spam-Level:
X-Spam-Status: No, score=-6.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9ZDuJWj-tKD2 for <nfsv4@core3.amsl.com>; Fri, 5 Nov 2010 07:07:02 -0700 (PDT)
Received: from mail-out2.uio.no (mail-out2.uio.no [129.240.10.58]) by core3.amsl.com (Postfix) with ESMTP id 9B07F3A6452 for <nfsv4@ietf.org>; Fri, 5 Nov 2010 07:07:01 -0700 (PDT)
Received: from mail-mx4.uio.no ([129.240.10.45]) by mail-out2.uio.no with esmtp (Exim 4.69) (envelope-from <trond.myklebust@fys.uio.no>) id 1PEMwi-0003VU-Ew; Fri, 05 Nov 2010 15:07:12 +0100
Received: from c-68-40-206-115.hsd1.mi.comcast.net ([68.40.206.115] helo=[192.168.1.29]) by mail-mx4.uio.no with esmtpsa (SSLv3:CAMELLIA256-SHA:256) user trondmy (Exim 4.69) (envelope-from <trond.myklebust@fys.uio.no>) id 1PEMwh-0002mm-Oy; Fri, 05 Nov 2010 15:07:12 +0100
From: Trond Myklebust <trond.myklebust@fys.uio.no>
To: david.noveck@emc.com
In-Reply-To: <BF3BB6D12298F54B89C8DCC1E4073D8002944F1E@CORPUSMX50A.corp.emc.com>
References: <BF3BB6D12298F54B89C8DCC1E4073D80028C76DB@CORPUSMX50A.corp.emc.com> <BF3BB6D12298F54B89C8DCC1E4073D80028C76EA@CORPUSMX50A.corp.emc.com> <4CC7B3AE.8000802@gmail.com> <AANLkTi=gD+qr-OhJuf19miV60w9t9TbJiopNS6y4-YVA@mail.gmail.com> <1288186821.8477.28.camel@heimdal.trondhjem.org> <BF3BB6D12298F54B89C8DCC1E4073D80028C7A3E@CORPUSMX50A.corp.emc.com> <op.vk8tpuc5unckof@usensfaibisl2e.eng.emc.com> <4CC857D5.5010104@panasas.com> <op.vk8vpbldunckof@usensfaibisl2e.eng.emc.com> <BF3BB6D12298F54B89C8DCC1E4073D80028C80AB@CORPUSMX50A.corp.emc.com> <1288373995.3701.35.camel@heimdal.trondhjem.org> <op.vlcwr1zqunckof@usensfaibisl2e.eng.emc.com> <1288388933.3701.47.camel@heimdal.trondhjem.org> <1288389823.3701.59.camel@heimdal.trondhjem.org> <BF3BB6D12298F54B89C8DCC1E4073D80029446BC@CORPUSMX50A.corp.emc.com> <1288707482.2925.44.camel@heimdal.trondhjem.org> <op.vljy4pqaunckof@usensfaibisl2e.eng.emc.c! om> <BF3BB6D12298F54B89C8DCC1E4073D8002944A75@CORPUSMX50A.corp.emc.com> <4CD17BFE.8000707@panasas.com! > <7C4DFC E962635144B8FAE8CA11D0BF1E03D58B97E2@MX14A.corp.emc.com> <BF3BB6D12298F54B89C8DCC1E4073D8002944F1E@CORPUSMX50A.corp.emc.com>
Content-Type: text/plain; charset="UTF-8"
Date: Fri, 05 Nov 2010 10:07:08 -0400
Message-ID: <1288966028.13204.4.camel@heimdal.trondhjem.org>
Mime-Version: 1.0
X-Mailer: Evolution 2.32.0 (2.32.0-2.fc14)
Content-Transfer-Encoding: 7bit
X-UiO-Ratelimit-Test: rcpts/h 6 msgs/h 2 sum rcpts/h 7 sum msgs/h 2 total rcpts 1136 max rcpts/h 20 ratelimit 0
X-UiO-Spam-info: not spam, SpamAssassin (score=-5.0, required=5.0, autolearn=disabled, UIO_MAIL_IS_INTERNAL=-5, uiobl=NO, uiouri=NO)
X-UiO-Scanned: C1BA08C50CEAD26317000A764940CB2EC898BF9E
X-UiO-SPAM-Test: remote_host: 68.40.206.115 spam_score: -49 maxlevel 80 minaction 2 bait 0 mail/h: 2 total 449 max/h 7 blacklist 0 greylist 0 ratelimit 0
Cc: bhalevy@panasas.com, nfsv4@ietf.org
Subject: Re: [nfsv4] Write-behind caching
X-BeenThere: nfsv4@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/nfsv4>
List-Post: <mailto:nfsv4@ietf.org>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 05 Nov 2010 14:07:02 -0000

On Thu, 2010-11-04 at 20:46 -0400, david.noveck@emc.com wrote:
> > The multiple pNFS data servers can provide much higher 
> > throughput than the MDS, and hence it should be valid 
> > for a client to cache writes more aggressively when it 
> > has a layout because it can drain its dirty cache faster.
> 
> But the existing text suggests that this very situation, draining the
> dirty data using the layout, should (or might) result in less aggressive
> caching.  The fact that you are doing it in response to a recall means
> that you have a higher drain rate times a limited time, rather than a
> more limited drain rate times an unlimited time.
> 
> I think the question is about how you consider the case "if you cannot
> get the layout back".  If a client is allowed to do writes more
> efficiently despite the recall, why is not allowed to do reads more
> efficiently and similarly delay the recall?  It seems that the same
> performance considerations would apply.  Would you want the client to be
> able to read through the area in the layout in order to use it
> effectively?  I wouldn't think so.
> 
> I've proposed that this choice (the one about the write) be made the
> prerogative of the mapping type specifically.  For pNFS file, I would
> think that the normal assumption when a layout is being recalled is that
> this is part of some sort of restriping and that you will get it back
> and it is better to return the layout as soon as you can.

Writeback policy does not belong in the layout drivers. You may mandate
whatever you like in the spec, but please do realise that it will not be
implemented.

Trond