Re: [nfsv4] New Version Notification for draft-haynes-nfsv4-layoutwcc-01.txt

Thomas Haynes <loghyr@hammerspace.com> Fri, 17 March 2023 23:35 UTC

Return-Path: <loghyr@hammerspace.com>
X-Original-To: nfsv4@ietfa.amsl.com
Delivered-To: nfsv4@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9C658C1522BE for <nfsv4@ietfa.amsl.com>; Fri, 17 Mar 2023 16:35:16 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=hammerspace.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Gx-HICCdfP_Z for <nfsv4@ietfa.amsl.com>; Fri, 17 Mar 2023 16:35:12 -0700 (PDT)
Received: from NAM10-BN7-obe.outbound.protection.outlook.com (mail-bn7nam10on2072d.outbound.protection.outlook.com [IPv6:2a01:111:f400:7e8a::72d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 328E0C1516E3 for <nfsv4@ietf.org>; Fri, 17 Mar 2023 16:35:11 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=BgsecV3e4w14G8y4RLdIWYH/jrCNIi5qf4fpKswz5lTFzkjXsdouXUsfyDyNQgpYfCS7Y/4tEeyPtH5cDtEGOEsRs9qWP2I+a0Cq8CkaG+9Ak8pgEjZrNf8wZZsoShvYcwWz4YxigkLecFm0O/8t9waY/PNurdZc8iuoTL/fukT5awj3DS2K6fypL7hUxTnSVHfmRBWXn/tiiVj37HDXLEidrBR92ady+4lQ1yzEBzyXSjlRTnniouUfbjV051gkJEP3VR9T9KFHt7UmFR8s82jFVfn3lEWosAknicXzjqb/tGPq63LjhbKf9ODxZtADFOntu7OX7kGyxODMOG6n7Q==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=x+7ER8vIFUcvKobKEJYQm4O2UJCYdmcZ9HwfjGuzyGc=; b=OBzY2vJU454AN1ZHO35dEXvUcvmnXi0DjxQJE9bKgHexEbyZ7rk1HgIJyTEm21gbDYz1D8ePs54jTXvj2CmeO8pQ1yOV8l3+VEjMDVVFn/ECKijkL2w32jN2LPWbnykwUyq24b1vcEXyOrtkhevsq3fl9B5s0/OMNN4rcQsJUyjrURS1U/4CCS5sRrSlZQIqTDs0p/MiVC3A/YyArCs7x0DGWkiKJtwQE9UGCW7OM0n6sl+fK4T8wovTkhYRJpeaczwaHGv6QKhCidU8ZFxC5zsINEKTk+l1xUxkj5cnmEtorD+IjOy+5eFINhi6pxBg/6yKCKL6zuWjhoqDVwOo6A==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=hammerspace.com; dmarc=pass action=none header.from=hammerspace.com; dkim=pass header.d=hammerspace.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hammerspace.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=x+7ER8vIFUcvKobKEJYQm4O2UJCYdmcZ9HwfjGuzyGc=; b=UggHUM6gyxCqNlqW+jS52V0qGTYC7cP5z8tUlnnjJJTt46gjk+O/si+zQ/zSb0qu4QDLhTpOrZ309KITBygelRXWlFUELsurOUVB03//jE0Cg1s7rpPWmWB+Zftu0j5doK3nHwLhDZH5Vkswb28FHTGkMBmOjfSAnsKdeHj++MM=
Received: from BY5PR13MB3748.namprd13.prod.outlook.com (2603:10b6:a03:22b::17) by BLAPR13MB4657.namprd13.prod.outlook.com (2603:10b6:208:327::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6178.35; Fri, 17 Mar 2023 23:35:07 +0000
Received: from BY5PR13MB3748.namprd13.prod.outlook.com ([fe80::d9b6:f066:8959:f789]) by BY5PR13MB3748.namprd13.prod.outlook.com ([fe80::d9b6:f066:8959:f789%6]) with mapi id 15.20.6178.033; Fri, 17 Mar 2023 23:35:07 +0000
From: Thomas Haynes <loghyr@hammerspace.com>
To: Rick Macklem <rick.macklem@gmail.com>
CC: NFSv4 <nfsv4@ietf.org>
Thread-Topic: [nfsv4] New Version Notification for draft-haynes-nfsv4-layoutwcc-01.txt
Thread-Index: AQHZWSkbwHE5AbceT0eYyxK/p6eo1w==
Date: Fri, 17 Mar 2023 23:35:07 +0000
Message-ID: <4CE0EA48-25DB-416E-A8AF-98C12F265C34@hammerspace.com>
References: <167690801491.19966.10073497475444708402@ietfa.amsl.com> <593CEF2C-EE09-4CB7-86F3-E84F3C7E35B4@hammerspace.com> <1681714268.9413960.1679079821291.JavaMail.zimbra@desy.de> <CAM5tNy49hNW08xhmpCZW610P3rz+fhsoYmhyzbkx85oUG-7RYA@mail.gmail.com>
In-Reply-To: <CAM5tNy49hNW08xhmpCZW610P3rz+fhsoYmhyzbkx85oUG-7RYA@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-mailer: Apple Mail (2.3731.400.51.1.1)
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=hammerspace.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: BY5PR13MB3748:EE_|BLAPR13MB4657:EE_
x-ms-office365-filtering-correlation-id: d1e38c46-d189-49f1-eac9-08db27403de3
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 0dGUCHQ5KN0sI2vB6bofAMCcgL3GH5P+SPWwFIMTGC6wk8MLd8VF1v2tO7JPpUaTKCDTWM/TUlT4S8NdYPlICjbDsQIXEdLKXAX7PvP/9rn9a4ght2y+lOEimGSZ2MVMHKPP6ca/WndWeJjWmfgubqEB5dFH5TjA68fjs9svL1ehbSl9niGYtHHiqotX2tp4rh/shntuW/IyKuXFinoR5Jqyh2tgt/N+tBVWWbJ/L0JoQ+t1cODHpMa1RWmXZ8DlSwXdVau6lMKyOEhHMFd39M5vYdSsKj4LgzymbcNU6vQnAvwNI779YUwW6DYrqSO/d/ok+JHuFH2cDianPYRmYpw/M0LsxuIDdDn6marSz1Ur6Dae4eJVfuXHkpx3joxmnm0pMTg3EtK2+6ZkM8W/epMGqwN8TSAzfTz9tYmSBxPBbxTro0WeswhVt3Mv96YH59jgK04rlplBquLRnsVpp8vxqUhu8qX/vUHlwRb9UKIcFEPAO7622x7Q+4f9Gz0+vpTFcTYk5uWtzxmcfno0XX+K3qab/eduip372Xt4PF/wQL7Zt1fUEuUDJVfGh8MjW/wFCFxCbMPJRfvZgjo1/LCPvnb+KGxwXZektITPIgEOGqhDrBZbRpfzH3fDIJTTGWyM78pS6xcWyAUegQ0jg8982D2dZ7YcinliF4a+ki+lXh6UE8zXd5541daM3aSNP5DgVci8Qkb/+LA6ye5CODFmgv5ES6SqB67WF6xC98U72UcmbAyHEpR4JCcMbpoXhNkBq9F+eH2bmB5jQsQIog==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BY5PR13MB3748.namprd13.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230025)(366004)(346002)(136003)(376002)(39840400004)(396003)(451199018)(2616005)(6506007)(26005)(6512007)(66574015)(966005)(6486002)(316002)(4326008)(83380400001)(76116006)(66476007)(186003)(53546011)(6916009)(64756008)(66946007)(66556008)(66446008)(478600001)(5660300002)(166002)(15650500001)(41300700001)(2906002)(122000001)(8936002)(8676002)(38070700005)(71200400001)(38100700002)(86362001)(33656002)(36756003)(45980500001); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: FAqaAfPP5HyALun+4jfPxZLwV06QXfs1d+Ii7RtIglGE1fEOF0gW1uu/iyDBqVODGeJ7O3beeqapSz4mxVx2ckoRSHh7Dvl4Tz2etCm/b5jcRWZ0W1bAdxw/oqrctF2NbLw96cL/4yJAfbb+5z26t7f6lUk9ltBjetSXtxMM0WoNRQ9tdT6qhoRUR400d3xLliyooAHj6IijsrMdI/PEd9e7nHVZKpYAIMFgdNhbinYiR8RIagRMF9cMTttOlqHYqzmL9jSZlECfurtMOSreIllr1V4ryq50Yi2vFYTNxEE5D6+5hqUDsV+LtduiROAf0NqJzBlcpvoAty9PTltMlsC08ewhpx2vrle6hG9IA9nAT0RHZCRHr64aN/+m7SFH+NtCbNtvKX5C6ruNd5U//gy2vB6tC1hJORIBTFFp7RNKkEjbxmByKrRsj8PfBr0NoxB1bI6wUDXWTBx3TRbmB8RXVX7EURL3mEBlr1ryG1n44OQ24dIGomP9lemtXby29ioBwY915Y0ovp3Dh8VTlD29C9xeUF+iUK1H8Enhuh5RK+coYJQ63X3uoRb39iA9wzunLdIpyUzVIMcWweOxzPAAp9UK2MA+tsqxejSwQ7rHsrMrBtzmJJ2HxDpkWqorJoUH0IEXV997SeSrtpDwNQSzQ14P7hQ93+PpvwSf5wyh1vG6+yDt+iLlKSwVSuG6KRHFA4l9MC+iHEEhw+N39LPbaF7vjQY06DU8z93wwIMJNEOhJ1EJnXttBXFw2/uwVjkk3dQ3N9UPZdsKE2VsE6VHl/sriCqTsdHxLI8ePl7TmT3s0wp2ea+MS5E7PsJ1x8lJxq1A1Tt3NWVm6L2GjzDZVqUK62k56O0VTnnr0OTTR/tq+CWs6q8fSaQzpLFZEJU+TyzL2loko/TwNC3dasvzrFQN7g7+rcYCJKVXe7YwDuLz2nADAciG8J8xsLH6zztJZqc9QpfbpBsduYpbpSzHYwy+GKMowU+AZfJ+p6NrqcMWWta0o6Tcvt0ZXElJOyz7vuKDk4xkc+9Xe2xAs+VFpebkd2s7A/zXVIEtbGNdGn3D5btA4boeObx9+BzFjdG2QN7segBGx5rXIRQudIm8GiT7Z41u6wDvQ+FGGkD5GLs1IZX8XXHNiF1tJRgr1rIvtZLJBHe3ueeUQjaainWo3ovdHtifGIX8rZo0eXytm6/+vBeRuY0cHz7cAHiRzdJS0usK888FXWNeKkzWYgwvr+WHlCZwRMqZAzRIb4NaLw5NBiXu4Fn7I0UP790vjaqO2Y8aUovZVZ3vyDmDxxaQsslYyU9j90cpNvbWsCsACMeJKXvBIu8HpV2wWAQ92qjsDD/c78sn99yxg/DbFBbJ01rK6afHDC3jUDpouvlIcbLHpWswD1VMTkOOwP2sCx7j/IGWButffir/DjazX050Y/3GegfwuqqogTXxz5UYacDKZCvPDqWBJZhJ4rFb8gctsHoncVJ0lrDIQR9jCWhoGnuspxFpBfAqpu86VYgrAcvQhIS1BA1d8SqKkB8dv7MwKzQWUI57eH1/PPYZ3uyTEoFLkq0faIDHZPTmHBHGYaus7kXcbF0RmHdWTM36aCoca5Tq84/LqErHz71KxA==
Content-Type: multipart/alternative; boundary="_000_4CE0EA4825DB416EA8AF98C12F265C34hammerspacecom_"
MIME-Version: 1.0
X-OriginatorOrg: hammerspace.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BY5PR13MB3748.namprd13.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: d1e38c46-d189-49f1-eac9-08db27403de3
X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Mar 2023 23:35:07.2633 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 0d4fed5c-3a70-46fe-9430-ece41741f59e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: CPoLMb5F7hFGC+sr1QPIekLHxipMJJEOj9Ewb1SNoZutxb5Av4uU+Ug5YnB8rXzIoyzOcbMOfMjyOLcesxf2pQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLAPR13MB4657
Archived-At: <https://mailarchive.ietf.org/arch/msg/nfsv4/JzEBxLwyAfRnHpK_8nFk1TMygXw>
Subject: Re: [nfsv4] New Version Notification for draft-haynes-nfsv4-layoutwcc-01.txt
X-BeenThere: nfsv4@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nfsv4/>
List-Post: <mailto:nfsv4@ietf.org>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 17 Mar 2023 23:35:16 -0000


On Mar 17, 2023, at 4:19 PM, Rick Macklem <rick.macklem@gmail.com> wrote:

Here are a few generic comments...
As it stands, I could not implement this in a way that I would think
would be useful.

- There is no indication when the client should issue this operation to
 the MDS. I'd suggest something like "whenever the client expects attributes
 related to writing is up-to-date for a Getattr against the MDS" or something
 like that.


This is a fair ask, I’ll add wording to that effect.



 --> As a client implementor, I need to know when to do this..

Which attributes? It doesn't seem to get specific about what attributes.
I'd suggest a specific list. Possibly:
Size
Change
TimeModify
SpaceUsed
and maybe TimeAccess?

Again, a good point. I’ll add text for this as well.



Change is going to be problematic for NFSv3 DSs.
Maybe a mechanism similar to what is defined for handling
Change when a client holds a Write delegation can be used?

When I did the pNFS flexfile layout client, I did a LayoutCommit
whenever the client needs up-to-date attrbute values, because I
thought that was what LayoutCommit would be useful for.
--> If the client does this, the pNFS flexfiles layout server only needs
     to get up-to-date attributes from the DS at that point in time and
     can cache them in the MDS otherwise, unless there are Getattr
     requests from client(s) that do not do pNFS, such as NFSv3/v4.0
     clients.
--> I discovered that the Linux client does not do LayoutCommit for
     some cases where it expects the above attributes to be up-to-date,
     so I was forced to query the DS whenever the MDS receives a
     Getattr and any RW layout for the file has been given out.

This is a GETATTR which asks for size, space_used, or one of the times, right?

Also, what do you do during grace recovery? Are you keeping track of open files across restarts?

Or when you see the client doing an OPEN previous, do you refresh your attrs?



     (The description of when to do LayoutCommit is vague in the RFCs.
       I recall the Linux client doesn't do a LayoutCommit unless it needs
       to also do a Commit to the DS.)

My point is, this situation can be improved if there is a well defined
"if the client expects up-to-date attributes, it must do this".

In general, for this to be useful for me to implement (client and server),
I need more specifics w.r.t. what attributes, when the Layout_wcc must
be done.

Okay, I can’t do a new version for two weeks because of the quiet period with the IETF.

Thanks for the review!



rick

----- Original Message -----
From: "Thomas Haynes" <loghyr@hammerspace.com>
To: "NFSv4" <nfsv4@ietf.org>
Sent: Monday, 20 February, 2023 16:48:45
Subject: [nfsv4] Fwd: New Version Notification for draft-haynes-nfsv4-layoutwcc-01.txt

This version addresses the issue that the draft is NFSv3 Flex Files only.

Thanks,
Tom

Begin forwarded message:

From: internet-drafts@ietf.org
Subject: New Version Notification for draft-haynes-nfsv4-layoutwcc-01.txt
Date: February 20, 2023 at 7:46:54 AM PST
To: "Thomas Haynes" <loghyr@hammerspace.com>, "Trond Myklebust"
<trondmy@hammerspace.com>


A new version of I-D, draft-haynes-nfsv4-layoutwcc-01.txt
has been successfully submitted by Thomas Haynes and posted to the
IETF repository.

Name: draft-haynes-nfsv4-layoutwcc
Revision: 01
Title: Add LAYOUT_WCC to NFSv4.2
Document date: 2023-02-20
Group: Individual Submission
Pages: 9
URL:
https://www.ietf.org/archive/id/draft-haynes-nfsv4-layoutwcc-01.txt
Status:         https://datatracker.ietf.org/doc/draft-haynes-nfsv4-layoutwcc/
Html:
https://www.ietf.org/archive/id/draft-haynes-nfsv4-layoutwcc-01.html
Htmlized:
https://datatracker.ietf.org/doc/html/draft-haynes-nfsv4-layoutwcc
Diff:
https://author-tools.ietf.org/iddiff?url2=draft-haynes-nfsv4-layoutwcc-01

Abstract:
The Parallel Network File System (pNFS) Flexible File Layout allows
for a file's metadata (MDS) and data (DS) to be on different servers.
It does not provide a mechanism for the data server to update the
metadata server of changes to the data part of the file.  The client
has knowledge of such updates, but lacks the ability to update the
metadata server.  This document presents a refinement to RFC8434 to
allow the client to update the metadata server to changes on the data
server.




The IETF Secretariat




_______________________________________________
nfsv4 mailing list
nfsv4@ietf.org
https://www.ietf.org/mailman/listinfo/nfsv4
_______________________________________________
nfsv4 mailing list
nfsv4@ietf.org
https://www.ietf.org/mailman/listinfo/nfsv4

_______________________________________________
nfsv4 mailing list
nfsv4@ietf.org<mailto:nfsv4@ietf.org>
https://www.ietf.org/mailman/listinfo/nfsv4