Re: [nfsv4] New Version Notification for draft-haynes-nfsv4-layoutwcc-01.txt
Thomas Haynes <loghyr@hammerspace.com> Fri, 17 March 2023 23:35 UTC
Return-Path: <loghyr@hammerspace.com>
X-Original-To: nfsv4@ietfa.amsl.com
Delivered-To: nfsv4@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9C658C1522BE for <nfsv4@ietfa.amsl.com>; Fri, 17 Mar 2023 16:35:16 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=hammerspace.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Gx-HICCdfP_Z for <nfsv4@ietfa.amsl.com>; Fri, 17 Mar 2023 16:35:12 -0700 (PDT)
Received: from NAM10-BN7-obe.outbound.protection.outlook.com (mail-bn7nam10on2072d.outbound.protection.outlook.com [IPv6:2a01:111:f400:7e8a::72d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 328E0C1516E3 for <nfsv4@ietf.org>; Fri, 17 Mar 2023 16:35:11 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=BgsecV3e4w14G8y4RLdIWYH/jrCNIi5qf4fpKswz5lTFzkjXsdouXUsfyDyNQgpYfCS7Y/4tEeyPtH5cDtEGOEsRs9qWP2I+a0Cq8CkaG+9Ak8pgEjZrNf8wZZsoShvYcwWz4YxigkLecFm0O/8t9waY/PNurdZc8iuoTL/fukT5awj3DS2K6fypL7hUxTnSVHfmRBWXn/tiiVj37HDXLEidrBR92ady+4lQ1yzEBzyXSjlRTnniouUfbjV051gkJEP3VR9T9KFHt7UmFR8s82jFVfn3lEWosAknicXzjqb/tGPq63LjhbKf9ODxZtADFOntu7OX7kGyxODMOG6n7Q==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=x+7ER8vIFUcvKobKEJYQm4O2UJCYdmcZ9HwfjGuzyGc=; b=OBzY2vJU454AN1ZHO35dEXvUcvmnXi0DjxQJE9bKgHexEbyZ7rk1HgIJyTEm21gbDYz1D8ePs54jTXvj2CmeO8pQ1yOV8l3+VEjMDVVFn/ECKijkL2w32jN2LPWbnykwUyq24b1vcEXyOrtkhevsq3fl9B5s0/OMNN4rcQsJUyjrURS1U/4CCS5sRrSlZQIqTDs0p/MiVC3A/YyArCs7x0DGWkiKJtwQE9UGCW7OM0n6sl+fK4T8wovTkhYRJpeaczwaHGv6QKhCidU8ZFxC5zsINEKTk+l1xUxkj5cnmEtorD+IjOy+5eFINhi6pxBg/6yKCKL6zuWjhoqDVwOo6A==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=hammerspace.com; dmarc=pass action=none header.from=hammerspace.com; dkim=pass header.d=hammerspace.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hammerspace.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=x+7ER8vIFUcvKobKEJYQm4O2UJCYdmcZ9HwfjGuzyGc=; b=UggHUM6gyxCqNlqW+jS52V0qGTYC7cP5z8tUlnnjJJTt46gjk+O/si+zQ/zSb0qu4QDLhTpOrZ309KITBygelRXWlFUELsurOUVB03//jE0Cg1s7rpPWmWB+Zftu0j5doK3nHwLhDZH5Vkswb28FHTGkMBmOjfSAnsKdeHj++MM=
Received: from BY5PR13MB3748.namprd13.prod.outlook.com (2603:10b6:a03:22b::17) by BLAPR13MB4657.namprd13.prod.outlook.com (2603:10b6:208:327::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6178.35; Fri, 17 Mar 2023 23:35:07 +0000
Received: from BY5PR13MB3748.namprd13.prod.outlook.com ([fe80::d9b6:f066:8959:f789]) by BY5PR13MB3748.namprd13.prod.outlook.com ([fe80::d9b6:f066:8959:f789%6]) with mapi id 15.20.6178.033; Fri, 17 Mar 2023 23:35:07 +0000
From: Thomas Haynes <loghyr@hammerspace.com>
To: Rick Macklem <rick.macklem@gmail.com>
CC: NFSv4 <nfsv4@ietf.org>
Thread-Topic: [nfsv4] New Version Notification for draft-haynes-nfsv4-layoutwcc-01.txt
Thread-Index: AQHZWSkbwHE5AbceT0eYyxK/p6eo1w==
Date: Fri, 17 Mar 2023 23:35:07 +0000
Message-ID: <4CE0EA48-25DB-416E-A8AF-98C12F265C34@hammerspace.com>
References: <167690801491.19966.10073497475444708402@ietfa.amsl.com> <593CEF2C-EE09-4CB7-86F3-E84F3C7E35B4@hammerspace.com> <1681714268.9413960.1679079821291.JavaMail.zimbra@desy.de> <CAM5tNy49hNW08xhmpCZW610P3rz+fhsoYmhyzbkx85oUG-7RYA@mail.gmail.com>
In-Reply-To: <CAM5tNy49hNW08xhmpCZW610P3rz+fhsoYmhyzbkx85oUG-7RYA@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-mailer: Apple Mail (2.3731.400.51.1.1)
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=hammerspace.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: BY5PR13MB3748:EE_|BLAPR13MB4657:EE_
x-ms-office365-filtering-correlation-id: d1e38c46-d189-49f1-eac9-08db27403de3
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 0dGUCHQ5KN0sI2vB6bofAMCcgL3GH5P+SPWwFIMTGC6wk8MLd8VF1v2tO7JPpUaTKCDTWM/TUlT4S8NdYPlICjbDsQIXEdLKXAX7PvP/9rn9a4ght2y+lOEimGSZ2MVMHKPP6ca/WndWeJjWmfgubqEB5dFH5TjA68fjs9svL1ehbSl9niGYtHHiqotX2tp4rh/shntuW/IyKuXFinoR5Jqyh2tgt/N+tBVWWbJ/L0JoQ+t1cODHpMa1RWmXZ8DlSwXdVau6lMKyOEhHMFd39M5vYdSsKj4LgzymbcNU6vQnAvwNI779YUwW6DYrqSO/d/ok+JHuFH2cDianPYRmYpw/M0LsxuIDdDn6marSz1Ur6Dae4eJVfuXHkpx3joxmnm0pMTg3EtK2+6ZkM8W/epMGqwN8TSAzfTz9tYmSBxPBbxTro0WeswhVt3Mv96YH59jgK04rlplBquLRnsVpp8vxqUhu8qX/vUHlwRb9UKIcFEPAO7622x7Q+4f9Gz0+vpTFcTYk5uWtzxmcfno0XX+K3qab/eduip372Xt4PF/wQL7Zt1fUEuUDJVfGh8MjW/wFCFxCbMPJRfvZgjo1/LCPvnb+KGxwXZektITPIgEOGqhDrBZbRpfzH3fDIJTTGWyM78pS6xcWyAUegQ0jg8982D2dZ7YcinliF4a+ki+lXh6UE8zXd5541daM3aSNP5DgVci8Qkb/+LA6ye5CODFmgv5ES6SqB67WF6xC98U72UcmbAyHEpR4JCcMbpoXhNkBq9F+eH2bmB5jQsQIog==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BY5PR13MB3748.namprd13.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230025)(366004)(346002)(136003)(376002)(39840400004)(396003)(451199018)(2616005)(6506007)(26005)(6512007)(66574015)(966005)(6486002)(316002)(4326008)(83380400001)(76116006)(66476007)(186003)(53546011)(6916009)(64756008)(66946007)(66556008)(66446008)(478600001)(5660300002)(166002)(15650500001)(41300700001)(2906002)(122000001)(8936002)(8676002)(38070700005)(71200400001)(38100700002)(86362001)(33656002)(36756003)(45980500001); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: FAqaAfPP5HyALun+4jfPxZLwV06QXfs1d+Ii7RtIglGE1fEOF0gW1uu/iyDBqVODGeJ7O3beeqapSz4mxVx2ckoRSHh7Dvl4Tz2etCm/b5jcRWZ0W1bAdxw/oqrctF2NbLw96cL/4yJAfbb+5z26t7f6lUk9ltBjetSXtxMM0WoNRQ9tdT6qhoRUR400d3xLliyooAHj6IijsrMdI/PEd9e7nHVZKpYAIMFgdNhbinYiR8RIagRMF9cMTttOlqHYqzmL9jSZlECfurtMOSreIllr1V4ryq50Yi2vFYTNxEE5D6+5hqUDsV+LtduiROAf0NqJzBlcpvoAty9PTltMlsC08ewhpx2vrle6hG9IA9nAT0RHZCRHr64aN/+m7SFH+NtCbNtvKX5C6ruNd5U//gy2vB6tC1hJORIBTFFp7RNKkEjbxmByKrRsj8PfBr0NoxB1bI6wUDXWTBx3TRbmB8RXVX7EURL3mEBlr1ryG1n44OQ24dIGomP9lemtXby29ioBwY915Y0ovp3Dh8VTlD29C9xeUF+iUK1H8Enhuh5RK+coYJQ63X3uoRb39iA9wzunLdIpyUzVIMcWweOxzPAAp9UK2MA+tsqxejSwQ7rHsrMrBtzmJJ2HxDpkWqorJoUH0IEXV997SeSrtpDwNQSzQ14P7hQ93+PpvwSf5wyh1vG6+yDt+iLlKSwVSuG6KRHFA4l9MC+iHEEhw+N39LPbaF7vjQY06DU8z93wwIMJNEOhJ1EJnXttBXFw2/uwVjkk3dQ3N9UPZdsKE2VsE6VHl/sriCqTsdHxLI8ePl7TmT3s0wp2ea+MS5E7PsJ1x8lJxq1A1Tt3NWVm6L2GjzDZVqUK62k56O0VTnnr0OTTR/tq+CWs6q8fSaQzpLFZEJU+TyzL2loko/TwNC3dasvzrFQN7g7+rcYCJKVXe7YwDuLz2nADAciG8J8xsLH6zztJZqc9QpfbpBsduYpbpSzHYwy+GKMowU+AZfJ+p6NrqcMWWta0o6Tcvt0ZXElJOyz7vuKDk4xkc+9Xe2xAs+VFpebkd2s7A/zXVIEtbGNdGn3D5btA4boeObx9+BzFjdG2QN7segBGx5rXIRQudIm8GiT7Z41u6wDvQ+FGGkD5GLs1IZX8XXHNiF1tJRgr1rIvtZLJBHe3ueeUQjaainWo3ovdHtifGIX8rZo0eXytm6/+vBeRuY0cHz7cAHiRzdJS0usK888FXWNeKkzWYgwvr+WHlCZwRMqZAzRIb4NaLw5NBiXu4Fn7I0UP790vjaqO2Y8aUovZVZ3vyDmDxxaQsslYyU9j90cpNvbWsCsACMeJKXvBIu8HpV2wWAQ92qjsDD/c78sn99yxg/DbFBbJ01rK6afHDC3jUDpouvlIcbLHpWswD1VMTkOOwP2sCx7j/IGWButffir/DjazX050Y/3GegfwuqqogTXxz5UYacDKZCvPDqWBJZhJ4rFb8gctsHoncVJ0lrDIQR9jCWhoGnuspxFpBfAqpu86VYgrAcvQhIS1BA1d8SqKkB8dv7MwKzQWUI57eH1/PPYZ3uyTEoFLkq0faIDHZPTmHBHGYaus7kXcbF0RmHdWTM36aCoca5Tq84/LqErHz71KxA==
Content-Type: multipart/alternative; boundary="_000_4CE0EA4825DB416EA8AF98C12F265C34hammerspacecom_"
MIME-Version: 1.0
X-OriginatorOrg: hammerspace.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BY5PR13MB3748.namprd13.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: d1e38c46-d189-49f1-eac9-08db27403de3
X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Mar 2023 23:35:07.2633 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 0d4fed5c-3a70-46fe-9430-ece41741f59e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: CPoLMb5F7hFGC+sr1QPIekLHxipMJJEOj9Ewb1SNoZutxb5Av4uU+Ug5YnB8rXzIoyzOcbMOfMjyOLcesxf2pQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLAPR13MB4657
Archived-At: <https://mailarchive.ietf.org/arch/msg/nfsv4/JzEBxLwyAfRnHpK_8nFk1TMygXw>
Subject: Re: [nfsv4] New Version Notification for draft-haynes-nfsv4-layoutwcc-01.txt
X-BeenThere: nfsv4@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nfsv4/>
List-Post: <mailto:nfsv4@ietf.org>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 17 Mar 2023 23:35:16 -0000
On Mar 17, 2023, at 4:19 PM, Rick Macklem <rick.macklem@gmail.com> wrote: Here are a few generic comments... As it stands, I could not implement this in a way that I would think would be useful. - There is no indication when the client should issue this operation to the MDS. I'd suggest something like "whenever the client expects attributes related to writing is up-to-date for a Getattr against the MDS" or something like that. This is a fair ask, I’ll add wording to that effect. --> As a client implementor, I need to know when to do this.. Which attributes? It doesn't seem to get specific about what attributes. I'd suggest a specific list. Possibly: Size Change TimeModify SpaceUsed and maybe TimeAccess? Again, a good point. I’ll add text for this as well. Change is going to be problematic for NFSv3 DSs. Maybe a mechanism similar to what is defined for handling Change when a client holds a Write delegation can be used? When I did the pNFS flexfile layout client, I did a LayoutCommit whenever the client needs up-to-date attrbute values, because I thought that was what LayoutCommit would be useful for. --> If the client does this, the pNFS flexfiles layout server only needs to get up-to-date attributes from the DS at that point in time and can cache them in the MDS otherwise, unless there are Getattr requests from client(s) that do not do pNFS, such as NFSv3/v4.0 clients. --> I discovered that the Linux client does not do LayoutCommit for some cases where it expects the above attributes to be up-to-date, so I was forced to query the DS whenever the MDS receives a Getattr and any RW layout for the file has been given out. This is a GETATTR which asks for size, space_used, or one of the times, right? Also, what do you do during grace recovery? Are you keeping track of open files across restarts? Or when you see the client doing an OPEN previous, do you refresh your attrs? (The description of when to do LayoutCommit is vague in the RFCs. I recall the Linux client doesn't do a LayoutCommit unless it needs to also do a Commit to the DS.) My point is, this situation can be improved if there is a well defined "if the client expects up-to-date attributes, it must do this". In general, for this to be useful for me to implement (client and server), I need more specifics w.r.t. what attributes, when the Layout_wcc must be done. Okay, I can’t do a new version for two weeks because of the quiet period with the IETF. Thanks for the review! rick ----- Original Message ----- From: "Thomas Haynes" <loghyr@hammerspace.com> To: "NFSv4" <nfsv4@ietf.org> Sent: Monday, 20 February, 2023 16:48:45 Subject: [nfsv4] Fwd: New Version Notification for draft-haynes-nfsv4-layoutwcc-01.txt This version addresses the issue that the draft is NFSv3 Flex Files only. Thanks, Tom Begin forwarded message: From: internet-drafts@ietf.org Subject: New Version Notification for draft-haynes-nfsv4-layoutwcc-01.txt Date: February 20, 2023 at 7:46:54 AM PST To: "Thomas Haynes" <loghyr@hammerspace.com>, "Trond Myklebust" <trondmy@hammerspace.com> A new version of I-D, draft-haynes-nfsv4-layoutwcc-01.txt has been successfully submitted by Thomas Haynes and posted to the IETF repository. Name: draft-haynes-nfsv4-layoutwcc Revision: 01 Title: Add LAYOUT_WCC to NFSv4.2 Document date: 2023-02-20 Group: Individual Submission Pages: 9 URL: https://www.ietf.org/archive/id/draft-haynes-nfsv4-layoutwcc-01.txt Status: https://datatracker.ietf.org/doc/draft-haynes-nfsv4-layoutwcc/ Html: https://www.ietf.org/archive/id/draft-haynes-nfsv4-layoutwcc-01.html Htmlized: https://datatracker.ietf.org/doc/html/draft-haynes-nfsv4-layoutwcc Diff: https://author-tools.ietf.org/iddiff?url2=draft-haynes-nfsv4-layoutwcc-01 Abstract: The Parallel Network File System (pNFS) Flexible File Layout allows for a file's metadata (MDS) and data (DS) to be on different servers. It does not provide a mechanism for the data server to update the metadata server of changes to the data part of the file. The client has knowledge of such updates, but lacks the ability to update the metadata server. This document presents a refinement to RFC8434 to allow the client to update the metadata server to changes on the data server. The IETF Secretariat _______________________________________________ nfsv4 mailing list nfsv4@ietf.org https://www.ietf.org/mailman/listinfo/nfsv4 _______________________________________________ nfsv4 mailing list nfsv4@ietf.org https://www.ietf.org/mailman/listinfo/nfsv4 _______________________________________________ nfsv4 mailing list nfsv4@ietf.org<mailto:nfsv4@ietf.org> https://www.ietf.org/mailman/listinfo/nfsv4
- [nfsv4] Fwd: New Version Notification for draft-h… Thomas Haynes
- Re: [nfsv4] Fwd: New Version Notification for dra… Mkrtchyan, Tigran
- Re: [nfsv4] Fwd: New Version Notification for dra… Rick Macklem
- Re: [nfsv4] New Version Notification for draft-ha… Thomas Haynes
- Re: [nfsv4] New Version Notification for draft-ha… Thomas Haynes
- Re: [nfsv4] New Version Notification for draft-ha… Rick Macklem