Re: [nfsv4] New Version Notification for draft-haynes-nfsv4-layrec-00.txt

Thomas Haynes <loghyr@hammerspace.com> Fri, 17 March 2023 23:26 UTC

Return-Path: <loghyr@hammerspace.com>
X-Original-To: nfsv4@ietfa.amsl.com
Delivered-To: nfsv4@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B334DC1516E3 for <nfsv4@ietfa.amsl.com>; Fri, 17 Mar 2023 16:26:25 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=hammerspace.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id LhszFqkJ7KGj for <nfsv4@ietfa.amsl.com>; Fri, 17 Mar 2023 16:26:21 -0700 (PDT)
Received: from NAM04-MW2-obe.outbound.protection.outlook.com (mail-mw2nam04on20702.outbound.protection.outlook.com [IPv6:2a01:111:f400:7e8c::702]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2F462C14CE36 for <nfsv4@ietf.org>; Fri, 17 Mar 2023 16:26:20 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=gxGmQT+x27NxwTPpJ3a8GJdCp0x3jmxCQlX7g/W8b9IKHNXGGBqHY3dZztK3T8tsTG4fK4sNQqM0l1lkY4scqBaIARacbl6OP7ssBIQgxbzvKnstcgqg8hzM0cULi+FQeaLjYcQ6Q7C00PMsY3YE00U9ET9fkZCY4VZlA1aiL8S2BZzSHW2gylw+tE7YD+fezjDhNebL4oZxVvaCr4jJ8WlKRwiBgVimNgzJhA4cUuMisqT8i1WmBoE0IkdRPJDRepNUKj+yIV4ahR0tVQZrls4cdIuVibxsjbrHzgTyB/VqWWgUEfXVKfZxo9ODZtBQOEExG9nDRVYlFte/1r4JOQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=1B/amdrb1s19+8yaYkS6pIn/2Y4H4gvvdCgEhuDVQ8I=; b=fT4FCJE1T+cuwRwse5e8nF+eKVrQIh54XE3SrtI55sR6TEPsBmyfjmKOK3AY9XbwoDysqsldIAnHs/GNkoe8PCgn4yDcs/t5822J3tE+6qtBdExQ96eN7NcMhP4/TzxGZs4Yq/KoxSfqVw07jX2PHxhQaLRz3u5C62G1DUgAfUfe/N/94bdqZw9Rv34m0ns7DQ/CG0Iu3V8DYCUshrPVV65RLGZX4WLsbm+/kRdIPdlUqAwfqoOR/j9Qp7EYIYkpSMAsdFpiCIBYVlvtI/REEyzz9KVj4XHabsj8pUlPu1oLJLnfY2H2MPoW/97xbQyynpqK6YhZoPoh7BqwodZEdA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=hammerspace.com; dmarc=pass action=none header.from=hammerspace.com; dkim=pass header.d=hammerspace.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hammerspace.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1B/amdrb1s19+8yaYkS6pIn/2Y4H4gvvdCgEhuDVQ8I=; b=Z2dHgdXwHAxI5gdX61gtIWXTDyzCV9nhfxyex+4itpHGzmOksSfz+JxiwXzRQMpOAPAIQttg7lqBJv17tWBwVCEteM/aQw7FJu+In7E+HiBleBMJyIEcNCDlAmYjHmxtJVXWmCECDDm4eoCqY+3M/WCrUhpxuXyT84JZa/V/lVY=
Received: from BY5PR13MB3748.namprd13.prod.outlook.com (2603:10b6:a03:22b::17) by BN0PR13MB4677.namprd13.prod.outlook.com (2603:10b6:408:12d::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6178.35; Fri, 17 Mar 2023 23:26:17 +0000
Received: from BY5PR13MB3748.namprd13.prod.outlook.com ([fe80::d9b6:f066:8959:f789]) by BY5PR13MB3748.namprd13.prod.outlook.com ([fe80::d9b6:f066:8959:f789%6]) with mapi id 15.20.6178.033; Fri, 17 Mar 2023 23:26:17 +0000
From: Thomas Haynes <loghyr@hammerspace.com>
To: "Mkrtchyan, Tigran" <tigran.mkrtchyan@desy.de>
CC: NFSv4 <nfsv4@ietf.org>
Thread-Topic: [nfsv4] New Version Notification for draft-haynes-nfsv4-layrec-00.txt
Thread-Index: AQHZVR1YBGGkrbbOk066QVsPTwDNkuZmrEvwyJj5KwA=
Date: Fri, 17 Mar 2023 23:26:16 +0000
Message-ID: <B0D36194-1A54-44FE-918A-6AAAAABD83B9@hammerspace.com>
References: <167865124684.24240.7742761509068328018@ietfa.amsl.com> <99EB2F8B-C1BB-40E5-A9E5-DC5E8369D5BF@hammerspace.com> <2004975907.9417461.1679081942719.JavaMail.zimbra@z-mbx-2>
In-Reply-To: <2004975907.9417461.1679081942719.JavaMail.zimbra@z-mbx-2>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-mailer: Apple Mail (2.3731.400.51.1.1)
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=hammerspace.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: BY5PR13MB3748:EE_|BN0PR13MB4677:EE_
x-ms-office365-filtering-correlation-id: beb2b7ca-83e7-44bb-25b7-08db273f01cc
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: aVgkgAtHq43HjtK8+a580KgbHDBkjxuTEZGqxnVAS57GTLMxcAqEcbi4iLnUYVZSgQ/UKZKh6ZatNqa6o9RGhsy8UVqxpVK902odXUE7xZrUTNwFzC3ZgYzqWN7grjm4yH0d1a1mJCqENLfZ6wDerDDE3oS/WDgMdLq0vnuJJAGAR4stH9xKV5CKsJr6j4nkUbelZ7fIKtucFVjnoXzW+JVHZZP9gbrkSgt59mXikeMNbVZVJFaxKx1TpiV6xFx+gticqKQMqBGVcgO0C/3E7BHzis6DY3aK+3RcJ7lyWMuF89Bn1LhxgzNNvj581KTCZKsSiLRxfcAjUuhZjvBOxfvQ9pvTdcWIbvv3l9PqRpXKMPO9wgJOBYyk3/ioZ0RiCawbHNO98dFpd/QVElkdL1E/WDnVjVyDJ5ZTT6KqP0hKkSPB3S6KMWKu2vmAQa352X8jS2JtgdiFEoW3VErT0B3p/i8sCuKAdJ1HJznVxR+SbYsGMD73yQfZiPaOpjaBoniXgAbfIGZ2yeQM41B5Pd+EFJdjB4Xsqm3aRuskEJ4fmRIsUTSclCyx5S0YqFTucreWjkueQ452ZB2U3JHFMEx0NQFAYtsjyh+1LB0W3YPB4Fwh7a26+hmbbzbOHgB6OyYtlDCizZlpPh3XZ55WhU74UKp+zeE6F5EmROn2FAq5vV6P33R8uLa0gaMVJ2pDAYDCNi92fwMrIJhzG3HM+L92otmdSCJbMFZtWHSao/0=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BY5PR13MB3748.namprd13.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230025)(366004)(346002)(376002)(39840400004)(136003)(396003)(451199018)(5660300002)(8936002)(6916009)(4326008)(41300700001)(33656002)(86362001)(36756003)(38070700005)(38100700002)(122000001)(15650500001)(2906002)(478600001)(966005)(6486002)(66574015)(83380400001)(2616005)(71200400001)(186003)(6512007)(66556008)(53546011)(66946007)(66446008)(66476007)(64756008)(6506007)(26005)(76116006)(8676002)(316002)(45980500001); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: zC/WvyZax+x0K5Y6I5mRJLxNH6NIUXb8xrLMjVyUJlv+FGUwjZhTlv1FyeqWEec7tTJAemtvbIxEtwUiJhJVnbJyDmycCrUbcCaAS0GcvFYmEkY44wCm6l1Ms2XxM97oS5384lrHp7AV6YZuaTYg7IrT1q4RrqjFwXg4zBps0abA6t2q7GlxvQCScBn7/HN5DONY5H6xhNEb9Zb0F+FSuGQ1pSsSo9nnqyu/0LoxWD0FkRx31a6QrK0G2P4Kcl5Cr5VqDYCKaXhLAldv4f2mLHohys3BHTn5+NUVE3iL8xSjn5F/zsqMX4/gPaJQke77RsXJKfPj/Lr0oqqKWk9bMWnr2b3mfU8+4POUE5J1WVXVqjfu6t3Ey2BKLybzq8Gl9KPkHQJspBp2GRwUk/g0YsOlYMu7hEWOygNNG0W8EQjBUJr2QpZ96G/RjdgVwXfErmvVrxEBNLDnMR2nCASott/4eOooWmZJnDGDwbVs1O7f+V94RPlT+PJTejoh1D+q/GtPx6wmTA/zXRADQYl5d9BxRnzn8dLSe/HFr7+UgHoFvCdYINrDx8NHNbsAxEyHu37TeawlS8GztLk/xMTmwZTzX2jNprGrbW5q5ogboBFVst3LkqNxpxeY7PRwxKVry5kbSEFy27tZxI5DjVwta1gQMIOM9RzrGPYpCyHS0N1RyQCrrRLx0fk0m+4UZ/T9W7LYkNsWe59GGdoSS5vrgsnCpSFa6PXk6NcRw+wJd6hqUIiF+10W9W0BFcPwCMG5U+YjO7ikotRFvzqTFvUDKs84v24kHs49Hsp2kAq6c2MjeUS2ERmRyiY+YN6Hif8/gkkW+rsI10lFYtj0gDdSWtD28FXmGJ5P5lsXz0LiEkexZlequSToC+qKVi7shhJVxbif3XtM6wOBeFum/TQb/rgjw9cR6yCt9dCqBVnf45O19lWRi8rb6G1zibnMz9695DEp2T2eylbNIc6pm0k+1Jx84ngzpeUxGd37IRbh5JepwI08Y1k50+kjhyOYt1IeQipl05r78pMeko2tfhvHXqf6P4O8iJeYbpMwqahqCOTS7nlHc1K8wnSFQMR1G9sMd9S/5hmLZtGVnxCtzKSd9kFYkrCi3Bb71I46rbi8/0pmojKe2Q1whNYrSZDAALToIMUCFwR2mQWyx7gF7tgrMsxi8vL1JHTaoD1L2CNHzO6xkEyJmHuPM9XaWfVWbUiL3OgmA3wwPBTgVlF0I2BBXKsVN7rbyboUEuwCx09jT0g9z0dfB8O8sjODJgy++/epRx5HmGDu0BFouABmyDbECj11Pzx6Rqty/SqdNk9H/pXOoFrNewTTc/KDG0dYU1BioovlL0KgskHdcMXfd63V/wwqBWt79sECwErEjxBrhgVv5K43Dv1z28+mFnkVnK4UtfaejXrM/a+aJ3z6n0xbrFhE7qbUfggKqhyeZIjn525/IPYocwF4EPKfWFbJcR9aqd6p9LAk9qPo7NK6rTmDIiZGT1FdPa2z9yC44iUMczJ9082TDC+/OCR4DLM1G83D1v0FEJV0nP2hHziXGIOKAkD+zPCG9tssL2RrKcMMtRtkiPN0OFXDj2HtCmS/ddsbm6zVMzjZ/eFwIsekwvOAUw==
Content-Type: text/plain; charset="utf-8"
Content-ID: <D68549F84527D54588FAEEFBAB6858C1@namprd13.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: hammerspace.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BY5PR13MB3748.namprd13.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: beb2b7ca-83e7-44bb-25b7-08db273f01cc
X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Mar 2023 23:26:16.9011 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 0d4fed5c-3a70-46fe-9430-ece41741f59e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: TzdTC+nIcHIkokwMt1R1ZFUiF3PIU7PMC9HvCJK/nVPpWj5AbhMh2ykHKWS6EsccRhkSZelEh5tPD82dulDpGA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN0PR13MB4677
Archived-At: <https://mailarchive.ietf.org/arch/msg/nfsv4/pxZDC2Ux6CRoemDxki4Kb_UYs1A>
Subject: Re: [nfsv4] New Version Notification for draft-haynes-nfsv4-layrec-00.txt
X-BeenThere: nfsv4@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nfsv4/>
List-Post: <mailto:nfsv4@ietf.org>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 17 Mar 2023 23:26:25 -0000


> On Mar 17, 2023, at 12:39 PM, tigran.mkrtchyan@desy.de wrote:
> 
> Hi Tom, 
> The final paragraph of section 2 says that if a client doesn't issues LAYOUTRETURN, then the server should assume that mirrors are ok. I think this is quite optimistic assumption. My experience says, that if the server not available for a longer period of time, a client, that have some dirty pages to flush just stucks. A typical solution is to reboot such client nodes. As a result, you might end up with a happy MDS and two inconsistent replicas. 
> Best regards, 

Hi Tigran,

Good point - I’ll check with what Trond put in place on the client.

Until then, I think my server actually does:

LAYOUTRETURN with no error - successful recovery
LAYOUTRETURN with error - needs resilvering
OPEN_PREV - successful recovery

Neither of the above, we need to assume it is an error.

Tom

> - Tigran
> -------- Original message --------
> From: Thomas Haynes
> Date: Sun, Mar 12, 2023, 21:02
> To: NFSv4
> Subject: [nfsv4] Fwd: New Version Notification for draft-haynes-nfsv4-layrec-00.txt
> 
> 
> Just submitted for consideration:
> 
> Begin forwarded message:
> 
> From: internet-drafts@ietf.org
> Subject: New Version Notification for draft-haynes-nfsv4-layrec-00.txt
> Date: March 12, 2023 at 1:00:46 PM PDT
> To: "Thomas Haynes" <loghyr@hammerspace.com>, "Trond Myklebust" <trondmy@hammerspace.com>
> 
> 
> A new version of I-D, draft-haynes-nfsv4-layrec-00.txt
> has been successfully submitted by Thomas Haynes and posted to the
> IETF repository.
> 
> Name: draft-haynes-nfsv4-layrec
> Revision: 00
> Title: Reporting of Errors via LAYOUTRETURN in NFSv4.2
> Document date: 2023-03-12
> Group: Individual Submission
> Pages: 6
> URL:            https://www.ietf.org/archive/id/draft-haynes-nfsv4-layrec-00.txt
> Status:         https://datatracker.ietf.org/doc/draft-haynes-nfsv4-layrec/
> Html:           https://www.ietf.org/archive/id/draft-haynes-nfsv4-layrec-00.html
> Htmlized:       https://datatracker.ietf.org/doc/html/draft-haynes-nfsv4-layrec
> 
> 
> Abstract:
>  The Parallel Network File System (pNFS) allows for a file's metadata
>  (MDS) and data (DS) to be on different servers.  When the metadata
>  server is restarted, the client can still modify the data file
>  component.  During the recovery phase of startup, the metadata server
>  and the data servers work together to recover state (which files are
>  open, last modification time, size, etc).  A problem with servers
>  which do client side mirroring there is no means by which the client
>  can report errors to the metadata server.  As such, the metadata
>  server has to assume that file needs resilvering.  This document
>  presents a refinement to RFC8435 to allow the client to update the
>  metadata
> 
> 
> 
> 
> The IETF Secretariat
> 
> 
> 
> 
> 
> _______________________________________________
> nfsv4 mailing list
> nfsv4@ietf.org
> https://www.ietf.org/mailman/listinfo/nfsv4
> _______________________________________________
> nfsv4 mailing list
> nfsv4@ietf.org
> https://www.ietf.org/mailman/listinfo/nfsv4