Re: [nfsv4] review of "draft-ietf-nfsv4-layrec-00"

Thomas Haynes <loghyr@gmail.com> Fri, 01 March 2024 18:32 UTC

Return-Path: <loghyr@gmail.com>
X-Original-To: nfsv4@ietfa.amsl.com
Delivered-To: nfsv4@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E340DC14F748 for <nfsv4@ietfa.amsl.com>; Fri, 1 Mar 2024 10:32:33 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.107
X-Spam-Level:
X-Spam-Status: No, score=-2.107 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id DE9YEoakR-6m for <nfsv4@ietfa.amsl.com>; Fri, 1 Mar 2024 10:32:31 -0800 (PST)
Received: from mail-pf1-x435.google.com (mail-pf1-x435.google.com [IPv6:2607:f8b0:4864:20::435]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C26FDC15152E for <nfsv4@ietf.org>; Fri, 1 Mar 2024 10:32:31 -0800 (PST)
Received: by mail-pf1-x435.google.com with SMTP id d2e1a72fcca58-6e58d259601so1533641b3a.3 for <nfsv4@ietf.org>; Fri, 01 Mar 2024 10:32:31 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1709317951; x=1709922751; darn=ietf.org; h=references:to:cc:in-reply-to:date:subject:mime-version:message-id :from:from:to:cc:subject:date:message-id:reply-to; bh=zec7cWPOk8Y+AbQ2Na5eMFeKnz+zxfRxXuip2Dh2qWM=; b=MFIR3Vuhtns8ldFAui1kz+xzpBnMAYWUUbwFRvp4tcjgrk3P9U5fnKtYnSm0DQuURa z+oQtoMw0+Qzi+OlwFz39IHGJ1wyLeuLzIIbPS9bL7YGE0LAPTpCSd1AjExLRBI+3RUo cMTEkyr+S8iNf1E1M4rrv+LH0TM/wZX9+CNVoJdLdT1inovxM/J6cdi5tHU2QLAJyO3p odOsqg/ZezYC6ZThOmIUzEBY9XfWjIllKUYofv76sVVUxv6btNhb9U/Oy9y0l6LL5x68 m1lbI4/6gb2G7srcE5LXBhUKhRMdcNQElTYWWKXK0/Q6TZrq4YIe1O5irSa2R488HbCW rqsg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1709317951; x=1709922751; h=references:to:cc:in-reply-to:date:subject:mime-version:message-id :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=zec7cWPOk8Y+AbQ2Na5eMFeKnz+zxfRxXuip2Dh2qWM=; b=QsY17OtlOdqHp27h7eW5Er0OqhLuM27WBgrAPWEHABN8HhB7WcmYe7rRVphSYHhpqa T9xC33clRWBiMH2T4neKBAOHsV5ubDhgG9vi+1iyz6vH0UG1O7JN85/HoGBRoH+8C+Ld 2ozplJa5oHZCE6h67xomHTCJlzzk9yrE+y9TSe8t2Z4af1Fm52alqKMDJoOPSQUfMhuG jb8Rzc/qFMhCqcoHeMTaoTOIVO8TFTuA+Ib23ew907PG0HOvMxT5xt/rkMvum8ace5Sn DKbxZV4Kv6nmBYFSAvNzZu44ydd43LkLQKgAz1uOGpRFMEQIptabtea8LdU+UBolpMVq c6ZA==
X-Forwarded-Encrypted: i=1; AJvYcCUUsjO9HxfKRB17tWiQwkrVkEl5L6Y0x2x2Pw7lvkeE9iGSSMfRbR90TG4d3bcZQjTSzqctGHrKXmlPhOBEsw==
X-Gm-Message-State: AOJu0YzlX8fYlYwOwPg5ObPxYZqyO3yswBkjlgUrjgFENYemgWxgLQcF GWIz9VoG82Bw4u6pH1dCmo7MF0EJ1JEgCy8A1iFQbggIBGDhpJh0
X-Google-Smtp-Source: AGHT+IH6qEBGVdMCXS7U7E6iTawhu1vQdbSu4TwINxlRbD+kjVZSztK+4OMFx9gmYrdVfZb+1TPEYQ==
X-Received: by 2002:a05:6a00:2301:b0:6e5:403a:87c4 with SMTP id h1-20020a056a00230100b006e5403a87c4mr3234048pfh.14.1709317950692; Fri, 01 Mar 2024 10:32:30 -0800 (PST)
Received: from smtpclient.apple ([2601:647:4500:91:6c44:a0dc:85d8:bb80]) by smtp.gmail.com with ESMTPSA id fa35-20020a056a002d2300b006e0814dbb3bsm3353400pfb.96.2024.03.01.10.32.29 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 01 Mar 2024 10:32:29 -0800 (PST)
From: Thomas Haynes <loghyr@gmail.com>
Message-Id: <EBB17E57-4D44-4D28-875B-92D34D844F26@gmail.com>
Content-Type: multipart/alternative; boundary="Apple-Mail=_417BA08A-32FA-489B-A5C1-6E4979BF7674"
Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.400.31\))
Date: Fri, 01 Mar 2024 10:32:18 -0800
In-Reply-To: <72ac300266157b6ec19b3201c79ee965dcd4c804.camel@poochiereds.net>
Cc: Rick Macklem <rick.macklem@gmail.com>, NFSv4 <nfsv4@ietf.org>, Trond Myklebust <trondmy@hammerspace.com>
To: Jeff Layton <jlayton@poochiereds.net>
References: <26ee2c63cdc2cca64903eaae3699b5c0758ca3a5.camel@poochiereds.net> <CAM5tNy6VeXaJhsop4MVbd88Oq08yPQhAYCbkHtcEjT0vM1vMkA@mail.gmail.com> <72ac300266157b6ec19b3201c79ee965dcd4c804.camel@poochiereds.net>
X-Mailer: Apple Mail (2.3774.400.31)
Archived-At: <https://mailarchive.ietf.org/arch/msg/nfsv4/EnFL8ponLRMU1fxTTQv-TIrwBag>
Subject: Re: [nfsv4] review of "draft-ietf-nfsv4-layrec-00"
X-BeenThere: nfsv4@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nfsv4/>
List-Post: <mailto:nfsv4@ietf.org>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 01 Mar 2024 18:32:34 -0000


> On Mar 1, 2024, at 3:09 AM, Jeff Layton <jlayton@poochiereds.net> wrote:
> 
> On Thu, 2024-02-29 at 20:45 -0800, Rick Macklem wrote:
>> On Thu, Feb 29, 2024 at 8:09 AM Jeff Layton <jlayton@poochiereds.net> wrote:
>>> 
>>> Most of this document looks fine to me, but it has this statement in
>>> section 2:
>>> 
>>> "The metadata server MUST NOT have been resilvering the file such
>>> that it has a different layout (set of mirror instances) than the
>>> client before the restart of the metadata server."
>>> 
>>> The rationale for this seems clear, but it seems like resilvering the
>>> file while the clients hold any sort of RW layout would be a bad idea,
>>> no?
>> I think this is a good point. It seems to me that, although the MDS can
>> use the LayoutReturn with stateid of all zeros to decide to resilver a file,
>> the actual resilvering cannot start until the MDS's grace period has ended.
>> 
>> (Until the grace period ends, the rebooted MDS cannot know that no client
>> is still using a layout, I think? If the MDS has a record of all clients that
>> held a layout for the file before the reboot, then it needs to wait until those
>> clients complete reclaim, but it may be simpler to just delay resilvering
>> until grace is over.)
>> 
>> Lets see what Tom thinks?
>> 
> 
> Yep. In fact, it says this in the doc too:
> 
> "Further, the metadata server MUST NOT start a new resilvering of the
> file during the grace period."


Thanks for pointing this one out - caused me to delve deeper into my code than I wanted. :-)


> 
> It might be simpler to lay out the conditions under which you _can_
> start resilvering, but maybe that's too restrictive.


Yes, I’ll revisit this whole issue and resolve it.


> -- 
> Jeff Layton <jlayton@poochiereds.net <mailto:jlayton@poochiereds.net>>