[nfsv4] Re: seqids after changing slot table size

Trond Myklebust <trondmy@hammerspace.com> Mon, 09 December 2024 17:56 UTC

Return-Path: <trondmy@hammerspace.com>
X-Original-To: nfsv4@ietfa.amsl.com
Delivered-To: nfsv4@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id CCCBDC1CAF59 for <nfsv4@ietfa.amsl.com>; Mon, 9 Dec 2024 09:56:46 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.105
X-Spam-Level:
X-Spam-Status: No, score=-2.105 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=hammerspace.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NGpjxo63mI4G for <nfsv4@ietfa.amsl.com>; Mon, 9 Dec 2024 09:56:42 -0800 (PST)
Received: from NAM11-CO1-obe.outbound.protection.outlook.com (mail-co1nam11on2099.outbound.protection.outlook.com [40.107.220.99]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-384) server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BC328C1D4CD4 for <nfsv4@ietf.org>; Mon, 9 Dec 2024 09:56:42 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=EYQOFm9K+vXZNzirFpzZhQu3wcewxh2x8XW6bSdQ1k9tcYXsiAbthxZ/tNEd0b679t4mqDSxzFeyVw/TyfO3ZOjLkySyOcRRSr6+hRunzA2k4LMqlawB0cu+N0W+8+OODp+MSHtYRCYLpPHZuHjGZ0y4D29D3cP2nUh4fESdCyvvgY6R8B3Fj5U3DScaqKRpxrWxukBCOSjuzxAbOVidJ5khBvABLR7rpFdmOGbJ6+v/jS9sgggcbDxzkqObfFQNvrzgfUodynGpJVgcd2I9oK67bao+kdSJVa9SW2klhnwKgGImMY19dQLnwdgjxHaZkSpnOupNc4i/h2zTcEy0SA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Le4WVgKFj3Q5zK3sZlkw1zHvSzfR0O7tThcdpt4QdJA=; b=vN1go6vP83GHPizNJhffGZSaCoDv8207trZaP+ghrQPQ8+l8ERYWDwuXFH0eMY7YaBrIg4/vsNKQhqYIxqK/ZmmKrzwVKHyso8UKR9MUYEojjTG0R8Q7X3otnCf5XWvLDo4fJ0vV/gF9Ly/BN2CS1bkVMuID3hy6UTVRsGTLTndDNRvz9jWgR2kDRtEsnLLDgdUCqmD3Wmo3dyzzB+JOfmmHDlqupmBXSmlK2Et3XS4yy9qWzNL01zaDAUlYxjIwtYLXwTUThEjDY+glmMuIziI8OEbTKjFzBq8ZixCghh4bq/ZCgXqk6Ses1f2gtGxB5TDhY6uAs0+VYtL4elKCuw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=hammerspace.com; dmarc=pass action=none header.from=hammerspace.com; dkim=pass header.d=hammerspace.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hammerspace.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Le4WVgKFj3Q5zK3sZlkw1zHvSzfR0O7tThcdpt4QdJA=; b=LLQmfhA4CKUyOr4+bCFyBNnMMueIN5fDjJw5HCCxIDIpW8DCvIi88BnKJ78o0d0JjGmGi096qYkIn2XySAxj9hvONkzBnnB6rRZ5yBJz7Dr9aoaaib6dVeaEunJBCrx7T8QocPhseRgYk4d6k0HA5ojdXJ2hQ5jcEHJdzS/WZ1M=
Received: from CH0PR13MB5084.namprd13.prod.outlook.com (2603:10b6:610:111::7) by DM8PR13MB5222.namprd13.prod.outlook.com (2603:10b6:8:9::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8230.18; Mon, 9 Dec 2024 17:56:39 +0000
Received: from CH0PR13MB5084.namprd13.prod.outlook.com ([fe80::67bb:bacd:2321:1ecb]) by CH0PR13MB5084.namprd13.prod.outlook.com ([fe80::67bb:bacd:2321:1ecb%6]) with mapi id 15.20.8230.016; Mon, 9 Dec 2024 17:56:38 +0000
From: Trond Myklebust <trondmy@hammerspace.com>
To: "davenoveck@gmail.com" <davenoveck@gmail.com>, "neilb@suse.de" <neilb@suse.de>
Thread-Topic: [nfsv4] Re: seqids after changing slot table size
Thread-Index: AQHbSmOyzPA2OHHRtki1cK4Y0uZH4Q==
Date: Mon, 09 Dec 2024 17:56:38 +0000
Message-ID: <fbb9c6ba2f4d7598c280a1870ce8f1c559fe2233.camel@hammerspace.com>
References: <> , <CADaq8jd+REbnckQ8x2sCG7ZoixK0cPoTyOC6KR1LM_85supMrg@mail.gmail.com> <173370056670.1734440.12873523017736051294@noble.neil.brown.name>
In-Reply-To: <173370056670.1734440.12873523017736051294@noble.neil.brown.name>
Accept-Language: en-US, en-GB
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=hammerspace.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: CH0PR13MB5084:EE_|DM8PR13MB5222:EE_
x-ms-office365-filtering-correlation-id: 1658d01a-3651-4bf9-d664-08dd187ad492
x-ms-exchange-atpmessageproperties: SA
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;ARA:13230040|376014|10070799003|1800799024|366016|38070700018;
x-microsoft-antispam-message-info: ziCrY7YFPDnIpKF8iVeVIGzagD0tTSEwAXiTiIXmndSX4cYzTcDYgrs2KMFNwOSjjRA8mm4gUgAF6wNn7JPIGutUsvbzk4Gl9v96POyxmcni51MIXEvaHzZwWI6/GwT/mgggXEz4xxl1rgtuGdnPKbW9cpeahzmv4Q3Ne4KztB+uDXfvuhgTeAvhWFeZ0bGWX74djzN9trUNMAkz4+9o7Qy6nwv6f/xB1BjMHAkdeJyHLK6MxL0OrQtcHNSYHXGSgBduSf4iIftxDd5oTpTnZiuE/dJ0j53xtxwAdTJfM9gZrR6UOfp1LMmQs0zdMRY1lJlHpNfw+HYUp+o1dwtoCxd6yKfwQC8ddEfV50k9xrTx0EqIQi0KOxA9f0sqGhYB/lMEkJxiwAE1pl+atsqlhfNkK/zaL1odyvNptPcBpkOuAyx4vIt5zCKqRqSt+wG4m3Tvlsr5GkL3HaPBPIAlykL02fXSkixmEvxDQBXQSGY1kg/GwrHUJGY6S+uCqovenMXqIAvGkkqX85yVimAV83b+DWeR6GryxCkSEpYE0EdMLZZIdwUdYj1xDayInlO7MyowUPN4iaYCz0cSoo/DzfyDYOP0vjv2E+hdCXx2Oihj/W7U3zKOz69kY0BIpaue26EcaorHiIT0cV4sjHzhb0NLGIT3UjU7GjYg+TleZ/02ofP4wg7HhIlOMgySX0n/+RT3EunwkAJAFqkjLFKpdh4sC3tpwv95hxN/kX/bj0RBKARxRZd81+Z+Y01DVgLr/ex3faA/LQVgMs9BgL3np/nteYrrQMtg/nRjNXFC5wWS0GplAwok6OUOJrTgInUfcenuZmlvt/dzFqm5qDrmmz4AIA44YLLOIKhAe/5TyEkZFW38TsOwx4Me9eSkbobX5mT07FdHViwDgXUK1pbHXE03nUb5vhb5jz0vIZhhBB+I05SY6BqrTTLxjOZq5NVyrOSdzkd7rChPa3xqO6nv+mFras3H1ZfCzkvqUl6+/wUGoxDGA/RnJTook0I4v8RD0+OoxHpSEbdWB1AOhmdbGLoPOZ4/7Hb8hjb+b6D7ooQWGbl3sKi1j9p2+LPdbZb/OclUpyqekvUB39gpg4JuFV/KSSXk4uPXUrNxEtuKIECw6+PoP+e3i53kVvhBsbDiQpms1Z89+rlmMJZ6hnLBjjwvByC+pLrC2ltEsR/yQCfjWUPgocm/6dFYO2zSJl+5TaZwXa88xUwk+aVK3M9xqjzDZVPKo6IlRMsD40bPaq/mhP+dpGd3KEUM7SYiKK/EEwYI+a1FrVbYGcuxbcfk8Lr4vWq/2EKnG1zAD+ZXwgPyEDQvkr4nKD+DqeOAYknIrgy4yU3z3FJfESYhIcqzNX4NkXL5/32duH/umVv4Do6irqNOihYXF7/IWLF2GB6rsXoJ07o3ijhSfM5AB36n+g==
x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CH0PR13MB5084.namprd13.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(376014)(10070799003)(1800799024)(366016)(38070700018);DIR:OUT;SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: +rLoEv1kghtPOqYD6zfJUgfcp4fD2hmAJPSuPE7QMe8MG6fGmZqUoPsvF7H3pF1SrcULN5a/CGVpYHRmzyHAoXHMfiJ2BYmlRCsyX2dspmsOwqA0jn0GuTes6eHgyrzce/CJA/nlMsD7IjLbhK4359SbHmnlnevTasRJfR24EjzePFuAsL6Ck9emOsNmUu7SV6DUmAUz8foL1BXYICwHnvyvcrIleJ68de4eYOUUqz8GZ4iuWqx28R8dKQ+V/lqFOxcqtgejc8aMqxAbw24myXkSIDYa43S439KTrE6S5G7v+ArJVV7JYCe7vZ5LMK7jELAtXZN65bav5Isr0HG05v3qxRJh4OKvZ/T5jnfYLaszTwZrJKXp7xmltYf2Vms39se5fn3c+aURZZI6vdGLwhCsMbNoNt/JCzNVcB0ArtsOKo++mNZZxF8QjMdqT/ul6NhiWJ+1ApTNHCW04C1wuaoqZhkIRhsMzRuKD/ad8XsUpbdNQkgMBJVVOB+Yq9FhP5zc4WR2+jeNwd+ODcnwqBp6wySxBbi88oL1AM0gfpNDlWMHIOAG0VCqhj2eXvpW+g+xrwben4A0OEZFHsyxpZkCsFcjVyNwla9tKfsXzo2qQaYcWsgnG8JZxtzZY5yVqJIMa2kOTOmeaCsLDtqTWY5okTw3brdWs32h/tKjhLVv+xwjzi2BjSl/OnPcCH6pECAeM0fTGDPivIueQifii/n+T6ETamRwp6VJayYYrDYwWlC618l9UEikyHFrGbQgKGRIoeVbAEWuiZySBONwuVpb8Ls2x0JS8ievB0I06SgF0ns/nOIp19tGPUDzF27VykCQseyai95asMBv1XpS7n7ioplbIjq8e73dL/Kwk/i6xRz/4opzsKn+CKN7eeOlbjkv8FYaVGMxeTVZnXHCeK9QoliuTQ5YPLD9EyAa+XE7XBuK4TkdFt4l4Q/RDAngZ+0F509uNULGfXBrAO6kyMxkHlZ83kBEWtlC+wA3Hu0gcw6DHL/Xz+h5imAicMxMvPxMUIro600Ela12EsYgTAHm28e6ExpRTn1Dl0b6kcn2I1DeR0QuP/vNdb9mAoR2H/eFYWY011ika6hXsr2YOTFmMCKIw0eDuMgAQDDHfGOMvQcOLzw2ibMMTttPJPKyAJ6KCdf9PH2awjpFCf45+2n6A/nRIHvvvDTQP/us16bn1ubGiheCcbSoZT8tzgk6tv9lqwiuWBEV2LC6EkIv931yZGRMCDMqJDSIkyjnIipYltDCz8bvrQzHhY5W12dJEHxjZUzQaFF7tRJqhkr4m1mxefR6bkKz9jWK5NonTZ1/9g35ZshcgPhGJmOA+B3CrncXAjvTiL3sU7LVPYYLIfBtBdlhCA1sZw2FT4IwyAvC6KCiACe9PYRDIbtywgY59pZtYbjLqwr+jaJIPqaNIXMnLOTA2IokBWO5TBEcEo3KUwBE9YmMQgNVoxrbB5PlMgDYQDaJCYdF+QSGdBixe/ImZBvhTRFuqj8SX0iDWSOqI6oNrZuX9DVdytb7gMslUQGdkz1ORhbbfkPUbo2arHexmge2e/IBY4RflWiSrEfxWjSajXYfINqaM3Z6S06dAfulXQTpNAK1WxH6xaxoqaZYdcWWwIz6KWeL8LMCcwH50aA/ACIlVhPyV+bwRCeVHSwO9oVm7iucI08enJ60Uw==
Content-Type: text/plain; charset="utf-8"
Content-ID: <AA1292EC60D72D428ABCAA3DBD94D463@namprd13.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: hammerspace.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: CH0PR13MB5084.namprd13.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 1658d01a-3651-4bf9-d664-08dd187ad492
X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Dec 2024 17:56:38.7644 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 0d4fed5c-3a70-46fe-9430-ece41741f59e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: rY1OY8556GyvJUREGD7JRbeKkMaqraOZSS+YhzEPbGG9WP43QBlz+geml3Awcbe/U6v3QB8xeUG6BqZyP2az8w==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM8PR13MB5222
Message-ID-Hash: CCLHR34FFEKYVXMUVTYD4N2HOBONMUPI
X-Message-ID-Hash: CCLHR34FFEKYVXMUVTYD4N2HOBONMUPI
X-MailFrom: trondmy@hammerspace.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-nfsv4.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: "tom@talpey.com" <tom@talpey.com>, "jlayton@kernel.org" <jlayton@kernel.org>, "nfsv4@ietf.org" <nfsv4@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [nfsv4] Re: seqids after changing slot table size
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/nfsv4/ggmV00PqKHrsHKS2Rldf9Tk4fo0>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nfsv4>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Owner: <mailto:nfsv4-owner@ietf.org>
List-Post: <mailto:nfsv4@ietf.org>
List-Subscribe: <mailto:nfsv4-join@ietf.org>
List-Unsubscribe: <mailto:nfsv4-leave@ietf.org>

On Mon, 2024-12-09 at 10:29 +1100, NeilBrown wrote:
> On Sat, 16 Nov 2024, David Noveck wrote:
> > 
> > 
> > I'm convinced.  The next draft of rfc5661bis will address this
> > issue.
> > 
> 
> Hi,
>  I would like to offer some thoughts on how this issue could be
>  addressed.
> 
>  The issue is that retiring of DRC slots is mentioned in the RFC but
>  details are scarce.  It is not clear whether or when either peer can
> be
>  sure that that the other has retired a slot, or exactly what that
>  means.  It *is* clear on some cases where the peer *cannot* retire a
>  slot.

The spec is very clear on how the client and server agree on whether or
not a slot has been retired.

   1. In the reply to any SEQUENCE op, the server sets the
      sr_target_highest_slotid to the value of the largest slot id that
      it wants the client to aim for. Additionally, it may or may not
      actually send a CB_RECALL_SLOT callback operation.
   2. Once the client is done with a slot, it starts to lower the value
      of sa_highest_slotid in the SEQUENCE op arguments in order to
      inform the server that it is completely done, and will not send
      any further requests (including replays) to that slot.
   3. Once the server sees that value of sa_highest_slotid in a
      SEQUENCE op (on a slot for which the sr_target_highest_slotid was
      also set to the new value in a preceding reply), it adjusts the
      value of sr_highest_slotid returned in the replies to the
      SEQUENCE ops to tell the client that the slot is actually
      retired.

All this is documented in RFC8881 in section 2.10.6.1.


-- 
Trond Myklebust Linux NFS client maintainer, Hammerspace
trond.myklebust@hammerspace.com