Re: [nfsv4] persistent sessions and compound atomicity

David Noveck <davenoveck@gmail.com> Thu, 10 December 2020 22:07 UTC

Return-Path: <davenoveck@gmail.com>
X-Original-To: nfsv4@ietfa.amsl.com
Delivered-To: nfsv4@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5B51C3A12E3 for <nfsv4@ietfa.amsl.com>; Thu, 10 Dec 2020 14:07:40 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id UZZBbiCfwm9s for <nfsv4@ietfa.amsl.com>; Thu, 10 Dec 2020 14:07:38 -0800 (PST)
Received: from mail-ej1-x62a.google.com (mail-ej1-x62a.google.com [IPv6:2a00:1450:4864:20::62a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7E0A43A12DF for <nfsv4@ietf.org>; Thu, 10 Dec 2020 14:07:38 -0800 (PST)
Received: by mail-ej1-x62a.google.com with SMTP id d17so9561544ejy.9 for <nfsv4@ietf.org>; Thu, 10 Dec 2020 14:07:38 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Pi9MfJ0cvH9gG7gsSpy0PhsBmA6qzHDQOreJJzUEo3s=; b=qSKbdLLsjQoBmmIR4Qy8Ln0xhdTr1D8AbcQPR4cVqm5+ZMgYRvM5FQHfAFxHjHc6Z3 AHfqqsFdsbdp4oxP6zTpn53RFxt45xN+iEkGK4OYRQPL3S2PB+RvnRqOXHOd4TjMW4L0 5VGpaepfYGRTKyUGgz77d7uIi66usQ7wRv06OvExIgHJXifhk0QZ1VLUvpD/HiEQYDap 9BfdsmGNEP3CfwuI19WeCkbb7OjvrCnSwGj5JES8w0MLluh0fLT7Gu2qW7bmIOd3bn3y BWrNadZghxTmnVtEUTFlvPIpujTB/6IEk6Tx91U7Xc0mnZ4EeFWMVn1iMawZksP4deew yoYg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Pi9MfJ0cvH9gG7gsSpy0PhsBmA6qzHDQOreJJzUEo3s=; b=JSivxOhoeFeoSUR3hK6oewup/W0Tk+OWTula4DeGYbgDiyCd5OomKd+QBLi+JZMv1+ 4q8AnsY67jW6paNGfC0UwnwGT53i3N4uaNsOZihLKVhpCc8ezo4nNYikBNC/m5vb9X8X /tk9qLcgs0xuzcKTbO4tIZN+6x7uIXTIlUHyUPZpeRMNntwI0sTJGKeDM559lKrjAr/O fiveho2zKZa8BD81KNiGZKfokkrh5ieCWTinGt12HENyrZpf1RxC+zuv/vdGrF7w5aTQ qTPkYe8pmzppK4U1EsILHn4GGSRwrDvf+5M8qQIVQJnUzLlykpbVHPZwZA2s0kl5I5U9 64NA==
X-Gm-Message-State: AOAM533iYSzJ/HuHWIKb0YzaV6b7I64pzsKwyZAsDZk3utb6Oa6vw6yZ vIQGMUi7Iflu1z9KKrwZJnXxyvu37BG33FRDC0s=
X-Google-Smtp-Source: ABdhPJwJZC1/yAwpd0mIMhXpGHJ9ob1kLVz7631a4/7YxrpQkNSyV+Pln4lam0Oo2pkt6aEwaNj3M/6yD7+vQ8HRQe0=
X-Received: by 2002:a17:907:2108:: with SMTP id qn8mr8291345ejb.127.1607638056905; Thu, 10 Dec 2020 14:07:36 -0800 (PST)
MIME-Version: 1.0
References: <20201209002639.GC16661@fieldses.org> <93d4e52e-23e6-cf5f-4b0f-50060f4c6151@talpey.com> <20201209144927.GB23889@fieldses.org> <2d94c517-04ba-75b0-9583-4b7eb4aa8ced@talpey.com> <YQXPR0101MB096883BD0B2EBF66D12FC732DDCC0@YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM> <20201209225944.GC24283@fieldses.org>
In-Reply-To: <20201209225944.GC24283@fieldses.org>
From: David Noveck <davenoveck@gmail.com>
Date: Thu, 10 Dec 2020 17:07:27 -0500
Message-ID: <CADaq8jdYyigfkHDbAdk7uARzdSsoNHdPZdUJjPMka5_4tZ6C6Q@mail.gmail.com>
To: "J. Bruce Fields" <bfields@fieldses.org>
Cc: Rick Macklem <rmacklem@uoguelph.ca>, Tom Talpey <tom@talpey.com>, "nfsv4@ietf.org" <nfsv4@ietf.org>
Content-Type: multipart/alternative; boundary="0000000000004f317e05b62367d6"
Archived-At: <https://mailarchive.ietf.org/arch/msg/nfsv4/3H-OOKJ6C64RkjlvmXUMh4QiSSE>
Subject: Re: [nfsv4] persistent sessions and compound atomicity
X-BeenThere: nfsv4@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nfsv4/>
List-Post: <mailto:nfsv4@ietf.org>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 10 Dec 2020 22:07:41 -0000

On Wed, Dec 9, 2020, 5:59 PM J. Bruce Fields <bfields@fieldses.org> wrote:

> On Wed, Dec 09, 2020 at 04:43:59PM +0000, Rick Macklem wrote:
> > I would say that the ATOMIC refers to the individual operations of the
> > compound. In other words, it must cache the reply to each operation
> > when it is completed, in the persistent cache.
> >
> > Then, if a retry of the compound is received after a server reboot,
> > the reply for the first K operations that were completed prior to the
> > reboot are generated from the cache and the remaining N-K are
> > performed on the file system to complete the reply. (At least for the
> > non-idempotent operations in the compound.)
> >
> > For this to all work correctly, I think the server file system would
> > need to perform each non-idempotent operation ATOMICALLY as well, such
> > that after the reboot the file system is in either the pre-operation
> > or post-operation state.
>
> Great, sounds like everyone agrees, I'll calm down.
>

I don't see the need for individual ops to be atomic especially since they
(e.g. writes) are not defined as atomic in general.

I don't think we have total agreement but we are moving in the same
direction.  No reason to be anything but calm.
.

>
> > rick, who has no intention of ever trying to implement a persistent
> > session cache.
>

Your input is still valuable.


> I can't decide.  It looks like kind of a pain.  It'll require some
> cooperation with the filesystem folks--I think it needs to be integrated
> with filesystem journaling somehow.
>

That makes sense.


> But I'm not looking forward to someone running into this, and having to
> say, "oh yeah, we've known about that bug for decades; just give me
> another few months or a year, and I'll fix it right up for you...."
>

I have a revised version of this section in draft-dnoveck-rfc5661bis-00.
(Will be out before next year).  I hope we will discuss that and get to a
text that everybody does agree on, and might even be implementable :-)

>
> --b.
>
> _______________________________________________
> nfsv4 mailing list
> nfsv4@ietf.org
> https://www.ietf.org/mailman/listinfo/nfsv4
>