Re: [nfsv4] I-D Action: draft-talpey-rdma-commit-02.txt

Tom Talpey <tom@talpey.com> Sat, 28 January 2023 17:23 UTC

Return-Path: <tom@talpey.com>
X-Original-To: nfsv4@ietfa.amsl.com
Delivered-To: nfsv4@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F3F58C14CF13 for <nfsv4@ietfa.amsl.com>; Sat, 28 Jan 2023 09:23:41 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level:
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, NICE_REPLY_A=-0.001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id KptwoMdXebod for <nfsv4@ietfa.amsl.com>; Sat, 28 Jan 2023 09:23:38 -0800 (PST)
Received: from NAM10-MW2-obe.outbound.protection.outlook.com (mail-mw2nam10on2085.outbound.protection.outlook.com [40.107.94.85]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4364AC14EB18 for <nfsv4@ietf.org>; Sat, 28 Jan 2023 09:23:38 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=GRb53dZ2l9LQ7Nl17I8DNUNXeVcTEJl1IF0yM7LSxsE9aDprUriZJS3pltCeX4ouBmHDr+NKH34R4mi+zIiRTOEyxByJAiZdcNd6ux5iPUYJzmCOJyAPXswkwbnfzDVN6syHUCQAZrHhyRUN3+kdeqwB52KcB+frrfM0u48jcwJwcXlH1SMZPStcXd/LNn5FPYZX5siJzWEli9cUA90PLM2yokYABiFp1DfSH3vnkSp6nMP/p49nn5jWC5VRvSNmCEhkRY23h5UnDZn6tkxIgj43Qw7BMit7ZfIF/j27WOIGuOBiCpEPnPhD940kWOxCVrGZ0QMHbnK8+S1F+yoVjQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=wRtEQypeYofjxT0r0qstzO+oYdfOK/ouf5Pd7XNe1kY=; b=b/GaehPUH/tTcacF15Ne3KzZR8uViUcRStl2g0ZBp0uISvIsUqaUOeXxU9D1dfgrJs0TpZnrRQq+6grUZWMCZgvJsunQVnMHs61qDH/qowaQR0K7dG5rChx7w9eUmEhGT5T5DEepeid4+wHIWuUysT0bA5OtJDa+ruOqiTTAhhwqhBS+Vpk76StkaADHzUoQYT7bh1Hqfenus3oyyg5BC1WN6N4ZWI2d47uvddKLFt41NhL5UGFdMDtD+8k+K0+Lxkqq9emTWDazri6TzGDJIFaeUA71dDuhIUeXB6i6W+7I1F8SaThgIKW1sPasAUxJEpNsTNgg4aG0cK8tq1oQJw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=talpey.com; dmarc=pass action=none header.from=talpey.com; dkim=pass header.d=talpey.com; arc=none
Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=talpey.com;
Received: from SN6PR01MB4445.prod.exchangelabs.com (2603:10b6:805:e2::33) by CY1PR01MB2171.prod.exchangelabs.com (2a01:111:e400:c612::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6043.22; Sat, 28 Jan 2023 17:23:35 +0000
Received: from SN6PR01MB4445.prod.exchangelabs.com ([fe80::d8d6:449f:967:ccb5]) by SN6PR01MB4445.prod.exchangelabs.com ([fe80::d8d6:449f:967:ccb5%7]) with mapi id 15.20.6043.022; Sat, 28 Jan 2023 17:23:35 +0000
Message-ID: <cd9a7b53-0ed3-d93c-b9df-cd5bbc562bd7@talpey.com>
Date: Sat, 28 Jan 2023 12:23:32 -0500
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.6.1
Content-Language: en-US
To: nfsv4@ietf.org
References: <167467274160.39051.3008830517684697598@ietfa.amsl.com> <1b04687d-92a3-8e70-d008-a96be7e32508@talpey.com> <1923E4A8-A466-4963-A891-0C3D08A60AA1@oracle.com>
From: Tom Talpey <tom@talpey.com>
In-Reply-To: <1923E4A8-A466-4963-A891-0C3D08A60AA1@oracle.com>
Content-Type: text/plain; charset="UTF-8"; format="flowed"
Content-Transfer-Encoding: 8bit
X-ClientProxiedBy: MN2PR04CA0006.namprd04.prod.outlook.com (2603:10b6:208:d4::19) To SN6PR01MB4445.prod.exchangelabs.com (2603:10b6:805:e2::33)
MIME-Version: 1.0
X-MS-PublicTrafficType: Email
X-MS-TrafficTypeDiagnostic: SN6PR01MB4445:EE_|CY1PR01MB2171:EE_
X-MS-Office365-Filtering-Correlation-Id: 56c4e76b-6be5-45bc-bbaf-08db015462f7
X-MS-Exchange-SenderADCheck: 1
X-MS-Exchange-AntiSpam-Relay: 0
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: PbyiZAIwGucIyIhNPlFmqv7aeKufS5rjVoKt6NZFduUq9WTVJzyXuT6MjkB2OWGKDudxzVJDDdr23xBsyMRQ1I06CHWlm3n6ZE4aV13GK9Pai7QhN3bn9MgU1fz1EOyTWw0Qwe0G2zw7ed9CiN/O6cclaZ0vPJEcq50wMqHBktE+ft/B/TPUMCl6Bo27AInmYEdLdLgODZKVgQ/bh+lfuzyD7Ec74LKLlPOtB3CjBz/vcP8sn16/WQqZ7J99AtqzxivtAYkYYvN3WzKiWq7j5TZ3UQDltp0i/oD5Iu17vRZn/HW/dXWcF4NKokwMyAu2c+VAPVcUyH07Vg4yq/XNivjqbaEs6mB0ap+QSZWFqJE22u+vWzd0zegWZR+Cftt8KegcoEZcmUTbFMoBXOZWTpd8AKiC/V7p6fw2HKAyY963w84MnQvNT+myL4g9ME+jcUN6hIh0l7A/MkfM7hFX0R9zLRGW9V0vPLGzN0+umEs2SDC50PlR0OLJ24nTR/nLPdaQMcEpuVR0B3PqHtwahJxckWCljCLImiQe91ObqYpnGdxPk9P6csWfkZGWI4IIN1EqJy5hCCeSY9r8U9NhfYPBFDsCATNZKEotzxayM9+Ya7u1VJxw5t2XMstJ7cPN+wrOj4jPETme8IeD+dS71HUNqVcC1afSL1R1smYFfXJDWhXpo9wruwtDCMbim89oYhnVgKvrCK3OdHN7ON+dfSKcv020cmJEYt03AxslOCwtbfOJrmAElr9xEtzaumyD
X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SN6PR01MB4445.prod.exchangelabs.com; PTR:; CAT:NONE; SFS:(13230025)(396003)(366004)(136003)(346002)(39830400003)(376002)(451199018)(31686004)(2906002)(316002)(186003)(26005)(6506007)(36756003)(53546011)(5660300002)(41300700001)(478600001)(66476007)(8676002)(6916009)(66556008)(6512007)(66946007)(86362001)(8936002)(52116002)(6486002)(38350700002)(38100700002)(966005)(66574015)(83380400001)(2616005)(31696002)(6666004)(43740500002); DIR:OUT; SFP:1101;
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: YToLJW0v8EP49YgVpMIUJDN4IpSutayfx34zUDuFmpRm04d3XWTGPQniTb7L62fbjVnoLpmCeYHbKY1VP586jrYcH2VEID8HJde9t/ct4tjdrJp2o+oEB8/L5psVvh5uNpty96jU9QoARI3XOlRdiHjHzF6OCeNLIGNPoErSeq5Eu8edQXxWqQ7fYqAeCfTpNtc/rCokLNXhP+EJ24oo/YXJOKmUawWcvZiaqaEce6+0d5VP9mPq0XZFOInWH1i5WY50n2vaikeTmVwTJ1g1KIO7B3iCD08YZIuKtddct4QEDeJjdbzO6Q1BIKf1o4Mg8vyrNRbxWJDu353+5G3Nmz0oN0iMePPb3Cq7B2TY7YYto213HUVssUrGh+nkV7qHuvmdlrDnZm9jljwNvJ3SseOxN3iT5vtYX6QhdI7eGs6fxntTKxGmH+3zwlLrzUKX+W8zik2yAAe9iG8PocFb5zTU+hPivVplUKGZeoyKuSXrspByUuiHipZnQIa6qTdJbk0eQrZbZUlKoCWNG2I4L5lxvErVXKyLuA52UvUK/a9bTHK+ie7nrW/dfu+g1IDO7Oj4//OkA+1spPLsTfks9bRvfz1xLrFO4Iy+zIdR80uQE4vHUeUyJde0EP1e3O33R6JybeHzuU0ePKnBvqAzVanBe8JZ7OCtpE6gUSdRmwi8p9nR6G/fZKnwtAX77EfepgGxj3M36mNCkxmBI6rSs2hPWJTH+bbisA8gGZ1CsjZMzxkzUR7StSFoZQpuhK1GCap1EN0tjIUcfACzmZOO1vFdcvRbn7qO9u6ZRQ3/5riB54+UM4/275gkO8OM1kcO7LU6eBvSyolLzdMEegEEI87D8Y0TJG6vNLhyyd77VaMgr0y+/g9lSWzDyRMYOP5M/lMK/iO/BRmhy/VILlqOtg+isFcKG9AHM4GcCBriOpwQek2YODKr10NefD1iBrER38KDUTapPV8AaUkUaUOfKGG6K7X/FRhje5VAAbLygEuh/s6fuONM2yz4dX5qo0pa4SN64Mh4AWDIjPv4nmmYpFw/ll8cln+EM3lHyEIBv48iVAzIc4efAnotoqcuywxbtYFq1k1HgSy1HWPGKFVKajCDB8pO5o7kzczk0ofg4MQQi7+5HPtEDxEMdCRHn0hdAMU/KEpe4314ov2wATZF8Vu+0s2WRwo0Hbs7dF7LSUHCqPvWt/1s/zOYLklSTFdBFUMf8CGgoMcRJKjxe32HEqCKqEW5cKk7vABan51dKZQR9LQc/NEvw/8OVbOk1iozZb28NPIK5CHdNgNraIz3zTxUd2H+C0jBsY1hWGr9M7UbM4ueJFJ/9geQ1j1k/aZsHBWYDqEP96tI2dW2Wacyh3aM+c6J5Ql0e/3gUZi9MyuMoF48w0VcQ0vEsgc2dCuM96/1/DsvL5d4Ez93ToC/kaVm6LHG9ni8LZiZIYTaJmpmiQvFvTUHpB9qHHW8qSPm4yWgTft3TqAACjzpUfMFAXW6Pck0DpumzOVAFfnb+2vdT2IN1CDK6ChYtC5KnPrhwpRJdsOIIBvNMRB7bZPeKFnnZ7E1aBAU5E4HdF3GFQT8XQPObqty09vQ9VqnobfM
X-OriginatorOrg: talpey.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 56c4e76b-6be5-45bc-bbaf-08db015462f7
X-MS-Exchange-CrossTenant-AuthSource: SN6PR01MB4445.prod.exchangelabs.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 28 Jan 2023 17:23:35.4684 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 2b2dcae7-2555-4add-bc80-48756da031d5
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: aeEQjFuVq2+/e6ATwSHmXjZ2MD1sG0+zDkW8gtbNi0h+8U2ddwVSzPll+aQmdAXR
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY1PR01MB2171
Archived-At: <https://mailarchive.ietf.org/arch/msg/nfsv4/5YYb5_R5dNcF1jwWCBiFV2I3Lac>
Subject: Re: [nfsv4] I-D Action: draft-talpey-rdma-commit-02.txt
X-BeenThere: nfsv4@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nfsv4/>
List-Post: <mailto:nfsv4@ietf.org>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 28 Jan 2023 17:23:42 -0000

On 1/26/2023 5:23 PM, Chuck Lever III wrote:
> I read through this document to get a flavor. A couple of observations/comments follow:

Thanks for the early review!

> The Requirements Language section needs to be updated to include a reference to RFC 8174. For reference, the most recent version of the RL boilerplate looks like this:

Interesting, the id-nits tool does not flag this. Because this is still 
an individual draft, I didn't update any of the boilerplate from the 
earlier versions. Obviously this will be done if it becomes a WG document.

> Section 1 is lengthy and contains considerable repetition.

Yes, this informational section was lightly updated, but for this review 
it was left in place. We can certainly discuss what part(s) remain 
useful in a normative standards-track version, and either edit, move or 
delete.

One note however:

> 	• The definition of "Persistence" in Section 1.1 is confusing.
> 		• Perhaps a short discussion of the terms "persistence" and "durability" (or a mention that they are synonyms) might be appropriate.

I intended to remove the no-longer-preferred term "durable", but oops I 
did neglect to delete the single reference to the term.

I also intended to remove "commit" where it was used to mean "flush", 
and there is at least one vestige. Its use in the filename is purely to 
maintain continuity and will be renamed if adopted.

> 	• Is there a purpose for "Global" in the definition of "Global Visibility" (as opposed to "Local Visibility")? A brief discussion of that distinction would help orient readers; or perhaps it is covered elsewhere in the document and I missed it.

Yes, "global" is an important qualifier and it's in the first sentence 
of the glossary. But it could be made clearer. In a nutshell, 
persistence is for storage semantics, while global visibility is for 
shared memory semantics. Upper layer processing is required to implement 
these over traditional RDMA.

> Section 3 is marked "INCOMPLETE". What is the plan to complete this section? Is there other remaining significant work planned for this document?

It's intended to mirror the format of RFC5040 and RFC7306, but there are 
some new requirements that make the old table format difficult to reuse. 
I have an idea, but thought it was better to get the ball rolling now.

And, I don't plan other additions, apart from things that a WG 
discussion might generate.

> Is there any implementation status to document via an "Implementation Status" section? I would like to see one... or at least an informal report on the mailing list about current implementation plans, as part of the planned IETF 116 discussion of this document.

There have been experimental implementations, which are not for me to 
cite in a standards-track document. There is also at least one non-IETF 
protocol which has implemented a similar set of functionalities, in fact 
whose semantics were based on earlier versions of this draft.

> The third paragraph of "6. Security Considerations" touches on this, but what is the trust relationship between the peers in push mode? How do push mode peers authenticate to each other?

This is entirely the domain of the upper layer. It needs to determine 
whether the peer is trusted, prior to creating and advertising a 
push-mode memory handle for that peer. Perhaps this can be stated more 
forcefully.

Tom.


>> -------- Forwarded Message --------
>> Subject: I-D Action: draft-talpey-rdma-commit-02.txt
>> Date: Wed, 25 Jan 2023 10:52:21 -0800
>> From: internet-drafts@ietf.org
>> Reply-To: internet-drafts@ietf.org
>> To: i-d-announce@ietf.org
>>
>>
>> A New Internet-Draft is available from the on-line Internet-Drafts directories.
>>
>>
>>         Title           : RDMA Extensions for Enhanced Memory Placement
>>         Author          : Tom Talpey
>>   Filename        : draft-talpey-rdma-commit-02.txt
>>   Pages           : 37
>>   Date            : 2023-01-25
>>
>> Abstract:
>>    This document specifies extensions to RDMA (Remote Direct Memory
>>    Access) protocols to provide capabilities in support of enhanced
>>    remotely-directed data placement on memory-addressable devices,
>>    including persistent memory.  The extensions include new operations
>>    supporting remote commitment to persistence of remotely-managed
>>    buffers, which can provide enhanced guarantees and improve
>>    performance for low-latency storage applications, and to the
>>    visibility of such buffers in support of remote shared memory
>>    semantics.  This document updates RFC 5040 (Remote Direct Memory
>>    Access Protocol (RDMAP)) and updates RFC 7306 (RDMA Protocol
>>    Extensions).
>>
>>
>>
>> The IETF datatracker status page for this draft is:
>> https://datatracker.ietf.org/doc/draft-talpey-rdma-commit/
>>
>> There is also an htmlized version available at:
>> https://datatracker.ietf.org/doc/html/draft-talpey-rdma-commit-02
>>
>> A diff from the previous version is available at:
>> https://author-tools.ietf.org/iddiff?url2=draft-talpey-rdma-commit-02
>>
>>
>> Internet-Drafts are also available by rsync at rsync.ietf.org::internet-drafts
>>
>>
>> _______________________________________________
>> I-D-Announce mailing list
>> I-D-Announce@ietf.org
>> https://www.ietf.org/mailman/listinfo/i-d-announce
>> Internet-Draft directories: http://www.ietf.org/shadow.html
>> or ftp://ftp.ietf.org/ietf/1shadow-sites.txt
>>
>> _______________________________________________
>> nfsv4 mailing list
>> nfsv4@ietf.org
>> https://www.ietf.org/mailman/listinfo/nfsv4
> 
> --
> Chuck Lever
> 
> 
> 
> _______________________________________________
> nfsv4 mailing list
> nfsv4@ietf.org
> https://www.ietf.org/mailman/listinfo/nfsv4