Re: [nfsv4] I-D Action: draft-ietf-nfsv4-rpcrdma-version-two-01.txt

Chuck Lever <> Fri, 17 January 2020 18:32 UTC

Return-Path: <>
Received: from localhost (localhost []) by (Postfix) with ESMTP id C4980120043 for <>; Fri, 17 Jan 2020 10:32:13 -0800 (PST)
X-Virus-Scanned: amavisd-new at
X-Spam-Flag: NO
X-Spam-Score: -1.998
X-Spam-Status: No, score=-1.998 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: (amavisd-new); dkim=pass (2048-bit key)
Received: from ([]) by localhost ( []) (amavisd-new, port 10024) with ESMTP id g7NiTRCKuYOE for <>; Fri, 17 Jan 2020 10:32:08 -0800 (PST)
Received: from ( [IPv6:2607:f8b0:4864:20::b32]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by (Postfix) with ESMTPS id BB419120025 for <>; Fri, 17 Jan 2020 10:32:08 -0800 (PST)
Received: by with SMTP id x18so6301872ybk.6 for <>; Fri, 17 Jan 2020 10:32:08 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;; s=20161025; h=from:content-transfer-encoding:mime-version:subject:date:references :to:in-reply-to:message-id; bh=lJzdKdZvwKzUz6WmIXQMjq1iN1Hn+3HZg9LHBtXvvtg=; b=dYDD7cx3eA3dLkhYi3wDer+RxgohYm4OK1bJPlXoH3JsWXqPZRXGjxNOBwCWbg4KCg 2YhGsR5fM3iY4kOoZozOOVSiYMoPykbTyY0fFydTVI2Eh+Kn8vRju8ZtgKevKnlWCzc+ 0conjbTsKsvgR4fd1bIa4WTuA/5fnt7K3/SrWpvohfK96sQE1Oeo3IJJGwryvbUCVHmM jpdKK7VJAYzaBBxg51bDLA30LV2lefEHO1wyPWARCxYWLImneVvqmX67hDhIUuB69TLx RJHI8vqcF3Ci9uCF2y+og6WkSTRDsaov2zFxq774XAnRqZwAvpDG+mp0vUYac5WNMaDO WOkg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:date:references:to:in-reply-to:message-id; bh=lJzdKdZvwKzUz6WmIXQMjq1iN1Hn+3HZg9LHBtXvvtg=; b=EbX12WnmWu3f+HbEJR6vQE/Tb6Xv8Weas+EvXeGLu6j6UxyFVTpt0RFaw03MopDvKr DevD7i1MeoEnDtDkqBMZW180uOUbWPqnnAPYlGqqQe7PSuTQvj8j3mUtVk6qPcEc7W4F JXuMU1PxsRj3O6UGh0zlJQRaLWoenaSXOrTMOfFyUU/467Kx74Ac7WP9H3byJ1VvBziL M3YRUzuMcoHycJPiHZRGHL3we2pmsAVLaisp7xVPw3XMwwo2sA3wdgxsYBJah7w0XZY2 euj7BLB7YgbPj7AJOsou4Al3t0KyXPI9fexPK59SrpKNCEEfW3Uwz5FyBBvUnSZkZ3xg 2czQ==
X-Gm-Message-State: APjAAAUOBKl3Jd/Fym9awMXQlp2KBIj/82al7z3R4wfd5ITzyCyPuHJ4 eODJX8YtuN6pDUx61y2+P9N4O7s+
X-Google-Smtp-Source: APXvYqx6yCIVs6lucV34l81B60RXXPCajBWoifDFgztoYQsvN3I31qXiizJLHTmyu76jpBEBrZrtSQ==
X-Received: by 2002:a25:c784:: with SMTP id w126mr30447360ybe.14.1579285927694; Fri, 17 Jan 2020 10:32:07 -0800 (PST)
Received: from ( []) by with ESMTPSA id b76sm12048493ywb.77.2020. for <> (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 17 Jan 2020 10:32:07 -0800 (PST)
From: Chuck Lever <>
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\))
Date: Fri, 17 Jan 2020 13:32:06 -0500
References: <>
To: NFSv4 <>
In-Reply-To: <>
Message-Id: <>
X-Mailer: Apple Mail (2.3445.104.11)
Archived-At: <>
Subject: Re: [nfsv4] I-D Action: draft-ietf-nfsv4-rpcrdma-version-two-01.txt
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NFSv4 Working Group <>
List-Unsubscribe: <>, <>
List-Archive: <>
List-Post: <>
List-Help: <>
List-Subscribe: <>, <>
X-List-Received-Date: Fri, 17 Jan 2020 18:32:14 -0000


> On Jan 17, 2020, at 1:11 PM, wrote:
> A New Internet-Draft is available from the on-line Internet-Drafts directories.
> This draft is a work item of the Network File System Version 4 WG of the IETF.
>        Title           : RPC-over-RDMA Version 2 Protocol
>        Authors         : Charles Lever
>                          David Noveck
> 	Filename        : draft-ietf-nfsv4-rpcrdma-version-two-01.txt
> 	Pages           : 83
> 	Date            : 2020-01-17
> Abstract:
>   This document specifies the second version of a transport protocol
>   that conveys Remote Procedure Call (RPC) messages using Remote Direct
>   Memory Access (RDMA).  This version of the protocol is extensible.
> The IETF datatracker status page for this draft is:
> There are also htmlized versions available at:
> A diff from the previous version is available at:
> Please note that it may take a couple of minutes from the time of submission
> until the htmlized version and diff are available at
> Internet-Drafts are also available by anonymous FTP at:

This is a substantially expanded revision of rpcrdma-version-two.
Changes include:

"Short" and "Long" messages have been renamed to encourage
implementers not to think only of RPC message size when choosing
how to convey an RPC message. Also, the discussion now has to
distinguish between using PZRs and Reply chunks v. Message
Continuation for messages that do not fit inline. The new term
is Payload Format. See Section 4.4.

A complete discussion of reverse-direction operation has been
merged into the document. See Section 4.5 and others.

A new section on error handling has been added. The section
fully describes each error and appropriate recovery behaviors
for Requesters and Responders. See Section 7.

The use of compliance keywords is more thrifty throughout.

The text has been thoroughly revised to make it easier to read
by reviewers and implementers.

I've attempted to address editor's notes, although some new ones
have appeared ( [ cel: .... ] ).

The document is now north of 80 pages, even though I'm watching
carefully for redundant text and sections that can be removed.
However the authors believe the proposed protocol is now close
to being feature-complete.

Chuck Lever