Re: [nfsv4] questions about flow control

Martin Duke <martin.h.duke@gmail.com> Mon, 03 May 2021 17:35 UTC

Return-Path: <martin.h.duke@gmail.com>
X-Original-To: nfsv4@ietfa.amsl.com
Delivered-To: nfsv4@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id EBB003A1DB7; Mon, 3 May 2021 10:35:17 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.096
X-Spam-Level:
X-Spam-Status: No, score=-2.096 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id QFfDb45h-y0s; Mon, 3 May 2021 10:35:13 -0700 (PDT)
Received: from mail-il1-x12a.google.com (mail-il1-x12a.google.com [IPv6:2607:f8b0:4864:20::12a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2171B3A1DB5; Mon, 3 May 2021 10:35:12 -0700 (PDT)
Received: by mail-il1-x12a.google.com with SMTP id l19so4234252ilk.13; Mon, 03 May 2021 10:35:12 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=ZNGX77dzpr4mce4dpJPrxhw/jXIW+xZN8tV2CmRUB8w=; b=SEakrn040QPYqpP+gmPW1ZMJPdG0mFMyEjglZhJ4GDR+m/um56IehSNNeiTQRNf/t3 3mez9d3c7JxKIHd5ijivrBJF+7CKldGCF53SYm62+qj/8ShKl6OcBX1Vn/uKPV+EAT49 plC8cpJi6/UtAm6bpgyBOVtUybWNOkjMEwHB10UbHQgoM45zuGG5c7HG1voOto6z+gcv SjI6V/Qh45MVSq6GLhYoTr+pCoJw5lvzxnumJ77dobHu+XywSoZdKdThCRkBGCGJpbBg 9hFdbrkN62KlmqdcHfMaNhwvXyK9LGFYir3K7pFTW3uGetpJtZ7/fMvykkpMRzY7YKxH c2lA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ZNGX77dzpr4mce4dpJPrxhw/jXIW+xZN8tV2CmRUB8w=; b=qz8JP3hQk2LYjFPxwrpFOdcJJ0k29syD6moRelUzCP+IuHQQCOq49llnL25448CMIL QmkN3gXdkeW2ayGfnSjSCZDrAGDlrqdzUXzXcLadyQ5SGqCapS6xmsC7hbLIX839g2F0 +CcZMgejMoq3MPDW5tUpW+/7S5s5XWrmyTkIc6vXCY/4a08RN/o8HazNs+5cFFYWLwOD z+0SCR6sOz1WgRMPwF0MMXEk8c36AQFCS3OVZzhu2wEt9Ummqr3keuoy4eo1HNp2lR/N CTBMy0brrLc9zNq3wV610E+vLiYmOEITiUt1tlH1tLej1TBz/pUSon0fyIJAjcPiBZBv hRpw==
X-Gm-Message-State: AOAM532dcCp/wHLi9LiLGT+leMiH1SV0Yb0xS3vAbwADqOtZkx9onUo9 9UChpGxFwBpfC2BIEPTBDcDybrJiHDhdKsNiRqA=
X-Google-Smtp-Source: ABdhPJxa5tT6W6JMi9C5JkrxzFjudmxNc/E9/Y11auQwz8yLL35Le2qboD/DxLCIXkLmAur00SzegOigp3+Ajgh6TUg=
X-Received: by 2002:a05:6e02:2162:: with SMTP id s2mr17110461ilv.237.1620063310465; Mon, 03 May 2021 10:35:10 -0700 (PDT)
MIME-Version: 1.0
References: <EAF8A6D7-5E55-4078-945A-8DA8CF28496D@oracle.com>
In-Reply-To: <EAF8A6D7-5E55-4078-945A-8DA8CF28496D@oracle.com>
From: Martin Duke <martin.h.duke@gmail.com>
Date: Mon, 03 May 2021 10:35:08 -0700
Message-ID: <CAM4esxQZY8JD6JAZK=N+-DdKbgGM3QaZG3sim5_9jAPkfjuxGg@mail.gmail.com>
To: Chuck Lever III <chuck.lever@oracle.com>
Cc: NFSv4 <nfsv4@ietf.org>, "nfsv4-ads@ietf.org" <nfsv4-ads@ietf.org>, David Noveck <davenoveck@gmail.com>
Content-Type: multipart/alternative; boundary="000000000000224ec505c1706206"
Archived-At: <https://mailarchive.ietf.org/arch/msg/nfsv4/3u7qpn0lYowz1chrp_1E8alimQY>
Subject: Re: [nfsv4] questions about flow control
X-BeenThere: nfsv4@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nfsv4/>
List-Post: <mailto:nfsv4@ietf.org>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 03 May 2021 17:35:18 -0000

There are tons of people I would trust with this, but I might recommend
Jana Iyengar as a first stop.

On Thu, Apr 29, 2021 at 11:17 AM Chuck Lever III <chuck.lever@oracle.com>
wrote:

> Howdy-
>
> We're working on prototyping RPC/RDMA version two. As many of
> you know, RPC/RDMA uses credit-based flow control.
>
> I've presented to the WG before on the kinds of improvements
> to credit accounting we need to make over version one of
> RPC/RDMA in order to support control plane operations and
> message continuation -- cases where we no longer have
> perfectly symmetrical Call/Reply pairing.
>
> I'm looking at Section 4.2.1.1 of draft-ietf-nfsv4-rpcrdma-version-two
> as it is currently constructed and I'm finding it ...
> underwhelming.
>
> I'm thinking of replacing it with something more akin to the
> original forms of credit-based flow control, as described in
> Chapter 4 of:
>
> https://dl.acm.org/doi/pdf/10.1145/190314.190324
>
> and implemented in the form of Chapter 5 of that paper. The
> rdma_credits field would be filled in with the sender's Vr,
> in both directions, and N2 + N3 would be the credit limit. We
> would need to add some kind of "reset credit accounting"
> message as well.
>
> I'm not feeling confident about this choice, however. Does
> anyone know a person or people who could answer some questions
> about flow control design? Or is there a good reference I could
> read to help me understand fundamentals and common pitfalls?
>
> Many thanks in advance!
>
>
> --
> Chuck Lever
>
>
>
>