Re: [nfsv4] AD Evaluation for draft-ietf-nfsv4-rpcrdma-bidirection-05

spencer shepler <spencer.shepler@gmail.com> Thu, 12 January 2017 18:32 UTC

Return-Path: <spencer.shepler@gmail.com>
X-Original-To: nfsv4@ietfa.amsl.com
Delivered-To: nfsv4@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5639012945F; Thu, 12 Jan 2017 10:32:24 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.699
X-Spam-Level:
X-Spam-Status: No, score=-2.699 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Mnovs9S5DxqX; Thu, 12 Jan 2017 10:32:22 -0800 (PST)
Received: from mail-io0-x232.google.com (mail-io0-x232.google.com [IPv6:2607:f8b0:4001:c06::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DC5881293F3; Thu, 12 Jan 2017 10:32:21 -0800 (PST)
Received: by mail-io0-x232.google.com with SMTP id v96so25387202ioi.0; Thu, 12 Jan 2017 10:32:21 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=dIDddDLoDHjtJ1EfUmy+DCIpQpVR+YxyzB5PPY8LIAU=; b=NJ/iRFvYQ9cAzWuBIIstkJOWH46D16LaIiSF2uhGqEUK9fotfcENWHNQPzMIFMiC4X JG2zJSZGxz+5dCL4Q/E7VCkBXDF6L87INnRefKn5RUZN4uYr6NCFSudujCgVSx9ILKpY /QgdvYTPhxXJQQNTxYYmPJkAuuNH675hE4+hIvgQLSd9VZU6rnYEj4gRf96mjNF+AQOx t0ryMYcy0w7zEiFk8TZe6m3e/X13Jg2c2vrnX2fZVMagwM0q0mI4TqhId16sX+Dbh/l2 9hMQZpx/2RlUqT1wMROjbp+ZXuFuioPfkHb1s5wYVQGLG7K5lRcJMCiTR+/OabaP12bL ofzQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=dIDddDLoDHjtJ1EfUmy+DCIpQpVR+YxyzB5PPY8LIAU=; b=KUWlxGId+NTiZvWsaiWpfsqK2CCgGIWAIJOEWcX1TIxjg7FalJpWnaJEX81IXei4jV FfrqbHqPc2cmPUda0wUKLzfIaUaXYA+22RP4vcfkosL04tj57SBjU0tvcTx6pribo0G2 KlppPE1ToUNv7cfDQApbrFHcAV6hJk16dLfeSkKLJKKQz7WEiS1E+9K3emSrHOPXsFq6 G6ZjjsvXTgc+Tx1EQMRcuHIgU+UjsdHUc0o5HIhMJLw08k/ygNNTuvhMRvDoER0MoMkR lzztNalGuwGNEOwbi/n3Is0wsG6x1kmlgjSTFdyyN2ip901hRuIKmv6Oi8ovddS5eWde WTWQ==
X-Gm-Message-State: AIkVDXIC33nXXIc3cZ2ZWGaz3kqYMtmsp8o+ESRhYWFF/1D0H4ophGj3RJzP+z1IHl7kjHWey/8+Id7YE4rzzA==
X-Received: by 10.107.19.169 with SMTP id 41mr14343592iot.209.1484245941254; Thu, 12 Jan 2017 10:32:21 -0800 (PST)
MIME-Version: 1.0
Received: by 10.107.5.77 with HTTP; Thu, 12 Jan 2017 10:32:20 -0800 (PST)
In-Reply-To: <CAKKJt-d8KhAeKQe-oCb5-22E-8EAg7ev=+V1dPz6GkKpxet2DQ@mail.gmail.com>
References: <CAKKJt-fuKMwX06PerWzxBdBqQ_=eMvhQKUdSDb5xLsSX47q=yw@mail.gmail.com> <6ED233CF-5ED5-4C64-B9BD-F04E0BED0445@oracle.com> <CAKKJt-eMeTaVxSUctAjvimKGJPf=7sXpoXa8Ky6MSsYXToy5MA@mail.gmail.com> <B7F5E6A3-9E31-4F63-BF2A-9B931F64A56E@oracle.com> <CAKKJt-d8KhAeKQe-oCb5-22E-8EAg7ev=+V1dPz6GkKpxet2DQ@mail.gmail.com>
From: spencer shepler <spencer.shepler@gmail.com>
Date: Thu, 12 Jan 2017 10:32:20 -0800
Message-ID: <CAFt6BakFgME+qO3B+e352v=8+Wd5fxVdvCT8UbNqeRVu=0z72A@mail.gmail.com>
To: Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com>
Content-Type: multipart/alternative; boundary="001a113f92d01681a00545e9f00d"
Archived-At: <https://mailarchive.ietf.org/arch/msg/nfsv4/AlJeashv4DDwMfDn5lye_sQGiCs>
Cc: draft-ietf-nfsv4-rpcrdma-bidirection@ietf.org, NFSv4 <nfsv4@ietf.org>
Subject: Re: [nfsv4] AD Evaluation for draft-ietf-nfsv4-rpcrdma-bidirection-05
X-BeenThere: nfsv4@ietf.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nfsv4/>
List-Post: <mailto:nfsv4@ietf.org>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 12 Jan 2017 18:32:24 -0000

Yes, Spencer D.  I believe we are ready with the updates that Chuck has
in-hand.  Thanks for the review.

Spencer S


On Tue, Jan 10, 2017 at 7:26 PM, Spencer Dawkins at IETF <
spencerdawkins.ietf@gmail.com> wrote:

> Hi, Chuck,
>
> On Tue, Jan 10, 2017 at 5:02 PM, Chuck Lever <chuck.lever@oracle.com>
> wrote:
>
>>
>> > On Jan 10, 2017, at 5:13 PM, Spencer Dawkins at IETF <
>> spencerdawkins.ietf@gmail.com> wrote:
>> >
>> > Hi, Chuck,
>> >
>> > On Tue, Jan 10, 2017 at 3:47 PM, Chuck Lever <chuck.lever@oracle.com>
>> wrote:
>> > Again, thanks for your review! Responses below.
>> >
>> > Oh, thank YOU. You responded while I still have this draft in my solid
>> state memory :-) ...
>> >
>> > It looks like we're good except for the last point.
>> >
>> > > On Jan 10, 2017, at 4:32 PM, Spencer Dawkins at IETF <
>> spencerdawkins.ietf@gmail.com> wrote:
>>
>> [ snipped ]
>>
>> > > In this text,
>> > >
>> > >    When message direction is not fully determined by context (e.g.,
>> > >    suggested by the definition of the RPC-over-RDMA version that is in
>> > >    use) or by an accompanying RPC message payload with a call
>> direction
>> > >    field, it is not possible for the receiver to tell with certainty
>> > >    whether the header credit value is a request or grant.  In such
>> > >    cases, the receiver MUST NOT use the header's credit value.
>> > >
>> > > does RDMA work at all, if the credit value can't be used?
>> >
>> > What this means is the receiver MUST NOT update its credit accounting
>> > based on the information in this header. These foggy situations should
>> > be exceptionally rare.
>> >
>> > "MUST ignore" might be more appropriate.
>> >
>> > I think what I was thinking about, is whether this situation can lead
>> to deadlock.
>>
>> The credit grant value has to be ignored whenever the forward and backward
>> grants are not the same value (which is typical in current
>> implementations).
>>
>> With the current set of protocols, the only case like this is RDMA_ERROR,
>> which is almost never used. Ignoring the credit value for those messages
>> doesn't seem problematic.
>>
>> If the backward credit grant (which is likely to be smaller) is suddenly
>> used in the forward direction, for that one message, the forward requester
>> would wait for any outstanding replies before sending more requests. The
>> next message from the responder would restore the forward credit grant to
>> its correct value.
>>
>> I don't think a deadlock could occur unless the grant value went to zero,
>> and that is already forbidden by rfc5666bis.
>
>
> I had forgotten that detail. Thanks for the wake-up call!
>
>
>> Another way to address this I suppose would be to ensure the grant values
>> in both directions are always the same.
>>
>>
>> > I guess I should back up and ask a more basic question, which is
>> whether you'd be able to recognize that this situation applies from looking
>> at the definition of the RPC-over-RDMA version, so you could just say "I'm
>> not going to do bidirectional" when a transport connection is established,
>> rather than trying to figure out that there's a problem during request
>> processing.
>>
>> An implementer would be able to tell where these corner cases are, since
>> her implementation has to ignore the credit value in those cases. But
>> maybe I'm missing something.
>>
>
> I'm thinking the guy who's missing something is me ;-)
>
> I think we're good to go on this document.
>
> Spencer (S), would you agree?
>
> Spencer (D)
>
>
> _______________________________________________
> nfsv4 mailing list
> nfsv4@ietf.org
> https://www.ietf.org/mailman/listinfo/nfsv4
>
>