Re: [nfsv4] AD Evaluation for draft-ietf-nfsv4-rpcrdma-bidirection-05

Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com> Thu, 12 January 2017 18:35 UTC

Return-Path: <spencerdawkins.ietf@gmail.com>
X-Original-To: nfsv4@ietfa.amsl.com
Delivered-To: nfsv4@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F1F5A12945F; Thu, 12 Jan 2017 10:35:34 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level:
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id RANDRKcqyDAr; Thu, 12 Jan 2017 10:35:32 -0800 (PST)
Received: from mail-yb0-x235.google.com (mail-yb0-x235.google.com [IPv6:2607:f8b0:4002:c09::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 200941294BB; Thu, 12 Jan 2017 10:35:28 -0800 (PST)
Received: by mail-yb0-x235.google.com with SMTP id c125so8267474ybf.1; Thu, 12 Jan 2017 10:35:28 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=fINpj0c+0oQP2LFrdvuMqexKfAXb5G1y41HQ9t7upjE=; b=f1Xjeoj9UQxqxacnBQ2AGTWKMUa+aQjy8+UPIRzCANy03ojYX+p6hifcWSh0J1dyU9 gFoyE9DHhcaAhug8Vk1y9CdI8TSpjcQoK0DNXG5P2444E2Q4oUVwQ/jsDYdY1NL0W5JG ezW4y9xFK/cuk+o2QtHe7YMWgB2jq5abXXNC7jUIweFNeThUNdAMnyHHZA6pTWnizfDH qKxUSP9x8dujRfs2wccgvB/YUdYsv99GulT6zI1bUVEWdp3qo8Eq7Tz51VAOnw96XEOV ZWtWB4VVjWvQOAHHx95vW6kR5Xl/YHaoz271Z/Cw1X+QXICn3xjbGUyGg2QDpPCjdFsR TXUQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=fINpj0c+0oQP2LFrdvuMqexKfAXb5G1y41HQ9t7upjE=; b=Y08VHZ8wd2i3B+4cbAcMWkExuhn9S2Tygxq/fsEGaXqcjCjyJFFwlBySiKtPt3LlL4 keQ3Ihu/Kg0jHjXkWd6q8lvpYyLn7Pd61qfDrCNG6D8OtbDQAvObk24O4wCMfnC89x7t 8YvjZWGG+YlANPBkkNiSXCmvTaDPljlWlseite5G+B2f3Ps3xWM/krvsh0wJ2/bpbG40 K+eUFgN/H435JwYAeyEXrMIOE6Xf0iP9307NUTyRMpNfwYqswuNHXH6iUI9Zm5lrWq5x tb8wXZtUnfNYn05+pY2p1Ylec1JSQ5AnIP9Qb47WgtXQ/u7ULSRK3yKmpoax4HGnNugk MujA==
X-Gm-Message-State: AIkVDXJ79AxCLoTCkgI2F/25ZfjXghu9CTrXaONgOm27X7M0hrtkkXYPMqXK2Re5hIBU4gH2wL32zpJjbn6B3Q==
X-Received: by 10.37.205.196 with SMTP id d187mr9661479ybf.161.1484246127262; Thu, 12 Jan 2017 10:35:27 -0800 (PST)
MIME-Version: 1.0
Received: by 10.37.221.195 with HTTP; Thu, 12 Jan 2017 10:35:26 -0800 (PST)
Received: by 10.37.221.195 with HTTP; Thu, 12 Jan 2017 10:35:26 -0800 (PST)
In-Reply-To: <CAFt6BakFgME+qO3B+e352v=8+Wd5fxVdvCT8UbNqeRVu=0z72A@mail.gmail.com>
References: <CAKKJt-fuKMwX06PerWzxBdBqQ_=eMvhQKUdSDb5xLsSX47q=yw@mail.gmail.com> <6ED233CF-5ED5-4C64-B9BD-F04E0BED0445@oracle.com> <CAKKJt-eMeTaVxSUctAjvimKGJPf=7sXpoXa8Ky6MSsYXToy5MA@mail.gmail.com> <B7F5E6A3-9E31-4F63-BF2A-9B931F64A56E@oracle.com> <CAKKJt-d8KhAeKQe-oCb5-22E-8EAg7ev=+V1dPz6GkKpxet2DQ@mail.gmail.com> <CAFt6BakFgME+qO3B+e352v=8+Wd5fxVdvCT8UbNqeRVu=0z72A@mail.gmail.com>
From: Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com>
Date: Thu, 12 Jan 2017 12:35:26 -0600
Message-ID: <CAKKJt-cVMOU9wgfj0p+OVQRq_g3-79OumvN+6LGrX8tqh0x-7Q@mail.gmail.com>
To: Spencer Shepler <spencer.shepler@gmail.com>
Content-Type: multipart/alternative; boundary="94eb2c189a2e2cbfe60545e9fb80"
Archived-At: <https://mailarchive.ietf.org/arch/msg/nfsv4/4RHyaVvJdj4X0H_c376wrv7oCwI>
Cc: draft-ietf-nfsv4-rpcrdma-bidirection@ietf.org, NFSv4 <nfsv4@ietf.org>
Subject: Re: [nfsv4] AD Evaluation for draft-ietf-nfsv4-rpcrdma-bidirection-05
X-BeenThere: nfsv4@ietf.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: NFSv4 Working Group <nfsv4.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nfsv4/>
List-Post: <mailto:nfsv4@ietf.org>
List-Help: <mailto:nfsv4-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nfsv4>, <mailto:nfsv4-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 12 Jan 2017 18:35:35 -0000

Hi, Spencer (S),

On Jan 12, 2017 12:32, "spencer shepler" <spencer.shepler@gmail.com> wrote:


Yes, Spencer D.  I believe we are ready with the updates that Chuck has
in-hand.  Thanks for the review.

Spencer S


Excellent. I'll request Last Call when Chuck submits his update.

Spencer



On Tue, Jan 10, 2017 at 7:26 PM, Spencer Dawkins at IETF <
spencerdawkins.ietf@gmail.com> wrote:

> Hi, Chuck,
>
> On Tue, Jan 10, 2017 at 5:02 PM, Chuck Lever <chuck.lever@oracle.com>
> wrote:
>
>>
>> > On Jan 10, 2017, at 5:13 PM, Spencer Dawkins at IETF <
>> spencerdawkins.ietf@gmail.com> wrote:
>> >
>> > Hi, Chuck,
>> >
>> > On Tue, Jan 10, 2017 at 3:47 PM, Chuck Lever <chuck.lever@oracle.com>
>> wrote:
>> > Again, thanks for your review! Responses below.
>> >
>> > Oh, thank YOU. You responded while I still have this draft in my solid
>> state memory :-) ...
>> >
>> > It looks like we're good except for the last point.
>> >
>> > > On Jan 10, 2017, at 4:32 PM, Spencer Dawkins at IETF <
>> spencerdawkins.ietf@gmail.com> wrote:
>>
>> [ snipped ]
>>
>> > > In this text,
>> > >
>> > >    When message direction is not fully determined by context (e.g.,
>> > >    suggested by the definition of the RPC-over-RDMA version that is in
>> > >    use) or by an accompanying RPC message payload with a call
>> direction
>> > >    field, it is not possible for the receiver to tell with certainty
>> > >    whether the header credit value is a request or grant.  In such
>> > >    cases, the receiver MUST NOT use the header's credit value.
>> > >
>> > > does RDMA work at all, if the credit value can't be used?
>> >
>> > What this means is the receiver MUST NOT update its credit accounting
>> > based on the information in this header. These foggy situations should
>> > be exceptionally rare.
>> >
>> > "MUST ignore" might be more appropriate.
>> >
>> > I think what I was thinking about, is whether this situation can lead
>> to deadlock.
>>
>> The credit grant value has to be ignored whenever the forward and backward
>> grants are not the same value (which is typical in current
>> implementations).
>>
>> With the current set of protocols, the only case like this is RDMA_ERROR,
>> which is almost never used. Ignoring the credit value for those messages
>> doesn't seem problematic.
>>
>> If the backward credit grant (which is likely to be smaller) is suddenly
>> used in the forward direction, for that one message, the forward requester
>> would wait for any outstanding replies before sending more requests. The
>> next message from the responder would restore the forward credit grant to
>> its correct value.
>>
>> I don't think a deadlock could occur unless the grant value went to zero,
>> and that is already forbidden by rfc5666bis.
>
>
> I had forgotten that detail. Thanks for the wake-up call!
>
>
>> Another way to address this I suppose would be to ensure the grant values
>> in both directions are always the same.
>>
>>
>> > I guess I should back up and ask a more basic question, which is
>> whether you'd be able to recognize that this situation applies from looking
>> at the definition of the RPC-over-RDMA version, so you could just say "I'm
>> not going to do bidirectional" when a transport connection is established,
>> rather than trying to figure out that there's a problem during request
>> processing.
>>
>> An implementer would be able to tell where these corner cases are, since
>> her implementation has to ignore the credit value in those cases. But
>> maybe I'm missing something.
>>
>
> I'm thinking the guy who's missing something is me ;-)
>
> I think we're good to go on this document.
>
> Spencer (S), would you agree?
>
> Spencer (D)
>
>
> _______________________________________________
> nfsv4 mailing list
> nfsv4@ietf.org
> https://www.ietf.org/mailman/listinfo/nfsv4
>
>