Re: [storm] iSER draft

Tom Talpey <ttalpey@microsoft.com> Thu, 14 July 2011 20:16 UTC

Return-Path: <ttalpey@microsoft.com>
X-Original-To: storm@ietfa.amsl.com
Delivered-To: storm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 19FC611E80C9 for <storm@ietfa.amsl.com>; Thu, 14 Jul 2011 13:16:21 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -110.598
X-Spam-Level:
X-Spam-Status: No, score=-110.598 tagged_above=-999 required=5 tests=[AWL=-0.000, BAYES_00=-2.599, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-8, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2G0QtUH3bWN9 for <storm@ietfa.amsl.com>; Thu, 14 Jul 2011 13:16:17 -0700 (PDT)
Received: from smtp.microsoft.com (smtp.microsoft.com [131.107.115.215]) by ietfa.amsl.com (Postfix) with ESMTP id D4C2A11E807B for <storm@ietf.org>; Thu, 14 Jul 2011 13:16:16 -0700 (PDT)
Received: from TK5EX14MLTC104.redmond.corp.microsoft.com (157.54.79.159) by TK5-EXGWY-E802.partners.extranet.microsoft.com (10.251.56.168) with Microsoft SMTP Server (TLS) id 8.2.176.0; Thu, 14 Jul 2011 13:16:16 -0700
Received: from TK5EX14MBXC111.redmond.corp.microsoft.com ([169.254.2.64]) by TK5EX14MLTC104.redmond.corp.microsoft.com ([157.54.79.159]) with mapi id 14.01.0323.002; Thu, 14 Jul 2011 13:16:16 -0700
From: Tom Talpey <ttalpey@microsoft.com>
To: Michael Ko <Michael@huaweisymantec.com>, Caitlin Bestler <cait@asomi.com>
Thread-Topic: [storm] iSER draft
Thread-Index: AQHMNlPpov6tD7xTq0WTfzkPhGmP2JTUcDZAgABph/mAAdAuAIATxsXggAFa2ACAAHJheIAAD/iA
Date: Thu, 14 Jul 2011 20:16:15 +0000
Message-ID: <F83812DF4B59B9499C1BC978336D91745EE039F9@TK5EX14MBXC111.redmond.corp.microsoft.com>
References: <BANLkTi=GVHUBdsZiwsRXxETd_rU=F8f85w@mail.gmail.com> <F83812DF4B59B9499C1BC978336D91745EDE207F@TK5EX14MBXC118.redmond.corp.microsoft.com> <971779FD6B314A40B1A3658E521C0D4A@china.huawei.com> <BANLkTik0rG2=orD0S0L3s62gBSJsLapA+w@mail.gmail.com> <F83812DF4B59B9499C1BC978336D91745EE0279D@TK5EX14MBXC111.redmond.corp.microsoft.com> <B443B9D1-754C-4D74-B43A-858A6031850A@asomi.com> <1680F0051D794095A86AF16343CAD400@china.huawei.com>
In-Reply-To: <1680F0051D794095A86AF16343CAD400@china.huawei.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [157.54.51.33]
Content-Type: multipart/alternative; boundary="_000_F83812DF4B59B9499C1BC978336D91745EE039F9TK5EX14MBXC111r_"
MIME-Version: 1.0
Cc: "storm@ietf.org" <storm@ietf.org>
Subject: Re: [storm] iSER draft
X-BeenThere: storm@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Storage Maintenance WG <storm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/storm>, <mailto:storm-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/storm>
List-Post: <mailto:storm@ietf.org>
List-Help: <mailto:storm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/storm>, <mailto:storm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 14 Jul 2011 20:16:21 -0000

Changing the name doesn't address the core issues here. There are no processing rules defined in the draft to support the arithmetic you describe below, or even to use the Steering/Virtual Address.

For example, section 7.3.5 states the target MUST use the Buffer Offset of the Data-In PDU as the Tagged Offset of an RDMA Write. Where does the new Steering Address in the control PDU header get folded into the Tagged Offset? And what protocol state would trigger the target to do so, including perform the arithmetic? Same question for several other sections.



From: Michael Ko [mailto:Michael@huaweisymantec.com]
Sent: Thursday, July 14, 2011 2:39 PM
To: Caitlin Bestler; Tom Talpey
Cc: Alexander Nezhinsky; storm@ietf.org
Subject: Re: [storm] iSER draft

When "Virtual Address" is not used, as in iWARP, the initiator side needs to translate the "Tagged Offset" which is just the offset into the buffer, into a usable address by adding it to the starting base address of the buffer.  If the starting base address is communicated to the target side, as is done in some RCaPs, then the "Tagged Offset" is the usable address itself at the initiator where data is to be fetched or stored.  Alex suggested that perhaps we can change the name "Virtual Address" to "Steering Address".  Then it can be defined in the glossary without tripping over the common term "virtual address".

Mike
----- Original Message -----
From: Caitlin Bestler<mailto:cait@asomi.com>
To: Tom Talpey<mailto:ttalpey@microsoft.com>
Cc: Alexander Nezhinsky<mailto:nezhinsky@gmail.com> ; Michael Ko<mailto:Michael@huaweisymantec.com> ; storm@ietf.org<mailto:storm@ietf.org>
Sent: Wednesday, July 13, 2011 9:49 PM
Subject: Re: [storm] iSER draft


On Jul 13, 2011, at 8:12 AM, Tom Talpey wrote:

> Yes, understood on the ZBVA/Infiniband issue. Regarding the VA term's presence in an earlier draft, I did not see it in RFC5046 and I did not review the expired draft, so consider these comments to be on the overall change, not the last revision.
>
> Let me try a different approach to perhaps make myself clearer.
>
> First, it seems to me that a "virtual address" has no real meaning to the network protocol. It begins, perhaps, as some value in an address space on the initiator, but it's not meaningful on the target in this way, it's only used to request that the remote RNIC perform a transfer to that originally registered remote address. So calling it a Virtual Address as an iSER protocol object seems, to me, an artificial and somewhat leading convention.
>
> Second, the Virtual Address goes out from the initiator to the target in a Control PDU, but where does it come back? The RDMA Read or Write as depicted in (xx) shows only a Tagged Offset. So, it's not clear what its protocol meaning is.
>
> Third, I don't ever see a Tagged Buffer described by a fully qualified four-tuple. I see it appearing as either { Stag, TO, length } or { Stag, VA, length }, depending on the addressing mode.
>
> I think the non-ZBVA mode is really just a special case of the existing one, but where the meaning of TO has changed from a small offset to some other token, generated and managed only at the initiator. So, it seems artificial to define it as distinct, and document it as possessing some new properties. Isn't it just a Target Offset, still?
>
> Tom.
>
>

I agree, so far we have not seen a protocol justification for the need to add "Virtual Address" to the glossary as something distinct from Target Offset
for the purpose of defining an IETF protocol.

I am sympathetic to the interoperability issues raised, but I don't think those can justify something that has *no* justification in the protocol.

If someone could site a class of implementation where there is a real need for this distinction in an iSER adapter, but as far as I can see the adapters have
to be able to translate to TO *anyway* in order to use an RDMA Write or RDMA Read.

Local Interface compatibility with IB can make a *lot* of sense, but why does it have to make its way into the *wire* protocol?

--
Caitlin Bestler
cait@asomi.com<mailto:cait@asomi.com>
http://www.asomi.com/CaitlinBestlerResume.html