Re: [storm] iSER - one last issue

Tom Talpey <ttalpey@microsoft.com> Thu, 19 January 2012 16:09 UTC

Return-Path: <ttalpey@microsoft.com>
X-Original-To: storm@ietfa.amsl.com
Delivered-To: storm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 559D721F863F for <storm@ietfa.amsl.com>; Thu, 19 Jan 2012 08:09:44 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -103.598
X-Spam-Level:
X-Spam-Status: No, score=-103.598 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-1, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ZsXxcN0FZEIc for <storm@ietfa.amsl.com>; Thu, 19 Jan 2012 08:09:38 -0800 (PST)
Received: from DB3EHSOBE001.bigfish.com (db3ehsobe001.messaging.microsoft.com [213.199.154.139]) by ietfa.amsl.com (Postfix) with ESMTP id 8110D21F8637 for <storm@ietf.org>; Thu, 19 Jan 2012 08:09:37 -0800 (PST)
Received: from mail32-db3-R.bigfish.com (10.3.81.240) by DB3EHSOBE001.bigfish.com (10.3.84.21) with Microsoft SMTP Server id 14.1.225.23; Thu, 19 Jan 2012 16:09:35 +0000
Received: from mail32-db3 (localhost [127.0.0.1]) by mail32-db3-R.bigfish.com (Postfix) with ESMTP id 78759180539; Thu, 19 Jan 2012 16:09:35 +0000 (UTC)
X-SpamScore: -48
X-BigFish: VS-48(zz9371I936eKc85fh148cM542M1418Mc1dM4015Lzz1202hzz1033IL8275bh8275dhz2fhc1bhc31hc1ahc1bhc31hc1ah2a8h668h839h)
X-Forefront-Antispam-Report: CIP:131.107.125.8; KIP:(null); UIP:(null); IPV:NLI; H:TK5EX14HUBC107.redmond.corp.microsoft.com; RD:none; EFVD:NLI
X-FB-SS: 13,
Received-SPF: pass (mail32-db3: domain of microsoft.com designates 131.107.125.8 as permitted sender) client-ip=131.107.125.8; envelope-from=ttalpey@microsoft.com; helo=TK5EX14HUBC107.redmond.corp.microsoft.com ; icrosoft.com ;
Received: from mail32-db3 (localhost.localdomain [127.0.0.1]) by mail32-db3 (MessageSwitch) id 1326989374601008_27863; Thu, 19 Jan 2012 16:09:34 +0000 (UTC)
Received: from DB3EHSMHS009.bigfish.com (unknown [10.3.81.254]) by mail32-db3.bigfish.com (Postfix) with ESMTP id 81DF3120061; Thu, 19 Jan 2012 16:09:34 +0000 (UTC)
Received: from TK5EX14HUBC107.redmond.corp.microsoft.com (131.107.125.8) by DB3EHSMHS009.bigfish.com (10.3.87.109) with Microsoft SMTP Server (TLS) id 14.1.225.23; Thu, 19 Jan 2012 16:09:33 +0000
Received: from TK5EX14MBXC118.redmond.corp.microsoft.com ([169.254.9.75]) by TK5EX14HUBC107.redmond.corp.microsoft.com ([157.54.80.67]) with mapi id 14.02.0247.005; Thu, 19 Jan 2012 08:09:21 -0800
From: Tom Talpey <ttalpey@microsoft.com>
To: Hemal Shah <hemal@broadcom.com>, "david.black@emc.com" <david.black@emc.com>, "Michael@huaweisymantec.com" <Michael@huaweisymantec.com>, "storm@ietf.org" <storm@ietf.org>
Thread-Topic: iSER - one last issue
Thread-Index: AQHM1jZ8MWLUJLTWDk+GYyBugVM345YTUwAAgABXYlCAALATgP//fm+A
Date: Thu, 19 Jan 2012 16:09:21 +0000
Message-ID: <F83812DF4B59B9499C1BC978336D917461CDE441@TK5EX14MBXC118.redmond.corp.microsoft.com>
References: <20120115134011.27535.67315.idtracker@ietfa.amsl.com> <BA395993A32345F6898D0CD255E01020@china.huawei.com> <7C4DFCE962635144B8FAE8CA11D0BF1E05A7CF06E5@MX14A.corp.emc.com> <6315937B35624B2E9C599A392DDB8EA1@china.huawei.com> <7C4DFCE962635144B8FAE8CA11D0BF1E05A7CF0CF7@MX14A.corp.emc.com> <2D98DD3F898B6B4DA287BF3BA07DAE93022E4D@IRVEXCHMB11.corp.ad.broadcom.com> <F83812DF4B59B9499C1BC978336D917461CDE2B8@TK5EX14MBXC118.redmond.corp.microsoft.com> <2D98DD3F898B6B4DA287BF3BA07DAE93023279@IRVEXCHMB11.corp.ad.broadcom.com>
In-Reply-To: <2D98DD3F898B6B4DA287BF3BA07DAE93023279@IRVEXCHMB11.corp.ad.broadcom.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [157.54.51.33]
Content-Type: multipart/alternative; boundary="_000_F83812DF4B59B9499C1BC978336D917461CDE441TK5EX14MBXC118r_"
MIME-Version: 1.0
X-OriginatorOrg: microsoft.com
Subject: Re: [storm] iSER - one last issue
X-BeenThere: storm@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Storage Maintenance WG <storm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/storm>, <mailto:storm-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/storm>
List-Post: <mailto:storm@ietf.org>
List-Help: <mailto:storm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/storm>, <mailto:storm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 19 Jan 2012 16:09:44 -0000

Thanks for pointing out that sentence in RFC5046 7.3.4. I believe it is the only such stipulation.

I'm ok with stating the requirement as RFC5046-over-RFC5040 compliance. But this new draft opens the door to alternative behaviors, therefore it needs to be stated more clearly. What's the requirement when SendSE is not supported? And, how does the receiver know what to expect?

In other words, if it's proposed that the statement be:
                "When the RCaP layer is as specified in [RFC5040] and [RFC5041], the SendSE message MUST be used."

... then what MUST be used when the RCaP is not? That statement needs to be made, too.


From: Hemal Shah [mailto:hemal@broadcom.com]
Sent: Thursday, January 19, 2012 10:38 AM
To: Tom Talpey; david.black@emc.com; Michael@huaweisymantec.com; storm@ietf.org
Subject: RE: iSER - one last issue

Tom,

RFC5046 is very clear about the use of Send Message Type for iSCSI control-type PDU. For specific iSCSI PDUs, Section 7 mandates the use of Send, SendSE, or SendSEInv. Section 7 of RFC5046 clearly specifies the use of specific Send Message Type for each iSCSI control-type PDUs (Login, Logout, Text request, Text response...). Section 7.3.4 mandates the use of plain-old Send also as needed. For example, see text below from 7.3.4.

For unsolicited data, if the F bit is set to 0 in a SCSI Data-out
PDU, the iSER layer at the initiator MUST use a Send Message to send
the SCSI Data-out PDU.

Regarding your comment in the second paragraph below, RFC5040 expectation is all the RDMAP messages specified in RFC5040 are supported (if that is not the case then we cannot count on any of the other RDMAP messages to be supported). So, an implementation that does not support SendSE at the sender is not compliant with RFC5040. So, your second point does not apply.

I hope that addresses your comments.

Hemal

From: Tom Talpey [mailto:ttalpey@microsoft.com]<mailto:[mailto:ttalpey@microsoft.com]>
Sent: Thursday, January 19, 2012 5:51 AM
To: Hemal Shah; david.black@emc.com<mailto:david.black@emc.com>; Michael@huaweisymantec.com<mailto:Michael@huaweisymantec.com>; storm@ietf.org<mailto:storm@ietf.org>
Subject: RE: iSER - one last issue

If using SendSE is so important here, when MUST a plain-old Send be used? There is no mention of any distinction in RFC5046 section 1.4.2 nor in this draft's section 2.4.2.

Even with a MUST on the SendSE, the behavior is indeterminate, since it would still be contingent on support for SendSE at the *sender*. This critical exception voids any normative requirement, even over iWARP. The strongest statement that can be made is SHOULD.

Tom.

From: storm-bounces@ietf.org<mailto:storm-bounces@ietf.org> [mailto:storm-bounces@ietf.org]<mailto:[mailto:storm-bounces@ietf.org]> On Behalf Of Hemal Shah
Sent: Wednesday, January 18, 2012 6:56 PM
To: david.black@emc.com<mailto:david.black@emc.com>; Michael@huaweisymantec.com<mailto:Michael@huaweisymantec.com>; storm@ietf.org<mailto:storm@ietf.org>
Subject: Re: [storm] iSER - one last issue

David and Mike,

I believe that the requirements should not be weakened and we should stick to the requirement in RFC5046.

RFC5046 required the use of specific Send Message Type for valid reasons.

In the case of requiring SendSE message use, the intent was to give a hint to the remote side to generate an event upon processing of SendSE message. For example, the SendSE is specifically carrying SCSI information that needs attention on the remote side e.g. SCSI command, Logout...

In the case of requiring SendInvSE Message, the intent was to invalidate the STag used in the data transfer as well as inform the remote side to generate an event. For example, mandating the use of SendInvSE for the SCSI response PDU for a SCSI Read limits the exposure of STag used in SCSI Read data transfer and avoids the explicit invalidation of the STag at the initiator. Plus, it allows the target to generate an event on the initiator upon the completion of SCSI Read command.

By relaxing RFC5046 requirements in the latest iSER draft, we will not only impact all iWARP based iSER implementations that rely on the use of specific Send Message Type for SCSI data transfers but also change the intended behavior of initiators and targets.

For iWARP, I strongly suggest that the iSER draft does not relax the requirements specified in RFC5046.

I hope that helps.

Hemal

From: storm-bounces@ietf.org<mailto:storm-bounces@ietf.org> [mailto:storm-bounces@ietf.org]<mailto:[mailto:storm-bounces@ietf.org]> On Behalf Of david.black@emc.com<mailto:david.black@emc.com>
Sent: Wednesday, January 18, 2012 3:10 PM
To: Michael@huaweisymantec.com<mailto:Michael@huaweisymantec.com>; storm@ietf.org<mailto:storm@ietf.org>
Subject: Re: [storm] iSER - one last issue

Mike,

Thank you for the explanation, but I don't believe you've correctly stated
the intent of RFC 5046.  Here are some examples from RFC 5046's text:

1.5.  SCSI Read Overview

   The iSER Message is transferred to the target using a SendSE Message.

   The iSER layer at the target uses a SendInvSE Message to transfer the
   SCSI Response PDU back to the iSER layer at the initiator.

Similar language occurs in 1.6 SCSI Write Overview.

5.2.1.  Normal Connection Termination at the Initiator

   The iSER layer at the initiator MUST
   use a SendSE Message to send the Logout Request PDU to the target.

Similar language occurs in 5.2.2 for target side normal connection termination,
and more importantly in 7.3.1 SCSI Command:

   The iSER layer at the initiator MUST send the SCSI command in a
   SendSE Message to the target.

None of the quoted text permits use of Send instead of SendSE or SendInv
instead of SendInvSE.

What you propose to do effectively changes "MUST" to "should" (lower case,
weaker than "SHOULD"), and that sure looks like a change to RFC 5046.

Are there good implementation-based reasons to weaken these requirements now?

Does anyone else have a viewpoint on this topic?

Thanks,
--David

From: Michael Ko [mailto:Michael@huaweisymantec.com]<mailto:[mailto:Michael@huaweisymantec.com]>
Sent: Wednesday, January 18, 2012 2:22 PM
To: Black, David; storm@ietf.org<mailto:storm@ietf.org>
Subject: Re: iSER - one last issue

David,

Here is my rationale for using the lower case "should".

The intent of RFC5046 is that the Send Message type must be used instead of RDMA Reads or Writes.  The Solicited Event feature of the Send Message is provided as a convenience.  The receiver must still do the right thing in handling the Send Message regardless of whether the SE feature is used.  In other words, the sender is responsible for using the right format for the message (Send vs RDMA) but the receiver must not rely on the sender to determine how to handle the received message.  The same rationale goes for the Invalidate feature.

Mike
----- Original Message -----
From: david.black@emc.com<mailto:david.black@emc.com>
To: Michael@huaweisymantec.com<mailto:Michael@huaweisymantec.com> ; storm@ietf.org<mailto:storm@ietf.org>
Sent: Monday, January 16, 2012 2:06 PM
Subject: iSER - one last issue

Mike,

Thanks for getting the -08 version of the iSER draft posted.  I think that
draft addresses all of the open issues, but I have a question for the WG
about how to express the SendSE and SendInvSE requirements from RFC 5046.

The -08 version of the iSER draft expresses requirements for the SendSE
and SendInvSE messages (this is primarily for iSER over RDDP/iWARP) as:

The SendSE Message should be used if
supported by the RCaP layer (e.g., iWARP).

My reading of RFC 5046 is that its requirements are tighter - to accurately
reflect RFC 5046, I would replace "should" with "MUST" in the above text,
at least for iWARP.

In the alternative, if the "should"s remain, an explanatory item
needs to be added to the Appendix A list of changes from RFC 5046.

What do others think the right course of action is here, use "MUST" or
explain weakening of requirement to "should" ?

Thanks,
--David

From: storm-bounces@ietf.org<mailto:storm-bounces@ietf.org> [mailto:storm-bounces@ietf.org]<mailto:[mailto:storm-bounces@ietf.org]> On Behalf Of Michael Ko
Sent: Sunday, January 15, 2012 8:43 AM
To: storm@ietf.org<mailto:storm@ietf.org>
Subject: Re: [storm] I-D Action: draft-ietf-storm-iser-08.txt

This version contains all the updates as discussed in the latest exchanges with Hemal Shah and David Black.

Mike
----- Original Message -----
From: internet-drafts@ietf.org<mailto:internet-drafts@ietf.org>
To: i-d-announce@ietf.org<mailto:i-d-announce@ietf.org>
Cc: storm@ietf.org<mailto:storm@ietf.org>
Sent: Sunday, January 15, 2012 5:40 AM
Subject: [storm] I-D Action: draft-ietf-storm-iser-08.txt


A New Internet-Draft is available from the on-line Internet-Drafts directories. This draft is a work item of the STORage Maintenance Working Group of the IETF.

Title           : iSCSI Extensions for RDMA Specification
Author(s)       : Michael Ko
                          Alexander Nezhinsky
Filename        : draft-ietf-storm-iser-08.txt
Pages           : 95
Date            : 2012-01-15

   iSCSI Extensions for RDMA provides the RDMA data transfer capability
   to iSCSI by layering iSCSI on top of an RDMA-Capable Protocol.  An
   RDMA-Capable Protocol provides RDMA Read and Write services, which
   enable data to be transferred directly into SCSI I/O Buffers without
   intermediate data copies.  This document describes the extensions to
   the iSCSI protocol to support RDMA services as provided by an RDMA-
   Capable Protocol.

   This document obsoletes RFC 5046.


A URL for this Internet-Draft is:
http://www.ietf.org/internet-drafts/draft-ietf-storm-iser-08.txt

Internet-Drafts are also available by anonymous FTP at:
ftp://ftp.ietf.org/internet-drafts/

This Internet-Draft can be retrieved at:
ftp://ftp.ietf.org/internet-drafts/draft-ietf-storm-iser-08.txt

_______________________________________________
storm mailing list
storm@ietf.org<mailto:storm@ietf.org>
https://www.ietf.org/mailman/listinfo/storm