Re: [storm] I-D Action: draft-ietf-storm-iser-03.txt

Michael Ko <Michael@huaweisymantec.com> Mon, 12 September 2011 02:50 UTC

Return-Path: <Michael@huaweisymantec.com>
X-Original-To: storm@ietfa.amsl.com
Delivered-To: storm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 98F6021F8AAC for <storm@ietfa.amsl.com>; Sun, 11 Sep 2011 19:50:22 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.598
X-Spam-Level:
X-Spam-Status: No, score=-2.598 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, HTML_MESSAGE=0.001]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YyOi3nvZOL9i for <storm@ietfa.amsl.com>; Sun, 11 Sep 2011 19:50:20 -0700 (PDT)
Received: from mta2.huaweisymantec.com (mta2.huaweisymantec.com [218.17.155.15]) by ietfa.amsl.com (Postfix) with ESMTP id E29BD21F8AA9 for <storm@ietf.org>; Sun, 11 Sep 2011 19:50:19 -0700 (PDT)
MIME-version: 1.0
Content-type: multipart/alternative; boundary="Boundary_(ID_R4Qkv+UWCDA7oGZlQfxgpQ)"
Received: from hstml02-in.huaweisymantec.com ([172.26.3.42]) by hstga02-in.huaweisymantec.com (Sun Java(tm) System Messaging Server 6.3-8.03 (built Apr 24 2009; 32bit)) with ESMTP id <0LRE00G222N6X880@hstga02-in.huaweisymantec.com> for storm@ietf.org; Mon, 12 Sep 2011 10:52:18 +0800 (CST)
Received: from m90003900a ([10.47.141.176]) by hstml02-in.huaweisymantec.com (Sun Java(tm) System Messaging Server 6.3-8.03 (built Apr 24 2009; 32bit)) with ESMTPA id <0LRE00BBD2MY9520@hstml02-in.huaweisymantec.com> for storm@ietf.org; Mon, 12 Sep 2011 10:52:18 +0800 (CST)
Message-id: <A3C3F3F154FD4E66B9897A8058FF260B@china.huawei.com>
From: Michael Ko <Michael@huaweisymantec.com>
To: david.black@emc.com, storm@ietf.org
References: <20110907011701.5649.63232.idtracker@ietfa.amsl.com> <2ECF865CEAF1472F84800EC7A9F229F1@china.huawei.com> <7C4DFCE962635144B8FAE8CA11D0BF1E058B27F52C@MX14A.corp.emc.com> <52D3969270BF4653A2AE00109DA2FA7D@china.huawei.com> <7C4DFCE962635144B8FAE8CA11D0BF1E058B27F697@MX14A.corp.emc.com> <B82DF80561744F11B10AE3EDB5C4254B@china.huawei.com> <7C4DFCE962635144B8FAE8CA11D0BF1E058B297C7D@MX14A.corp.emc.com> <378CB8788EF34F94A3135764216C6584@china.huawei.com> <7C4DFCE962635144B8FAE8CA11D0BF1E058B297C7E@MX14A.corp.emc.com>
Date: Sun, 11 Sep 2011 19:52:10 -0700
X-Priority: 3
X-MSMail-priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2900.5931
X-MIMEOLE: Produced By Microsoft MimeOLE V6.00.2900.6109
Subject: Re: [storm] I-D Action: draft-ietf-storm-iser-03.txt
X-BeenThere: storm@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Storage Maintenance WG <storm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/storm>, <mailto:storm-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/storm>
List-Post: <mailto:storm@ietf.org>
List-Help: <mailto:storm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/storm>, <mailto:storm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 12 Sep 2011 02:50:22 -0000

David,

For item #5, if MaxAHSLength is supported, then the default of 256 should 
cover the situation where "an initiator supports SCSI functionality that can 
create CDBs that are significantly larger than 32 bytes (e.g., OSD, SPC-4 
capability-based command security)".  So perhaps you mean when it is "larger 
than 256 bytes" then "MaxAHSLength SHOULD be explicitly negotiated".  But 
even if MaxAHSLength is not supported, a target can still function properly 
as long as there is no "Weird stuff like OSD and capability based command 
security" which can produce larger CDBs.  So perhaps an iSER device MAY 
terminate the connection if it anticipates MaxAHSLength > 256 and the key is 
not understood.

Since the iSER update is intended to reflect running code, then for item #7, 
the default for iSERHelloRequired being "Yes" would require changes in 
existing implementation in order to comply with the new iSER spec.  Do we 
really want to change running code to accommodate something that doesn't 
exist?

Mike
----- Original Message ----- 
From: david.black@emc.com
To: Michael@huaweisymantec.com ; storm@ietf.org
Sent: Sunday, September 11, 2011 5:32 PM
Subject: RE: [storm] I-D Action: draft-ietf-storm-iser-03.txt


Mike,

For item #4 The reason for the "SHOULD" is that if the default is left at 0 
for backwards compatibility, then a "SHOULD" provides appropriate warning 
that accepting this default is usually not a good idea.

For item #5, the interesting concern is what to do when the response to an 
attempt to negotiate MaxAHSLength is "MaxAHSLength=NotUnderstood" (i.e., the 
other party is an RFC 5046 implementation that does not understand the new 
key).  A SHOULD for negotiating this key won't help, in contrast to item #4, 
where a "NotUnderstood" response is not possible.  Please add some text to 
Section 6.8 advising an implementation that wants to negotiate MaxAHSLength 
what it should do if the response is "NotUnderstood".  FWIW, the default 
value of 256 seems ok, as it's not easy to create an iSCSI AHS that's larger 
than 256 bytes - the largest CDBs in anything resembling common use are 32 
bytes (which would produce an AHS with 16 bytes of payload plus the AHS 
header).  Weird stuff like OSD and capability based command security (see 
SPC-4) can definitely produce larger CDBs, so perhaps the caution ought to 
be something like "If an initiator supports SCSI functionality that can 
create CDBs that are significantly larger than 32 bytes (e.g., OSD, SPC-4 
capability-based command security), then MaxAHSLength SHOULD be explicitly 
negotiated."

Item #7 seems to be more complex.  My reading of the summary of item #7 is 
that courtesy of underlying communication infrastructure differences, an 
implementation that needs to turn off iSER Hello messages is likely to be 
talking to an implementation that will cooperate (e.g., InfiniBand), and one 
that doesn't need turn off those messages is likely to be talking to an 
implementation that supports them.  Again, I think some text is needed about 
how to deal with a "NotUnderstood" response, but the previous sentence 
should be part of the discussion (e.g., before suggesting that an 
implementation that needs to turn off iSER Hello messages should respond to 
"iSERHelloRequired=NotUnderstood" by abandoning the connection/session).  As 
part of this, I think the default for iSERHelloRequired should be changed to 
"Yes" and text needs to be added to say that an initiator implementation 
that does not support iSER Hello messages MUST explicitly declare this key 
(i.e., "iSERHelloRequired=No").

Thanks,
--David

________________________________
From: Michael Ko [Michael@huaweisymantec.com]
Sent: Sunday, September 11, 2011 8:05 PM
To: Black, David; storm@ietf.org
Subject: Re: [storm] I-D Action: draft-ietf-storm-iser-03.txt

David,

I agree with the assessment on item #1.

For item #4, If we add "SHOULD" for it, then we should probably also add it 
for items #5 and #7.

Mike
----- Original Message -----
From: david.black@emc.com<mailto:david.black@emc.com>
To: Michael@huaweisymantec.com<mailto:Michael@huaweisymantec.com> ; 
storm@ietf.org<mailto:storm@ietf.org>
Sent: Sunday, September 11, 2011 11:12 AM
Subject: RE: [storm] I-D Action: draft-ietf-storm-iser-03.txt

Mike,

That approach will work, here's some minor rewording to make the "running 
code" aspect more explicit:

"Except as noted, all changes are backwards compatible with RFC 5046." ->
     "With the exception of item 8, all changes are backwards compatible 
with RFC 5046."

"reflects the known implementations which deviated from RFC 5046" -> 
"reflects all known implementations of iSER, each of which has implemented 
this change, despite its absence in RFC 5046."

Also, please double-check whether items 1 (ok to open connection in 
"zero-copy" instead of "normal" mode) and 4 (change default value for 
MaxOutstandingUnexpectedPDUs) are backwards-compatible.  I suspect that item 
1 is ok because when an initiator opens a connection in "zero-copy" mode 
with a responder that expects a "normal" mode open, the result should 
produce errors and die quickly.
OTOH, the default value change for MaxOutstandingUnexpectedPDUs in item 4 
does not appear to be backwards-compatible.  If all of the implementations 
have made this change, handle it as item 8 above.  Otherwise an alterative 
is to add a statement that the MaxOutstandingUnexpectedPDUs key SHOULD be 
negotiated because the default value of 0 is problematic for most 
implementations as it does not impose a bound on resources consumable by 
unexpected PDUs.

Thanks,
--David

________________________________
From: Michael Ko [Michael@huaweisymantec.com]
Sent: Friday, September 09, 2011 10:22 PM
To: Black, David; storm@ietf.org<mailto:storm@ietf.org>
Subject: Re: [storm] I-D Action: draft-ietf-storm-iser-03.txt

David,

There is only one change which is not backwards compatible, and that is the 
inclusion of Base Offset in the iSER header.  I could just leave the first 
sentence of the paragraph so I don't have to repeat it umpteen times.  So 
section 14 would lead off with the following:

"Except as noted, all changes are backwards compatible with RFC 5046."

And then for the iSER header change, I will add the following:

"This change is not backwards comptaible with RFC 5046 but it reflects the 
known implementations which deviated from RFC 5046."

Mike
----- Original Message -----
From: 
david.black@emc.com<mailto:david.black@emc.com<mailto:david.black@emc.com<mailto:david.black@emc.com>>
To: 
Michael@huaweisymantec.com<mailto:Michael@huaweisymantec.com<mailto:Michael@huaweisymantec.com<mailto:Michael@huaweisymantec.com>> 
; 
storm@ietf.org<mailto:storm@ietf.org<mailto:storm@ietf.org<mailto:storm@ietf.org>>
Sent: Friday, September 09, 2011 6:20 PM
Subject: RE: [storm] I-D Action: draft-ietf-storm-iser-03.txt

Mike - that proposed text is just enough to attract the attention of IETF 
reviewers to ask for more.

Please list the specific changes that are not backwards compatible and state 
that they reflect the known implementations, all of which chose to do 
something different from RFC 5046.  The second sentence about the 
hypothetical implementation should not be used - this is about actual 
implementations (i.e., “running code”).

Thanks,
--David

From: Michael Ko [mailto:Michael@huaweisymantec.com]
Sent: Friday, September 09, 2011 8:44 PM
To: Black, David; storm@ietf.org<mailto:storm@ietf.org>
Subject: Re: [storm] I-D Action: draft-ietf-storm-iser-03.txt

David,

I intend to add the following paragraph in section 14.

Except as noted, all changes are backwards compatible with RFC 5046. 
However, there are some changes which reflect existing implementation and 
are not backwards compatible with RFC 5046.  As a result, a hypothetical 
implementation based on RFC 5046 will not interoperate with an 
implementation based on this version of the specification.

Mike
----- Original Message -----
From: 
david.black@emc.com<mailto:david.black@emc.com<mailto:david.black@emc.com<mailto:david.black@emc.com>>
To: 
Michael@huaweisymantec.com<mailto:Michael@huaweisymantec.com<mailto:Michael@huaweisymantec.com<mailto:Michael@huaweisymantec.com>> 
; 
storm@ietf.org<mailto:storm@ietf.org<mailto:storm@ietf.org<mailto:storm@ietf.org>>
Sent: Friday, September 09, 2011 8:34 AM
Subject: RE: [storm] I-D Action: draft-ietf-storm-iser-03.txt

Mike,

Thanks for submitting this updated draft.

In Section 14 (Appendix A), please add a discussion of backwards 
compatibility with RFC 5046 - it’s important to explain how an 
implementation based on this draft will interact with a hypothetical 
implementation based on RFC 5046.  As part of this, it’s important to 
identify changes that are incompatible with RFC 5046, but compatible with 
existing implementations because the implementations did something different 
from RFC 5046.  As a start, it would help to identify each numbered change 
as backwards-compatible (with RFC 5046) vs. backwards-incompatible (because 
RFC 5046 got it wrong in 20/20 hindsight).

Thanks,
--David

From: storm-bounces@ietf.org<mailto:storm-bounces@ietf.org> 
[mailto:storm-bounces@ietf.org] On Behalf Of Michael Ko
Sent: Wednesday, September 07, 2011 12:59 PM
To: storm@ietf.org<mailto:storm@ietf.org>
Subject: Re: [storm] I-D Action: draft-ietf-storm-iser-03.txt

The summary of changes since RFC 5046 can be found in section 14.  In 
particular, the following changes were made since the -02 version of the 
draft:

8. Added two 64-bit fields in iSER header in section 9.2 for the Read Base 
Offset and the Write Base Offset to accommodate a non-zero Base Offset. 
This allows one implementation such as the OFED stack to be used in both the 
Infiniband and the iWARP environment.  Changes were made in the definition 
of Base Offset, Advertisement, and Tagged Buffer.  Changes were also made in 
sections 2.4.1, 2.5, 2.6, 7.3.1, 7.3.3, 7.3.5, 7.3.6, 9.1, 9.3, 9.4, 9.5.1, 
and 9.5.2.
9. Remove iWARP specific behavior.  Changes were made in the definition 
section on RDMA Operation and Send Message Type.  Changes affecting Send 
with Invalidate were made in sections 2.4.1, 2.5, 2.6, 4.1, and 7.3.2. 
Changes affecting Terminate were made in sections 10.1.2.1 and 10.1.2.2. 
(Forgot to mention here that section 15 was also updated to remove iWARP 
specific behavior.)
10. Denial of service descriptions for the initiator in section 5.1.1 was 
removed since it is applicable for the target only.
Mike
----- Original Message -----
From: 
internet-drafts@ietf.org<mailto:internet-drafts@ietf.org<mailto:internet-drafts@ietf.org<mailto:internet-drafts@ietf.org>>
To: 
i-d-announce@ietf.org<mailto:i-d-announce@ietf.org<mailto:i-d-announce@ietf.org<mailto:i-d-announce@ietf.org>>
Cc: 
storm@ietf.org<mailto:storm@ietf.org<mailto:storm@ietf.org<mailto:storm@ietf.org>>
Sent: Tuesday, September 06, 2011 6:17 PM
Subject: [storm] I-D Action: draft-ietf-storm-iser-03.txt

A New Internet-Draft is available from the on-line Internet-Drafts 
directories. This draft is a work item of the STORage Maintenance Working 
Group of the IETF.

Title           : iSCSI Extensions for RDMA Specification
Author(s)       : Michael Ko
                          Alexander Nezhinsky
Filename        : draft-ietf-storm-iser-03.txt
Pages           : 91
Date            : 2011-09-06

   iSCSI Extensions for RDMA provides the RDMA data transfer capability
   to iSCSI by layering iSCSI on top of an RDMA-Capable Protocol.  An
   RDMA-Capable Protocol provides RDMA Read and Write services, which
   enable data to be transferred directly into SCSI I/O Buffers without
   intermediate data copies.  This document describes the extensions to
   the iSCSI protocol to support RDMA services as provided by an RDMA-
   Capable Protocol.

   This document obsoletes RFC5046
   Table of Contents


A URL for this Internet-Draft is:
http://www.ietf.org/internet-drafts/draft-ietf-storm-iser-03.txt

Internet-Drafts are also available by anonymous FTP at:
ftp://ftp.ietf.org/internet-drafts/

This Internet-Draft can be retrieved at:
ftp://ftp.ietf.org/internet-drafts/draft-ietf-storm-iser-03.txt
_______________________________________________
storm mailing list
storm@ietf.org<mailto:storm@ietf.org<mailto:storm@ietf.org<mailto:storm@ietf.org>>
https://www.ietf.org/mailman/listinfo/storm