Re: [rddp] Re: iSCSI/iWARP drafts and flow control

Caitlin Bestler <cait@asomi.com> Fri, 01 August 2003 15:19 UTC

Received: from optimus.ietf.org (ietf.org [132.151.1.19] (may be forged)) by ietf.org (8.9.1a/8.9.1a) with ESMTP id LAA26155 for <rddp-archive@odin.ietf.org>; Fri, 1 Aug 2003 11:19:28 -0400 (EDT)
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 19ibgM-0007IM-3d for rddp-archive@odin.ietf.org; Fri, 01 Aug 2003 11:19:02 -0400
Received: (from exim@localhost) by www1.ietf.org (8.12.8/8.12.8/Submit) id h71FJ2tf028036 for rddp-archive@odin.ietf.org; Fri, 1 Aug 2003 11:19:02 -0400
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 19ibgM-0007I7-0J for rddp-web-archive@optimus.ietf.org; Fri, 01 Aug 2003 11:19:02 -0400
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id LAA26149 for <rddp-web-archive@ietf.org>; Fri, 1 Aug 2003 11:18:58 -0400 (EDT)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 19ibgL-0003Iu-00 for rddp-web-archive@ietf.org; Fri, 01 Aug 2003 11:19:01 -0400
Received: from ietf.org ([132.151.1.19] helo=optimus.ietf.org) by ietf-mx with esmtp (Exim 4.12) id 19ibgK-0003Ir-00 for rddp-web-archive@ietf.org; Fri, 01 Aug 2003 11:19:00 -0400
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 19ibgK-0007Hd-LR; Fri, 01 Aug 2003 11:19:00 -0400
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 19ibg7-0007H7-1y for rddp@optimus.ietf.org; Fri, 01 Aug 2003 11:18:47 -0400
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id LAA26143 for <rddp@ietf.org>; Fri, 1 Aug 2003 11:18:43 -0400 (EDT)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 19ibg6-0003Ie-00 for rddp@ietf.org; Fri, 01 Aug 2003 11:18:46 -0400
Received: from thebe.your-site.com ([140.186.45.26]) by ietf-mx with esmtp (Exim 4.12) id 19ibg5-0003IU-00 for rddp@ietf.org; Fri, 01 Aug 2003 11:18:45 -0400
Received: from asomi.com (64-144-5-25.client.dsl.net [64.144.5.25]) by thebe.your-site.com (Postfix) with ESMTP id 784F1245F45; Fri, 1 Aug 2003 11:18:25 -0400 (EDT)
Date: Fri, 01 Aug 2003 10:18:12 -0500
Subject: Re: [rddp] Re: iSCSI/iWARP drafts and flow control
Content-Type: text/plain; charset="US-ASCII"; format="flowed"
Mime-Version: 1.0 (Apple Message framework v552)
Cc: ips@ece.cmu.edu, rddp@ietf.org
To: "Mallikarjun C." <cbm@rose.hp.com>
From: Caitlin Bestler <cait@asomi.com>
In-Reply-To: <020c01c357c6$0a21e340$18a4f40f@rose.hp.com>
Message-Id: <5DA68BAA-C433-11D7-A551-003065D48EE0@asomi.com>
Content-Transfer-Encoding: 7bit
X-Mailer: Apple Mail (2.552)
Content-Transfer-Encoding: 7bit
Sender: rddp-admin@ietf.org
Errors-To: rddp-admin@ietf.org
X-BeenThere: rddp@ietf.org
X-Mailman-Version: 2.0.12
Precedence: bulk
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/rddp>, <mailto:rddp-request@ietf.org?subject=unsubscribe>
List-Id: IETF Remote Direct Data Placement (rddp) WG <rddp.ietf.org>
List-Post: <mailto:rddp@ietf.org>
List-Help: <mailto:rddp-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/rddp>, <mailto:rddp-request@ietf.org?subject=subscribe>
Content-Transfer-Encoding: 7bit
Content-Transfer-Encoding: 7bit

On Thursday, July 31, 2003, at 07:43 PM, Mallikarjun C. wrote:

>> No new wire protocol is required.
>
> Please explain to me how credit can be replenished
> in the following example - without new positive flow
> control protocol.

I thought of at least one algorithm overnight. This is
not presented as a definitive proposal, merely to show
a strategy that can allow iSER to provide flow control
of *all* untagged messages.


iSER untagged messages are divided into a predictable
portion regulated by CmdSNs in a very direct fashion
and asynchronous messages. The latter category can be
characterized as having a low sustained rate compared
to the CmdSN-related untagged messages, but that the
traffic is very bursty. That is, the peak rate can be
high.

That suggests adapting a classic "leaky bucket" credit
system of the type typically used to regulate burst
traffic over rate controlled networks. The key
difference is that the "clock" is the Max CmdSN.

What is required is the following:

The sender maintains a asynch-credit counter. It is
initialized to a known value. This value could be
negotiated if it is believed that there is enough
variation to warrant negotiation, otherwise it would
be fixed. That caveat applies to all other "constants"
cited in this algorithm.

When the ULP desires to send an untagged message using
one of these credits:

     The credit count is brought up to date: The
     current Max CmdSN is compared with the value when
     the prior "fringe" send was performed. The delta
     is used to grant new credits, however there is a
     maximum number of credits that may be accumulated.


     If there are enough credits: the credit count is
     reduced and the untagged message may be sent.

     If there are not enough credits: the untagged
     message must be delayed until the Max CmdSN is
     advanced. After a configurable delay, iSER
     SHOULD send some form of NOP command to cause
     Max CmdSN to advance.


Note that there are NO iSER defined messages for
the purpose of flow control.  Untagged messages
may be delayed, but that could happen over TCP
just as easily. The only change is that *only*
untagged messages will be delayed, never tagged
messages, and *where* they are delayed (iSER
versus TCP).


_______________________________________________
rddp mailing list
rddp@ietf.org
https://www1.ietf.org/mailman/listinfo/rddp