Re: [bmwg] Ben Campbell's No Objection on draft-ietf-bmwg-dcbench-terminology-17: (with COMMENT)

Ben Campbell <ben@nostrum.com> Wed, 21 June 2017 19:36 UTC

Return-Path: <ben@nostrum.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id CBB261241FC; Wed, 21 Jun 2017 12:36:58 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.88
X-Spam-Level:
X-Spam-Status: No, score=-1.88 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RP_MATCHES_RCVD=-0.001, T_SPF_HELO_PERMERROR=0.01, T_SPF_PERMERROR=0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id GLBmPXVY1jDW; Wed, 21 Jun 2017 12:36:56 -0700 (PDT)
Received: from nostrum.com (raven-v6.nostrum.com [IPv6:2001:470:d:1130::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5122D12714F; Wed, 21 Jun 2017 12:36:56 -0700 (PDT)
Received: from [10.0.1.63] (cpe-66-25-7-22.tx.res.rr.com [66.25.7.22]) (authenticated bits=0) by nostrum.com (8.15.2/8.15.2) with ESMTPSA id v5LJapfP050986 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Wed, 21 Jun 2017 14:36:52 -0500 (CDT) (envelope-from ben@nostrum.com)
X-Authentication-Warning: raven.nostrum.com: Host cpe-66-25-7-22.tx.res.rr.com [66.25.7.22] claimed to be [10.0.1.63]
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\))
From: Ben Campbell <ben@nostrum.com>
In-Reply-To: <CAArZqeX2_1XJhuqhMdHYRELrERgMzu+AV9zQAFLQUdpMbh7PcA@mail.gmail.com>
Date: Wed, 21 Jun 2017 14:36:51 -0500
Cc: The IESG <iesg@ietf.org>, draft-ietf-bmwg-dcbench-terminology@ietf.org, Sarah Banks <sbanks@encrypted.net>, bmwg-chairs@ietf.org, bmwg@ietf.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <CA7A6183-2EEA-475F-B33B-9B77F075D5FD@nostrum.com>
References: <149807196602.15838.8048520689148705215.idtracker@ietfa.amsl.com> <CAArZqeX2_1XJhuqhMdHYRELrERgMzu+AV9zQAFLQUdpMbh7PcA@mail.gmail.com>
To: Lucien <lucien.avramov@gmail.com>
X-Mailer: Apple Mail (2.3273)
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/_D6Uv5-wb9qkSf4ok1IByKjZYZo>
Subject: Re: [bmwg] Ben Campbell's No Objection on draft-ietf-bmwg-dcbench-terminology-17: (with COMMENT)
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 21 Jun 2017 19:36:59 -0000

Thanks for the response. Comments inline:

Ben.

> On Jun 21, 2017, at 2:17 PM, Lucien <lucien.avramov@gmail.com> wrote:
> 
> Hi Ben, 
> 
> Thanks for the comment! Please find my answers inline, and please acknowledge back!
> 
> Appreciate you taking the time to look at our work.
> 
> Lucien
> 
> On Wed, Jun 21, 2017 at 12:06 PM, Ben Campbell <ben@nostrum.com> wrote:
> Ben Campbell has entered the following ballot position for
> draft-ietf-bmwg-dcbench-terminology-17: No Objection
> 
> When responding, please keep the subject line intact and reply to all
> email addresses included in the To and CC lines. (Feel free to cut this
> introductory paragraph, however.)
> 
> 
> Please refer to https://www.ietf.org/iesg/statement/discuss-criteria.html
> for more information about IESG DISCUSS and COMMENT positions.
> 
> 
> The document, along with other ballot positions, can be found here:
> https://datatracker.ietf.org/doc/draft-ietf-bmwg-dcbench-terminology/
> 
> 
> 
> ----------------------------------------------------------------------
> COMMENT:
> ----------------------------------------------------------------------
> 
> I find the naming of the draft fairly confusing. It goes way beyond
> "terminology"; it makes a number of normative (using 2119 language) statements
> about benchmarking procedures. I wonder why the sections about procedure did
> not go into the methodology draft instead. In general, I don't think putting
> normative language in an informational terminology draft is a good idea. (This
> would have been a DISCUSS, except that I am aware the bmwg has decided to make
> all its drafts informational and to still use 2119 language. For the record, I
> think that policy falls down with this draft.)
> 
> That's how we have decided it makes sense at BMWG to proceed with these two drafts. We have been hashing this out for 4+ years now and the current state is the consensus.  As author, I have no intention nor desire to change this

For the record, I think BMWG has adopted interpretations of both informational RFC and 2119 keywords that are at best unconventional, and at worst tortured. But I also recognize the precedent has been set, and don’t mean to hold this draft hostage to it. Thus it was a non-blocking comment which you can feel free to ignore :-)


> 
> I agree with the comment from others that this does not seem to be specific to
> datacenters.
> 
> Great, so did we, this is why we already worked on addressing this by:
> 	•  calling out specifically that this specifically applies to data center switches (defining what those are today)
> 	• stating clearly that it can be applied to switches out of the data center, but that's not the specific scope of this

Works for me, thanks.


> 
> - 2.2: Definitions of "store-and-forward" and "cut-through" when used in this
> context would be helpful. The first may be obvious, but the best I can do with
> "cut-through" is assume it means the opposite of "store-and-forward".
> 
> Those are cleary defined in RFC 1242, which we reference. We don't want to duplicate definitions here. 

Apologies, I missed the earlier citation to 1242, which was specifically in regard to these terms.

>   
>  
> 
> - 6.2: After reading the definition of "Incast" several times, I'm still not
> sure what it means or what is being measured.
> 
> It's many to one type of network traffic patterns. Its very commonly found in cloud data centers implementing distributed storage/compute frameworks (big data for example).   
> 

As written, it’s not clear to me if “Incast” means “one to many/many-to-many” communication in general, or the patterns of synchronization that result from that. The first paragraph seems to say the former but the second paragraph seems to say the latter.