Re: [bmwg] Genart last call review of draft-ietf-bmwg-dcbench-methodology-07

Lucien Avramov <lucienav@google.com> Sat, 10 June 2017 17:26 UTC

Return-Path: <lucienav@google.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A429C128768 for <bmwg@ietfa.amsl.com>; Sat, 10 Jun 2017 10:26:11 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2
X-Spam-Level:
X-Spam-Status: No, score=-2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, MIME_QP_LONG_LINE=0.001, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id yRRU8_Mnd5qz for <bmwg@ietfa.amsl.com>; Sat, 10 Jun 2017 10:26:09 -0700 (PDT)
Received: from mail-pg0-x229.google.com (mail-pg0-x229.google.com [IPv6:2607:f8b0:400e:c05::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 25E7C1279EB for <bmwg@ietf.org>; Sat, 10 Jun 2017 10:26:07 -0700 (PDT)
Received: by mail-pg0-x229.google.com with SMTP id a70so34560946pge.3 for <bmwg@ietf.org>; Sat, 10 Jun 2017 10:26:07 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=ZtGTPVNvFOUzYfWK8go3UQ72lUnqON4f8m60bYv6k4I=; b=BJ11Os8/GrHAUniJQNH47dCojHjE5bSsQEXCXNMhHIvuuHmbtmyuDMPdAW6SbYEXE4 VQveikwBtiMZRA3t459N5STf8sdLALORzhQvwqso5l4pTQgvduGCjiX/hdDpR+TIYYyy m9qWy/zxDcdadmcqxVe+0p1QeMqCe4B6wO5N3HfR0ZkGXuowxeKk9bvay1LswKO+H/hg eFa1chKPxNI3NtpHlvCaikWREe22eGmRCYQxrdkZfVH/PF4+xzAaKLymbFJZryZNtNho hPd4cKxX1cymUqV4as4cvyS0a5+GdQwMZjuSwzBl8obpn3eJPi+JtelcotByaaNvYjAw XfYg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=ZtGTPVNvFOUzYfWK8go3UQ72lUnqON4f8m60bYv6k4I=; b=BQ0u9S2X8BCeZtUa7o4CSU4XCOutNYxFyqUwbh2jfje+tI/t7MCQQRHYB76zrOH60J 2APJ/Q+nZrKKvk2kMu0HK8LmRUqaWKxiZgAK88B/dYPOY2VKfYK4mOqOgzM7yS6W6Q0S OBOup42YLm+b6W9+rBobf8NeajuqO8WDD0wg4FoInGiorpkjiWTsCpiCedOrQFNuN1SE DF6E4HQ4A3gqDE5OVGQq6Z0oPQpV6d80Jz7P8II9rW454IGUNqWoaOX/7yAT0A7lNIYF oJOTXlH/rMTiuYryBeGRT76fHqEuyrIT8kL5+O0kMtjgmv4thJ8bpKLrd2nse6npI+oO CWqA==
X-Gm-Message-State: AODbwcCXmtueZT/idqOHZj08SqQcQW4aHN48hBiYicrs/+r2U9kpqGeX uhWXbuAfZQE5Xaby
X-Received: by 10.98.80.140 with SMTP id g12mr17181420pfj.146.1497115566443; Sat, 10 Jun 2017 10:26:06 -0700 (PDT)
Received: from [10.0.1.76] (c-98-248-223-72.hsd1.ca.comcast.net. [98.248.223.72]) by smtp.gmail.com with ESMTPSA id k15sm4542588pfb.1.2017.06.10.10.26.05 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 10 Jun 2017 10:26:05 -0700 (PDT)
Content-Type: multipart/alternative; boundary="Apple-Mail-07F97384-E491-4FE1-AD34-2328613D6C54"
Mime-Version: 1.0 (1.0)
From: Lucien Avramov <lucienav@google.com>
X-Mailer: iPhone Mail (14E304)
In-Reply-To: <CAFgnS4Vstv9zyg9rE4-K-q-6GH-P6noXCmoOLvdjTY+dU_uRHw@mail.gmail.com>
Date: Sat, 10 Jun 2017 10:26:04 -0700
Cc: gen-art <gen-art@ietf.org>, draft-ietf-bmwg-dcbench-methodology.all@ietf.org, ietf <ietf@ietf.org>, bmwg@ietf.org
Content-Transfer-Encoding: 7bit
Message-Id: <AC86F980-D9C1-4DE1-8296-70DB2A6482F9@google.com>
References: <149692498024.25760.14056448148418579949@ietfa.amsl.com> <CALTEt=DUhEVgSvYN+2XYUR8Ddq5n8HJtZW2RNj3DV3rSgH0YKQ@mail.gmail.com> <CAFgnS4Vstv9zyg9rE4-K-q-6GH-P6noXCmoOLvdjTY+dU_uRHw@mail.gmail.com>
To: Dan Romascanu <dromasca@gmail.com>
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/YF0d73Sh37tVnoeVQLNrDd-RfE0>
Subject: Re: [bmwg] Genart last call review of draft-ietf-bmwg-dcbench-methodology-07
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 10 Jun 2017 17:26:11 -0000

Thank you Dan, much appreciative of your feedback.

Lucien

> On Jun 10, 2017, at 08:27, Dan Romascanu <dromasca@gmail.com> wrote:
> 
> Hi,
> 
> All answers are acceptable. Thanks for addressing my comments. 
> 
> Regards,
> 
> Dan
> 
> 
>> On Fri, Jun 9, 2017 at 8:11 AM, Lucien Avramov <lucienav@google.com> wrote:
>> Hi Dan, 
>> 
>> Thank you very much for the comments. I addressed them and published version -09. 
>> 
>> Inline are some the comments / answer to your feedback. The parts without answers mean they have been addressed. 
>> 
>> Again, thank you for spending the time to read this in this fine detail. 
>> 
>> Lucien
>> 
>> 
>> 
>>> On Thu, Jun 8, 2017 at 5:29 AM, Dan Romascanu <dromasca@gmail.com> wrote:
>>> Reviewer: Dan Romascanu
>>> Review result: Ready with Issues
>>> 
>>> I am the assigned Gen-ART reviewer for this draft. The General Area
>>> Review Team (Gen-ART) reviews all IETF documents being processed
>>> by the IESG for the IETF Chair.  Please treat these comments just
>>> like any other last call comments.
>>> 
>>> For more information, please see the FAQ at
>>> 
>>> <https://trac.ietf.org/trac/gen/wiki/GenArtfaq>.
>>> 
>>> Document: draft-ietf-bmwg-dcbench-methodology-??
>>> Reviewer: Dan Romascanu
>>> Review Date: 2017-06-08
>>> IETF LC End Date: 2017-06-13
>>> IESG Telechat date: Not scheduled for a telechat
>>> 
>>> Summary:
>>> 
>>> This Informational I-D describes test and evaluation methodology and
>>> measurement techniques for physical network equipment in the data center. It's
>>> an useful and clearly written document and it is ready for publication, after a
>>> number of minor issues and nits will be addressed.
>>> 
>>> Major issues:
>>> 
>>> Minor issues:
>>> 
>>> 1. There is one single mention of the scope being benchmarking of 'physical
>>> network equipment in the data center'. I assume this is written as opposed to
>>> virtual networking equipment. This is not included in the title or repeated any
>>> place else. I suggest to make more clear the scope by mentioning 'physical
>>> equipment' at least once more, for example in the Introduction section.
>>> 
>>> 2. Section 1.2: I am a little concerned about adding additional interpretations
>>> to the keywords in RFC2119.
>>> 
>>> Especially about:
>>> 
>>> 'MAY: Comprehensive metric for the scenario described'
>> 
>> Thank you, MAY provides an optional metric, I have addressed your comment 
>>> 
>>> MAY has a different meaning in 2119, and the fact that a metric is
>>> 'comprehensive' (whatever this means) seems to me orthogonal to the 2119
>>> semantics. The proposed interpretation makes little sense to me, if
>>> 'comprehensive' than why not required? or at least as a 'should'?
>>> 
>>> 3. Section 6.2: 'The intensity of a microburst MAY be varied ...' It would be
>>> useful to make clear what is meant by 'intensity'.
>> 
>> The intensity of a microburst is defined in the definitions document [1] so i referenced it that way
>>  
>>> 
>>> Nits/editorial comments:
>>> 
>>> 1. The different formatting of the references [1], [2], etc. vs. [RFC2119],
>>> etc. is slightly confusing. Unless there is some good reason I suggest to fix
>>> this. Also use of references is inconsistent through the text, sometimes they
>>> are mentioned, sometimes they are not.
>> 
>> Fixed it for [2] and [3], however kept [1] as [1], as this document is not an RFC yet.
>>  
>>> 
>>> 2. Section 2.2: 'Alternatively when a traffic generator CAN NOT be connected '
>>> - this capitalization is not conformant to RFC2119.
>>> 
>>> 3. 'vlan ZZZ' is not consistent with 'vlan X' and 'vlan Y' previously used.
>>> 
>>> 4. Missing reference - RFC 6985
>>> 
>>> 5. Missing expansion and references for DSCP and COS
>>> 
>>> 6. Sections 3.3 and 6.3: s/number of iteration/number of iterations/
>>> 
>>> 7. The methodology (e.g. in section 5) makes an assumption that the DUT has at
>>> least nine ports. This may be trivial in a DC, but it's worth being mentioned
>>> 
>> 
>> Thanks added this in section 2.3 as it was making more sense to be clarified there 
>> 
>