Re: [bmwg] Genart last call review of draft-ietf-bmwg-dcbench-methodology-07

Dan Romascanu <dromasca@gmail.com> Sat, 10 June 2017 15:28 UTC

Return-Path: <dromasca@gmail.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2F405129437; Sat, 10 Jun 2017 08:28:03 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.699
X-Spam-Level:
X-Spam-Status: No, score=-2.699 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1RmU7x4qxKK9; Sat, 10 Jun 2017 08:28:00 -0700 (PDT)
Received: from mail-qk0-x22c.google.com (mail-qk0-x22c.google.com [IPv6:2607:f8b0:400d:c09::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B6A1A1200E5; Sat, 10 Jun 2017 08:28:00 -0700 (PDT)
Received: by mail-qk0-x22c.google.com with SMTP id d14so14867990qkb.1; Sat, 10 Jun 2017 08:28:00 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=uA4EcL4Plhm1/Af6UUXZTzs4HmJ0cTgYxzmPEml63s4=; b=O1pI0YeVMjxy86XzjJicapWld37Gs9pif0aQtBP5lROdUYxOyL0B62VLKfe1l2v0sm Oa25sucd9IJRFHcsKqn3YOdlAcYfqXFv9AYnnQMI1jmPwzG8z5vdFk1/LYYE2N9gfW4j 5Km63mYIYUA7m0Tlv+TZ4r180CKMKWa2sayQ4bzHBUlsMxe2yWjRE10f6yKm6tCVqeN3 TlduPiSONBUvjTJyDbMVlnm8Fj2M3jE4+sYLe81Gmc/Fd5idLXoGEw5Q322TJb/iQ2a9 x/rTz9Dqu5dcr9Ep0k4eI1oAm30pLWfrme602Hi4fYfSsau811wkeQxLAOMHL/ke1Z8p Sd3Q==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=uA4EcL4Plhm1/Af6UUXZTzs4HmJ0cTgYxzmPEml63s4=; b=Sofixyc4C1ZCBDiF+/kP50zu5SAtTHZkVOw1HVvCMwUmo5bKpmCoMf/ghb3ckYOQWH Q+ajF2ePZydTrVBQCXYCv/pQYP3U/a/vRPppbNGlIKPlm9k6k6IHR+vi0JA6yzi4g/mT ReNNtIOhJrOXT10gorAaarCVZo8SoREOie9kCOefjaUrAc6ukn8mkdoK8rb1o3GUpgZq 9dAl2lEX2IUZoApEYEWmuGsGLR7RQd2SYb7WctiEqJyZAWYLi3g+s6fPwY63KSErfEzI wfGVlV3Yjc8XwUtXwNh4WwDxk0IguiujpBmraRYu9DgmOktBoUHSNFKR5ohDdGvPEDg0 4mfA==
X-Gm-Message-State: AKS2vOwjHcRYqoIzUpc+d8hrBekPhGrIW3c1oJTMeuT5ZNkkL/aI67Pc 4qWoHzOPU7Qpr6Sq/u3K4i3l9emNyg==
X-Received: by 10.55.159.13 with SMTP id i13mr8952731qke.150.1497108479870; Sat, 10 Jun 2017 08:27:59 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.140.31.101 with HTTP; Sat, 10 Jun 2017 08:27:59 -0700 (PDT)
In-Reply-To: <CALTEt=DUhEVgSvYN+2XYUR8Ddq5n8HJtZW2RNj3DV3rSgH0YKQ@mail.gmail.com>
References: <149692498024.25760.14056448148418579949@ietfa.amsl.com> <CALTEt=DUhEVgSvYN+2XYUR8Ddq5n8HJtZW2RNj3DV3rSgH0YKQ@mail.gmail.com>
From: Dan Romascanu <dromasca@gmail.com>
Date: Sat, 10 Jun 2017 18:27:59 +0300
Message-ID: <CAFgnS4Vstv9zyg9rE4-K-q-6GH-P6noXCmoOLvdjTY+dU_uRHw@mail.gmail.com>
To: Lucien Avramov <lucienav@google.com>
Cc: gen-art <gen-art@ietf.org>, draft-ietf-bmwg-dcbench-methodology.all@ietf.org, ietf <ietf@ietf.org>, bmwg@ietf.org
Content-Type: multipart/alternative; boundary="001a114d8aa0220ec305519cbbdd"
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/581MPZ1CR8uj2GbvUcdsdUl3lUI>
Subject: Re: [bmwg] Genart last call review of draft-ietf-bmwg-dcbench-methodology-07
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 10 Jun 2017 15:28:03 -0000

Hi,

All answers are acceptable. Thanks for addressing my comments.

Regards,

Dan


On Fri, Jun 9, 2017 at 8:11 AM, Lucien Avramov <lucienav@google.com> wrote:

> Hi Dan,
>
> Thank you very much for the comments. I addressed them and published
> version -09.
>
> Inline are some the comments / answer to your feedback. The parts without
> answers mean they have been addressed.
>
> Again, thank you for spending the time to read this in this fine detail.
>
> Lucien
>
>
>
> On Thu, Jun 8, 2017 at 5:29 AM, Dan Romascanu <dromasca@gmail.com> wrote:
>
>> Reviewer: Dan Romascanu
>> Review result: Ready with Issues
>>
>> I am the assigned Gen-ART reviewer for this draft. The General Area
>> Review Team (Gen-ART) reviews all IETF documents being processed
>> by the IESG for the IETF Chair.  Please treat these comments just
>> like any other last call comments.
>>
>> For more information, please see the FAQ at
>>
>> <https://trac.ietf.org/trac/gen/wiki/GenArtfaq>.
>>
>> Document: draft-ietf-bmwg-dcbench-methodology-??
>> Reviewer: Dan Romascanu
>> Review Date: 2017-06-08
>> IETF LC End Date: 2017-06-13
>> IESG Telechat date: Not scheduled for a telechat
>>
>> Summary:
>>
>> This Informational I-D describes test and evaluation methodology and
>> measurement techniques for physical network equipment in the data center.
>> It's
>> an useful and clearly written document and it is ready for publication,
>> after a
>> number of minor issues and nits will be addressed.
>>
>> Major issues:
>>
>> Minor issues:
>>
>> 1. There is one single mention of the scope being benchmarking of
>> 'physical
>> network equipment in the data center'. I assume this is written as
>> opposed to
>> virtual networking equipment. This is not included in the title or
>> repeated any
>> place else. I suggest to make more clear the scope by mentioning 'physical
>> equipment' at least once more, for example in the Introduction section.
>>
>> 2. Section 1.2: I am a little concerned about adding additional
>> interpretations
>> to the keywords in RFC2119.
>>
>> Especially about:
>>
>> 'MAY: Comprehensive metric for the scenario described'
>>
>
> *Thank you, MAY provides an optional metric, I have addressed your
> comment *
>
>>
>> MAY has a different meaning in 2119, and the fact that a metric is
>> 'comprehensive' (whatever this means) seems to me orthogonal to the 2119
>> semantics. The proposed interpretation makes little sense to me, if
>> 'comprehensive' than why not required? or at least as a 'should'?
>>
>> 3. Section 6.2: 'The intensity of a microburst MAY be varied ...' It
>> would be
>> useful to make clear what is meant by 'intensity'.
>>
>
> The intensity of a microburst is defined in the definitions document [1]
> so i referenced it that way
>
>
>>
>> Nits/editorial comments:
>>
>> 1. The different formatting of the references [1], [2], etc. vs.
>> [RFC2119],
>> etc. is slightly confusing. Unless there is some good reason I suggest to
>> fix
>> this. Also use of references is inconsistent through the text, sometimes
>> they
>> are mentioned, sometimes they are not.
>>
>
> Fixed it for [2] and [3], however kept [1] as [1], as this document is not
> an RFC yet.
>
>
>>
>> 2. Section 2.2: 'Alternatively when a traffic generator CAN NOT be
>> connected '
>> - this capitalization is not conformant to RFC2119.
>>
>> 3. 'vlan ZZZ' is not consistent with 'vlan X' and 'vlan Y' previously
>> used.
>>
>> 4. Missing reference - RFC 6985
>>
>> 5. Missing expansion and references for DSCP and COS
>>
>> 6. Sections 3.3 and 6.3: s/number of iteration/number of iterations/
>>
>> 7. The methodology (e.g. in section 5) makes an assumption that the DUT
>> has at
>> least nine ports. This may be trivial in a DC, but it's worth being
>> mentioned
>>
>> Thanks added this in section 2.3 as it was making more sense to be
> clarified there
>
>