Re: [bmwg] AD Evaluation for draft-ietf-bmwg-ipv6-tran-tech-benchmarking

Marius Georgescu <marius.georgescu@rcs-rds.ro> Sat, 15 April 2017 09:35 UTC

Return-Path: <marius.georgescu@rcs-rds.ro>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1F5F6124D6C; Sat, 15 Apr 2017 02:35:24 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.701
X-Spam-Level:
X-Spam-Status: No, score=-2.701 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=rcs-rds.ro
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id spPhUFJL-vad; Sat, 15 Apr 2017 02:35:21 -0700 (PDT)
Received: from mailproxy2.rcs-rds.ro (mailproxy2.rcs-rds.ro [212.54.127.5]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E232912420B; Sat, 15 Apr 2017 02:35:20 -0700 (PDT)
Received: from [10.252.8.18] (unknown [10.252.8.18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mailproxy2.rcs-rds.ro (Postfix) with ESMTPSA id E16ED10411E; Sat, 15 Apr 2017 12:35:17 +0300 (EEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=rcs-rds.ro; s=MailProxy; t=1492248918; bh=lshIfw9jQaiPe7gHmEI4lDKStPIkzU+IAwuWL9QxVYY=; h=Subject:From:In-Reply-To:Date:Cc:References:To; b=MeLhqe22lxweT6nmzAbT4VegxDmi7QS5dO3EGj/uQV4dub90qLp2UpJvFfGe7mqOZ 5mGCOcwZQQ7lY2i0WcwRhkf5eP60R+Y6vKDZhOTZDNkAhwOLuA8RUIzjdWRhOQCkp5 USKz3WmXyvz/DoCDk9Ul4XSzluWIUQqKkI5ihub4=
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\))
From: Marius Georgescu <marius.georgescu@rcs-rds.ro>
In-Reply-To: <CAHw9_iJ+PcuJVS3ougbFUQkT0OwmEXbRVqy=44bORwUHar-FzQ@mail.gmail.com>
Date: Sat, 15 Apr 2017 12:35:11 +0300
Cc: draft-ietf-bmwg-ipv6-tran-tech-benchmarking@ietf.org, bmwg-chairs@ietf.org, bmwg@ietf.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <ADC8E1B6-CEC2-42CE-9BB8-F4A8EE8630EF@rcs-rds.ro>
References: <CAHw9_iJ+PcuJVS3ougbFUQkT0OwmEXbRVqy=44bORwUHar-FzQ@mail.gmail.com>
To: Warren Kumari <warren@kumari.net>
X-Mailer: Apple Mail (2.3259)
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/dbvFa2bvR-yIuC58t3woD8wFiuI>
Subject: Re: [bmwg] AD Evaluation for draft-ietf-bmwg-ipv6-tran-tech-benchmarking
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 15 Apr 2017 09:35:24 -0000

Hello Warren,

Thank you very much for your kind words and for the detailed review.
We will revise the draft considering the Shepherd writeup and your comments. 
Is there a deadline we should be aware of?

Best regards,
Marius

> On Apr 14, 2017, at 7:46 PM, Warren Kumari <warren@kumari.net> wrote:
> 
> Hi there,
> 
> First off, thanks for a really well written document -- I've done some
> benchmarking of routers and switches and similar, but never and
> translation devices. This document explains how I would benchmark this
> nicely.
> 
> I had a few minor nits which I think would be nice if you could
> address before I start IETF LC - this should help the document sail
> though the process.
> While addressing these, there are also 2 editorial notes in the
> Shepherd writeup, both (IMO) easy to address.
> 
> 
> W
> 
> Section 1:
> "ability to gracefully accommodate greater numbers of flows
>   than the maximum number of flows which the DUT can operate normally."
> 
> [O] DUT
> [P] [spell out DUT]
> [R] first use of the acronym
> 
> 
> Section 1.1. IPv6 Transition Technologies
> "4. Encapsulation: The production network is assumed to have all three
> domains, Domains A and B are IPvX specific, while the core ..."
> 
> [O] three domains, Domains A and B
> [P] three domains; Domains A and B
> [R] grammar
> 
> 
> Section 5.1. Frame Formats and Sizes
> 
> "The two documents can be referred for the dual-stack transition technologies."
> 
> [O] referred
> [P] referenced
> [R] not sure what is meant; referenced is just a guess here. Or
> "referred to"? Nither sounds great.
> 
> 
> 
> "The calculation method for the Ethernet, as well as a calculation
> example are detailed in Appendix A. "
> 
> [O] calculation example are
> [P] calculation example, are
> [R] grammar
> 
> 
> Section 6. Modifiers
> 
>   The idea of testing under different operational conditions was first
>   introduced in [RFC2544](Section 11) and represents an important
>   aspect of benchmarking network elements, as it emulates to some
>   extent the conditions of a production environment. Section 6 of
> 
> [O]  as it emulates to some extent the
> [P] as it emulates, to some extent, the
> [R] grammar
> 
> 
> Section 8. Additional Benchmarking Tests for Stateful IPv6 Transition
> Technologies
> 
>   This section describes additional tests dedicated to the stateful
>   IPv6 transition technologies. For the tests described in this
>   section the DUT devices SHOULD follow the test setup and test
> 
> [O] section the DUT device
> [P] section, the DUT device
> [R] grammar
> 
> 
> - If the DNS64 server implements caching and there is a cache hit
>        then step 1 is followed by step 6 (and steps 2 through 5 are
>        omitted).
> - If the domain name has an AAAA record then it is returned in
> 
> [O] If the domain name has an AAAA record then it is returned
> [P] If the domain name has an AAAA record, then it is returned
> 
> 
> 
> (When all the domain names are cached then the results do not depend
> on what percentage of the ...
> 
> [O] are cached then the
> [P] are cached, the
> [R] readability
> 
> 
> 
> (When all the domain names
>   are cached then the results do not depend on what percentage of the
>   domain names have AAAA records, thus these combinations are not
>   worth testing one by one.)
> [O] are cached then the
> [P] are cached, the
> [R] readability
> 
> 
> queries at the required frequency using up not more than the half of
> the timeout time.
> 
>   Remark: a sample open-source test program, dns64perf++ is available
> 
> [O] dns64perf++ is
> [P] dns64perf++, is
> [R] grammar
> 
> 
> 
>  For encapsulation transition technologies a m:n setup can be
> 
> [O]  For encapsulation transition technologies
> [P]  For encapsulation transition technologies,
> [R] grammar
> 
>   created, where m is the number of flows applied to the same client
>   device and n the number of client devices connected to the same
>   server device.
>   For the translation based transition technologies the client devices
> 
> [O] For the translation based transition technologies the client
> [P] For the translation based transition technologies, the client
> [R] grammar
> 
> 
> 
> In other words, if flow I is started at time x, flow i+1
> 
> [O] flow I is started at time x, flow i+1
> [R] I and i should be consistent; either use upper or lower case. Same
> for other variables.
> 
> 
> 
> Section 11. NAT44 and NAT66
> 
>   Although these technologies are not the primarily scope of this
> 
> [O] the primarily scope
> [P] the primary scope
> [R] word choice
> 
> 
> Section 12. Summarizing function and variation
> 
> For a fine grain analysis of the frequency distribution of the data,
> 
> [O] fine grain analysis
> [P] fine grained analysis
> [R] word choice
> 
> 
> -- 
> I don't think the execution is relevant when it was obviously a bad
> idea in the first place.
> This is like putting rabid weasels in your pants, and later expressing
> regret at having chosen those particular rabid weasels and that pair
> of pants.
>   ---maf