IETF Logo Mail Archive

Re: [bmwg] WGLC: draft-ietf-bmwg-sdn-controller-benchmark-term-02 and meth-02

Marius Georgescu <marius.georgescu@rcs-rds.ro> Mon, 09 January 2017 14:54 UTC

Return-Path: <marius.georgescu@rcs-rds.ro>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 71AE8129466 for <bmwg@ietfa.amsl.com>; Mon, 9 Jan 2017 06:54:39 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.5
X-Spam-Level:
X-Spam-Status: No, score=-4.5 tagged_above=-999 required=5 tests=[BAYES_05=-0.5, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RP_MATCHES_RCVD=-3.199, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=rcs-rds.ro
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id OcX_kzDU4GmU for <bmwg@ietfa.amsl.com>; Mon, 9 Jan 2017 06:54:37 -0800 (PST)
Received: from mailproxy5.rcs-rds.ro (mailproxy5.rcs-rds.ro [212.54.124.6]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 41525129D30 for <bmwg@ietf.org>; Mon, 9 Jan 2017 06:54:37 -0800 (PST)
Received: from [10.172.5.198] (unknown [10.172.5.198]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mailproxy5.rcs-rds.ro (Postfix) with ESMTPSA id A2EBA2831BF; Mon, 9 Jan 2017 16:54:35 +0200 (EET)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=rcs-rds.ro; s=MailProxy; t=1483973675; bh=JIHwqZ/ER1MMJwWePXKpDnodJQu4zc1h/Nbh/uL63Nw=; h=Subject:From:In-Reply-To:Date:Cc:References:To; b=OoAwQSh80/PbRVVn94fY6LFrW6Eq9TzIuTnVgbhrEtHJXHCV+HCJAuSJKJZCFpRQW +G9I19YY1zRnkvHcLRvJnDhB4xb4VZg+kOU/kNb8neBUxgMGd1Lai06fROo6xyMH2J r+/Bq2ADlllTubMiSv5+3ZnhRjPFwcOtfoLmAgZU=
Content-Type: text/plain; charset="us-ascii"
Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\))
From: Marius Georgescu <marius.georgescu@rcs-rds.ro>
In-Reply-To: <1941588895.47034.1483741667991.JavaMail.zimbra@veryxtech.com>
Date: Mon, 09 Jan 2017 16:54:32 +0200
Content-Transfer-Encoding: quoted-printable
Message-Id: <940EDD7C-07A7-471E-8267-861584888E40@rcs-rds.ro>
References: <3bccc7f4-f887-96cf-90bb-90455419443f@rcs-rds.ro> <1941588895.47034.1483741667991.JavaMail.zimbra@veryxtech.com>
To: "Bhuvan (Veryx Technologies)" <bhuvaneswaran.vengainathan@veryxtech.com>
X-Mailer: Apple Mail (2.3259)
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/emJt9DewDK9Z63nzbWct2w_tiKE>
Cc: Vishwas Manral <vishwas.manral@gmail.com>, bmwg@ietf.org, "Tassinari, Mark" <mark.tassinari@hpe.com>
Subject: Re: [bmwg] WGLC: draft-ietf-bmwg-sdn-controller-benchmark-term-02 and meth-02
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 09 Jan 2017 14:54:39 -0000

Dear Bhuvan and Co-authors,

Thank you for considering my comments.
Please find my answers inline with the tag [MG]. 

> On Jan 7, 2017, at 12:27 AM, Bhuvan (Veryx Technologies) <bhuvaneswaran.vengainathan@veryxtech.com> wrote:
> 
> Hi Marius,
> 
> Thank you for your comments and please find below our responses inline with tag [Authors].
> 
> Best Regards,
> Bhuvan
> 
> ----- Original Message -----
> From: "Marius Georgescu" <marius.georgescu@rcs-rds.ro>
> To: bmwg@ietf.org
> Sent: Tuesday, 1 November, 2016 09:38:34
> Subject: Re: [bmwg] WGLC: draft-ietf-bmwg-sdn-controller-benchmark-term-02 and meth-02
> 
> Hello BMWG,
> 
> I have read both drafts and generally I find them mature enough to be forwarded to the IESG. 
> I also have one comment which seems still uncovered and may improve the draft further. 
> 
> #1# Is the average the most representative time in most of the measurements presented in 
> https://tools.ietf.org/html/draft-ietf-bmwg-sdn-controller-benchmark-meth-02 ? 
> [Authors] We had lot of discussion internally and we think If we run the test as many times 
> as BMWG recommends, then presumably the mean and median would be close. 
> 

[MG] If the empirical data showed a normal distribution, then the mean would be indeed sufficient.

> Would it make sense to have maybe a "Maximum Topology Discovery Time" as a sort of worst case scenario? 
> The question can stand as well for other benchmarks. 
> [Authors] We think, determining the 'maximum' would be meaningful for size&rate and not sure about the time.
> Please let us know if we miss something here.
[MG] If there is consensus among the authors and no other opinion supporting this "worst case" time, I do not insist on having it included. 

Best regards,
---
Marius Georgescu
Backbone Engineer
RCS & RDS Bucharest
http://www.rcs-rds.ro 
Any views or opinions presented in this email are solely those of the author 
and do not necessarily represent those of the company.
Privileged/Confidential Information may be contained in this message. 
If you are not the addressee indicated in this message (or responsible for delivery of the message to such person),
you may not copy or deliver this message to anyone. In such a case, you should destroy this message 
and kindly notify the sender by reply e-mail

v2.23.0 | Report a Bug | By Email