Re: [bmwg] New Version for draft Methodology for VNF Benchmarking Automation

Raphael Vicente Rosa <raphaelvrosa@gmail.com> Tue, 20 October 2020 19:16 UTC

Return-Path: <raphaelvrosa@gmail.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 478EA3A131E for <bmwg@ietfa.amsl.com>; Tue, 20 Oct 2020 12:16:54 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.997
X-Spam-Level:
X-Spam-Status: No, score=-1.997 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=0.1, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id E-EYQnqpUcow for <bmwg@ietfa.amsl.com>; Tue, 20 Oct 2020 12:16:52 -0700 (PDT)
Received: from mail-wr1-x433.google.com (mail-wr1-x433.google.com [IPv6:2a00:1450:4864:20::433]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A62E23A1419 for <bmwg@ietf.org>; Tue, 20 Oct 2020 12:16:39 -0700 (PDT)
Received: by mail-wr1-x433.google.com with SMTP id n15so3665633wrq.2 for <bmwg@ietf.org>; Tue, 20 Oct 2020 12:16:39 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=HPEnMeV8cs72RIqPMoxx6mXbMoNXH5TrJHyRG8KhFtU=; b=mhhkGqiOJAsEcwmjI0frgKCNo5NFDA9CzwBsapP8RYCmnwK15m3+aErP3c+TT7jUWh RZqaLm3+XsZTJ03X0Fc7v/TiT9e4vArn8yOcOocaSRaiZFNnsjQ4tyjOKwSmxll5gV8Q JboIU0ZBypSOGvbCsch4CmtmS0ms/Z3Baf58A5J/EAB2xVKONRYkIx6abgC79/08BPEz hD2XTOeQQgNY3yWP1RYsuZ7VNtKs8AUmc7L2vHhXBZii/i15WBhqDooL1p8LaaojB/Cl e8/q0hb6HOVTyEDEv7IVVM+A+yfjkwZvbiQjB+CLQIlhR49gn/PW+mALLkZxvXMM4Qot OWyA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=HPEnMeV8cs72RIqPMoxx6mXbMoNXH5TrJHyRG8KhFtU=; b=o0z2XXIapK6WSF7RTh9AOg72A6KRPJjtj0SHR3hRjJVgFgGegTMNpDP0ZGErCTjl/t LcR0XBaRo7ZmZ9yD30qTHjRBHtm7DzERY+7p6G3HpTWuG3rmSAN84OGdPo9Ug2BuI05t XNgyldtmO2ourVr4Tf/bpBcdq+TAblsgw1DT3uRobtQZ1Y8nAahl5UJWuimhvx9GlUxi KggWAHwprxA5SPWBWFCSP63F4Iq/3mNIXWrl/ac+Nc1WXAvMfhTlrJv5ezy+Wuxjm3JQ 6lO3r51Ki6J4t6X5Wn/eT30WGFJcMsHSxY/pKTKmG1+88gKkXCHK1EJP1FA65cTfEcOz OwKQ==
X-Gm-Message-State: AOAM530D4mdK7sy9uvcyW0OVm5MzpOT6rvoXd3LzbBSntlKPCEgmrxnO tYSjMml1/lAd58dKhcDGJbkJj1pUYPTzr65+fHg=
X-Google-Smtp-Source: ABdhPJzlO8+XJy1GHlql65bjTowVf2Mr/c6O2UVq9p3Uow2t1VQPnaJOn3yvUoMFPqDdxGBwJq46TI3uzjTcDHkQAt4=
X-Received: by 2002:adf:e8d0:: with SMTP id k16mr5041640wrn.362.1603221398054; Tue, 20 Oct 2020 12:16:38 -0700 (PDT)
MIME-Version: 1.0
References: <CAD-XRrWqr1uNoHX9km7UA_LiL5hV4FMjRgLmLRe0HK=i5+5CGg@mail.gmail.com> <4D7F4AD313D3FC43A053B309F97543CF0147618556@njmtexg4.research.att.com>
In-Reply-To: <4D7F4AD313D3FC43A053B309F97543CF0147618556@njmtexg4.research.att.com>
From: Raphael Vicente Rosa <raphaelvrosa@gmail.com>
Date: Tue, 20 Oct 2020 16:16:26 -0300
Message-ID: <CAD-XRrV9YFTO7i7bpWkypU3cithM3E1G4+5Qag-4obmg3GUSXg@mail.gmail.com>
To: "MORTON, ALFRED C (AL)" <acm@research.att.com>
Cc: "bmwg@ietf.org" <bmwg@ietf.org>
Content-Type: multipart/alternative; boundary="000000000000ed696a05b21f1146"
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/PL2Wz8_WBRUqy2AQq-W2ZJdZs9c>
Subject: Re: [bmwg] New Version for draft Methodology for VNF Benchmarking Automation
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 20 Oct 2020 19:16:54 -0000

Hi Al,

Good to be back!
Sorry for being inactive for a while, tough times we are living in, but the
interest in the draft keeps alive.

Thanks for asking, the main draft updates are:

1. The introduction states a clear/better motivation for the draft;
2. In considerations, we clearly state what are the "Phases of a
Benchmarking Test" subject to automation;
3. The methodology depicts the need of YANG modules, explains them, and
presents the procedures that define the flow of information involved in
utilizing the YANG models to realize the methodology for VNF benchmarking
automation;
4. The methodology explains the composition of a VNF benchmarking report,
its inputs and outputs, by the means of automation and utilizing the draft
considerations (e.g., components of the proposed architectural framework);
5. YANG modules were added to the draft (not sure if it is correct, help
needed there);
6. Some of the sections/subsections titles were changed for clarity;
7. The reference implementation realizes all the methodology (getting some
results to present).

It was a major refactor in the draft content, giving more maturity to it
while clarifying its core concepts and proposal.

Raphael

On Tue, Oct 20, 2020 at 2:37 PM MORTON, ALFRED C (AL) <acm@research.att.com>
wrote:

> Hi Raphael, welcome back!
>
>
>
> What are the updates we can expect to read in the latest draft?
>
>
>
> Al
>
> bmwg co-chair
>
>
>
> *From:* bmwg [mailto:bmwg-bounces@ietf.org] *On Behalf Of *Raphael
> Vicente Rosa
> *Sent:* Tuesday, October 20, 2020 1:25 PM
> *To:* bmwg@ietf.org
> *Subject:* [bmwg] New Version for draft Methodology for VNF Benchmarking
> Automation
>
>
>
> Hi BMWG members,
>
>
>
> We submitted a new version of the draft "Methodology for VNF Benchmarking
> Automation", see below.
>
>
>
> @BMWG Chairs: we would like a slot to present the draft updates (e.g.,
> addressing the comments of the mailing-list) in the next IETF/BMWG meeting
> and propose it to be adopted by the working group.
>
>
>
> Best regards,
>
> Raphael
>
>
>
>
>
> A new version of I-D, draft-rosa-bmwg-vnfbench-06.txt
> has been successfully submitted by Raphael Vicente Rosa and posted to the
> IETF repository.
>
> Name:           draft-rosa-bmwg-vnfbench
> Revision:       06
> Title:          Methodology for VNF Benchmarking Automation
> Document date:  2020-10-20
> Group:          Individual Submission
> Pages:          49
> URL:
> https://www.ietf.org/archive/id/draft-rosa-bmwg-vnfbench-06.txt
> <https://urldefense.com/v3/__https:/www.ietf.org/archive/id/draft-rosa-bmwg-vnfbench-06.txt__;!!BhdT!3cH5bVyOTbrnUEYtPCIt78eTqjM3FF6OfBUQyGYogIG5TgzhZFgVJNEur1Ar$>
> Status:         https://datatracker.ietf.org/doc/draft-rosa-bmwg-vnfbench/
> <https://urldefense.com/v3/__https:/datatracker.ietf.org/doc/draft-rosa-bmwg-vnfbench/__;!!BhdT!3cH5bVyOTbrnUEYtPCIt78eTqjM3FF6OfBUQyGYogIG5TgzhZFgVJKrUDB7P$>
> Htmlized:
> https://datatracker.ietf.org/doc/html/draft-rosa-bmwg-vnfbench
> <https://urldefense.com/v3/__https:/datatracker.ietf.org/doc/html/draft-rosa-bmwg-vnfbench__;!!BhdT!3cH5bVyOTbrnUEYtPCIt78eTqjM3FF6OfBUQyGYogIG5TgzhZFgVJP8XAMxk$>
> Htmlized:       https://tools.ietf.org/html/draft-rosa-bmwg-vnfbench-06
> <https://urldefense.com/v3/__https:/tools.ietf.org/html/draft-rosa-bmwg-vnfbench-06__;!!BhdT!3cH5bVyOTbrnUEYtPCIt78eTqjM3FF6OfBUQyGYogIG5TgzhZFgVJKw8XcyD$>
> Diff:
> https://www.ietf.org/rfcdiff?url2=draft-rosa-bmwg-vnfbench-06
> <https://urldefense.com/v3/__https:/www.ietf.org/rfcdiff?url2=draft-rosa-bmwg-vnfbench-06__;!!BhdT!3cH5bVyOTbrnUEYtPCIt78eTqjM3FF6OfBUQyGYogIG5TgzhZFgVJLo_GgVw$>
>
> Abstract:
>    This document describes a common methodology for the automated
>    benchmarking of Virtualized Network Functions (VNFs) executed on
>    general-purpose hardware.  Specific cases of automated benchmarking
>    methodologies for particular VNFs can be derived from this document.
>    An open source reference implementation is reported as running code
>    embodiment of the proposed, automated benchmarking methodology.
>
>
>
>
> Please note that it may take a couple of minutes from the time of
> submission
> until the htmlized version and diff are available at tools.ietf.org
> <https://urldefense.com/v3/__http:/tools.ietf.org/__;!!BhdT!3cH5bVyOTbrnUEYtPCIt78eTqjM3FF6OfBUQyGYogIG5TgzhZFgVJJe1MOBJ$>
> .
>
> The IETF Secretariat
>