[bmwg] Updates on draft: Methodology for VNF Benchmarking Automation

Raphael Vicente Rosa <raphaelvrosa@gmail.com> Wed, 20 February 2019 12:51 UTC

Return-Path: <raphaelvrosa@gmail.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D5B171286E7 for <bmwg@ietfa.amsl.com>; Wed, 20 Feb 2019 04:51:28 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level:
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id gokqm01q9jdv for <bmwg@ietfa.amsl.com>; Wed, 20 Feb 2019 04:51:26 -0800 (PST)
Received: from mail-ua1-x92c.google.com (mail-ua1-x92c.google.com [IPv6:2607:f8b0:4864:20::92c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3F22C1279E6 for <bmwg@ietf.org>; Wed, 20 Feb 2019 04:51:26 -0800 (PST)
Received: by mail-ua1-x92c.google.com with SMTP id c5so6259843uaq.7 for <bmwg@ietf.org>; Wed, 20 Feb 2019 04:51:26 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=AYP+yE5n2I2MDtyi67FJ/I37jSWOfreUw4IyySkxdlc=; b=qr14ERyyoX6S+fUipjphU3FLhGBDs+Ickr0Frz4UNsSouRXiTjWSGTkefS54bFsxbO /I4YoQqjIJU1Ex3f3LV5eyICDtEqCZRa/QNX9oRmGlC4cTo9B7eP+Y/cOTmNaEoVoBDP joYcQeWb3t+cqnk4SvZBB6tIwGUomxxfTi0+N3supJSaGSFyu0AKi/KAB/HI04Yx4YOm m44A0H9JgkYHe7HhAMWgeodiTCf+l2vaw17F60NOp9BG6c7aYjXgI0fLiYjfB1kPO/Pa ZhcH2w7LvfH7NnnM3EDX9RcPBi9sQuKzYhngNXwEvvwCNHgTolyOnzcUkztK3w6mAWi7 ItMA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=AYP+yE5n2I2MDtyi67FJ/I37jSWOfreUw4IyySkxdlc=; b=WiIi71r63u1R0C0J+lri0irWQGrwyOwHYvqLwP4Olq+IWomG59g1cpK+PzOJMY/sNh IenW4Fbd9c5ugZn85rTrDGzabIsmhHBsEkalp1qX3mzNemFgXDoy1XK0l0toScyxrZRY AWVqi2g8qrWUfjVTyxEthxkVUawtBsHnmp4OOQ/H82UqbC6nwFU0660KmatOqCINQqTr S1hxDYinYP4nYhEJQcZCuHNlf1YL3ijckn2CemwPoEPaCQFZtntUisIuK7GQVQ/+SD3h ozxMS6Ps+bobNS4HJz3JKP5MQO98WURnhr7oj7CaAFBwx68RgxetQb+p8ChCpdZrr61r Kcxw==
X-Gm-Message-State: AHQUAubPlYSx7G7QSerQbzhR5d7vTya8bBGEPgE98xEIMODYHzQ8n3BW GzSNOcWmyqg+YdiIITS0S48zmSgdsBW9PlQPN2qucFx3
X-Google-Smtp-Source: AHgI3IYpuS7XEK8hTlNp8hbd7AfeuhIbNv99lfuTFWhzl8PWR0GU+zu9YEfRqZMOmUFFGOAwCZOoVir30j/sbYcU6pI=
X-Received: by 2002:ab0:490f:: with SMTP id z15mr17086416uac.81.1550667084720; Wed, 20 Feb 2019 04:51:24 -0800 (PST)
MIME-Version: 1.0
From: Raphael Vicente Rosa <raphaelvrosa@gmail.com>
Date: Wed, 20 Feb 2019 09:51:13 -0300
Message-ID: <CAD-XRrU2dbEm_2oRP2SrCxcA07dBJeAVnU2W3v0mUYhGiYRM9g@mail.gmail.com>
To: bmwg@ietf.org
Content-Type: multipart/alternative; boundary="000000000000bfed2f058252d016"
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/Wry9gYvSLIj7d6ks7MCG8UkKBcc>
Subject: [bmwg] Updates on draft: Methodology for VNF Benchmarking Automation
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 20 Feb 2019 12:51:29 -0000

Hi folks,

By the end of the last year we submitted the -03 version of the draft
"Methodology for VNF Benchmarking Automation" (see the info below).

Among the main achievements in the draft we highlight so far:
- We redefined the structure of the draft
- We produced an information model (github link
<https://github.com/raphaelvrosa/vnf-bench-model>) for the VNF Benchmark
Report (VNF-BR) that we now intend to translate into an YANG model (we
believe it could be more useful/important for the IETF community).
- We are running parallel experiments with our reference implementations,
and evolving the configurability and comparability factors in the VNF-BR
info model. We are going to bring the results to BMWG.
- We defined a set of common procedures in the methodology proposed by the
draft that we are following in the reference implementations.

Thus, we believe the draft stands in a version in need of comments from the
BMWG community. We are aware of the loose ends in the draft, and we have
plans to consolidate the knowledge there through experimental results.
Accordingly, for the next IETF meeting we intend to release a -04 version.

Finally, we would like to hear from you, if you believe the draft is ready
for adoption (or what is still needed to have it ready).

Best regards,
Raphael Rosa, on behalf of the authors


A new version of I-D, draft-rosa-bmwg-vnfbench-03.txt
has been successfully submitted by Raphael Vicente Rosa and posted to the
IETF repository.

Name:           draft-rosa-bmwg-vnfbench
Revision:       03
Title:          Methodology for VNF Benchmarking Automation
Document date:  2018-12-29
Group:          Individual Submission
Pages:          25
URL:
https://www.ietf.org/internet-drafts/draft-rosa-bmwg-vnfbench-03.txt
Status:         https://datatracker.ietf.org/doc/draft-rosa-bmwg-vnfbench/
Htmlized:       https://tools.ietf.org/html/draft-rosa-bmwg-vnfbench-03
Htmlized:
https://datatracker.ietf.org/doc/html/draft-rosa-bmwg-vnfbench
Diff:
https://www.ietf.org/rfcdiff?url2=draft-rosa-bmwg-vnfbench-03

Abstract:
   This document describes a common methodology for the automated
   benchmarking of Virtualized Network Functions (VNFs) executed on
   general-purpose hardware.  Specific cases of benchmarking
   methodologies for particular VNFs can be derived from this document.
   Two open source reference implementations are reported as running
   code embodiments of the proposed, automated benchmarking methodology.