[bmwg] New version of the draft Methodology for VNF Benchmarking Automation

Raphael Vicente Rosa <raphaelvrosa@gmail.com> Wed, 06 November 2019 19:24 UTC

Return-Path: <raphaelvrosa@gmail.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3A6C312010C for <bmwg@ietfa.amsl.com>; Wed, 6 Nov 2019 11:24:13 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.998
X-Spam-Level:
X-Spam-Status: No, score=-1.998 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id XUFCBnF6uy5Z for <bmwg@ietfa.amsl.com>; Wed, 6 Nov 2019 11:24:11 -0800 (PST)
Received: from mail-wr1-x42a.google.com (mail-wr1-x42a.google.com [IPv6:2a00:1450:4864:20::42a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1B1BD120104 for <bmwg@ietf.org>; Wed, 6 Nov 2019 11:24:11 -0800 (PST)
Received: by mail-wr1-x42a.google.com with SMTP id f2so18508809wrs.11 for <bmwg@ietf.org>; Wed, 06 Nov 2019 11:24:11 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=TrxGF5WU0IUFrSGwILH0ODwSTb7dZPz/QeHA6pm4T4M=; b=rnJTBbZ8LNK09PNFjRyfS1j2WJ8hWsfUC+tAKTl/OZlpIJvgKqGBTFC4rfQfWdj4XD itOibJLnahBRc4ZY1QNo76M8aA6cfCdttPUnczjTe+mKKl72tRZ52tbhT7rSkMygYLjR 8FGZBBdrXbPmZg4kmQo2g65xHfJc7HPpogpZL8rayoSdr3C2vDb1ngaS2ZqDiVdhc/cG 9UGAVqDUPRwiwEXvyRO53104kxehq+tA64Hp29VZTq6Gq5TDkhOP04y5wxyFz7Rmtt8t ify5qxk5wzihMYPti3IpFEXU2VFLlT3Jx4ZlRlBF41NyEP8ppnKTEcZ5gcsXRe6fdcq6 92eA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=TrxGF5WU0IUFrSGwILH0ODwSTb7dZPz/QeHA6pm4T4M=; b=Z55JQtrfIrB8rJwI5AT0Xf57Y1s972kcn+r4dr3sF/dQ5MSczkJCwExwTEDhj52Gvy VfiwezSO/nYgTZkAggMU+X8LbUMUgmDyLUGIPFZZUPo23M7IQnrh5/67pUIkql10mkQd FkMO8BGiTVOeaWN/r1RSHaAZfQXMf4DlVbrVBrnWj6y9xAYVzc+9CN+rGuXfTmh4N7vZ iKRhLYh7ytDcuYnPhEJA4UHuAvGEg2K5U/JA5zP+Cn4LSTw3Ni3j9SyoWMnKESMsEc8S 5ZN3a4RDzmr0w+zIBzkuGprUIfujyYbEWzFzB4vaqE91yeMHy1+HkZb++GvqCU76BVEe +0yQ==
X-Gm-Message-State: APjAAAXbcgLqmBYWdEvQGZmUunygAkaUTS3t2hYCkGoDpkidZ3qWbo9E OI/vGPi+UrkYI1/bM37yWZlDQ0iUGJJLdsUXwJrKhxX5
X-Google-Smtp-Source: APXvYqwHLJ83p8cIuO3fbjolZkev2JlxAgL214oRxID9rUzHTZ/N5Oad9dsYO+Tz+ROTor/MiZAP2SdaaC0NfbJ+bZU=
X-Received: by 2002:adf:f388:: with SMTP id m8mr4078469wro.18.1573068249184; Wed, 06 Nov 2019 11:24:09 -0800 (PST)
MIME-Version: 1.0
From: Raphael Vicente Rosa <raphaelvrosa@gmail.com>
Date: Wed, 06 Nov 2019 16:23:57 -0300
Message-ID: <CAD-XRrXX17RJy5_o_0GnYcTyNvxoqT1+NkaVSFqiFm-F5dRPdA@mail.gmail.com>
To: bmwg@ietf.org
Content-Type: multipart/alternative; boundary="000000000000333f050596b27e66"
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/Vwoy2ls0SSCVrNblnMfAYHQyyvI>
Subject: [bmwg] New version of the draft Methodology for VNF Benchmarking Automation
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 06 Nov 2019 19:24:13 -0000

Hi BMWG,

We had reviews on the draft since the last IETF meeting, as listed below:
- Improvements based on Luis Contreras comments
- Structured VNF Performance Profile section

Associated with the draft content, we have done the following activities:
- Developed Yang models for VNF-BD and VNF-PP [1]
- Utilized VNF-BD  in both reference implementations, comparison tests [2]
(check in [2] the jupyter notebooks named analysis.ipynb in
gym-bench-02/results and upb-vnf-bench-02/results)

We are going to present the draft updates and next activities in the next
IETF/BMWG meeting.

Best regards,
The Authors

[1] https://github.com/raphaelvrosa/vnf-bench-model/tree/master/vnf-br/yang
[2] https://github.com/raphaelvrosa/vnf-bench-model/tree/master/experiments


A new version of I-D, draft-rosa-bmwg-vnfbench-05.txt
has been successfully submitted by Raphael Vicente Rosa and posted to the
IETF repository.

Name:           draft-rosa-bmwg-vnfbench
Revision:       05
Title:          Methodology for VNF Benchmarking Automation
Document date:  2019-11-04
Group:          Individual Submission
Pages:          27
URL:
https://www.ietf.org/internet-drafts/draft-rosa-bmwg-vnfbench-05.txt
Status:         https://datatracker.ietf.org/doc/draft-rosa-bmwg-vnfbench/
Htmlized:       https://tools.ietf.org/html/draft-rosa-bmwg-vnfbench-05
Htmlized:
https://datatracker.ietf.org/doc/html/draft-rosa-bmwg-vnfbench
Diff:
https://www.ietf.org/rfcdiff?url2=draft-rosa-bmwg-vnfbench-05

Abstract:
   This document describes a common methodology for the automated
   benchmarking of Virtualized Network Functions (VNFs) executed on
   general-purpose hardware.  Specific cases of automated benchmarking
   methodologies for particular VNFs can be derived from this document.
   Two open source reference implementations are reported as running
   code embodiments of the proposed, automated benchmarking methodology.