[bmwg] An Upgrade to Benchmarking Methodology for Network Interconnect Devices -- Fwd: New Version Notification for draft-lencse-bmwg-rfc2544-bis-00.txt

Lencse Gábor <lencse@hit.bme.hu> Wed, 20 May 2020 07:38 UTC

Return-Path: <lencse@hit.bme.hu>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A4DD13A3B3A for <bmwg@ietfa.amsl.com>; Wed, 20 May 2020 00:38:22 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level:
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id bbI5XAz9ukTP for <bmwg@ietfa.amsl.com>; Wed, 20 May 2020 00:38:20 -0700 (PDT)
Received: from frogstar.hit.bme.hu (frogstar.hit.bme.hu [IPv6:2001:738:2001:4020::2c]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id EFA643A3B38 for <bmwg@ietf.org>; Wed, 20 May 2020 00:38:19 -0700 (PDT)
Received: from [192.168.1.135] (host-79-121-42-113.kabelnet.hu [79.121.42.113]) (authenticated bits=0) by frogstar.hit.bme.hu (8.15.2/8.15.2) with ESMTPSA id 04K7c7cU015321 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO) for <bmwg@ietf.org>; Wed, 20 May 2020 09:38:13 +0200 (CEST) (envelope-from lencse@hit.bme.hu)
X-Authentication-Warning: frogstar.hit.bme.hu: Host host-79-121-42-113.kabelnet.hu [79.121.42.113] claimed to be [192.168.1.135]
References: <158995996438.13925.2934780472900149847@ietfa.amsl.com>
To: bmwg@ietf.org
From: Lencse Gábor <lencse@hit.bme.hu>
X-Forwarded-Message-Id: <158995996438.13925.2934780472900149847@ietfa.amsl.com>
Message-ID: <14002442-9713-d474-8012-bca5dcd6976c@hit.bme.hu>
Date: Wed, 20 May 2020 09:38:02 +0200
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:68.0) Gecko/20100101 Thunderbird/68.8.0
MIME-Version: 1.0
In-Reply-To: <158995996438.13925.2934780472900149847@ietfa.amsl.com>
Content-Type: multipart/alternative; boundary="------------A87CBFBE2E3D901FAB5D2FDC"
Content-Language: en-US
X-Virus-Scanned: clamav-milter 0.101.2 at frogstar.hit.bme.hu
X-Virus-Status: Clean
Received-SPF: pass (frogstar.hit.bme.hu: authenticated connection) receiver=frogstar.hit.bme.hu; client-ip=79.121.42.113; helo=[192.168.1.135]; envelope-from=lencse@hit.bme.hu; x-software=spfmilter 2.001 http://www.acme.com/software/spfmilter/ with libspf2-1.2.10;
X-DCC--Metrics: frogstar.hit.bme.hu; whitelist
X-Scanned-By: MIMEDefang 2.79 on 152.66.248.44
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/yEzFCign03ZveEUkvXsEevm8dDU>
Subject: [bmwg] An Upgrade to Benchmarking Methodology for Network Interconnect Devices -- Fwd: New Version Notification for draft-lencse-bmwg-rfc2544-bis-00.txt
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 20 May 2020 07:38:23 -0000

Dear BMWG List Members!

On the basis of our experience with RFC 8219, we have made four 
recommendations to upgrade RFC 2544 in our new draft "*An Upgrade to 
Benchmarking Methodology for Network Interconnect Devices*".

Could you please read and comment it?

It is really short: we tried to summarize the essence of our 
recommendations. We are happy to work out the details, if there is 
interest / support in BMWG.

Any feedback is welcome!

Best regards,

Gábor Lencse


-------- Továbbított üzenet --------
Tárgy: 	New Version Notification for draft-lencse-bmwg-rfc2544-bis-00.txt
Dátum: 	Wed, 20 May 2020 00:32:44 -0700
Feladó: 	internet-drafts@ietf.org
Címzett: 	Gabor Lencse <lencse@hit.bme.hu>, Keiichi Shima 
<keiichi@iijlab.net>




A new version of I-D, draft-lencse-bmwg-rfc2544-bis-00.txt
has been successfully submitted by Gabor Lencse and posted to the
IETF repository.

Name: draft-lencse-bmwg-rfc2544-bis
Revision: 00
Title: An Upgrade to Benchmarking Methodology for Network Interconnect 
Devices
Document date: 2020-05-20
Group: Individual Submission
Pages: 9
URL: 
https://www.ietf.org/internet-drafts/draft-lencse-bmwg-rfc2544-bis-00.txt
Status: https://datatracker.ietf.org/doc/draft-lencse-bmwg-rfc2544-bis/
Htmlized: https://tools.ietf.org/html/draft-lencse-bmwg-rfc2544-bis-00
Htmlized: 
https://datatracker.ietf.org/doc/html/draft-lencse-bmwg-rfc2544-bis


Abstract:
RFC 2544 has defined a benchmarking methodology for network
interconnect devices. We recommend a few upgrades to it for
producing more reasonable results. The recommended upgrades can be
classified into two categories: the application of the novelties of
RFC 8219 for the legacy RFC 2544 use cases and the following new
ones. Checking a reasonably small timeout individually for every
single frame in the throughput and frame loss rate benchmarking
procedures. Performing a statistically relevant number of tests for
all benchmarking procedures. Addition of an optional non-zero frame
loss acceptance criterion for the throughput measurement procedure
and defining its reporting format.



Please note that it may take a couple of minutes from the time of submission
until the htmlized version and diff are available at tools.ietf.org.

The IETF Secretariat