[bmwg] question regarding draft-dcn-bmwg-containerized-infra-10

Gábor LENCSE <lencse@hit.bme.hu> Sun, 26 March 2023 18:24 UTC

Return-Path: <lencse@hit.bme.hu>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 933EFC1524DB for <bmwg@ietfa.amsl.com>; Sun, 26 Mar 2023 11:24:20 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.897
X-Spam-Level:
X-Spam-Status: No, score=-6.897 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id AaEHt298odlh for <bmwg@ietfa.amsl.com>; Sun, 26 Mar 2023 11:24:16 -0700 (PDT)
Received: from frogstar.hit.bme.hu (frogstar.hit.bme.hu [IPv6:2001:738:2001:4020::2c]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 84B3EC1524BC for <bmwg@ietf.org>; Sun, 26 Mar 2023 11:24:14 -0700 (PDT)
Received: from [192.168.123.14] (szefw.sze.hu [193.224.128.20]) (authenticated bits=0) by frogstar.hit.bme.hu (8.17.1/8.17.1) with ESMTPSA id 32QIO1P8065885 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO) for <bmwg@ietf.org>; Sun, 26 Mar 2023 20:24:06 +0200 (CEST) (envelope-from lencse@hit.bme.hu)
X-Authentication-Warning: frogstar.hit.bme.hu: Host szefw.sze.hu [193.224.128.20] claimed to be [192.168.123.14]
Content-Type: multipart/alternative; boundary="------------UQto810e9ByDZCfm7WDRi0Fi"
Message-ID: <55ef9cd8-4019-b4bd-665d-8e27a089b823@hit.bme.hu>
Date: Sun, 26 Mar 2023 20:23:56 +0200
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.9.0
Content-Language: en-US
To: "bmwg@ietf.org" <bmwg@ietf.org>
From: Gábor LENCSE <lencse@hit.bme.hu>
X-Virus-Scanned: clamav-milter 0.103.8 at frogstar.hit.bme.hu
X-Virus-Status: Clean
Received-SPF: pass (frogstar.hit.bme.hu: authenticated connection) receiver=frogstar.hit.bme.hu; client-ip=193.224.128.20; helo=[192.168.123.14]; envelope-from=lencse@hit.bme.hu; x-software=spfmilter 2.001 http://www.acme.com/software/spfmilter/ with libspf2-1.2.11;
X-DCC--Metrics: frogstar.hit.bme.hu; whitelist
X-Scanned-By: MIMEDefang 2.86 on 152.66.248.44
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/SeE8TeNWfXP_MqzPBLPw7PYIE10>
Subject: [bmwg] question regarding draft-dcn-bmwg-containerized-infra-10
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 26 Mar 2023 18:24:20 -0000

Dear Authors,

I have found your topic interesting and I have looked into your slides ( 
https://datatracker.ietf.org/meeting/116/materials/slides-116-bmwg-considerations-for-benchmarking-network-performance-in-containerized-infrastructures 
) in advance.

I have a question, and I thought that perhaps it is better if I ask it 
in advance and not during the meeting.

I have seen that you have some nice results "From Hackathon 116". There 
are several graphs that show throughput (measured in Gbps) as a function 
of frame size and some different other parameters (e.g. number of CPU 
cores, etc.)

I wonder how many times the tests were repeated, and what summarizing 
function was used (e.g. average, median) to express the results of 
(hopefully) multiple tests only with a single number.
I would be interested in the standard deviation and/or minimum, maximum, 
etc., (whatever you chose) of the results so that I can see that stable 
or scattered nature of the results.

I ask this, because I have noticed among the BIOS settings: "Intel(R) 
Hyper-Threading Tech Enabled", which I always disable to avoid unstable 
results.

Best regards,

Gábor