Re: [bmwg] Usage of multiple IP address with RFC 2544 / RFC 5180 compliant throughput tests

"sbanks@encrypted.net" <sbanks@encrypted.net> Thu, 06 July 2023 19:36 UTC

Return-Path: <sbanks@encrypted.net>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4221AC13AE5B for <bmwg@ietfa.amsl.com>; Thu, 6 Jul 2023 12:36:55 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.693
X-Spam-Level:
X-Spam-Status: No, score=-1.693 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_INVALID=0.1, DKIM_SIGNED=0.1, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=neutral reason="invalid (public key: not available)" header.d=encrypted.net
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id pMdehobgzu6b for <bmwg@ietfa.amsl.com>; Thu, 6 Jul 2023 12:36:50 -0700 (PDT)
Received: from xyz.hosed.org (xyz.hosed.org [71.114.67.91]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2BF24C13632C for <bmwg@ietf.org>; Thu, 6 Jul 2023 12:36:49 -0700 (PDT)
Received: from localhost (localhost [127.0.0.1]) by xyz.hosed.org (Postfix) with ESMTP id 4039B19C2235; Thu, 6 Jul 2023 15:36:48 -0400 (EDT)
X-Virus-Scanned: Debian amavisd-new at xyz.hosed.org
Received: from xyz.hosed.org ([127.0.0.1]) by localhost (xyz.hosed.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id evipSzmmoy0d; Thu, 6 Jul 2023 15:36:48 -0400 (EDT)
Received: from smtpclient.apple (c-73-71-250-98.hsd1.ca.comcast.net [73.71.250.98]) by xyz.hosed.org (Postfix) with ESMTPSA id C0C4E19C16F8; Thu, 6 Jul 2023 15:36:47 -0400 (EDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=encrypted.net; s=default; t=1688672208; bh=sLhZVw8GgemxTknQtBmijBffT/HDfK5XQJIXrPupD/c=; h=From:Subject:Date:In-Reply-To:Cc:To:References:From; b=C3ySyAoExwpvtRIoh3GgQ+oy6AQUD5RkwqYxUPN0mbNUd3rulw+2cHDg4yYMvy2d4 xbG4r3UwOnVsQR+KvKNR1gLyxmxjSLciwc08aOzN8JVkCXYGgCYKBljN4O8QcVZZ1g +E6l2m1lK8ZmWOP7umLnAHUqjLhxLA6qfe8ZyjJM=
From: "sbanks@encrypted.net" <sbanks@encrypted.net>
Message-Id: <25BF790D-E5A1-4525-A732-99F219D79D9D@encrypted.net>
Content-Type: multipart/alternative; boundary="Apple-Mail=_FFAB5BEF-0CE2-4F18-877D-1F3E9D05402A"
Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\))
Date: Thu, 06 Jul 2023 12:36:34 -0700
In-Reply-To: <252f68bd-54ad-1e31-8377-6dfb0d4c3430@hit.bme.hu>
Cc: "bmwg@ietf.org" <bmwg@ietf.org>
To: Lencse Gábor <lencse@hit.bme.hu>
References: <252f68bd-54ad-1e31-8377-6dfb0d4c3430@hit.bme.hu>
X-Mailer: Apple Mail (2.3731.400.51.1.1)
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/z0uvTb94lZTNjlI5prXnCIaDCn4>
Subject: Re: [bmwg] Usage of multiple IP address with RFC 2544 / RFC 5180 compliant throughput tests
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 06 Jul 2023 19:36:55 -0000

Hi Lencse,
	My apologies for the long delay in this; I’d been looking for an RFC to see if this was covered, and I can’t find one. However, my thoughts…
	How OpenBSD chooses to handle (or not) the RSS item is an implementation detail; you know it, which is nice, but we can’t know this for every system on the Internet. Using 1 pseudorandom src/dest IP or using <n> of them seems no different than what test ports would generate (albeit in this case, they’re all pseudorandom I suppose). If I’m missing something let me know, but I wonder if, if we’re confident that there might be some exceptions where the system under test in the lab can’t mimic close to production, then we note it in the document and keep moving forward with the work. Thoughts?

Thank you,
Sarah

> On Jun 5, 2023, at 2:12 AM, Lencse Gábor <lencse@hit.bme.hu> wrote:
> 
> Dear All,
> 
> Is there any RFC that describes how to use multiple IP addresses with RFC 2544 / RFC 5180 compliant throughput tests?
> 
> Originally, RFC 2544 used fixed test frame format. Then RFC 4814 specified how to use pseudorandom source and destination port numbers. However, I did not find any guidance, how one should use multiple, pseudorandom source and destination IP addresses. 
> 
> It is an issue, because in some systems, like OpenBSD, one cannot set the Receive-Side Scaling (RSS) to include also the port numbers into the hash tuple for distributing the interrupts of the incoming packets among the CPU cores. Please see this e-mail for the details: https://marc.info/?l=openbsd-misc&m=166581934723445&w=2
> 
> However, when the system is used to forward Internet traffic, then it faces with different source and destination IP addresses. Thus, the laboratory test results will not reflect the results experienced under operational conditions.
> 
> Now I am working on implementing the usage of pseudorandom source and destination IP addresses in siitperf, my stateful and stateless NAT64 tester, which can also be used to benchmark IPv4 or IPv6 routers. My main motivation is to support stateful NAT64 tests with OpenBSD PF, but I also would like to support stateless IPv4 and IPv6 packet forwarding measurements. 
> 
> Regarding the stateless IPv4 tests, I planned this setup:
> 
>     198.18.[2-65534]/16                            198.19.[2-65534]/16
>               \  +--------------------------------------+  /
>                \ |                                      | /
>    +-------------|                Tester                |<------------+
>    |             |                                      |             |
>    |             +--------------------------------------+             |
>    |                                                                  |
>    |             +--------------------------------------+             |
>    |             |                                      |             |
>    +------------>|          DUT: IPv4 router            |-------------+
>                / |                                      | \
>               /  +--------------------------------------+  \
>     198.18.0.1/16                                        198.19.0.1/16
> 
> I am aware that this solution sacrifices the opportunity of testing with 256 destination networks. 
> 
> Any suggestions are welcome!
> 
> Best regards,
> 
> Gábor
> 
> 
> 
> _______________________________________________
> bmwg mailing list
> bmwg@ietf.org
> https://www.ietf.org/mailman/listinfo/bmwg