Re: [bmwg] Query about 50% values in [Benchmarking Methodology for Network Security Device Performance draft 02]

[[e-mail]]

Simon,

 

This requirement was agreed to and adopted by the working group within
NetSecOPEN. It first appeared in the IETF individual draft on October 14,
2018.
(https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-05). It
was clarified and expanded on March 5, 2019 in
https://tools.ietf.org/html/draft-ietf-bmwg-ngfw-performance-00. It's form
has largely been unchanged since then.

 

I will leave it to the technical folks to expand on this more. However, I am
saying all of this because it has been in the position to be reviewed and
commented on by the BMWG community for awhile. Our assumption is that given
no one appears to have an issue with it that we hit the mark.

 

Brian

 

From: bmwg <[e-mail]> On Behalf Of Simon Edwards
Sent: June 3, 2020 5:10 AM
To: [e-mail]
Subject: [bmwg] Query about 50% values in [Benchmarking Methodology for
Network Security Device Performance draft 02]

 

Hi all,

 

In a number of sections, but specifically '7.8.3.2.  Test Equipment
Configuration Parameters', there are requirements to measure with 50% of the
maximum connections/ sec measured in the HTTP/S throughput tests

 

E.g. "Target objective for scenarios 1 and 2: 50% of the maximum connections
per second measured in test scenario..."

 

I'm sure this 50% value is the product of much thought and discussion,
rather than an arbitrary choice. Is anyone able to explain the reason for
the specific '50%' value (as opposed to 25%, 75% or whatever) or could you
please point to documentation around that decision made by the group?

 

I'm asking just to understand. I don't disagree with the decision : )

 

Very best wishes,

Simon