[bmwg] Query about 50% values in [Benchmarking Methodology for Network Security Device Performance draft 02]

Simon Edwards <simon@selabs.uk> Wed, 03 June 2020 09:10 UTC

Return-Path: <simon@selabs.uk>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id DBF4B3A0F4B for <bmwg@ietfa.amsl.com>; Wed, 3 Jun 2020 02:10:44 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.901
X-Spam-Level:
X-Spam-Status: No, score=-1.901 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=07920787146.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id F8a7fGWTNFCN for <bmwg@ietfa.amsl.com>; Wed, 3 Jun 2020 02:10:43 -0700 (PDT)
Received: from EUR03-DB5-obe.outbound.protection.outlook.com (mail-eopbgr40137.outbound.protection.outlook.com [40.107.4.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9BC4E3A0F49 for <bmwg@ietf.org>; Wed, 3 Jun 2020 02:10:43 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Sw5CZES8GdDBbmBL3pfN83qm5j9KbwUJM6tQfZSpfGe/auix7A8c3EdtGjwEQO2IgGBlr1AeIyYXGFIzivHXaOOeDXAHswdWrSjhxorsCT+qCb6p88y2EKsz/mWnhKkXUpvuLo30p2+Z0HuS19Hl21tlTfpay2WJYB9+VB+db34TJegnY8YrBOPctq2pkxoK2zMNAH5sZfo3viF3zBEtHPNedfiTxoII4QoeXEoh3LEYtTi5sJU7Wo0sWNQPCbHD9BzLgDCqi+3QxWgWwGB2dR+WjxsCX8QCZwA8kbJJ1+QrzSncmBMhbCeVq8Xh3d5DgRiuAcRmS/nxQyNpBolfng==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=W+sc36187KfoVwEL9KIPllIE1fMqo1vhH7Agdv7Vizk=; b=hmng6pZifP8dAs1fiFYrwuAm01O50NLE83tfbjG/22E+qE4Jk9pM9XReBviVsS3bqEFqe5GeVq3DV8Z1hqYewloFU2L+rRo6w4HoIsIr6QrDOfqYlKLbNmAi8a4lN8QPpV6aLs6D8BTIb2Ogq+BuGV4LKJOaycW1HlIlq1QtnMVcTlHR68UY0kj8xnOXY3EqDT4plkOyPSjW5nr2/UBNNv1NZ3FVqtUYDaYGKMoUKWcKVodmRnWR5F1/cmnNjSNEQGPGk6+w7rM4cGWozHeBITLzEkFCjHVZ8sUsF459kYRnkKoFho2jL4Dk/wBkcjotq1pXqE876CO5NdkeeCK3Dw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=selabs.uk; dmarc=pass action=none header.from=selabs.uk; dkim=pass header.d=selabs.uk; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=07920787146.onmicrosoft.com; s=selector2-07920787146-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=W+sc36187KfoVwEL9KIPllIE1fMqo1vhH7Agdv7Vizk=; b=jryqRFSyz3P0Rit8tFPAktXhx3ICLBWI+5/Wv/8pngzWD+YVi9WvumO5+xlqyJ8EhDlp3vbgVmMnclJqgzcCoRdgpOGDTbXjbdyIN4RzNcQz9eRS48IRL37Cc63KKcrtSbHpwyQlP4IiQpwh6PpJUrTy2tpnzsVri4hnvVgFmG4=
Received: from DBBPR09MB3061.eurprd09.prod.outlook.com (2603:10a6:10:f4::23) by DBBPR09MB3159.eurprd09.prod.outlook.com (2603:10a6:10:da::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3045.17; Wed, 3 Jun 2020 09:10:40 +0000
Received: from DBBPR09MB3061.eurprd09.prod.outlook.com ([fe80::f063:ee0b:8ca6:becb]) by DBBPR09MB3061.eurprd09.prod.outlook.com ([fe80::f063:ee0b:8ca6:becb%7]) with mapi id 15.20.3045.024; Wed, 3 Jun 2020 09:10:40 +0000
From: Simon Edwards <simon@selabs.uk>
To: "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: Query about 50% values in [Benchmarking Methodology for Network Security Device Performance draft 02]
Thread-Index: AdY5hnfAwWz4XwJFTbSITAGUlRwjvA==
Date: Wed, 3 Jun 2020 09:10:10 +0000
Deferred-Delivery: Wed, 3 Jun 2020 09:09:10 +0000
Message-ID: <DBBPR09MB30618401FAD3184921486E79B6880@DBBPR09MB3061.eurprd09.prod.outlook.com>
Accept-Language: en-GB, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels: MSIP_Label_e34f525b-d3b2-42c7-9a4a-89c28da09ae3_ActionId=4738c918-2c50-480a-b26c-000028075ab6; MSIP_Label_e34f525b-d3b2-42c7-9a4a-89c28da09ae3_ContentBits=0; MSIP_Label_e34f525b-d3b2-42c7-9a4a-89c28da09ae3_Enabled=true; MSIP_Label_e34f525b-d3b2-42c7-9a4a-89c28da09ae3_Method=Standard; MSIP_Label_e34f525b-d3b2-42c7-9a4a-89c28da09ae3_Name=Public; MSIP_Label_e34f525b-d3b2-42c7-9a4a-89c28da09ae3_SetDate=2020-06-03T09:07:21Z; MSIP_Label_e34f525b-d3b2-42c7-9a4a-89c28da09ae3_SiteId=4227db78-0b9f-4121-8980-9fe2923605fc;
authentication-results: ietf.org; dkim=none (message not signed) header.d=none;ietf.org; dmarc=none action=none header.from=selabs.uk;
x-originating-ip: [90.254.21.207]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: c63d1983-eb64-4bd6-09d5-08d8079dfcc7
x-ms-traffictypediagnostic: DBBPR09MB3159:
x-microsoft-antispam-prvs: <DBBPR09MB3159C7044F578ECDBE97672BB6880@DBBPR09MB3159.eurprd09.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-forefront-prvs: 04238CD941
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: K+EzamNAaf/jr4zDbg3Bzo1czH4WZv/XvasbupJJzHfTI/OKVUpizX8dxxPX57WtFz5njgrikOmprq6hLN9rV0QjsBfihGv8AHRuwtd/8EAhjW2rRoeWQ+tCyAcr9EH94BvY4Asx8ixIQy3ZnigWJyedI79HgJaVD5Fs6V+eK0lP3OljWyN4IN6u4Pn/2vRaE6QK9qiJlp8IBvPE4NBYjulHEBSMAn1wMJSkREhLUIuGkN/7pDHjPIJ9AGBc7rBrTE3zusqHPuTSAwlNAjj3SGHeQsOcEwngWSi4a952N73sX7KNLgQzz5hAiCKI40Kq
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DBBPR09MB3061.eurprd09.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(366004)(136003)(376002)(396003)(39830400003)(346002)(5660300002)(316002)(33656002)(4744005)(2906002)(6916009)(52536014)(9686003)(86362001)(8676002)(55016002)(508600001)(71200400001)(6666004)(6506007)(7696005)(8936002)(66446008)(76116006)(66946007)(186003)(66476007)(64756008)(26005)(66556008); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata: JyPOgfVJ1ycagsG5X1sF+S1WTtazEMXYKZ5XmzP9ujRe6pQJqzRbWnZEkXMjzdJCaPQl4FXV/fuEml7daE4bxgs2d/BONJAXoKmpbU7BzZ27JMbEwQ36qWLYZ6PmnY/ui4s/Ydx52+ZzsqUUCE1KQSCQbPs4uQOnsug19Y4EBe2w0emElvrij+Rc63WXQK47wtbkegtx6wAUr3R306yvizoeVCsKyPm7BK0Zu19mKHSW6O9Xzkh4zXqvdNUxNeYLHNSSPSlmdiLCM7FhOmJgK+mDCGEgCC7MXtGKvYp/bW0SuuouPdv3q79fw1xWxKAcWTRj0GG+OPsaLFvimQSuWHJLNxxmcv3LghmItObrptj63EtMVzPMv8fSF0awmGArSrT3vKG8tv2Uw4VdPrLcW4Xp72j7+A9Ea4Tsmg2yLOCUs1YP6XWLk/IVmqx0XQczOkuLqdgNqFuQYBqLPYvgfeGTrWy2sTw6HsDlJvzaG7id1yp99XLmrvpk7HSxhxgX
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_DBBPR09MB30618401FAD3184921486E79B6880DBBPR09MB3061eurp_"
MIME-Version: 1.0
X-OriginatorOrg: selabs.uk
X-MS-Exchange-CrossTenant-Network-Message-Id: c63d1983-eb64-4bd6-09d5-08d8079dfcc7
X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Jun 2020 09:10:40.4068 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 4227db78-0b9f-4121-8980-9fe2923605fc
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: xHYUcar8AEypmIO+HFVm5im32OLQJJgJt+UqsxP8hwnfUsFDTkeGMysAjlpyBXII
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DBBPR09MB3159
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/AGYaSjIKLxO5wr0_MTzWBKYgWtg>
Subject: [bmwg] Query about 50% values in [Benchmarking Methodology for Network Security Device Performance draft 02]
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 03 Jun 2020 12:37:45 -0000

Hi all,

In a number of sections, but specifically '7.8.3.2.  Test Equipment Configuration Parameters', there are requirements to measure with 50% of the maximum connections/ sec measured in the HTTP/S throughput tests

E.g. "Target objective for scenarios 1 and 2: 50% of the maximum connections per second measured in test scenario..."

I'm sure this 50% value is the product of much thought and discussion, rather than an arbitrary choice. Is anyone able to explain the reason for the specific '50%' value (as opposed to 25%, 75% or whatever) or could you please point to documentation around that decision made by the group?

I'm asking just to understand. I don't disagree with the decision : )

Very best wishes,
Simon