[bmwg] Benchmarking Methodology for Network Security Device Performance, version 5

bmonkman@netsecopen.org Wed, 04 November 2020 18:00 UTC

Return-Path: <bmonkman@netsecopen.org>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3DD393A0E47 for <bmwg@ietfa.amsl.com>; Wed, 4 Nov 2020 10:00:36 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.898
X-Spam-Level:
X-Spam-Status: No, score=-1.898 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=netsecopen-org.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id HAk5XBvVNf5A for <bmwg@ietfa.amsl.com>; Wed, 4 Nov 2020 10:00:34 -0800 (PST)
Received: from mail-qt1-x829.google.com (mail-qt1-x829.google.com [IPv6:2607:f8b0:4864:20::829]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 769413A0E12 for <bmwg@ietf.org>; Wed, 4 Nov 2020 10:00:34 -0800 (PST)
Received: by mail-qt1-x829.google.com with SMTP id g17so4337287qts.5 for <bmwg@ietf.org>; Wed, 04 Nov 2020 10:00:34 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netsecopen-org.20150623.gappssmtp.com; s=20150623; h=from:to:subject:date:message-id:mime-version:thread-index :content-language; bh=EAJ24gnlJHM2pVXLFKjSzZVBsdsQ9j1UepJ5aq2Yegw=; b=w3Y2wRv9tS1a74zPY4lh7CHWXxlYLpTw2+qtoKy4y7pLAmFjogXGWJy3nfRTqvlkcY +Wrvzv5/vH/iJzmJQsinwUSmx0t7+6RiiDyngs/v/+xwJVrDHYRmsDE63jcayYa8s7Sx omdWdspGCEWJFmyWeaybNvRV/kw8nJX4qijvsgHFaPuedWYyDkeE0PE4OR6exWwCnnQc 5gssUZCuqiyEn53gaQ2x2SZmxL56H/803IAalB8dLO9i+RbYVOPzcP7p5d7qHQtJ3zdg y6Gw3zxcm49c/kxXrNKu56RWgksjW2IJZTaCM7I2EWrr9pbbSWYRbyfrq2CnqFJQy6Y+ Z1Lw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id:mime-version :thread-index:content-language; bh=EAJ24gnlJHM2pVXLFKjSzZVBsdsQ9j1UepJ5aq2Yegw=; b=AUiY2fjYMb9XVgL+mEB7dMS69+SvgRMi79bM2lTTglFBsqAx+5Z2kdsHEeP+meqWHv +JQtf7dMHLzoe8gRed29Ylkfc3cMJ4RQUC1ne6iYJ05kI6FB6p0eC3Tm9gVp0MZcbqTD aHQv1KmU8ULgd6gxq5Ke6J/m/1venoJ5orRzwN4jeobldBSLC68ZSQyehOj9Kev9OuqB C9zAX67DGZfmiA4T5biKW3ZaQ+18hskPI8fz+cZhAGEL0yr7dtyvGLQmEes7+HYVCRoV OBPYJJYT8eZzxrTCFQe39tCzDp+4NUBwxY8buRz8S04+6i+f/XJff8Z0+1QlgiyWbVBK DHUw==
X-Gm-Message-State: AOAM533QfeYUbhpl4oXLDel6u4gV88xdWsj6pIBTR5CZQjMCNnf4zgCJ Gwn8KFtY1SZqVNq83nk4APK+Cpx94JhjZYoP
X-Google-Smtp-Source: ABdhPJy0os/OXeW6bXxbIbXUy5J7MeiRNNPQIg+LpqmGJMvmrqO0KWoutaxHhxE5dlTIYaG2ouVaDg==
X-Received: by 2002:ac8:934:: with SMTP id t49mr6707000qth.129.1604512833160; Wed, 04 Nov 2020 10:00:33 -0800 (PST)
Received: from WINDOWSU6SOVGL (c-98-235-212-118.hsd1.pa.comcast.net. [98.235.212.118]) by smtp.gmail.com with ESMTPSA id 6sm2933504qks.51.2020.11.04.10.00.31 for <bmwg@ietf.org> (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 04 Nov 2020 10:00:32 -0800 (PST)
From: <bmonkman@netsecopen.org>
To: <bmwg@ietf.org>
Date: Wed, 4 Nov 2020 13:00:30 -0500
Message-ID: <009401d6b2d4$62b1d200$28157600$@netsecopen.org>
MIME-Version: 1.0
Content-Type: multipart/related; boundary="----=_NextPart_000_0095_01D6B2AA.79DD50A0"
X-Mailer: Microsoft Outlook 16.0
Thread-Index: Aday0/uGCsshqc3zSxCI6iXypjvDCQ==
Content-Language: en-ca
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/Fy37Kew2jKLKrXeSJ-RM6pKjd9U>
Subject: [bmwg] Benchmarking Methodology for Network Security Device Performance, version 5
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Nov 2020 18:00:36 -0000

Folks,

 

We have updated the draft. You can find it here:

 

https://tools.ietf.org/html/draft-ietf-bmwg-ngfw-performance-05

 

In additional to spelling and some grammar corrections the following was
changed:

Abstract: 

*	Added NGIDS/NGIPS as a security device for performance benchmarking

3.  Scope: 

- Now the draft also covers validation of security effectiveness
configuration of the security devices (See appendix A)

4.2.  DUT/SUT Configuration: 

- Added security feature table for NGIDS/NGIPS (see table 2)

- added description for security features (see table 3)

- added new text "The ACL configuration on NGIDS/NGIPS devices is NOT
RECOMMENDED. "

- Added new subsection "4.2.1.  Security Effectiveness Configuration " This
section describes how to select CVEs (Thanks to Ryan Liles)

Test case 7.1

*	Renamed the test case 7.1
*	updated 7.1.1.  Objective (Thanks to Jurrie)
*	added how to document the tested traffic mix 

7.1.3.4.  Test Results Validation Criteria: 

- Removed the Criteria C (Since it is complex to measure and we didn't
validate this in the lab yet)

10.  Contributors: updated

11.  Acknowledgements: updated

Appendix A :

*	 Removed   NetSecOPEN Basic Traffic Mix 
*	 Added "Test Methodology - Security Effectiveness Evaluation

I would like to start the working group last call process. Could you advise
on how to do that?

 

Brian

 

---------

Brian Monkman

Executive Director, NetSecOPEN

Office: +1-717-610-0808 

Fax: +1-717-506-0460

Mobile: +1-717-462-5422

 



 <https://www.netsecopen.org> https://www.netsecopen.org