[bmwg] Draft Minutes of BMWG Interim Virtual Meeting

"MORTON, ALFRED C (AL)" <acmorton@att.com> Wed, 07 March 2018 19:39 UTC

Return-Path: <acmorton@att.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost []) by ietfa.amsl.com (Postfix) with ESMTP id 67AB112D0C3 for <bmwg@ietfa.amsl.com>; Wed, 7 Mar 2018 11:39:49 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.6
X-Spam-Status: No, score=-2.6 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([]) by localhost (ietfa.amsl.com []) (amavisd-new, port 10024) with ESMTP id hP-PW_bP4fEB for <bmwg@ietfa.amsl.com>; Wed, 7 Mar 2018 11:39:47 -0800 (PST)
Received: from mx0a-00191d01.pphosted.com (mx0b-00191d01.pphosted.com []) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 792531200F1 for <bmwg@ietf.org>; Wed, 7 Mar 2018 11:39:47 -0800 (PST)
Received: from pps.filterd (m0049462.ppops.net []) by m0049462.ppops.net-00191d01. ( with SMTP id w27JbIGk048416; Wed, 7 Mar 2018 14:39:45 -0500
Received: from tlpd255.enaf.dadc.sbc.com (sbcsmtp3.sbc.com []) by m0049462.ppops.net-00191d01. with ESMTP id 2gjnxnrm1y-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 07 Mar 2018 14:39:45 -0500
Received: from enaf.dadc.sbc.com (localhost []) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id w27JdiVq121214; Wed, 7 Mar 2018 13:39:44 -0600
Received: from zlp30496.vci.att.com (zlp30496.vci.att.com []) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id w27Jderi121108; Wed, 7 Mar 2018 13:39:40 -0600
Received: from zlp30496.vci.att.com (zlp30496.vci.att.com []) by zlp30496.vci.att.com (Service) with ESMTP id 237BC410F45B; Wed, 7 Mar 2018 19:39:40 +0000 (GMT)
Received: from clpi183.sldc.sbc.com (unknown []) by zlp30496.vci.att.com (Service) with ESMTP id EE97F410F458; Wed, 7 Mar 2018 19:39:39 +0000 (GMT)
Received: from sldc.sbc.com (localhost []) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id w27JddMW015979; Wed, 7 Mar 2018 13:39:39 -0600
Received: from mail-azure.research.att.com (mail-azure.research.att.com []) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id w27JdY9d015686; Wed, 7 Mar 2018 13:39:34 -0600
Received: from exchange.research.att.com (njmtcas2.research.att.com []) by mail-azure.research.att.com (Postfix) with ESMTP id 324B7E1069; Wed, 7 Mar 2018 14:39:34 -0500 (EST)
Received: from njmtexg5.research.att.com ([fe80::b09c:ff13:4487:78b6]) by njmtcas2.research.att.com ([fe80::d550:ec84:f872:cad9%15]) with mapi id 14.03.0361.001; Wed, 7 Mar 2018 14:39:34 -0500
From: "MORTON, ALFRED C (AL)" <acmorton@att.com>
To: "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: Draft Minutes of BMWG Interim Virtual Meeting
Thread-Index: AdO2S7BMVpMZl+HNRm+AuVV32nUyXg==
Date: Wed, 7 Mar 2018 19:39:33 +0000
Message-ID: <4D7F4AD313D3FC43A053B309F97543CF490C19C8@njmtexg5.research.att.com>
Accept-Language: en-US
Content-Language: en-US
x-originating-ip: []
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:, , definitions=2018-03-07_09:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1711220000 definitions=main-1803070223
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/cj8igECH_kWEipBDu7Y7QmPIyRE>
Subject: [bmwg] Draft Minutes of BMWG Interim Virtual Meeting
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 07 Mar 2018 19:39:49 -0000


Please find the Draft Minutes of our Interim Meeting below.

Any Comments: please send to the list and co-chairs.

Sarah and Al
bmwg co-chairs


BMWG Interim Virtual Meeting
March 1, 2018, 1800 CET

Attendees (14):
Sarah Banks, co-chair
Al Morton, co-chair
Amritam Putatunda
Andrew Jamieson
Bala Balarajah
Brian Monkman
Carsten Rossenhoevel
Chris Pearson
Chuck Mcauley
James Cumming
Jurrie van den Breekel
Raphael Vicente Rosa
Samaresh Nair
Samuel Kommu

- IETF Note Well covered
- Agenda Bashing
- WG Status: SDN Drafts have been updated to address Directorate comments,

- Methodology for Next-Gen Firewall Benchmarking (version 01)

Brian's Intro
NetSecOpen background available at https://www.netsecopen.org/
Current focus is only performance test of NGFW.
Contact Brian Monkman for more info on NetSec Open.

Bala's Summary, 9 test cases planned, 2 are included now.
Bala had to disconnect, Carsten takes over.
Table 2 describes the set of features and coverage
Traffic Mix is a key aspect, need real-world traffic mixes for this work.
Many aspects of testing were previously unclear: need reproducible results.
Some dependency of applicable benchmarks on use cases. 
FW's see different deployment scenarios, 
so reference configurations are needed.

Sarah and Al volunteered to review by London.
Open Question: Whether to Update or Replace RFC3511
Al suggested "Profiles" for Different FW Use Cases,
Sarah gave this a big "+1"

- Update to RFC2544 Back-to-back Frame Benchmarking
Current Draft addresses comments from the previous meeting.
Review is requested.

- Considerations for Benchmarking Network Virtualization Platforms 
Author Samuel Kommu requests review.

- Other drafts - None

- ETSI NFV Liaison on NFVI Benchmarking Normative Specification
<see list archive while we work-out an issue with statements@ietf.org>
Comments can be collected from BMWG and replied as a WG, or sent directly
to the chairs of ETSI NFV TST WG (see the liaison text). 

- Re-Charter Text and Milestones
The revised text includes a sentence in the second paragraph to
adopt test system calibration under the charter. New Milestones for the 
group are also proposed (taking all active drafts into account, but 
draft adoption is a separate process). There appeared to be general
support for the new text, and comments on the mailing list were 

- Meeting closed at 1852 CET, after thanking all who participated and
especially Sarah & NetScout for providing the Webex conference for the