Re: [bmwg] Document Action: 'Benchmarking Methodology for SDN Controller Performance' to Informational RFC (draft-ietf-bmwg-sdn-controller-benchmark-meth-09.txt)

"MORTON, ALFRED C (AL)" <acm@research.att.com> Fri, 25 May 2018 22:47 UTC

Return-Path: <acm@research.att.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 04E2812D7E4; Fri, 25 May 2018 15:47:58 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.601
X-Spam-Level:
X-Spam-Status: No, score=-2.601 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id EziEtNE8TTGd; Fri, 25 May 2018 15:47:55 -0700 (PDT)
Received: from mx0a-00191d01.pphosted.com (mx0a-00191d01.pphosted.com [67.231.149.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 73F54127286; Fri, 25 May 2018 15:47:55 -0700 (PDT)
Received: from pps.filterd (m0049287.ppops.net [127.0.0.1]) by m0049287.ppops.net-00191d01. (8.16.0.22/8.16.0.22) with SMTP id w4PJiv3o027108; Fri, 25 May 2018 15:45:51 -0400
Received: from tlpd255.enaf.dadc.sbc.com (sbcsmtp3.sbc.com [144.160.112.28]) by m0049287.ppops.net-00191d01. with ESMTP id 2j6ru6r3c4-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 25 May 2018 15:45:51 -0400
Received: from enaf.dadc.sbc.com (localhost [127.0.0.1]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id w4PJjog0103325; Fri, 25 May 2018 14:45:50 -0500
Received: from zlp30495.vci.att.com (zlp30495.vci.att.com [135.46.181.158]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id w4PJjl0Y103312; Fri, 25 May 2018 14:45:47 -0500
Received: from zlp30495.vci.att.com (zlp30495.vci.att.com [127.0.0.1]) by zlp30495.vci.att.com (Service) with ESMTP id B7D2C40002D9; Fri, 25 May 2018 19:45:47 +0000 (GMT)
Received: from tlpd252.dadc.sbc.com (unknown [135.31.184.157]) by zlp30495.vci.att.com (Service) with ESMTP id A313640006B6; Fri, 25 May 2018 19:45:47 +0000 (GMT)
Received: from dadc.sbc.com (localhost [127.0.0.1]) by tlpd252.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id w4PJjlcF109393; Fri, 25 May 2018 14:45:47 -0500
Received: from mail-azure.research.att.com (mail-azure.research.att.com [135.207.255.18]) by tlpd252.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id w4PJjibB109297; Fri, 25 May 2018 14:45:44 -0500
Received: from exchange.research.att.com (njmtcas2.research.att.com [135.207.255.47]) by mail-azure.research.att.com (Postfix) with ESMTP id B3EC7E1399; Fri, 25 May 2018 15:45:43 -0400 (EDT)
Received: from njmtexg4.research.att.com ([fe80::8cd:baa3:219e:5bd4]) by njmtcas2.research.att.com ([fe80::d550:ec84:f872:cad9%15]) with mapi id 14.03.0399.000; Fri, 25 May 2018 15:45:34 -0400
From: "MORTON, ALFRED C (AL)" <acm@research.att.com>
To: "draft-ietf-bmwg-sdn-controller-benchmark-meth@ietf.org" <draft-ietf-bmwg-sdn-controller-benchmark-meth@ietf.org>, "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: Document Action: 'Benchmarking Methodology for SDN Controller Performance' to Informational RFC (draft-ietf-bmwg-sdn-controller-benchmark-meth-09.txt)
Thread-Index: AQHT9Fz7AhuP+StdH0qa8Gyz68EPi6RA17Xw
Date: Fri, 25 May 2018 19:45:42 +0000
Message-ID: <4D7F4AD313D3FC43A053B309F97543CF4A92519D@njmtexg4.research.att.com>
References: <152727582884.12880.16858138943756846224.idtracker@ietfa.amsl.com>
In-Reply-To: <152727582884.12880.16858138943756846224.idtracker@ietfa.amsl.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [69.141.203.172]
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2018-05-25_07:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1711220000 definitions=main-1805250205
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/JeWy-fpToVkMz_NuiZJzAqGgZ1I>
Subject: Re: [bmwg] Document Action: 'Benchmarking Methodology for SDN Controller Performance' to Informational RFC (draft-ietf-bmwg-sdn-controller-benchmark-meth-09.txt)
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 25 May 2018 22:47:58 -0000

Congratulations to the SDN Controller author team,
and Bhuvan in particular for leading the IETF/IESG comment 
responses.

These drafts were the last items on our "old" charter,
and BMWG can begin anew with new milestones to achieve.

regards,
Al
bmwg co-chair

> -----Original Message-----
> From: The IESG [mailto:iesg-secretary@ietf.org]
> Sent: Friday, May 25, 2018 3:17 PM
> To: IETF-Announce <ietf-announce@ietf.org>
> Cc: draft-ietf-bmwg-sdn-controller-benchmark-meth@ietf.org; The IESG
> <iesg@ietf.org>rg>; bmwg-chairs@ietf.org; MORTON, ALFRED C (AL)
> <acm@research.att.com>om>; MORTON, ALFRED C (AL) <acm@research.att.com>om>;
> bmwg@ietf.org; warren@kumari.net; rfc-editor@rfc-editor.org
> Subject: Document Action: 'Benchmarking Methodology for SDN Controller
> Performance' to Informational RFC (draft-ietf-bmwg-sdn-controller-
> benchmark-meth-09.txt)
> 
> The IESG has approved the following document:
> - 'Benchmarking Methodology for SDN Controller Performance'
>   (draft-ietf-bmwg-sdn-controller-benchmark-meth-09.txt) as Informational
> RFC
> 
> This document is the product of the Benchmarking Methodology Working
> Group.
> 
> The IESG contact persons are Warren Kumari and Ignas Bagdonas.
> 
> A URL of this Internet Draft is:
> https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__datatracker.ietf.org_doc_draft-2Dietf-2Dbmwg-2Dsdn-2Dcontroller-
> 2Dbenchmark-2Dmeth_&d=DwICaQ&c=LFYZ-
> o9_HUMeMTSQicvjIg&r=OfsSu8kTIltVyD1oL72cBw&m=E1ZjpTM8KSoH0KzjCIzI7j1eBcF74
> ddfHUgI5JQADIc&s=wQWYBgLAaypvz5nKtqC-zzUtYsekma9rK__oyZk7RGs&e=
> 
> 
> 
> 
> 
> Technical Summary
> 
>   These two documents (
>   draft-ietf-bmwg-sdn-controller-benchmark-term and
>   draft-ietf-bmwg-sdn-controller-benchmark-meth)
>   specify the terminology, benchmark definitions
>   and methods for characterizing key performance aspects of
>   Software Defined Network (SDN) Controllers. Considering the
>   number of benchmarking and performance comparison studies that
>   have been published prior to standards development, this is an
>   important area for new specifications and tools to implement them.
>   These memos focus on the ability of SDN controllers to learn
>   topology, communicate with switches, and instantiate paths using
>   both reactive and proactive techniques (including controller clusters).
>   Further, requirements for test traffic and network emulation
>   capabilities of the test devices are specified. The memos approach
>   this problem in a generic way (Openflow specific procedures are
>   included in an Appendix) for broader applicability and longevity.
> 
> 
> Working Group Summary
> 
>  Consensus for these drafts required several WGLC which prompted
>  careful review and further comments. However, the process to achieve
>   consensus was smooth, and at no time was there sustained controversy.
> 
> 
> Document Quality
> 
>    There are existing implementations of the methods described here,
>   both full and partial, and many are available as Open Source tools.
>   Tools are tied to specific versions of Northbound and Southbound
>   protocols, but the memo avoids this dependency (and redundancy with
>   other industry efforts) by defining benchmarks for generic SDN
>   controller functions (as suggested in
> https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__mailarchive.ietf.org_arch_msg_bmwg_Glchqbvg6F7vOUc0ug3ACyztcNg&d=DwICa
> Q&c=LFYZ-
> o9_HUMeMTSQicvjIg&r=OfsSu8kTIltVyD1oL72cBw&m=E1ZjpTM8KSoH0KzjCIzI7j1eBcF74
> ddfHUgI5JQADIc&s=qmB_8prKT83I7M9AI4TGE-FE63c5XQxsl27qZ6sSnh8&e= ).
>   The document benefits from review in the NFVRG, and from interactions
>   with the Open Platform for Network Function Virtualization (OPNFV)
> "CPerf"
>   project team (which includes members from Open Daylight Integration
>   test team, ETSI NFV Test and Open Source WG, and other Linux Foundation
>   and independent Open Source projects related to SDN performance).
> 
> Personnel
> 
>   Al Morton is the Document Shepherd
>   Warren Kumari is RAD!
> 
> 
> RFC Editor Note
> 
> The documents draft-ietf-bmwg-sdn-controller-benchmark-term and
> draft-ietf-bmwg-sdn-controller-benchmark-meth should progress together.
> 
> It would be nice if they could have sequential RFC Numbers.