Re: [bmwg] General questions about BMWG - the usage of benchmark RFCs and autonomous network levels

"MORTON, ALFRED C (AL)" <acm@research.att.com> Tue, 30 July 2019 12:55 UTC

Return-Path: <acm@research.att.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 58FE3120172; Tue, 30 Jul 2019 05:55:27 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.498
X-Spam-Level:
X-Spam-Status: No, score=-2.498 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=0.1, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id G1JOGsbNZo6o; Tue, 30 Jul 2019 05:55:23 -0700 (PDT)
Received: from mx0a-00191d01.pphosted.com (mx0a-00191d01.pphosted.com [67.231.149.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7FEBB1200F1; Tue, 30 Jul 2019 05:55:23 -0700 (PDT)
Received: from pps.filterd (m0049287.ppops.net [127.0.0.1]) by m0049287.ppops.net-00191d01. (8.16.0.27/8.16.0.27) with SMTP id x6UCjalS039838; Tue, 30 Jul 2019 08:55:14 -0400
Received: from tlpd255.enaf.dadc.sbc.com (sbcsmtp3.sbc.com [144.160.112.28]) by m0049287.ppops.net-00191d01. with ESMTP id 2u2p0e8cjf-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 30 Jul 2019 08:55:14 -0400
Received: from enaf.dadc.sbc.com (localhost [127.0.0.1]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id x6UCtCOr060634; Tue, 30 Jul 2019 07:55:13 -0500
Received: from zlp30495.vci.att.com (zlp30495.vci.att.com [135.46.181.158]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id x6UCt9VI060574 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Tue, 30 Jul 2019 07:55:09 -0500
Received: from zlp30495.vci.att.com (zlp30495.vci.att.com [127.0.0.1]) by zlp30495.vci.att.com (Service) with ESMTP id 6001C4009E7E; Tue, 30 Jul 2019 12:55:09 +0000 (GMT)
Received: from clpi183.sldc.sbc.com (unknown [135.41.1.46]) by zlp30495.vci.att.com (Service) with ESMTP id 3A8084005C3A; Tue, 30 Jul 2019 12:55:09 +0000 (GMT)
Received: from sldc.sbc.com (localhost [127.0.0.1]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id x6UCt9Ls020700; Tue, 30 Jul 2019 07:55:09 -0500
Received: from mail-blue.research.att.com (mail-blue.research.att.com [135.207.178.11]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id x6UCt4cX020357; Tue, 30 Jul 2019 07:55:05 -0500
Received: from exchange.research.att.com (njbdcas1.research.att.com [135.197.255.61]) by mail-blue.research.att.com (Postfix) with ESMTP id 33632F13DD; Tue, 30 Jul 2019 08:55:04 -0400 (EDT)
Received: from njmtexg4.research.att.com ([fe80::8cd:baa3:219e:5bd4]) by njbdcas1.research.att.com ([fe80::8c6b:4b77:618f:9a01%11]) with mapi id 14.03.0468.000; Tue, 30 Jul 2019 08:54:13 -0400
From: "MORTON, ALFRED C (AL)" <acm@research.att.com>
To: "Liushucheng (Will Liu)" <liushucheng@huawei.com>, "bmwg@ietf.org" <bmwg@ietf.org>
CC: "bmwg-chairs@ietf.org" <bmwg-chairs@ietf.org>
Thread-Topic: General questions about BMWG - the usage of benchmark RFCs and autonomous network levels
Thread-Index: AdVGoEYd0mIJ07EoQaiotX0stXbifgAMjbZQ
Date: Tue, 30 Jul 2019 12:54:12 +0000
Message-ID: <4D7F4AD313D3FC43A053B309F97543CFA0AD8224@njmtexg4.research.att.com>
References: <C9B5F12337F6F841B35C404CF0554ACB8BEA34D8@dggeml509-mbx.china.huawei.com>
In-Reply-To: <C9B5F12337F6F841B35C404CF0554ACB8BEA34D8@dggeml509-mbx.china.huawei.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [69.141.203.172]
Content-Type: multipart/alternative; boundary="_000_4D7F4AD313D3FC43A053B309F97543CFA0AD8224njmtexg4researc_"
MIME-Version: 1.0
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2019-07-30_06:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1906280000 definitions=main-1907300134
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/YJsU0YCfJ44Grq2v9_3-7xec83w>
Subject: Re: [bmwg] General questions about BMWG - the usage of benchmark RFCs and autonomous network levels
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 30 Jul 2019 12:55:28 -0000

Hi Will,
please see replies below,
Al
bmwg co-chair

From: Liushucheng (Will Liu) [mailto:liushucheng@huawei.com]
Sent: Tuesday, July 30, 2019 2:31 AM
To: bmwg@ietf.org
Cc: bmwg-chairs@ietf.org
Subject: General questions about BMWG - the usage of benchmark RFCs and autonomous network levels

Hi BMWG,

I attended the meeting on last Monday (my first BMWG meeting, used to work in v6ops, 6man, nmrg, etc), and learn a lot thanks!
I have some questions maybe naïve (Sorry I searched in BMWG mail list but didn’t find the answer):

1.      I took a look in BMWG datatracker page, and find almost all the drafts are informational. Many other WGs in IETF are working on protocols and models which are mostly standard track. How to use the output of BMWG? And is there any examples that RFCs are used by operators/ vendors/enterprise users?
[acm]
Many, many examples of test equipment built to RFC 2544 and RFC 2889,
and many examples of these and other RFCs being used in Benchmarking
tests and published on equipment data sheets.
The BMWG RFCs contain RFC 2119 Requirements Terms that any system claiming
compliance needs to meet. But there was no clear way for BMWG Terms and
Methods to advance along the Standards Track at the time BMWG began producing
RFCs (See RFC 1242, and RFC 1944), so Status == Informational.


2.      Recently, there is a new trend about autonomous network, learning from the successful example from automobile self-driving 0-5 levels. And I saw some SDOs are working on defining the autonomous network 5 levels. https://www.tmforum.org/wp-content/uploads/2019/05/22553-Autonomous-Networks-whitepaper.pdf<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.tmforum.org_wp-2Dcontent_uploads_2019_05_22553-2DAutonomous-2DNetworks-2Dwhitepaper.pdf&d=DwMGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=OfsSu8kTIltVyD1oL72cBw&m=2CS9GL9ImSBf9TFOg-DrgHp5fJD8mYrhOQ9B0uCfeC8&s=7WiFsgEzQCXsN4A4GptkKFRxsw9WZm1TVdSCtSvpZO0&e=>  Do you think this work is related to BMWG and we can start some IETF version work here?
[acm]
Opinion: I think this would be a very challenging topic for any SDO,
and it likely requires coordination across many SDOs, some of which
do not have open contribution policies (therefore, many liaisons required).
Much of BMWG’s successful work has been focused on IETF’s protocols
and lately, the virtualized infrastructure they run on.

Please read our charter, approved  2018-05-23:
https://tools.ietf.org/wg/bmwg/charters
and let us know what you think.

Regards,  / 致礼!
Will LIU   / 刘树成
----------------------------------------------------------------------------------------------
Shucheng LIU (Will, 刘树成), Ph.D.
Senior Principal Delegate in Standardization Area
Huawei Technologies Co.,Ltd
liushucheng@huawei.com<mailto:liushucheng@huawei.com>
http://www.linkedin.com/in/shucheng<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.linkedin.com_in_shucheng&d=DwMGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=OfsSu8kTIltVyD1oL72cBw&m=2CS9GL9ImSBf9TFOg-DrgHp5fJD8mYrhOQ9B0uCfeC8&s=4lzz7fI5nTQDEt7F0ybNFc1w7eSwFMuENZgOaYp9r8o&e=>
----------------------------------------------------------------------------------------------