Re: [Nmlrg] Using Machine Learning for Network Device Initial Configurations-//RE: Machine Learning in network - solicitation for use cases

"Liubing (Leo)" <leo.liubing@huawei.com> Tue, 01 September 2015 11:47 UTC

Return-Path: <leo.liubing@huawei.com>
X-Original-To: nmlrg@ietfa.amsl.com
Delivered-To: nmlrg@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F0E181B74D8 for <nmlrg@ietfa.amsl.com>; Tue, 1 Sep 2015 04:47:14 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.211
X-Spam-Level:
X-Spam-Status: No, score=-4.211 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id MsQX5cNHXCEu for <nmlrg@ietfa.amsl.com>; Tue, 1 Sep 2015 04:47:11 -0700 (PDT)
Received: from szxga02-in.huawei.com (szxga02-in.huawei.com [119.145.14.65]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1D8931B7487 for <nmlrg@irtf.org>; Tue, 1 Sep 2015 04:46:58 -0700 (PDT)
Received: from 172.24.1.48 (EHLO nkgeml403-hub.china.huawei.com) ([172.24.1.48]) by szxrg02-dlp.huawei.com (MOS 4.3.7-GA FastPath queued) with ESMTP id CRQ19631; Tue, 01 Sep 2015 19:46:49 +0800 (CST)
Received: from NKGEML506-MBX.china.huawei.com ([169.254.3.214]) by nkgeml403-hub.china.huawei.com ([10.98.56.34]) with mapi id 14.03.0235.001; Tue, 1 Sep 2015 19:46:39 +0800
From: "Liubing (Leo)" <leo.liubing@huawei.com>
To: Sheng Jiang <jiangsheng@huawei.com>, "nmlrg@irtf.org" <nmlrg@irtf.org>
Thread-Topic: Using Machine Learning for Network Device Initial Configurations-//RE: Machine Learning in network - solicitation for use cases
Thread-Index: AdDjmyqcBYGW/oG2RQurcvQ8aGxCogAHemcAACsap5AAD1VbkA==
Date: Tue, 1 Sep 2015 11:46:38 +0000
Message-ID: <8AE0F17B87264D4CAC7DE0AA6C406F45C227AAE4@nkgeml506-mbx.china.huawei.com>
References: <5D36713D8A4E7348A7E10DF7437A4B927BB2962B@nkgeml512-mbx.china.huawei.com> <8AE0F17B87264D4CAC7DE0AA6C406F45C2278267@nkgeml506-mbx.china.huawei.com> <5D36713D8A4E7348A7E10DF7437A4B927BB2B1D8@nkgeml512-mbx.china.huawei.com>
In-Reply-To: <5D36713D8A4E7348A7E10DF7437A4B927BB2B1D8@nkgeml512-mbx.china.huawei.com>
Accept-Language: en-US, zh-CN
Content-Language: zh-CN
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [10.111.98.117]
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-CFilter-Loop: Reflected
Archived-At: <http://mailarchive.ietf.org/arch/msg/nmlrg/4AIQKQzKcj5z2oJWzgiTMkb_WJw>
Subject: Re: [Nmlrg] Using Machine Learning for Network Device Initial Configurations-//RE: Machine Learning in network - solicitation for use cases
X-BeenThere: nmlrg@irtf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Network Machine Learning Research Group <nmlrg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/nmlrg>, <mailto:nmlrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nmlrg/>
List-Post: <mailto:nmlrg@irtf.org>
List-Help: <mailto:nmlrg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/nmlrg>, <mailto:nmlrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Tue, 01 Sep 2015 11:47:15 -0000

Hi Sheng,

> >We're working on a use case of applying Machine Learning technologies
> >to network device initial configuration.
> >The basic scenario is to learn knowledge/patterns of how to configure a
> >device from historical data (device configuration data of a number of
> >networks ) and then apply them to the new networks.
> 
> Hi, Bing,
> 
> Thanks for sharing. It would be helpful if you could introduce a little bit more
> on how to leverage the machine learning in your use case, such as the
> learning objectives, what a result of the learning, how it apply to a network,
> etc. 

[Bing] The program processes the database which is a collection of a number of existing/historical network information/configurations as the training data, to learn the correlation pattern between a specific parameter configuration and the network information. The network information includes network planning manifest, topology (mostly local partial topology around the device to configure), and every device's information including device manufacture, type, capacity etc.

The learning results are be kind of rules or functions that used for predicting configurations for a given device in a network to be configured. 
For example, the result could be a classification model. Because many of the parameter values could be considered as tags, even for some numeric value, it could also be divided into several value segments that are identical as tags.
When applying it to the new network, just input the device and network information, then we can get the output classification result ( the parameter value). 
Comparing to current device configuration approach, the input is towards minimum requirements for human operations. And it is very flexible, because the configurations are generated dynamically based on the input. 

There are various ways to perform machine learning in this use cases. The design space relies on the data pattern and algorithms chosen.

> It would also useful to discuss the precondition of your use case and the
> constrain of the machine learning mechanism, either in general way or
> specific in your use case.

[Bing] The most important precondition is the training data. The training data should contain a decent number of network samples. The minimum number depends on the quality of the data. And each network sample should contain complete topology information, network planning manifest and every device's information and complete configuration lines.

For constrains, in general there are two:
1) As you see, this is actually a Data-Mining process, which strongly consumes computing resources and time, especially when the training data is huge.
2) The results are only prediction, they are NOT guaranteed to be valid, and currently we lack a mechanism to evaluate them instantly.

B.R.
Bing


> Best regards,
> 
> Sheng
> 
> >This is to leverage the automation on network initial configuration and
> >only require a minimal set of input such as high-level network
> >planning, which includes architecture design, address pool/block
> >assignment, protocol selection etc.
> >
> >The advantages of using Machine Learning on network initial
> >configuration could possibly be:
> >- Saving human cost
> >- Flexibility
> >  - dynamically generating configurations on site
> >  - adaptive to different types of networks
> >- The ability to continuously optimize the parameters, if the program
> >also learning the running performance
> >- etc.
> >
> >Comments are welcomed.
> >
> >Best regards,
> >Bing
> >
> >
> >> -----Original Message-----
> >> From: nmlrg [mailto:nmlrg-bounces@irtf.org] On Behalf Of Sheng Jiang
> >> Sent: Monday, August 31, 2015 11:16 AM
> >> To: nmlrg@irtf.org
> >> Subject: [Nmlrg] Machine Learning in network - solicitation for use
> >> cases
> >>
> >> Hi, all,
> >>
> >> Thanks for subscribe to NMLRG (Network Machine Learning) mail list.
> >> As we know, there are already many ongoing researches for Machine
> >> Learning in network, in many areas. But up to now, there are few
> >> matured applications yet. So it is the time for a Research Group to
> >> work on this future-oriented technology.
> >>
> >> The first step would be to collect possible use cases: where the
> >> machine learning mechanism could be used in networks. The use cases
> >> does not need to be mature, but should have potential.
> >>
> >> Note that this topic is rapidly moving from academic research into
> >> practical application. Therefore, use cases from university
> >> environments, industrial research and development organizations are all
> welcome.
> >>
> >> Best regards,
> >>
> >> Sheng
> >> _______________________________________________
> >> nmlrg mailing list
> >> nmlrg@irtf.org
> >> https://www.irtf.org/mailman/listinfo/nmlrg
> >
> >_______________________________________________
> >nmlrg mailing list
> >nmlrg@irtf.org
> >https://www.irtf.org/mailman/listinfo/nmlrg