Re: [Idnet] Intelligence-Defined Network Architecture and Call for Interests

Brian E Carpenter <brian.e.carpenter@gmail.com> Thu, 30 March 2017 15:36 UTC

Return-Path: <brian.e.carpenter@gmail.com>
X-Original-To: idnet@ietfa.amsl.com
Delivered-To: idnet@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 53125128990 for <idnet@ietfa.amsl.com>; Thu, 30 Mar 2017 08:36:57 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2
X-Spam-Level:
X-Spam-Status: No, score=-2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2qRl2Pp6XPDs for <idnet@ietfa.amsl.com>; Thu, 30 Mar 2017 08:36:54 -0700 (PDT)
Received: from mail-it0-x243.google.com (mail-it0-x243.google.com [IPv6:2607:f8b0:4001:c0b::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BA5D7127449 for <idnet@ietf.org>; Thu, 30 Mar 2017 08:36:54 -0700 (PDT)
Received: by mail-it0-x243.google.com with SMTP id 190so13375588itm.3 for <idnet@ietf.org>; Thu, 30 Mar 2017 08:36:54 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:cc:from:organization:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=cgICkkFPh+nv+iNMlw89d+BexMYUeeL7XN1pqkCiRRs=; b=poFpK6MAbDNwX7DbRcIj58ZuQZhJoApCMBjqGr/GIxLIKtivSHzUkuoEmfInHy1QJy fh7vwhqcdM8yzmxgOwYApVBwkcA8zOYy3l4S3L2Y0MVTuL5v8ZDvUceJ/xwnUvqvAmmy ErfBdufY3ln6GMj2HnjHYPai4NsQHDIcDN6nuMKngH4WiSPHTbA7pBrCPRT38wHHDbNb NXSoTUe0L9n5spSg2Y+9K56d+WONlMpZTViWCGaSHAJbozPoMpxyRgP/Y7OxvrKCe0e3 G49Ymu2b5XGMeRpGjdbaS7/KFZu3D/yiyl8FCGyE39fvoWu1RTXGfCmUrMnR05BXiVPl CFlA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:cc:from:organization :message-id:date:user-agent:mime-version:in-reply-to :content-transfer-encoding; bh=cgICkkFPh+nv+iNMlw89d+BexMYUeeL7XN1pqkCiRRs=; b=cGdTUM+LNIhTSO6NEpKLTzCZt+OfHJTYq8jYenxLV+fCDngqLAoK4n/aOu/3Y8SGWW OwZWprYHU65ZeTY4JrW6BD84A76PSlOR70u+1u4Fw5WqEuwAiohhqeaITGI8xq0vXJIb T4aGe8xwsK7NmvUKBwVckKN1cuw/BZS8L6JHXTPT/t6YZbEnu62Jm3rFbTb+LYXzN3hd W9w/UukArPEzDtMimEzpRZ/c+YWlGwVE7Bnog1cGUZXM4QtOaMNJ9ZqnDTKKEtTLEoU4 UXgTDHhYhoGe8C1rU3fh/WmQA8WxelpKnedXlK8hLpUECpsVaH8Db/LXFLgqpb4PGVrN ZS/g==
X-Gm-Message-State: AFeK/H0vVmboxEbtwWngJ3ClM8OD1DJLKU9VG/keVajxaCwRa2zUfgGZOG51zxha5biU6Q==
X-Received: by 10.36.122.135 with SMTP id a129mr5103260itc.16.1490888214027; Thu, 30 Mar 2017 08:36:54 -0700 (PDT)
Received: from ?IPv6:2001:67c:370:128:28cc:dc4c:9703:6781? (t2001067c0370012828ccdc4c97036781.v6.meeting.ietf.org. [2001:67c:370:128:28cc:dc4c:9703:6781]) by smtp.gmail.com with ESMTPSA id e195sm5169534itb.18.2017.03.30.08.36.52 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 30 Mar 2017 08:36:53 -0700 (PDT)
To: Sheng Jiang <jiangsheng@huawei.com>, David Meyer <dmm@1-4-5.net>
References: <5D36713D8A4E7348A7E10DF7437A4B927CD15A18@NKGEML515-MBS.china.huawei.com> <CAHiKxWgT3hKr2VwhbfpmR_siHgiY4PbiKy3QgesG7uqUTnedmw@mail.gmail.com> <CAHiKxWjbAY5uaBw+M+Wxzy8VZYu=epEtWBakLR8TdkqPRt_BAw@mail.gmail.com> <5D36713D8A4E7348A7E10DF7437A4B927CD16EE8@NKGEML515-MBS.china.huawei.com>
Cc: "idnet@ietf.org" <idnet@ietf.org>
From: Brian E Carpenter <brian.e.carpenter@gmail.com>
Organization: University of Auckland
Message-ID: <e1b1e4cd-470e-5cbd-81b6-2d9cc51b3fc1@gmail.com>
Date: Fri, 31 Mar 2017 04:37:00 +1300
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0
MIME-Version: 1.0
In-Reply-To: <5D36713D8A4E7348A7E10DF7437A4B927CD16EE8@NKGEML515-MBS.china.huawei.com>
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/idnet/xnU8EV1fyHIDVmF5Qndi7rRBq9A>
Subject: Re: [Idnet] Intelligence-Defined Network Architecture and Call for Interests
X-BeenThere: idnet@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: "The IDNet \(Intelligence-Defined Network\) " <idnet.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/idnet>, <mailto:idnet-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/idnet/>
List-Post: <mailto:idnet@ietf.org>
List-Help: <mailto:idnet-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/idnet>, <mailto:idnet-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 30 Mar 2017 15:36:57 -0000

Agreed, and there are (still) two key points:

1. What is our underlying model (what Dave called a "theory of networking")? With no such model, it's very hard to tell the ML system what to do.

2. And as others have said: get hold of large datasets that can processed by ML according to that model. For developing open solutions, a corpus of open data sets seems essential. As anybody from the network measurement community will tell you, getting hold of large data sets from operators is extremely difficult for both privacy and commercial reasons.

   Brian


On 31/03/2017 03:41, Sheng Jiang wrote:
> Hi, David,
> 
> I think I agree with you, but in slight different  expression. Yes, the hard parts of getting ML into Network lies on machine learning. But, it is not that we need to develop any new ML technical/algorithms for networking in particular. It is that we MUST re-set up our network domain knowledge from the perspective of applying ML. My slides [0] does not suggest that *someone else* will handle the ML part. Actually, oppositely, it suggests some experts who have knowledge of both ML and network (probably we) would develop tools/algorithms/systems to handle the ML part for other network experts (more than 98 percent of current network administrators). So that, these network experts would be allowed to manage their network easily with intelligence association, but no need to become ML experts themselves. Here, we would like to treat the network administrators like the users in other successful ML application. We are the domian experts to do the dirty AI work for them.
> 
> I believe we have common understanding in the above description. But certainly my slides needs further refine to clarify my viewpoint.
> 
> Best regards,
> 
> Sheng
> ________________________________
> From: IDNET [idnet-bounces@ietf.org] on behalf of David Meyer [dmm@1-4-5.net]
> Sent: 29 March 2017 2:01
> To: Sheng Jiang
> Cc: idnet@ietf.org
> Subject: Re: [Idnet] Intelligence-Defined Network Architecture and Call for Interests
> 
> s/NMRL/NMLRG/   (sorry about that). Dave
> 
> On Tue, Mar 28, 2017 at 10:59 AM, David Meyer <dmm@1-4-5.net<mailto:dmm@1-4-5.net>> wrote:
> Hey Sheng,
> 
> I just wanted to revive my key concern on [0] (same one I made at the NMRL): The hard parts of getting Machine Learning intelligence into Networking is the Machine Learning part. In addition, successful deployment of ML requires knowledge of ML combined with domain knowledge. We definitely have the domain knowledge; the problem is that we don't have the ML knowledge, and this is one of the big factors holding us back; see e.g. Andrew's discussion of talent in [1].  Slides such as [0] seem to imply that *someone else* (in particular, not us)  will handle the ML part of all of this. I'll just note that in general successful deployments of ML don't work this way; the domain experts will have to learn ML (and vice versa) for us to be successful (again, see [1] and many others).
> 
> Perhaps a useful exercise would be to write an ID that makes your assumptions explicit?
> 
> Thanks,
> 
> Dave
> 
> 
> [0] https://www.ietf.org/proceedings/97/slides/slides-97-nmlrg-intelligence-defined-network-01.pdf
> [1] https://hbr.org/2016/11/what-artificial-intelligence-can-and-cant-do-right-now
> 
> 
> On Tue, Mar 28, 2017 at 9:29 AM, Sheng Jiang <jiangsheng@huawei.com<mailto:jiangsheng@huawei.com>> wrote:
> Hi, all,
> 
> Although there are many understanding for Intelligence-Defined Network, we are actually using this IDN as a term reference to the SDN-beyond architecture that we presented in IETF97, see the below link. A reference model is presented in page 3, while potential standardization works is presented in page 9.
> 
> https://www.ietf.org/proceedings/97/slides/slides-97-nmlrg-intelligence-defined-network-01.pdf
> 
> Although it might be a little bit too early for AI/ML in network giving the recent story of the concluded proposed NMLRG, we still would like to call for interests in IDN. Anybody (on site in Chicago this week) are interested in this or even wider topics regarding to AI/ML in network, please contact me on jiangsheng@huawei.com<mailto:jiangsheng@huawei.com> . Then we may have an informal meeting to discuss some common interests and potential future activities (not any activities in IETF, but also other STO or experimental trails, etc.)  on Thursday morning.
> 
> FYI, we have already working on a Work Item, called IDN in the ETSI NGP (Next Generation Protocol) ISG, links below.
> 
> https://portal.etsi.org/tb.aspx?tbid=844&SubTB=844
> https://portal.etsi.org/webapp/WorkProgram/Report_WorkItem.asp?WKI_ID=51011
> 
> Meanwhile, please do use this mail list as a forum to discuss any topics that may applying AI/ML into network area.
> 
> Best regards,
> 
> Sheng
> _______________________________________________
> IDNET mailing list
> IDNET@ietf.org<mailto:IDNET@ietf.org>
> https://www.ietf.org/mailman/listinfo/idnet
> 
> 
> 
> 
> 
> _______________________________________________
> IDNET mailing list
> IDNET@ietf.org
> https://www.ietf.org/mailman/listinfo/idnet
>