Re: [nmrg] [NMRG] research challenges in AI for NM - Next meeting

"Ciavaglia, Laurent (Nokia - FR/Paris-Saclay)" <laurent.ciavaglia@nokia.com> Wed, 09 December 2020 09:38 UTC

Return-Path: <laurent.ciavaglia@nokia.com>
X-Original-To: nmrg@ietfa.amsl.com
Delivered-To: nmrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0F6443A0FCD; Wed, 9 Dec 2020 01:38:50 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.902
X-Spam-Level:
X-Spam-Status: No, score=-1.902 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 4a4PiHHbOpgx; Wed, 9 Dec 2020 01:38:48 -0800 (PST)
Received: from EUR04-HE1-obe.outbound.protection.outlook.com (mail-eopbgr70102.outbound.protection.outlook.com [40.107.7.102]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id EF02F3A0FCB; Wed, 9 Dec 2020 01:38:47 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=MGxkn5Klc2ryFubMVaVHyHYPPRLk58vaAnpKYy6kim9JLsdDPiQtlWKlKGNEoUYHwd0BYFZ5nU0N6HBM9ZzVnwsbT9tnvyxCbikN+2xn8Qv3rTzcz0cXnZE5jDbHhK/jezYzcGR1gRk9Z222aTC+RFRv/svhrM+YH1OH87b2fyHSKuLwB79vzJZpYH5Op6KWF3+C0HAqc/oupq+0Lms33iFTcofHd5k1fr75SWaGkuDsQliVkGv4vG8vmLOYmISG76f0nhWFPRj/8l/15f85akwzO92BTLnNMUIbvqCyCM5NYGmDtMMuNB4UnR/1+/jEzBkGoADEzdbH+rIwHrSAiQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=uLVt7byGXkYzbsAuLIiDtkSfxw5Si94shURyk9JHE9A=; b=f8GCw73MHrAIDcl9KDsSunLAptgulxmGAKuAegSobgbCSFsbv3fctF23lk6xSNOEUU6Z0ifJRD+x35WmMRpugpUn56mAs7EWVoby+CZm1/DBY7j+4eyo1mfQAvpXY+o9Ip8eIn6uzopRkGfoDz3JZGUSupgY+0ZzDDMiQ+24HUi+SzWQsxOrLujg0OZERy8abqngdNCWD98T9uCYwEjAQX8JKc+no8OEAkWOK8J/Snw9ptTYfLzVy8FBAEpGinlHmVF02vugM1/dfR7u92zrv/0gMb3I+/HcoLZmDI50UkMi7RXzHSoft4YPwdkwKh/jH3ew8LxYXiZ6Vx51eDx1cw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nokia.com; dmarc=pass action=none header.from=nokia.com; dkim=pass header.d=nokia.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector1-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=uLVt7byGXkYzbsAuLIiDtkSfxw5Si94shURyk9JHE9A=; b=lKgKmhboovakVZHk/OEXOn9T8Py0zwy2CdCLHkhy1NCv/FfWDTKCUWyd9Y/NchE+Ge1FEZcg1yeYsWJXp1p7Jqqsrv4jG1jFJ4DcTLihSfVCpunNrCDCMgDG+mXytLBeFizoS9vueoTFawDAFV8V2NM/9778JoxkHBsr+XhHEUs=
Received: from PR3PR07MB6826.eurprd07.prod.outlook.com (2603:10a6:102:7f::20) by PA4PR07MB7087.eurprd07.prod.outlook.com (2603:10a6:102:f9::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3654.5; Wed, 9 Dec 2020 09:38:45 +0000
Received: from PR3PR07MB6826.eurprd07.prod.outlook.com ([fe80::2565:c003:5d49:1209]) by PR3PR07MB6826.eurprd07.prod.outlook.com ([fe80::2565:c003:5d49:1209%5]) with mapi id 15.20.3654.014; Wed, 9 Dec 2020 09:38:44 +0000
From: "Ciavaglia, Laurent (Nokia - FR/Paris-Saclay)" <laurent.ciavaglia@nokia.com>
To: Jérôme François <jerome.francois@inria.fr>, "nmrg@irtf.org" <nmrg@irtf.org>
CC: "nmrg-chairs@irtf.org" <nmrg-chairs@irtf.org>
Thread-Topic: [NMRG] research challenges in AI for NM - Next meeting
Thread-Index: AQHWzav8RP+Cw+aMVEe1Fzei/QS206nudYwA
Date: Wed, 09 Dec 2020 09:38:44 +0000
Message-ID: <PR3PR07MB6826CDF1787EFFD2730D4A01F3CC0@PR3PR07MB6826.eurprd07.prod.outlook.com>
References: <17214e8d-bee0-ece0-2dca-bafd2bc9d517@inria.fr> <d4f39e33-5719-0a34-dfc1-688b16a92dab@inria.fr>
In-Reply-To: <d4f39e33-5719-0a34-dfc1-688b16a92dab@inria.fr>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: inria.fr; dkim=none (message not signed) header.d=none;inria.fr; dmarc=none action=none header.from=nokia.com;
x-originating-ip: [91.171.237.229]
x-ms-publictraffictype: Email
x-ms-office365-filtering-ht: Tenant
x-ms-office365-filtering-correlation-id: a48d70bc-d533-400c-b3b0-08d89c2638be
x-ms-traffictypediagnostic: PA4PR07MB7087:
x-microsoft-antispam-prvs: <PA4PR07MB70877EA0DEE9A54B573570AAF3CC0@PA4PR07MB7087.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:8273;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: +1rY8QiBBzXELKc0IWUSQYeyS/bDgJsJAy0G62iijHt3SLReFSxFtodyam3TVJd96mTphfx7mTQZuffPp9xFPPR2AMdrCbwo1xB0wkn1inoEDeMEV/5LeVokQ6UdCmnoYYn0j33J9eIEsV13fz1ESUR7oenJ8rm5nLJ6r6W3JwZ/iCXWLebiKQuWQWdc2J1EkWP4HbEErEUHiK83V7uPRd9MSs0BwgLTCmd/YDz5ZCNeX1Opa7vryWZlX5gvGULdWcRD0pA3oFrZ0EMVKoke2d4hTNDSmZ+WnaoZA3bIsd7ozBTzarOrNgJ1uRZEvrvhRj3bYSApRrahJBjL6UPZC1lq78iiAPh6MPM8GCKgapAa8eTS7uL4UgiPytgqsO2eKJ6eF/v9RiUEJw5HhBqeVw==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PR3PR07MB6826.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(39860400002)(346002)(136003)(376002)(366004)(396003)(33656002)(2906002)(8936002)(55016002)(64756008)(8676002)(66476007)(53546011)(71200400001)(966005)(9686003)(26005)(86362001)(316002)(6506007)(83380400001)(7696005)(4326008)(76116006)(186003)(66574015)(52536014)(478600001)(66946007)(66446008)(16799955002)(110136005)(66556008)(5660300002); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata: ZEBP2F5pj4zi66MWt2604QLiG/prDpa1CG1B4Oplh+TVBZwjQYekbpKv+wQ2mreA6vdkwOQbgjNyQZlll4kcyOaxe1gbEjm7Q+Yc4DSsbdpTS3tVlIZeZmg1S9fbxSCLB6cJR68PJjCN/DVDFbg4yYIcBTEEZI5uahbTd5gtKYMDBC9Oa4IlYkewcWEEJ29tXTpVKB086E0EXEOaSP0Q8fCNq4bvXV0ycYTAFGgOw8N0XFrn4USVUk4ZVtA75uZZa8MamglZpKCCG/6lCoeK4OITw/RQqIl3x9GPYWg4TEI9H90OcUrD0oyO0BvlcVuhf8I8+E2iPW2ZWOgCrq/2HqEAjlF65DbkqbnH+DPO+SsNBg6mx6tDKvgVazwEzfxYhIL1mDgz5xhGLw08n2HdL158QKCDM4z4X8MWmc52MXteove9ZDcWY8Dl0BwbV/RCHXKJM30I+YLJ9ToceBnNuFzev40Ki2Aim6a1nyA7/8IIg/LwV1J3Jte2LxbmgvG1Zq6oVd4ggSt1iiOuGUsUMjFRCFOV5ESQZoMtGN1zBG5GV6YYDcOt/b/RbKMUE38LvHDIfMrdE6A51AN2RRaX7eT/XncH8xE3NYVzV0DWVzPiXcL9kABcYJMfw473PHA5BxvDTJZjVG2wkVTPh5XSR4xBthLw41tjpqxmoQwV4mFWHEeViwMebPB+IeRnodMQ8ZBMM+bQsmWT69hgAVTWhEp1s+SHaaNP4cIQvsCFb4W/19Bf5ZIEjvsIbb5OmZJLkKY3CoLyTCL13k+r2logoIBJg1O32dRZGfip7eWepRaitsiVQBkN0op0WIb8lHHZ167YP9fE0A22G8XGr+kzvmxEbA890TMmtW84DD4GhbNOsgRR+6MTrss+61S5O+BYOdLaSxXhs0Ug7KGC6N62nsVUEg5NpuB2HJw5JI+lDsJkiT+amaW/LkI3yX0fsNec0+PO/BTLtL1M4nAUWK3rGUBcvcKXdfS5f+h02ZlxE48=
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: nokia.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: PR3PR07MB6826.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: a48d70bc-d533-400c-b3b0-08d89c2638be
X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Dec 2020 09:38:44.6751 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 1mbhfmvZf8XKwNapUDyTvf9kmCJjEcPphKNOrpC7L34Qxp0lDEyvSxRukLLcwUJSFflBhGeBIJ87oFl5J0veaY5KBmL8QFLKfmUMakpTarY=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PA4PR07MB7087
Archived-At: <https://mailarchive.ietf.org/arch/msg/nmrg/GTd0G4h9hAMa9QlDIkuBU_rwQPE>
Subject: Re: [nmrg] [NMRG] research challenges in AI for NM - Next meeting
X-BeenThere: nmrg@irtf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Network Management Research Group discussion list <nmrg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/nmrg>, <mailto:nmrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nmrg/>
List-Post: <mailto:nmrg@irtf.org>
List-Help: <mailto:nmrg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/nmrg>, <mailto:nmrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Wed, 09 Dec 2020 09:38:50 -0000

Hi Jérôme,

Looking forward to the meeting next week to progress on the document.

Regarding your question on how to rightly define the challenges:
	- An important thing to clarify early is to avoid confusion between a challenge and a use case.
	A rough distinction would be that a challenge exists at the NM domain level and applies across multiple/all use cases. A use case may illustrate several challenges, or facets of challenges in a particular context.
	I think that we could utilize use cases to fuel our analysis and reflections but also that we should strive to extract commonalities, patterns among the use cases. Such commonalities could hint to more systemic challenges, or help in their identification, understanding and definition.
	I agree with the approach to analyze the characteristics of NM problems or activities (based on a "taxonomy", e.g. FCAPS) and analyze the characteristics of AI techniques; however we should be careful not to prescribe or imply which AI technique(s) should be used to address which NM problem(s).
	- Another aspect that could help to properly describe (the scope of the) challenges is to define what/how we aim to describe them, e.g. a description, motivations for, considerations of the challenge followed by research questions or directions. This would be in line with the existing guidelines for challenge description.
	- Sources to identify and define the right set of challenges could be diverse: SotA review, technical documentation (e.g. from standards, open source...), but also I think we should not neglect our own domain knowledge and capacity of analysis (e.g. by asking ourselves questions such as: "Is the list of challenges comprehensive?" "Are there gaps or additional areas to consider?" "Are we covering the most important aspects of AI-based NM?", etc.)

Best regards, 
Laurent

> -----Original Message-----
> From: Jérôme François <jerome.francois@inria.fr>
> Sent: Tuesday, December 8, 2020 22:49
> To: nmrg@irtf.org
> Cc: nmrg-chairs@irtf.org
> Subject: [NMRG] research challenges in AI for NM - Next meeting
> 
> Dear all,
> 
> The next meeting regarding the AI document will be Dec 15 at 14:00 (UTC+1)
> 
> Tentative agenda:
> - review comments received regarding scope
> - discuss the method on how to identify the righ challenge sets (and so
> verify the
> oens we already described): I was suggesting to list properties of NM
> problems and
> AI technique properties) -> if anyone has good references on theses
> aspects,
> please share it.
> 
> 
> Any other suggestion ?
> 
> A datatracker entry will be created for this meeting. Webex details below.
> 
> Best regards
> jerome
> 
> 
> 
> https://ietf.webex.com/ietf/j.php?MTID=m7d9057e767719e6fcd1b7d1f05975e0f
> Tuesday, 15 Dec, 2020 14:00 | 1 hour | (UTC+01:00) Brussels, Copenhagen,
> Madrid, Paris
> Meeting number: 178 859 5216
> Password: cEP6WaMNu33
> 432c93cde3704433833ae5836e94a06f
> 
> Join by video system
> Dial 1788595216@ietf.webex.com
> You can also dial 173.243.2.68 and enter your meeting number.
> 
> Join by phone
> 1-650-479-3208 Call-in toll number (US/Canada)
> Access code: 178 859 5216