Re: [nmrg] [NMRG] research challenges in AI for NM - Next meeting
Roberto Riggio <roberto.riggio@gmail.com> Wed, 09 December 2020 18:25 UTC
Return-Path: <roberto.riggio@gmail.com>
X-Original-To: nmrg@ietfa.amsl.com
Delivered-To: nmrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 439753A16EB; Wed, 9 Dec 2020 10:25:26 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 5cSfMmijK6ps; Wed, 9 Dec 2020 10:25:24 -0800 (PST)
Received: from mail-io1-xd2f.google.com (mail-io1-xd2f.google.com [IPv6:2607:f8b0:4864:20::d2f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2B9133A16E6; Wed, 9 Dec 2020 10:25:24 -0800 (PST)
Received: by mail-io1-xd2f.google.com with SMTP id 81so2593055ioc.13; Wed, 09 Dec 2020 10:25:23 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=vwEJW224y9AKbxCqMHctb05/3NTHMGB4t64hTf1jXbs=; b=JoW1PoC7ov4cP8TR2y2M+dl5fvZMszjRTKCK9ekMVNNsJo+ZDevfzDJdwlPVltFOxS SkrGalygAfZpP355WQeH01yCje0ZUWeD/VVHFEHAvLHPfg0soMwY6xjSwZ0oJV6NS8Fp S+902LdH5qOieuqNrTnvNgoZmiWzZGccWPwKV5YXEVCgMjEWMofGgfNG33RRCqHM9A8R bQ6OEV2zmC8pK884RY2SD6iw4GfY1GknAGyakzgfnghF4xTUyPxdXbJ+oVS9dZCd9IcY BVwoVL7MwCQFCgts2AskH9aUPmFVPuGXxykKdc++rptjxfsoQrpZed563DZZ8q5s1pwj Wh5A==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=vwEJW224y9AKbxCqMHctb05/3NTHMGB4t64hTf1jXbs=; b=WRT0B1bcwmqhFl1td33uKnH0/AmEUx7k3YCIQkNQ8BAw/3gh3woFjUmwAyzvxqlIs0 2RzpdlPiw8JSxyMgAXCXaD7UR24dZav8nIrJw4w1eCDP12yJA+nKbemECMm2SwxhvK7O nGOh3ODv3yi7Xm1NAT3D/0CM7DFGHP24LsWjhYYFderrQlF/CrSaRS7iXoKpaoDNq5dx uIzaT97btcpnH6vGZ4AIyg7QMpaCRqPk7oDQC87O4xTnrQqU4c5SCwg3Gx00VmQpBOpx ePm/joQn60UF4WE9YcXP0HGuHzYPYAbRB1Gp30kV54CaYfNDEwpX+jU50ynAW8DflnmO rzZQ==
X-Gm-Message-State: AOAM530i9Vk28yxZI/yrGy/e/ULTUpDho91eCY5WRahjP5M3xuc9393P +dB2uKKCx7d/KjVHwzfa3aCoRhRuamZyMeIUm3g=
X-Google-Smtp-Source: ABdhPJw3ajiQvTlv5dZLvSNOLLWLgOXrzAe1j8m3SWN21hMlrYbFVtohwrAR/0M4E4qWRWZJ7NtHDRj1vgNGRX/ljWk=
X-Received: by 2002:a6b:b2c3:: with SMTP id b186mr4321965iof.126.1607538323197; Wed, 09 Dec 2020 10:25:23 -0800 (PST)
MIME-Version: 1.0
References: <17214e8d-bee0-ece0-2dca-bafd2bc9d517@inria.fr> <d4f39e33-5719-0a34-dfc1-688b16a92dab@inria.fr> <PR3PR07MB6826CDF1787EFFD2730D4A01F3CC0@PR3PR07MB6826.eurprd07.prod.outlook.com>
In-Reply-To: <PR3PR07MB6826CDF1787EFFD2730D4A01F3CC0@PR3PR07MB6826.eurprd07.prod.outlook.com>
From: Roberto Riggio <roberto.riggio@gmail.com>
Date: Wed, 09 Dec 2020 19:25:12 +0100
Message-ID: <CAKkT90Z4sN-4S6NmZ6-TdOXnifnbZTBAR5_zQ=CuuBrqwD_ZVg@mail.gmail.com>
To: "Ciavaglia, Laurent (Nokia - FR/Paris-Saclay)" <laurent.ciavaglia@nokia.com>
Cc: Jérôme François <jerome.francois@inria.fr>, "nmrg@irtf.org" <nmrg@irtf.org>, "nmrg-chairs@irtf.org" <nmrg-chairs@irtf.org>
Content-Type: multipart/alternative; boundary="000000000000b7959a05b60c2ed0"
Archived-At: <https://mailarchive.ietf.org/arch/msg/nmrg/Og5E2twaS_QhHbQEW5COyigS3W4>
Subject: Re: [nmrg] [NMRG] research challenges in AI for NM - Next meeting
X-BeenThere: nmrg@irtf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Network Management Research Group discussion list <nmrg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/nmrg>, <mailto:nmrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nmrg/>
List-Post: <mailto:nmrg@irtf.org>
List-Help: <mailto:nmrg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/nmrg>, <mailto:nmrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Wed, 09 Dec 2020 18:25:26 -0000
Hi, I will not be able to participate in that call because I have a keynote in parallel but I wanted to provide my two cents to the discussion. Another dimension we could take into consideration is the split between AIML challenges (interpretability, computational complexity, ease of use, ...) and NM challenges (stability, convergence, security, etc.) and put the use cases at the crossing between both of them, for example, a use case on routing could be at the intersection between interpretability (because a network administrator may want to know why a route was chosen) and stability (to avoid flip flop effects). Of course a use case could be in multiple cells of the matrix so we could have one matrix for each use case. R. On Wed, 9 Dec 2020 at 10:38, Ciavaglia, Laurent (Nokia - FR/Paris-Saclay) < laurent.ciavaglia@nokia.com> wrote: > Hi Jérôme, > > Looking forward to the meeting next week to progress on the document. > > Regarding your question on how to rightly define the challenges: > - An important thing to clarify early is to avoid confusion > between a challenge and a use case. > A rough distinction would be that a challenge exists at the NM > domain level and applies across multiple/all use cases. A use case may > illustrate several challenges, or facets of challenges in a particular > context. > I think that we could utilize use cases to fuel our analysis and > reflections but also that we should strive to extract commonalities, > patterns among the use cases. Such commonalities could hint to more > systemic challenges, or help in their identification, understanding and > definition. > I agree with the approach to analyze the characteristics of NM > problems or activities (based on a "taxonomy", e.g. FCAPS) and analyze the > characteristics of AI techniques; however we should be careful not to > prescribe or imply which AI technique(s) should be used to address which NM > problem(s). > - Another aspect that could help to properly describe (the scope > of the) challenges is to define what/how we aim to describe them, e.g. a > description, motivations for, considerations of the challenge followed by > research questions or directions. This would be in line with the existing > guidelines for challenge description. > - Sources to identify and define the right set of challenges could > be diverse: SotA review, technical documentation (e.g. from standards, open > source...), but also I think we should not neglect our own domain knowledge > and capacity of analysis (e.g. by asking ourselves questions such as: "Is > the list of challenges comprehensive?" "Are there gaps or additional areas > to consider?" "Are we covering the most important aspects of AI-based NM?", > etc.) > > Best regards, > Laurent > > > -----Original Message----- > > From: Jérôme François <jerome.francois@inria.fr> > > Sent: Tuesday, December 8, 2020 22:49 > > To: nmrg@irtf.org > > Cc: nmrg-chairs@irtf.org > > Subject: [NMRG] research challenges in AI for NM - Next meeting > > > > Dear all, > > > > The next meeting regarding the AI document will be Dec 15 at 14:00 > (UTC+1) > > > > Tentative agenda: > > - review comments received regarding scope > > - discuss the method on how to identify the righ challenge sets (and so > > verify the > > oens we already described): I was suggesting to list properties of NM > > problems and > > AI technique properties) -> if anyone has good references on theses > > aspects, > > please share it. > > > > > > Any other suggestion ? > > > > A datatracker entry will be created for this meeting. Webex details > below. > > > > Best regards > > jerome > > > > > > > > https://ietf.webex.com/ietf/j.php?MTID=m7d9057e767719e6fcd1b7d1f05975e0f > > Tuesday, 15 Dec, 2020 14:00 | 1 hour | (UTC+01:00) Brussels, Copenhagen, > > Madrid, Paris > > Meeting number: 178 859 5216 > > Password: cEP6WaMNu33 > > 432c93cde3704433833ae5836e94a06f > > > > Join by video system > > Dial 1788595216@ietf.webex.com > > You can also dial 173.243.2.68 and enter your meeting number. > > > > Join by phone > > 1-650-479-3208 Call-in toll number (US/Canada) > > Access code: 178 859 5216 > _______________________________________________ > nmrg mailing list > nmrg@irtf.org > https://www.irtf.org/mailman/listinfo/nmrg >
- [nmrg] [NMRG] resarch challenges in AI for NM - q… Jérôme François
- [nmrg] [NMRG] research challenges in AI for NM - … Jérôme François
- Re: [nmrg] [NMRG] research challenges in AI for N… Ciavaglia, Laurent (Nokia - FR/Paris-Saclay)
- Re: [nmrg] [NMRG] research challenges in AI for N… Roberto Riggio