Re: [nmrg] Comments welcome on revised NMRG charter

"Randriamasy, Sabine (Nokia - FR/Paris-Saclay)" <sabine.randriamasy@nokia-bell-labs.com> Thu, 12 December 2019 18:29 UTC

Return-Path: <sabine.randriamasy@nokia-bell-labs.com>
X-Original-To: nmrg@ietfa.amsl.com
Delivered-To: nmrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 494C51209EC; Thu, 12 Dec 2019 10:29:18 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.799
X-Spam-Level:
X-Spam-Status: No, score=-1.799 tagged_above=-999 required=5 tests=[AC_DIV_BONANZA=0.001, BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NvvUYGT7r1B8; Thu, 12 Dec 2019 10:29:15 -0800 (PST)
Received: from FRA01-PR2-obe.outbound.protection.outlook.com (mail-eopbgr120138.outbound.protection.outlook.com [40.107.12.138]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 897E612000F; Thu, 12 Dec 2019 10:29:14 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=MjE1C0oMYaNVq/jwBFv1kK6S3OdvEUxkwCfZpVmRw4zCsii3mrc5AYHh1KjCnwLWkA611GGOS7qkRxIgNO0MUwfqi3HO6VWPx2+f2BNliphiVthHkafK6mFebuM0NtnfcIzwo6hzaTtVXwZ6ANiNivYsULSsBA8BpObixYpVxHAhuPbzVfCFQ4zVDe/yrufsh53ka/q6fInCdBsLNipGwPwJeYZjW89xaA9f64u5QWb2HBgD8SLlDMjG0Zd/gY15MaUsHpAuypZIfAg5nGqlOR6I8r/qugRziQOLz4PrIXM7KMyjPfL5QCRJ1hsi7jtz7ADTcW83VEuOrbupx2mT2w==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=dHSF2s1eiUoBDe4Q91uKP9qwpvTEAvm4jdMr+OsB3pY=; b=HCWYArjZG66I8Ai8APt/jR5fzOqiJd3VlFTuqHbTVx/lRjyqO0OlnAA/OFvmE3gWnGl/7sPqzgFx0B/xVbHW2SXRlX7lJ2c+07jShcIBnDntPYCyx9LJr0SEmIQiX1va1vZyvFGHjU4Q/YuUci4C+0xEYIJw2s1MLzhNPUk5eSCuSz8QYkFPJM46vzHR/4XDAHDWye4eNdCbtsgNtAcPK4UBEIBQ384NRstoEWucPvyAHuHCDxF/5oZwpucNAyZI5KEOscdu4nNCNmq8DMC6soimREnYJBS3jatc7S6izlsbJIk7YrFaUyTopewkaT/WVTNGmn0tVg4GaqJw8mOVhQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nokia-bell-labs.com; dmarc=pass action=none header.from=nokia-bell-labs.com; dkim=pass header.d=nokia-bell-labs.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector1-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=dHSF2s1eiUoBDe4Q91uKP9qwpvTEAvm4jdMr+OsB3pY=; b=VZ1X3ZG8FV+lWvIwOrf5qQLSrOnujjgh3aQIJL3J8OaGY4+5GrSf4sNTRri2sckj0EofhBtJQRVfqsrh7OFYm7Z6wDVfm5Yn+38d0S68ZLrjND1oMeungJA2geFNueYB6krDQ+OvNHANMp7X0dohI5T4c+iXO/8BmO5mV3N0Ph4=
Received: from PR1PR07MB5100.eurprd07.prod.outlook.com (20.177.209.144) by PR1PR07MB4890.eurprd07.prod.outlook.com (20.177.211.221) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2538.9; Thu, 12 Dec 2019 18:29:11 +0000
Received: from PR1PR07MB5100.eurprd07.prod.outlook.com ([fe80::57d:33b3:b726:98fe]) by PR1PR07MB5100.eurprd07.prod.outlook.com ([fe80::57d:33b3:b726:98fe%7]) with mapi id 15.20.2538.016; Thu, 12 Dec 2019 18:29:11 +0000
From: "Randriamasy, Sabine (Nokia - FR/Paris-Saclay)" <sabine.randriamasy@nokia-bell-labs.com>
To: Yong-Geun Hong <yonggeun.hong@gmail.com>, Vishnu Ram OV <vishnu.n@ieee.org>
CC: "Ciavaglia, Laurent (Nokia - FR/Paris-Saclay)" <laurent.ciavaglia@nokia.com>, "nmrg-chairs@irtf.org" <nmrg-chairs@irtf.org>, "nmrg@irtf.org" <nmrg@irtf.org>, "irtf-chair (irtf-chair@irtf.org)" <irtf-chair@irtf.org>
Thread-Topic: [nmrg] Comments welcome on revised NMRG charter
Thread-Index: AQHVq0szf3m5r3Gbtkih9ep4m6SchKe23NMw
Date: Thu, 12 Dec 2019 18:29:11 +0000
Message-ID: <PR1PR07MB5100F8C9F384EAC13AD67E1695550@PR1PR07MB5100.eurprd07.prod.outlook.com>
References: <PR1PR07MB4891347E917384D7042F58CCF34F0@PR1PR07MB4891.eurprd07.prod.outlook.com> <PR1PR07MB4891985BBF4D945841881F14F34F0@PR1PR07MB4891.eurprd07.prod.outlook.com> <BY5PR13MB33005C1563199A914C37D97ADB5D0@BY5PR13MB3300.namprd13.prod.outlook.com> <PR1PR07MB4891B59A5BC455CA7A9408F3F35D0@PR1PR07MB4891.eurprd07.prod.outlook.com> <CAC7wRiu43pn_-hJTsWMPgAmPvBbfi8MgyBM2ebk4KC7uAVj7VA@mail.gmail.com> <CACt2foE6yq=h2FLPOQbFREq_ttdC1ttig0TiaQxt+24Fa8Jz0w@mail.gmail.com>
In-Reply-To: <CACt2foE6yq=h2FLPOQbFREq_ttdC1ttig0TiaQxt+24Fa8Jz0w@mail.gmail.com>
Accept-Language: fr-FR, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=sabine.randriamasy@nokia-bell-labs.com;
x-originating-ip: [131.228.32.181]
x-ms-publictraffictype: Email
x-ms-office365-filtering-ht: Tenant
x-ms-office365-filtering-correlation-id: f3bb076e-9bef-4765-e92e-08d77f312eef
x-ms-traffictypediagnostic: PR1PR07MB4890:
x-ms-exchange-transport-forked: True
x-microsoft-antispam-prvs: <PR1PR07MB4890AAD92D38469ADE11825295550@PR1PR07MB4890.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-forefront-prvs: 0249EFCB0B
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(136003)(366004)(346002)(376002)(39860400002)(396003)(51444003)(199004)(189003)(53754006)(316002)(81156014)(8676002)(26005)(966005)(186003)(6506007)(9686003)(81166006)(8936002)(4326008)(55016002)(53546011)(110136005)(7696005)(54906003)(66574012)(52536014)(5660300002)(2906002)(71200400001)(33656002)(478600001)(66946007)(66446008)(76116006)(66556008)(64756008)(66476007)(86362001); DIR:OUT; SFP:1102; SCL:1; SRVR:PR1PR07MB4890; H:PR1PR07MB5100.eurprd07.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:0; MX:1;
received-spf: None (protection.outlook.com: nokia-bell-labs.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 1A05Qg9x8vzEWBFydbROryITmn6gC/DQeNyJutCLtlI0gNJTr/tUXpC5k0+7rDZu8gyNG4A3rICLOidJG7U16VLslAVzoiqB669xhN5ln97naJIq6vX1QGJOWu92BA2ckjdJ1vkqz4Zvq3EtsrTO+psE4gpp3uholo5YXNYrKUlAfwdtolSjUQYFb+thjPXru12xK7deBhU1lNZSBavGmWLNAv9kkwH/wBhnEnq8Ly1EPndGdMQtDG4xEx/WXrWDU/Ltat88ZZ1+eGXwO1PUQj39dadmkBxyeMYi0DObZPrRgRByr1jdh5/AYiAS6d2WQDf+nNDaPtCRMuS+8tMzuLwPJcJMQfRac7msf+MG/Efzy5I0I/ShXbwvDXf4X37PI6upLe+1tYVFnd+x43lmdvZwVqBh2h89HksSase3zbAdjoYsw+XhtlVYi54IqooOxBblq9YeRgUWwYNNSGlwm28mg4g7TZwU/QirdCDu1U8P/vyxKOV/oAJa5PeHHi2s4QWNpuH+h5oEddPkLNUjPf9Gk3WFmpfKw9fh561tnN/p1rkYQYqD4JqlRakkP0zp
Content-Type: multipart/alternative; boundary="_000_PR1PR07MB5100F8C9F384EAC13AD67E1695550PR1PR07MB5100eurp_"
MIME-Version: 1.0
X-OriginatorOrg: nokia-bell-labs.com
X-MS-Exchange-CrossTenant-Network-Message-Id: f3bb076e-9bef-4765-e92e-08d77f312eef
X-MS-Exchange-CrossTenant-originalarrivaltime: 12 Dec 2019 18:29:11.2794 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: ZrjojnrIwy6eshxssjtH+77zWD6KqQVjSJoWe936TC9L5NnmloxadNFaA0W4mEnUDSaWUZfGa+BxwdqThqAgrPSAOBEdjni296zwTFDmOhDEnYnqfaX607LFWTjRE130
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PR1PR07MB4890
Archived-At: <https://mailarchive.ietf.org/arch/msg/nmrg/Ai_ShIGpd5tiDrToN-0huKx_hN0>
Subject: Re: [nmrg] Comments welcome on revised NMRG charter
X-BeenThere: nmrg@irtf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Network Management Research Group discussion list <nmrg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/nmrg>, <mailto:nmrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nmrg/>
List-Post: <mailto:nmrg@irtf.org>
List-Help: <mailto:nmrg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/nmrg>, <mailto:nmrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Thu, 12 Dec 2019 18:29:18 -0000

Hello all,

Thank you for this charter update. I focused on the IBN aspects and the proposal is clear and covers well the challenges and aimed results. One question: does the RG want to position the work wrt IETF work? that is, how NMRG work on IBN and IETF may related to each other? or is it too soon?

Please find below a couple of suggestions and nits. Some of the nits have already been mentioned in other feedbacks.

Thanks,
Sabine
---------------------------------------------------
SUGGESTIONS
---------------------------------------------------

- Section - Research Activities (2017-2022)
-- para 2
Sentence "In this area, ... for the users": MAYBE drop "for the users". Sentence will be lighter.

After this sentence: MAYBE add "Abstracted user requests, known as Intents, protect infrastructure information confidentiality while hiding its complexity."

- Section - Work plan

(WI stands for "work item")

* the expression "Intent" is omnipresent in presentations and so is the question "what is an intent?". Since it is a key IBN feature, before WI3 on categorizing Intents, the text of WI2 may append: "in particular, characterize an Intent and its differences with a usual (service) request".

* draft on IBN Concepts and Overview has a section 5 on "Principles" and other text that call for given properties that characterize an IBN framework. So maybe the work "properties" could be added in WI 4, near "requirements".

---------------------------------------------------
NITS
---------------------------------------------------

- section - Research Activities (2017-2022)
-- para 2
OLD: where the human users remain “in the loop” and is progressively assisted
NEW: where the human users remain “in the loop” and **are** progressively assisted

OLD: One one hand
NEW: **On** one hand

OLD: alleviates the need user to
NEW: alleviates the need **for the** user to

OLD require
NEW require*s*

OLD as little as possible human involvement
NEW MAYBE: as little human involvement as possible

OLD re-examine deeply
NEW deeply re-examine

From: Yong-Geun Hong <yonggeun.hong@gmail.com>
Sent: Thursday, December 05, 2019 10:05 AM
To: Vishnu Ram OV <vishnu.n@ieee.org>
Cc: Ciavaglia, Laurent (Nokia - FR/Paris-Saclay) <laurent.ciavaglia@nokia.com>; nmrg-chairs@irtf.org; nmrg@irtf.org; irtf-chair (irtf-chair@irtf.org) <irtf-chair@irtf.org>
Subject: Re: [nmrg] Comments welcome on revised NMRG charter

 Dears.

Thanks for your efforts to update the NMRG charter.
I think the proposed charter looks good and I support it.

I would like to emphasize the network artificial intelligence topic and it is very welcome to find the topic is included in the revised charter.
I have been involved in the discussion of network artificial intelligence from NMLRG(Network Machine Learning Research Group) and
IDNET(Intelligent Defined Network) from 2015. From that, we have spend lots of time and effort to progress the topic but it is not easy to make a progress.
Currently, I believe that the NMRG is an outstanding place to develop the network artificial intelligence topic and we can identify many interest of the topics
from participants in IETF meetings.

To efficiently develop the network artificial intelligence topic in the NMRG, it is better to have more specific and practical goals such as priority of candidate items
and scheduling of each item.

Best regards.

Yong-Geun.



On Thu, Dec 5, 2019 at 4:24 PM Vishnu Ram OV <vishnu.n@ieee.org<mailto:vishnu.n@ieee.org>> wrote:
Hello All,

Thanks for asking feedback. I support the charter.
I can also say (from my personal experience) that some of the work items are quite interesting to ITU FG ML5G that I work with.

Comments -
if the group sees sufficient interest, we can add the AI challenge, that we discussed separately, as one of the possible work items under network artificial intelligence topics?

Thanks,
Vishnu
whatsapp: +91 9844178052
Skype: vishnubright_1
WeChat: Vishnu-Ram-OV
FB Messenger: Vishnu.Ram.OV
https://www.researchgate.net/profile/Vishnu_Ov/projects


On Thu, Dec 5, 2019 at 4:23 AM Ciavaglia, Laurent (Nokia - FR/Paris-Saclay) <laurent.ciavaglia@nokia.com<mailto:laurent.ciavaglia@nokia.com>> wrote:
Thank you Alex for the feedback on the charter. We will incorporate your comments.

As for the milestones:
You are right, milestones have not been defined yet. This is not an omission, rather an open/pending point.
To my knowledge it is neither a common nor established practice to define milestones for RG (HRPC has one). But the possibility exists.
With milestones, we (NMRG chairs) wanted to express a general planning of the research activities, in particular for the IBN work plan.
Tis was also part of an initial discussion with Colin (IRTF Chair). Given the items listed in the work plan and the pace at which the RG is progressing, we currently think it is "challenging" to define milestones in a meaningful way, and not a posteriori.
This is a point we will discuss with Colin on the updates of the revised charter.

Best regards, Laurent.

From: Alexander Clemm <alex@futurewei.com<mailto:alex@futurewei.com>>
Sent: Wednesday, December 4, 2019 23:40
To: Ciavaglia, Laurent (Nokia - FR/Paris-Saclay) <laurent.ciavaglia@nokia.com<mailto:laurent.ciavaglia@nokia.com>>; nmrg@irtf.org<mailto:nmrg@irtf.org>
Cc: nmrg-chairs@irtf.org<mailto:nmrg-chairs@irtf.org>; irtf-chair (irtf-chair@irtf.org<mailto:irtf-chair@irtf.org>) <irtf-chair@irtf.org<mailto:irtf-chair@irtf.org>>
Subject: RE: Comments welcome on revised NMRG charter

Hello all,

I think the charter proposal looks fine overall.

One nit re: “The initial focus of the NMRG will be on higher-layer management services that interface with the current Internet management framework.”  NMRG has a long tradition, so perhaps it is better to not call it “The initial focus”, but to state “The current focus”, or perhaps (not ideal) “the initial focus of the current NMRG cycle”.

Likewise the statement “The NMRG will investigate in priority three related topics”.  This suggests that the listed topics are in priority order, which I don’t think is correct – they are simply all topics of priority.  Perhaps rephrase to “The NMRG will prioritize investigation of three related topics”, or similar?

There is one typo: “One one hand” (should be “On one hand”).

Some more minor comments FWIW (feel free to ignore):

- Third bullet item under IBN “categorize the different forms of intents and define what constitutes a “well-formed” intent; describe how an intent can be expressed and what can be expressed using an intent with means such as information models, grammars, and languages.”  I think that arguably the categorization could be covered under terminology; perhaps this bullet should simply focus on the second aspect (how to express intent), which is a more open-ended problem to which several solutions may be put forward.

Since no milestones are listed, is the Milestones section still needed?  (I assume they will be defined as working group documents get adopted.)

Cheers
--- Alex

From: nmrg <nmrg-bounces@irtf.org<mailto:nmrg-bounces@irtf.org>> On Behalf Of Ciavaglia, Laurent (Nokia - FR/Paris-Saclay)
Sent: Wednesday, November 20, 2019 1:17 AM
To: Ciavaglia, Laurent (Nokia - FR/Paris-Saclay) <laurent.ciavaglia@nokia.com<mailto:laurent.ciavaglia@nokia.com>>; nmrg@irtf.org<mailto:nmrg@irtf.org>
Cc: nmrg-chairs@irtf.org<mailto:nmrg-chairs@irtf.org>; irtf-chair (irtf-chair@irtf.org<mailto:irtf-chair@irtf.org>) <irtf-chair@irtf.org<mailto:irtf-chair@irtf.org>>
Subject: Re: [nmrg] Comments welcome on revised NMRG charter

Hello,

In addition to the previous email, a few additional links for your convenience:

  *   Version -01 of NMRG charter: https://docs.google.com/document/d/1e84-M4DEDi-LCXjLG0Wf0JhbPXVcIPm2hnFFIQPrkro/edit?usp=sharing<https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.google.com%2Fdocument%2Fd%2F1e84-M4DEDi-LCXjLG0Wf0JhbPXVcIPm2hnFFIQPrkro%2Fedit%3Fusp%3Dsharing&data=02%7C01%7Calex%40futurewei.com%7C33241176de274246eed408d76d9a78d1%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C0%7C637098382547674184&sdata=e85hgUuBg71bWNaQUL5iNwVPWrSQYuMx%2B%2BW26KP8TVM%3D&reserved=0>
  *   Comparison between version -01 and -02: https://docs.google.com/document/d/19xidbplhn5gPr41QdeXBTh2WLhoA9kbhNieZiSh0Uyk/edit?usp=sharing<https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.google.com%2Fdocument%2Fd%2F19xidbplhn5gPr41QdeXBTh2WLhoA9kbhNieZiSh0Uyk%2Fedit%3Fusp%3Dsharing&data=02%7C01%7Calex%40futurewei.com%7C33241176de274246eed408d76d9a78d1%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C0%7C637098382547684192&sdata=U%2BZkwEydIcU26n7GNnMQfwcCMnbr40058ChrQEXPQXs%3D&reserved=0>

Also, to clarify:

  *   The intent of the charter revision is not a complete overhaul but more to capture more recent activities the RG has engaged into and reflect that in an update of the original charter together with a work plan.
You can see in the comparison, that the first part (original charter) has not been changed.

Thank you.
Best regards, Laurent.


From: Ciavaglia, Laurent (Nokia - FR/Paris-Saclay) <laurent.ciavaglia@nokia.com<mailto:laurent.ciavaglia@nokia.com>>
Sent: Wednesday, November 20, 2019 06:46
To: nmrg@irtf.org<mailto:nmrg@irtf.org>
Cc: nmrg-chairs@irtf.org<mailto:nmrg-chairs@irtf.org>
Subject: Comments welcome on revised NMRG charter

Hi NMRG,

Jérôme and I have been working on a new version of the NMRG charter to capture better the current shape and activity of the RG.

We'd like to receive comments from the community. This is on the agenda of the session on Friday.

https://docs.google.com/document/d/14eHQALG95VHE5N-YIAwH6vriKFG2WvI8d63TtugZLgU/edit?usp=sharing<https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.google.com%2Fdocument%2Fd%2F14eHQALG95VHE5N-YIAwH6vriKFG2WvI8d63TtugZLgU%2Fedit%3Fusp%3Dsharing&data=02%7C01%7Calex%40futurewei.com%7C33241176de274246eed408d76d9a78d1%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C0%7C637098382547694199&sdata=LfR1fw5Q4IshxAbHRn%2F5M5AZXge6kzsL%2BFlLpbI7%2F%2B8%3D&reserved=0>

Thank you.
Best regards, Jérôme & Laurent.
_______________________________________________
nmrg mailing list
nmrg@irtf.org<mailto:nmrg@irtf.org>
https://www.irtf.org/mailman/listinfo/nmrg
_______________________________________________
nmrg mailing list
nmrg@irtf.org<mailto:nmrg@irtf.org>
https://www.irtf.org/mailman/listinfo/nmrg