[Nemops-interest] Re: [Nemops-workshop-attendees] NEMOPS Workshop Report

Benoit Claise <benoit.claise@huawei.com> Thu, 10 April 2025 13:52 UTC

Return-Path: <benoit.claise@huawei.com>
X-Original-To: nemops-interest@mail2.ietf.org
Delivered-To: nemops-interest@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 750AD1A2C1D5; Thu, 10 Apr 2025 06:52:03 -0700 (PDT)
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -4.196
X-Spam-Level:
X-Spam-Status: No, score=-4.196 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H2=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id geTeHxUZpTrL; Thu, 10 Apr 2025 06:52:02 -0700 (PDT)
Received: from frasgout.his.huawei.com (frasgout.his.huawei.com [185.176.79.56]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id 4631D1A2C1BD; Thu, 10 Apr 2025 06:52:01 -0700 (PDT)
Received: from mail.maildlp.com (unknown [172.18.186.31]) by frasgout.his.huawei.com (SkyGuard) with ESMTP id 4ZYLk11jTvz6L6pd; Thu, 10 Apr 2025 21:48:09 +0800 (CST)
Received: from frapeml500001.china.huawei.com (unknown [7.182.85.94]) by mail.maildlp.com (Postfix) with ESMTPS id 87AD7140276; Thu, 10 Apr 2025 21:51:59 +0800 (CST)
Received: from [10.126.172.135] (10.126.172.135) by frapeml500001.china.huawei.com (7.182.85.94) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.39; Thu, 10 Apr 2025 15:51:55 +0200
Content-Type: multipart/alternative; boundary="------------bQ6S4yNULoVaC9L0vGlUT05H"
Message-ID: <dc63a767-e34f-4110-b56a-8bcc1e9a304d@huawei.com>
Date: Thu, 10 Apr 2025 15:51:50 +0200
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
To: Dhruv Dhody <dd@dhruvdhody.com>, nemops-interest@iab.org
References: <CAP7zK5YV5s2-0jutfN0mg3CBUNbZgA4KJbkFdqFXvbEqphsj-Q@mail.gmail.com>
Content-Language: en-US
From: Benoit Claise <benoit.claise@huawei.com>
In-Reply-To: <CAP7zK5YV5s2-0jutfN0mg3CBUNbZgA4KJbkFdqFXvbEqphsj-Q@mail.gmail.com>
X-Originating-IP: [10.126.172.135]
X-ClientProxiedBy: dggems703-chm.china.huawei.com (10.3.19.180) To frapeml500001.china.huawei.com (7.182.85.94)
X-MailFrom: benoit.claise@huawei.com
X-Mailman-Rule-Hits: max-size
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; news-moderation; no-subject; digests; suspicious-header
Message-ID-Hash: XMPH4PTL5J5ZVBERRELCZXPIZXLDO3KJ
X-Message-ID-Hash: XMPH4PTL5J5ZVBERRELCZXPIZXLDO3KJ
X-Mailman-Approved-At: Thu, 10 Apr 2025 06:55:38 -0700
CC: nemops-workshop-attendees@iab.org, architecture-discuss@iab.org, "nmop-chairs@ietf.org" <nmop-chairs@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [Nemops-interest] Re: [Nemops-workshop-attendees] NEMOPS Workshop Report
List-Id: Next Era of Network Management Operations <nemops-interest.iab.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/nemops-interest/djLEwUxFoEeYCvccxR8mtBlYTkw>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nemops-interest>
List-Help: <mailto:nemops-interest-request@iab.org?subject=help>
List-Owner: <mailto:nemops-interest-owner@iab.org>
List-Post: <mailto:nemops-interest@iab.org>
List-Subscribe: <mailto:nemops-interest-join@iab.org>
List-Unsubscribe: <mailto:nemops-interest-leave@iab.org>

Dhruv, Wes,

I have been reviewing 
https://intarchboard.github.io/draft-iab-nemops-workshop-report/draft-iab-nemops-workshop-report.html, 
the March 6th version
Pretty good report. While reading the report,, I refreshed my mind by 
reviewing all the presentations, hence some references to the slides.

Here is some feedback.

- OLD: Define a reference approach/process for service exposure 
discovery and API discovery
- NEW: Define a reference approach/process for service exposure 
discovery (API discovery)
Source: 
https://datatracker.ietf.org/meeting/interim-2024-nemopsws-02/materials/slides-interim-2024-nemopsws-02-sessa-5-rfc-3535-20-years-later-02

- If you mentioned presenter names, it might be best to mention the 
presenter name.
Just one mistake in that front.
OLD: [LARSSON 
<https://intarchboard.github.io/draft-iab-nemops-workshop-report/draft-iab-nemops-workshop-report.html#LARSSON>] 
cautioned against making changes that could disrupt the ecosystem.
NEW: [FARRER] cautioned against ...

- On the following presentation:
[KELLER 
<https://intarchboard.github.io/draft-iab-nemops-workshop-report/draft-iab-nemops-workshop-report.html#KELLER>] 
shared Deutsche Telekom’s perspective, emphasizing that while YANG 
models perform well for provisioning, they currently fall short in 
providing the operational stability required for validation. Achieving 
fully closed-loop automated and autonomous networking will require a 
greater focus on observability, particularly through advancements in 
streaming telemetry with the "on-change" feature [RFC9196 
<https://intarchboard.github.io/draft-iab-nemops-workshop-report/draft-iab-nemops-workshop-report.html#RFC9196>].
I find the following observation about vendor YANG models very 
interesting, and worth mentioning IMO.

This relates to your later sentence "The implementation and support of 
multiple models (IETF, OpenConfig, and native) is an unavoidable reality 
in network management. " and to the 3.3.2 Discussion section.

- rfc3535bis presented by [CONTRERAS], you are missing some key 
requirements.
Background: as NMOP co-chairs, I specifically reviewing this report of 
light of I-D.boucadair-nmop-rfc3535-20years-later 
<https://intarchboard.github.io/draft-iab-nemops-workshop-report/draft-iab-nemops-workshop-report.html#I-D.boucadair-nmop-rfc3535-20years-later>
If you look at 
https://datatracker.ietf.org/meeting/interim-2024-nemopsws-02/materials/slides-interim-2024-nemopsws-02-sessa-5-rfc-3535-20-years-later-02,the 
missing requirements are greyed out


The only reason why they were greyed out is that there were covered in 
other presentations. For completeness, I believe we should add those 
under [CONTRERAS]

- I specifically liked this paragraph

    _Some topics absent_ from the workshop discussions included tooling
    (what is currently missing) and strategies to support tool
    development (who pays, who develops, who maintains). The primary
    focus of the discussion was on YANG and NETCONF/RESTCONF, while
    several other network management protocols and techniques currently
    used received less attention during the workshop. The discussion on
    future directions prioritized improving existing solutions rather
    than introducing entirely new ones (such as enabling intelligence in
    network management). Some key recommendations made by operators
    during outreach (Section 2
    <https://intarchboard.github.io/draft-iab-nemops-workshop-report/draft-iab-nemops-workshop-report.html#outreach>)
    are listed in Appendix B
    <https://intarchboard.github.io/draft-iab-nemops-workshop-report/draft-iab-nemops-workshop-report.html#recommendations>.

I believe it deserves it own "Not Covered in the Workshop" section 
(maybe 3.4.6), because this is important but also because it leads to 
potential next brainstorming/actionable steps.
 From my own notes: "Tools and opensource reference implementations, of 
course (exactly like everybody wants free training or free beers) but 
who will pay for the development?"
This relates to Michael Richardson's message:

    Lots of talk about open source, but not really any mention of how such a
    thing could be funded.  That's really the problem.

Note: The last sentence (Some key recommendations made by operators 
during outreach (Section 2 
<https://intarchboard.github.io/draft-iab-nemops-workshop-report/draft-iab-nemops-workshop-report.html#outreach>) 
are listed in Appendix B 
<https://intarchboard.github.io/draft-iab-nemops-workshop-report/draft-iab-nemops-workshop-report.html#recommendations>.) 
seems to be misplaced. The paragraph starts with "not covered" and 
finishes with "recommendations made by operators"

- Appendix A. 
<https://intarchboard.github.io/draft-iab-nemops-workshop-report/draft-iab-nemops-workshop-report.html#appendix-A>Insights 
from Operator Feedback 
<https://intarchboard.github.io/draft-iab-nemops-workshop-report/draft-iab-nemops-workshop-report.html#name-insights-from-operator-feed> 

[TODO: Check if this is useful in the RFC or should be removed]
=> Yes, this is useful and should be kept in the RFC, as it can serve a 
source of information (without analzying the survey again) for brainstorming

Nits:
- NetConf => NETCONF
- Alexander PELOV => Alexander Pelov
- section 3.1.1 Future Directions. Create 3 paragraphs, starting by 
[CLAISE], [WATSEN], [WILTON]

Regards, Benoit
On 2/20/2025 7:32 AM, Dhruv Dhody wrote:
> Hi,
>
> Wes and I have posted the initial version of the NEMOPS Workshop Report -
>
> https://datatracker.ietf.org/doc/draft-iab-nemops-workshop-report/
> https://www.ietf.org/archive/id/draft-iab-nemops-workshop-report-01.html
>
> We’d appreciate your feedback, ideally on the nemops-interest@iab.org 
> list or directly to the authors. You can also submit a PR on GitHub:
>
> https://github.com/intarchboard/draft-iab-nemops-workshop-report
>
> Reminder: The report summarizes the proceedingsof the workshop and 
> does not necessarily reflect the IAB’s views or positions.
>
> Thanks!
> Dhruv & Wes
>
> _______________________________________________
> Nemops-workshop-attendees mailing list --nemops-workshop-attendees@iab.org
> To unsubscribe send an email tonemops-workshop-attendees-leave@iab.org