Re: [nmrg] [External] [NMRG] review of draft-li-nmrg-intent-classification-03.txt

"El Khatib, Yehia (elkhatib)" <y.elkhatib@lancaster.ac.uk> Wed, 27 May 2020 18:01 UTC

Return-Path: <y.elkhatib@lancaster.ac.uk>
X-Original-To: nmrg@ietfa.amsl.com
Delivered-To: nmrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 005143A03EA for <nmrg@ietfa.amsl.com>; Wed, 27 May 2020 11:01:41 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.8
X-Spam-Level:
X-Spam-Status: No, score=-1.8 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=livelancsac.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id eQsqDq1iBCJe for <nmrg@ietfa.amsl.com>; Wed, 27 May 2020 11:01:36 -0700 (PDT)
Received: from GBR01-CWL-obe.outbound.protection.outlook.com (mail-eopbgr110122.outbound.protection.outlook.com [40.107.11.122]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A9B003A02BC for <nmrg@irtf.org>; Wed, 27 May 2020 11:01:34 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=VUm1ffsrcqHvQzJDr/Ber9zRPl93LeYQcFqOnwPDY3uiZHVhPbLRyRgv+lxc1Putp0zf/cjf6CKETncfzoARqTwW1i+c8JQmLJB9rShGJ5ctaUEphElYRhSEyKvdKyvnr0FkQh33Lwxlcd15Igm2ikxcjSTxIfVmUcOvnGrOlGpsq6+ud/z1ONYUputgnx886m3Os9yCZVNNcNLRM1+DHayRFsNg5Y6vH5QXByEo47TZ6Ef6KOVldDb+eiPQNWBg3N5c+NUStL+9vfuI+dEEhACfVzBgWIh+fIRisIAi135aZ0PPHEMkunMxnindMEMYc1teSmpyc9p7M4QaKXI1JA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=rud6aqTYMUuKP49z4JtPYzaTx1iku1nNMIkmsgMP624=; b=PzgbZeUrKbbbSM2x9jzAqc0EFwJkkvlJqBN0GAzJzM+n60Qu4USUTS2wXYhO8MAMILH68oIGNYZrK605y5+VtnCMKOJmVMjjNpkS2pNqzN50Bt4ZZ1BZ1EkvCFtmdJfWKAF+soDmQs0Jsa/WFcVIafYHe0sF+6LNOpWVoth9bzvFi7Lfns1AU8/U5yZjcFhn1o3l/ZDOGvsFBKmQ17x0QjnvFqkHD2NlnefGefFKcK/Zk09K3Gc58Xi8FTwG3T9BTuT8GdGgQ2EvDsQg7Tnk+l9z366g8oCIIla2FsSxWiPTIgSybnFUA3mDx3SLj4dSmnExM3LwWZHxHRRzfCtVOA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=lancaster.ac.uk; dmarc=pass action=none header.from=lancaster.ac.uk; dkim=pass header.d=lancaster.ac.uk; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=livelancsac.onmicrosoft.com; s=selector2-livelancsac-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=rud6aqTYMUuKP49z4JtPYzaTx1iku1nNMIkmsgMP624=; b=a+FLE0CSRbCszHTaZPS4EfQWOOtto09jC7hbAxoVc3TUWFoLWRLGOEJApPty13yGZZ0TEsNaVyTJZTQ8TFkli4t+dYmfB1hNNPfPAf88yVLuXXIZiYRzA9rFfetrJaye/dvPKrFoJZ34wvz/NOySSNK2ReklAPKNkDUZuZ9ucLU=
Received: from LO2P265MB1680.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:97::14) by LO2P265MB0255.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:6b::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3045.19; Wed, 27 May 2020 18:01:31 +0000
Received: from LO2P265MB1680.GBRP265.PROD.OUTLOOK.COM ([fe80::7594:9941:7ad5:1672]) by LO2P265MB1680.GBRP265.PROD.OUTLOOK.COM ([fe80::7594:9941:7ad5:1672%3]) with mapi id 15.20.3021.029; Wed, 27 May 2020 18:01:31 +0000
From: "El Khatib, Yehia (elkhatib)" <y.elkhatib@lancaster.ac.uk>
To: "lichen6@chinatelecom.cn" <lichen6@chinatelecom.cn>, nmrg <nmrg@irtf.org>
CC: draft-li-nmrg-intent-classification <draft-li-nmrg-intent-classification@ietf.org>
Thread-Topic: [nmrg] [External] [NMRG] review of draft-li-nmrg-intent-classification-03.txt
Thread-Index: AQHWNFDZkoa8ja5hdUWkHFA05v83Ig==
Date: Wed, 27 May 2020 18:01:31 +0000
Message-ID: <D24B68D3-6B38-45DC-B5BA-0C6D71B9052C@lancaster.ac.uk>
Accept-Language: en-GB, en-US
Content-Language: en-GB
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/10.1f.0.191110
authentication-results: chinatelecom.cn; dkim=none (message not signed) header.d=none;chinatelecom.cn; dmarc=none action=none header.from=lancaster.ac.uk;
x-originating-ip: [90.248.145.199]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 069c20c5-8a5e-4954-4d47-08d80267fca3
x-ms-traffictypediagnostic: LO2P265MB0255:
x-microsoft-antispam-prvs: <LO2P265MB0255E7C2C228DD71231C439BD4B10@LO2P265MB0255.GBRP265.PROD.OUTLOOK.COM>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-forefront-prvs: 04163EF38A
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: yNxMd5rQWlhcYZqYxmfAhWekfeMHXRizWQtP9otHwE+w8t5ozMiq6n6uwpF3/LvoOV4iWVtWBqNgyczrNIdquzgeMHQiZNg/eErFQcp6y0rw10XKwP1T2+gM8c/Xan6dX6DzCGPPTG2mOB+GhCSHaxm/RJw+GsgiPtMBkNJjsrw99ecZyNFUzkqOxEUXq88dI5htGwXBz4aLAx/V5E8gNe0twSsLkBPu4MXbyohWTqRtHQG1unE1IsgOdUnWaJXCwN5hySYeagifcomb6lDbR8+vWRvnMEsBN+T1D0bIjhe1MOCAeE/UfC2m0pseH8qmcPZ6o8NCXG6kmyiVhF1LsshoOC/hslQBNvKCvf9kNmf+TIaYWfHmNvCEdVm6Ub/0yv4IBxGDJtrDa8Lpmv4Vqw==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:LO2P265MB1680.GBRP265.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFTY:; SFS:(4636009)(136003)(39860400002)(396003)(376002)(346002)(366004)(83380400001)(86362001)(53546011)(6506007)(8936002)(26005)(966005)(4326008)(110136005)(66946007)(786003)(5660300002)(186003)(478600001)(33656002)(316002)(36756003)(6486002)(76116006)(83080400001)(2906002)(6512007)(66446008)(64756008)(66556008)(66476007)(8676002)(71200400001)(166002)(2616005)(559001)(579004); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata: NEKPbBFlauEfUNLT8bZiewL0VNFW9AAvN614o7WVV7vrst38d55aPXSeyt7cKMuSY0aS9Y5pkbHA6H1epkn8Irwd7YkOdRqF8Hev5YNu923fKKlYVufkeAxVytvGpEKRlHUvcNaCcHBqwYS6pmoAok1luzUX2H21nY0KAkBRTZvgoUxkUeIgnIMgHBgs0v9c+uLs02fdW78sQW05SiFhWcdWnu6em7U32GenOUJlYrgu+Go9J5sLj380dLrsqTaqfnsztYa63bZYuHk6GUwia4mt9FQiSil8mNcgXeoYH0WaG2ZSNCa6eVjhWW46i2jIl83JKeLbGn7DiF1JvpOw6dZ4hgHLACICG9On3jXRrgjxc+qnHPwJ6gbrnk/rdzqbAf5zqCXDK1fDQg0Z1HvZ89ejv95Gu1hIuFpOsMc566TklWC6FObdhWYF+VLMsIH1hk5OwkpW6zyWDza5u3swJ4rk0hNXwJ+QH2kAx3mG6E2iXiHTcuHTPjRnKSfSrh5P
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_D24B68D36B3845DCB5BA0C6D71B9052Clancasteracuk_"
MIME-Version: 1.0
X-OriginatorOrg: lancaster.ac.uk
X-MS-Exchange-CrossTenant-Network-Message-Id: 069c20c5-8a5e-4954-4d47-08d80267fca3
X-MS-Exchange-CrossTenant-originalarrivaltime: 27 May 2020 18:01:31.5574 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 9c9bcd11-977a-4e9c-a9a0-bc734090164a
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: w2KzLQul8/gv4PZQZVhQyDef79FUli74TinGn39ybL3jG3oNHCnRs6wowYe8dPfwvkgMcLWRDOwFUwvfi/JQnOG4PgKjF+yWGoWJVyDC2CE=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: LO2P265MB0255
Archived-At: <https://mailarchive.ietf.org/arch/msg/nmrg/R5nAtb7pOYB6EU4ui8Tn1cL1UBM>
Subject: Re: [nmrg] [External] [NMRG] review of draft-li-nmrg-intent-classification-03.txt
X-BeenThere: nmrg@irtf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Network Management Research Group discussion list <nmrg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/nmrg>, <mailto:nmrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nmrg/>
List-Post: <mailto:nmrg@irtf.org>
List-Help: <mailto:nmrg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/nmrg>, <mailto:nmrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Wed, 27 May 2020 18:01:41 -0000

Thanks for addressing the comments.

/y



From: <lichen6@chinatelecom.cn> on behalf of "lichen6@chinatelecom.cn" <lichen6@chinatelecom.cn>
Date: Wednesday, 27 May 2020 at 02:51
To: Yehia Elkhatib <y.elkhatib@lancaster.ac.uk>, nmrg <nmrg@irtf.org>
Cc: draft-li-nmrg-intent-classification <draft-li-nmrg-intent-classification@ietf.org>
Subject: Re: FW: [nmrg] [External] [NMRG] review of draft-li-nmrg-intent-classification-03.txt

Dear Yehia,

Thank you very much for your comments. Thanks for your opinion that this version of the draft is much better and brings more clarity. Please see the replies below. We propose to address in the next version of the document those comments with reply “Added to the list of updates for the next version”. For others, we added some clarification – please let us know if you need additional clarification.

Best Regards,
Chen

________________________________
李  晨  Li Chen
中国电信战略与创新研究院 战略与规划研究所 网络规划中心
电话:010-50902891/18910853955
邮箱:lichen6@chinatelecom.cn/18910853955@chinatelecom.cn
只为成功找方法,不为失败找借口
==============================
Chen  Li
Network Evolution and Planning Center
Network Technology & Planning Department
Email:lichen6@chinatelecom.cn /18910853955@chinatelecom.cn
Tel: +86-10-50902891
Mobile: +86-18910853955

From: nmrg [mailto:nmrg-bounces@irtf.org] On Behalf Of El Khatib, Yehia (elkhatib)
Sent: Friday 15 May 2020 13:43
To: nmrg@irtf.org
Subject: Re: [nmrg] [External] [NMRG] review of draft-li-nmrg-intent-classification-03.txt

Hi all,

This version of the draft is better than the last. I think it brings more clarity about the different ways intents could be used, which also helps to define who the users of intents are. Some suggestions:

- Like Mehdi mentioned, the bit in §3.1 about “Intent is very often just a synonym for policy” comes off as being confirmative of that stance, although the draft argues otherwise. And the rest of the paragraph repeats the same 2 points again. Perhaps just better wording here would help. Suggested alternative:

   An intent is mistaken by many to be just a synonym for policy.
   While it is easier for those familiar with different standards to
   understand what service, CFS, RFS, resource, policy continuum, ECA
   policy, declarative policy, abstract policy or intent policy is, it
   may be more difficult for the wider audience. Furthermore, those
   familiar with policies understand the difference between a business,
   intent, declarative, imperative and ECA policy.

Added to the list of updates for the next version –
Thank you for your suggestion on improving the wording. We will update in the next version to further clarify that for the wider audience intents are sometimes confused with policies.

- There is a number of examples spread throughout the draft, but none of them go into any detail so would leave some readers a little lost. I think the draft would benefit from having at least one case study explained in a little more detail. I’ve used some examples in my papers, e.g. : section III in
https://yelkhatib.github.io/papers/elkhatib2017idn.pdf<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fyelkhatib.github.io%2Fpapers%2Felkhatib2017idn.pdf&data=02%7C01%7Cy.elkhatib%40lancaster.ac.uk%7Cb7dcbe0813b145735fd708d801e087b4%7C9c9bcd11977a4e9ca9a0bc734090164a%7C0%7C1%7C637261411162193391&sdata=f9%2BTetWnPIexyrbaMHNWP885vo7%2F%2B%2BudgTAvfKfhsRw%3D&reserved=0>

An alternative would be to just expand a little more whenever each of these examples is thrown in, such as “Request high priority queueing for traffic of class A”. The expansion would be a couple of sentences on how this would be manifested in an operational sense without being tech-specific.

Added to the list of updates for the next version –
The examples presented in tables 5.3.1, 5.4.1 and 5.5.1 have been added based on the previous draft comments received. The purpose of these intents is to provide actual examples of intent from the perspective of a user for different solutions, intent user types, and intent types. We agreed that the Use Cases, Intent Formal Definition (DSL) the operational aspects (such as how these intents are decomposed) behind these intents are outside of the scope of this draft and would be addressed by other drafts (Use Cases, Intent DSL, Intent Architecture). But your suggestion to add some expansions is welcome and we will add some clarification in the next draft version.
Thanks for sharing the link, it is excellent reference and should be used when the RG start working on use cases and formal definition and architecture.

- The draft mentioned that an intent-driven network (IDN) “should be able to detect and resolve intent conflicts”, but not how or whose responsibility this would be. This is probably beyond the scope of this draft, but it’s not ideal to leave that requirement there and never comment on its feasibility or responsibility. Even a brief comment would be better than nothing at all.

Added to the list of updates for the next version -
We agreed that addressing in detail intent conflict resolution is outside the scope of this draft.
We will update this sentence in the next version of the draft, to explain that a new intent issued by an intent user, can be in conflict with the already existing intents, and that once the system identifies such a conflict, an option is to report back to the user to refine its intent.

- I assume that the intent scopes in §4.3 are expandable and are context-specific?
Yes, the intent scopes are expendable through the methodology presented in section 5.1.


Best,
Yehia


--
Dr. Yehia Elkhatib
Distributed Systems Group Lead  &  Director of PhD Admissions
School of Computing & Communications
Lancaster University, LA1 4WA, UK
y.elkhatib /then add/ lancaster.ac.uk
https://yelkhatib.github.io<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fyelkhatib.github.io%2F&data=02%7C01%7Cy.elkhatib%40lancaster.ac.uk%7Cb7dcbe0813b145735fd708d801e087b4%7C9c9bcd11977a4e9ca9a0bc734090164a%7C0%7C1%7C637261411162203383&sdata=QWiHXl4Ds1%2BLo7Y24jUkLgJw0l%2Fd4WSWKMtwoARBt90%3D&reserved=0>


From: nmrg <nmrg-bounces@irtf.org<mailto:nmrg-bounces@irtf.org>> on behalf of "Bezahaf, Mehdi" <mehdi.bezahaf@lancaster.ac.uk<mailto:mehdi.bezahaf@lancaster.ac.uk>>
Date: Thursday, 14 May 2020 at 9:46 pm
To: "nmrg@irtf.org<mailto:nmrg@irtf.org>" <nmrg@irtf.org<mailto:nmrg@irtf.org>>
Subject: [External] [nmrg] [NMRG] review of draft-li-nmrg-intent-classification-03.txt


This email originated outside the University. Check before clicking links or attachments.
Dear all,

I hope this email finds you all safe and sound. Please find below my review of the last version of Draft-li-nmrg-intent-classification-03.txt.


     *   Lifecycle or life-cycle, keep it consistent
     *   Add NBI, API, VNF, PNF, AI and GBP to the acronym section
     *   In section 3.1

        *   The authors mentioned that "Intent is very often just a synonym for policy". I am sure that the authors meant that for the wider audience confusing intent and policy. Probably need to link this sentence with the one just before it.

     *   Section 3.2

        *   It is a bit confusing because the authors are talking about intent solutions and they present as an example carrier networks, DC networks, and Enterprise networks, which for me are more as situations, scenarios or contexts than a solution
        *   Does the table cover all the possibilities or just some examples (if it is the case, it needs to be clear in the text)?
        *   I don't agree. I guess if we pick the scenario (carrier networks for example) and a user (network operator), you will probably have different intent types depending on the use-case. What I mean is that just the user and the context does not describe or define the intent type
        *   Section 3.1 and 3.2 are related. If you can pick the actor, the context, and the use case, you can have a clear definition of your intent!

     *   Section 3.3

        *   The title of this section is "current problems and requirements".. I wouldn't say 'problems' as it is defined in this section but more as possible improvement or intent benefits! I guess there are still some technical people that they want/need to use APIs/CLI to fix/access/interact with the system on specific issues!


     *   Section 5.1

        *   The figure in this section is a bit confusing! Does the classification process follow this order (R1-U1, R2-U2,…..)? I think this picture can be deleted!

     *   Section 5.2

        *   In section 4.2, three different intent user types were defined (customers, App dev, and Management). However, in section 5.2, the authors mentioned other intent user types such as Network or service operator, Enterprise administrator, cloud administrator, underlay network administrator. There is a difference between intent user and intent user type..

     *   Section 5.3.1

        *   In the first table, the authors duplicated some entries twice (probably by mistake).
        *   In section 3.4, the authors define a list of intent types that should be supported but in section 5.3.1, 5.4.1, and 5.5.1 new intent types are defined such as "strategy intent".

     *   Section 6

        *   I don't see the point of having this section (at least as it is) in this document. What I mean, is that I cannot see how AI will impact the classification!
        *   I don't agree with the authors when they support that intent determined by AI-based will have a format closer to machine language structures than natural language structures to avoid misconception. One way to do it is to have multiple exchanges between the user (human) and the system (the first loop) to be sure about the user request and that the AI-based agent gets the user's intention.


Best Regards,
Mehdi


Mehdi Bezahaf, PhD
Senior Research Associate
D31, InfoLab21
School of Computing & Communications
Lancaster University
+44 (0) 1524 510384