Re: [OPSAWG] Manifest need? Re: draft-claise-opsawg-collected-data-manifest

Alexander Clemm <alex@futurewei.com> Mon, 21 November 2022 18:09 UTC

Return-Path: <alex@futurewei.com>
X-Original-To: opsawg@ietfa.amsl.com
Delivered-To: opsawg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 99EA5C15258C for <opsawg@ietfa.amsl.com>; Mon, 21 Nov 2022 10:09:09 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.997
X-Spam-Level:
X-Spam-Status: No, score=-1.997 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=0.1, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=futurewei.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qNh5E_HAb31K for <opsawg@ietfa.amsl.com>; Mon, 21 Nov 2022 10:09:04 -0800 (PST)
Received: from NAM04-DM6-obe.outbound.protection.outlook.com (mail-dm6nam04on2071a.outbound.protection.outlook.com [IPv6:2a01:111:f400:7e8b::71a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 93AB5C14CF17 for <opsawg@ietf.org>; Mon, 21 Nov 2022 10:09:04 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=RStAXg64S2pvQe9JmBD1+4YyBFOfH3iTj/bcmm4wd4qccxwBIvkPw79yGXRJy4oH0d8Jb1///S8Q0+wI2sKGy42izuEf53dWltyOwceGdXHrpO7KwT4xod36MMGNwJthIuHt4LLXZUqdsei4NdL96bYiN5sYIWvuXrbLt7Mkngr1vcOp79UWQ1/CzkkP3KRqHOxImsgEOfBq/7bOdK00g/k7oriwZQj6zH700ZGgS/IYFD20K5HAK3GFK80x7HioaAV6XxYQ7aPHEe30yzUs6HdyQ3YoKFJjQ8RqwniSMFV23ULBrI4Y8Ojpgc9UTe9KEgNSpeh9rKjE8hOr5zrZlg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=q8vO5roStGrPpOuGR+agpUOu8/u7P5/afrMwspnKgrg=; b=PqXsBWlNLWw1M4wfGkQSubQV9nRQGop+SH5BZb5g+uJ3DHR2PNDXBSNbRULQB0oILpDJBM2fwgnxklzQJNLh4XmVYxo5hPwo0AG815N6KGHleK8L6LAgQmVZQwhyjylX/0TIY/IGL5Qg+X8wkPHrz+ya8X4RJrWVP4Uvf0ambNYyEMGglokRUWCJLVchlhj+/QYfg7NQxSsPyqdmEXJVI62/BDe9yKi+nU2I2WaYzI1tWyS0tOzRkMw61LDubE5d/QGM+bvNiB+S+UnZky3qOTd1CGJtcN/pJDIi8Pzv2l3r6gPgOgHkTGffVpumEv8m7wrVDBmk/+meh88ojKv2LQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=futurewei.com; dmarc=pass action=none header.from=futurewei.com; dkim=pass header.d=futurewei.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Futurewei.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=q8vO5roStGrPpOuGR+agpUOu8/u7P5/afrMwspnKgrg=; b=l1NEva3D/Ri4fxxKCVmkxjTSOwnMEiojg584lHwwvAw/gvzJLEBvz7ZOJ//qAiEzSTzCY18S9gam3/LvXCUUTYWWgljS9ILRfC43oYVj8Heq7L3mQ8epYCi8ax4xVtdvH4lAIUYDa1ODB3uxIyfXGn5t066luSPEKbScD1itQi4=
Received: from SN4PR13MB5374.namprd13.prod.outlook.com (2603:10b6:806:20d::8) by BY5PR13MB3812.namprd13.prod.outlook.com (2603:10b6:a03:21b::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5834.15; Mon, 21 Nov 2022 18:08:57 +0000
Received: from SN4PR13MB5374.namprd13.prod.outlook.com ([fe80::a2cc:8680:86ad:f718]) by SN4PR13MB5374.namprd13.prod.outlook.com ([fe80::a2cc:8680:86ad:f718%5]) with mapi id 15.20.5834.015; Mon, 21 Nov 2022 18:08:57 +0000
From: Alexander Clemm <alex@futurewei.com>
To: IGNACIO DOMINGUEZ MARTINEZ-CASANUEVA <ignacio.dominguezmartinez@telefonica.com>, Tianran Zhou <zhoutianran@huawei.com>, "opsawg@ietf.org" <opsawg@ietf.org>
Thread-Topic: [OPSAWG] Manifest need? Re: draft-claise-opsawg-collected-data-manifest
Thread-Index: AQHY/ajsiz2DGtqqo0KvtYYplbPCnK5JrKpg
Date: Mon, 21 Nov 2022 18:08:57 +0000
Message-ID: <SN4PR13MB5374058A70B3D44A71432B97DB0A9@SN4PR13MB5374.namprd13.prod.outlook.com>
References: <5DE33697-1939-4CB5-95C6-C41128B8E035@telefonica.com>
In-Reply-To: <5DE33697-1939-4CB5-95C6-C41128B8E035@telefonica.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=futurewei.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: SN4PR13MB5374:EE_|BY5PR13MB3812:EE_
x-ms-office365-filtering-correlation-id: b98de266-338a-4642-a8ec-08dacbeb7561
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 4XrDpJFCdzJzU8fgPVJLZN39nxcGQnmEufzG0SjS6qWZailQ+tSsgdbmremFn+5h7J/LrLox6XXkuF3BzIFVpehfrmV/7dDEw0heBfzFfRxQTecd6+PwbeaSkmUFMW782yTtQsw3gB8Ex0SJZRlQEUtgkh1Rha7aAN0nsmnkQu174PzrhxSonQlHeRetrxUBuG4omaZDm5kMs+H8/V2uImKFk5ENbnjZmDOt8HxPLG053QEdNdC71vVJ5EQMAZHsOECQMm9s0wvuPH2VpDFrzIU9iTliyqRWj8rKfyuHc70K//GXmw7zD8tvNgv99u/BtIx4O2P9M+m3AIM2jVW6KjnMyirMLmfBRJi5McSQulX8zeNr0trm4WC5KuEGhHeqJllptzmsTCLtKMM2jaxDjmKj5p/bRmWiZLTfgZFu9iWyfpk5mbPsCTdhWmcyScuvs9sg9QbR3n6Vfg3A8+C50LlMKlB00YFi3Q6uYXHAlhIw268yoOw/QJjS+4oaWI1CRBATMWlzbrJKUrcblfMCGXvumvPxSbZPAYhQNj+1ip6ziX5t7vZ0FMi82eGMQyPDWcYoQMpJ/uv2eIZs5dQ5fCH6ivCQ4qWM3cBpTw2Jnv8gMrvlymJSnOIcb6kB772BvAM/wlVtGCb0i7h9hc5GY4sKlqn1emG5luG8pYemB3JotzqieSMmzNYembtO9FE27WII4FKx2MSm07Qrs4lbRykLsGuNQ1ZDCOcPmE/ODAuobpjZFDhCVjVoopJ0fOz4jK8NPS8GKCzjNjeZJVjyMg==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SN4PR13MB5374.namprd13.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230022)(4636009)(136003)(39830400003)(366004)(346002)(396003)(376002)(451199015)(33656002)(86362001)(38070700005)(66574015)(7696005)(64756008)(76116006)(55016003)(5660300002)(26005)(2906002)(53546011)(9686003)(186003)(166002)(122000001)(38100700002)(83380400001)(296002)(66556008)(966005)(52536014)(71200400001)(6506007)(66446008)(8936002)(41300700001)(66476007)(66946007)(316002)(110136005)(478600001)(8676002); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: BuuAJFgYKIZIpXrhOq28RB3rW/DjwpQ0KRXYCHRNiTK546SizrgQoH08p4NxlJf+HL9BND2aY6KjFzu0KmnTo8WaK6bXwj3mzpeEZBM7izGPdKOPPeCF/qBbnzd2mv2YOqNUAMGqna4to4WjXrFUqi4Vcjjfl+O8tYvMoHUT3/4nOkwsFuQZZ5R9JPitiVIaG+BQqXQ1qq6lMKLB7q+3BRBr7BpO22l9yg5Ok8hx+OkaQyyNjlhk4xM0NcSjvtqsPpU9dHftGafMf2vvoHU0N4077iz1WsrcilFj7wZAGghb/nxEJZaOBMowXUUgSpXv1P/BXhLI+CIK/AoRzc0em5xW6mgW19Dhq/qUn9nPqfCQSL3DAKScsHpfk18/t1bf1UZQ0ZV3xxBx5KITgVS7fMx/Nx7CrKLhH46cG+Rmrml2LqXjNEje3ktKoNcWZFPcSJvCCXtKjH9+H7fPmnnbdNj9zaBZXGfZkru/hqtEPA6gsdvBx/bH9xSsvBao7yYPDEJ7t/Fg/gLZeaEomCGYLpVdUvwuwfPGhnWQFhY3//P3/6HLknqzZIwmaBSwM/VZe/VZYEoxhWNubBaQFhXkj1q5AbQ2FbkSSyrXKX2StnISj0eLUbm//VqjQzjdSLyOHJso4yNCcLR3/bTLetM4CPNiDPcKudCyTKpW54UscKtV67xlis8kQVkSnBr4EuEkiCLD8YHGX607o8CVWnPu/nlQ/7iMvs22W7B1/EgTWpM0DhNWIBxRIO/QAE+ZZtbeJ1sFZFuaCjQ8n1oX4bN2L5N6joIh75kh2MEOIOnD9x2TSUo+7NOVeLv1zSEVol19bCN2ncHRN+d/eld4w7JGUrsksvP1VX4mBVRnlKwBSArpUhTX0P0UrsUh8FwjTJtwtm2J4PFgvZ1bBWAwlsLHix6iZjLIzH8qi1C7AU01evPqeLxkjm3ZJy/zMdVxgohTbwFOA8a0ysQmBBw+55FoORg9/8ojSX2i6pVBH/NqxFlBuuAnXp+csFM8j9AEq8fmfkUOhTdBo60aIb+N00qliw1qfm8HzjEuZoqF3NFTW//Ae7rruQY4gV0PU2cU4KaOFJN1T1pXzv5kSqzHX6xpH/Duw2Grpnw8vwc/bkD9UKkSVuejm/eJeSSQqO+KzrAqm68J0/TgjPv2nevO0mOEDI9KE5rRcN6sYuq5ynOos+Q4XpPdW58HCZJ860NrRxtI+2HT6PoJjmSlhrafb7QViwULkXfzvPZj+yfXbiFWxqK+pHyckC6D8a7PkzzKjYxvLs98tC2zdmCVIGAqzdsU4MiIH2tO4ka38O37mOTs/atrICQ/QySe1zxr/Xo+H+93dNsIMcdZLMyCMF/GbCT0yj+o8s1qCZUNPeA54syh2DLtzjW+TiWAdjm//KSPPGpbf330c0MTz1gJSioYRtEvWRqHEME3oMd9LzvN/NP07icMePgv2bEi7bEaolS1dG4OlYGml7IAQJnWCSpwk6KUHYCPnlrK5EIio8BJ+OnlGSNyzyb7mPjDl5I1tDccdy5cBdU28ktgLFcFIubsAzoizlD9jig3LYhy39y/KcyKBFMIhhR9dPJ102lkj29D2f11
Content-Type: multipart/alternative; boundary="_000_SN4PR13MB5374058A70B3D44A71432B97DB0A9SN4PR13MB5374namp_"
MIME-Version: 1.0
X-OriginatorOrg: Futurewei.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: SN4PR13MB5374.namprd13.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: b98de266-338a-4642-a8ec-08dacbeb7561
X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Nov 2022 18:08:57.2964 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 0fee8ff2-a3b2-4018-9c75-3a1d5591fedc
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 7PxWEbqXoUCKJxJFxGcjdrXQu2qBU4JwlxbfR2nEYGl79zR2yd4iCbmeJUfQLoxLNqqWqdogPRxVrOUjhIyKXw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY5PR13MB3812
Archived-At: <https://mailarchive.ietf.org/arch/msg/opsawg/ZtX207-2NrOBaNZF8dkUZ0Xnsmk>
Subject: Re: [OPSAWG] Manifest need? Re: draft-claise-opsawg-collected-data-manifest
X-BeenThere: opsawg@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: OPSA Working Group Mail List <opsawg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/opsawg>, <mailto:opsawg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/opsawg/>
List-Post: <mailto:opsawg@ietf.org>
List-Help: <mailto:opsawg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/opsawg>, <mailto:opsawg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 21 Nov 2022 18:09:09 -0000

Thank you for clarifying.  Yes, I think it will be good to make this more explicit to the draft (and perhaps hint also to at the alternative option of subscribing to the subscription configuration if it were only YANG-Push (as opposed to other mechanisms) that was being used, to more clearly differentiate the delta provided by this draft).
Best
--- Alex

From: IGNACIO DOMINGUEZ MARTINEZ-CASANUEVA <ignacio.dominguezmartinez@telefonica.com>
Sent: Monday, November 21, 2022 4:58 AM
To: Alexander Clemm <alex@futurewei.com>; Tianran Zhou <zhoutianran@huawei.com>; opsawg@ietf.org
Subject: Re: [OPSAWG] Manifest need? Re: draft-claise-opsawg-collected-data-manifest

Hi Alex,

The purpose of the Data Collection Manifest is to cover all possible MDT mechanisms, not only YANG Push. There are other mechanisms like gNMI, which rely on subscriptions based on YANG path, for which we need the context of the subscription (e.g., on-change, suppress-redundancy). Additionally, vendors like Cisco or Huawei also implement other MDT mechanisms based on YANG Path.

For more details, you can follow an internal discussion he had on github: https://github.com/JeanQuilbeufHuawei/draft-collected-data-manifest/pull/30<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FJeanQuilbeufHuawei%2Fdraft-collected-data-manifest%2Fpull%2F30&data=05%7C01%7Calex%40futurewei.com%7Cfc991751e54546b710f208dacbc010fe%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C0%7C638046323051566819%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tCn666gG%2F5jeS3dCi6R5Xfxo0PVdzfBSeTkN0mMK7yE%3D&reserved=0>

In any case, I agree that we can better clarify this aspect in the draft.

Many thanks for your feedback!

Best regards,
Nacho.

From: OPSAWG <opsawg-bounces@ietf.org<mailto:opsawg-bounces@ietf.org>> on behalf of Alexander Clemm <alex@futurewei.com<mailto:alex@futurewei.com>>
Date: Friday, 18 November 2022 at 17:39
To: Tianran Zhou <zhoutianran@huawei.com<mailto:zhoutianran@huawei.com>>, "opsawg@ietf.org<mailto:opsawg@ietf.org>" <opsawg@ietf.org<mailto:opsawg@ietf.org>>
Subject: Re: [OPSAWG] Manifest need? Re: draft-claise-opsawg-collected-data-manifest

So, saving the invocation of one command to establish the “meta-subscription”, that’s all this is for?  And for this we are asking implementors to create what is in effect redundant instrumentation?  This seems a lot of effort for a small saving.

As a thought, even in that case, would you even need a redundant YANG-data model, or would it make sense to instead augment the existing model with an additional parameter instead “provide manifest info”, which adds implicitly a subscription to the subscription info to the subscription itself?  Such an alternative could be accomplished by augmenting such a parameter into the existing model, and save the need to create YANG data instrumentation that is basically redundant, hence reduce the complexity of implementations.

--- Alex

From: Tianran Zhou <zhoutianran@huawei.com<mailto:zhoutianran@huawei.com>>
Sent: Thursday, November 17, 2022 10:49 PM
To: Alexander Clemm <alex@futurewei.com<mailto:alex@futurewei.com>>; opsawg@ietf.org<mailto:opsawg@ietf.org>
Subject: RE: Manifest need? Re: draft-claise-opsawg-collected-data-manifest

Hi Alex,

I think this is a very good discussion. I raised this question before in the mailing list.
I think there may be some benefits:
1. The meta data can always go with the telemetry data, without explicit subscription. This facilitates the close loop automation.
2. Another subscription to the subscription information may make the management complex, since we put all the subscriptions in one list.

Best,
Tianran

发件人: OPSAWG [mailto:opsawg-bounces@ietf.org] 代表 Alexander Clemm
发送时间: 2022年11月18日 7:40
收件人: opsawg@ietf.org<mailto:opsawg@ietf.org>
主题: [OPSAWG] Manifest need? Re: draft-claise-opsawg-collected-data-manifest

Hello draft-claise-opsawg-collected-data-manifest coauthors,

I just wanted to follow up on my comment at the microphone in London regarding draft-claise-opsawg-collected-data-manifest.

Clearly, there is a need to preserve context to be able to correctly interpret data after it has been collected.  That being said, as currently stated, the draft appears to overspecify some of those things, defining some YANG data that IMHO is not actually needed as the same can already be accomplished.  This concerns the specifics about the subscription itself.

RFC 8641 includes a YANG model that reflects for each subscription how it is configured (whether configured directly or established by RPC), including the selection filter, the update trigger, the period and anchor time (in case of periodic subscription), dampening periods and excluded changes (in case of on-change subscription), etc. The corresponding YANG data can be itself be subscribed to, or retrieved on demand, just like any other kind of YANG data.

I am therefore not quite sure what the proposed manifest would provide that couldn't be accomplished already.  The suggestion to retain the subscription data along with the subscribed data makes a lot of sense but would appear to be a practice that will be up to the management application to implement, with the mechanism already provided.  (This could of course be included as a description of a recommended practice in the draft.)  Or is there something else that is missing?

If there is indeed a delta that cannot be otherwise accomplished, my suggestion would be to add text to the draft that clearly describes the possibility of subscribing to subscription configuration data, then explaining the functional delta that your draft covers in addition to that.

Thanks
--- Alex

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is confidential and privileged information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição