Re: [netmod] pls clarify get operation

"Rob Wilton (rwilton)" <rwilton@cisco.com> Fri, 28 June 2019 09:33 UTC

Return-Path: <rwilton@cisco.com>
X-Original-To: netmod@ietfa.amsl.com
Delivered-To: netmod@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 236951201F3; Fri, 28 Jun 2019 02:33:24 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.5
X-Spam-Level:
X-Spam-Status: No, score=-14.5 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=LyHiKvz6; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=BF4U5RCX
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id KyuB_uYy0dUH; Fri, 28 Jun 2019 02:33:21 -0700 (PDT)
Received: from rcdn-iport-3.cisco.com (rcdn-iport-3.cisco.com [173.37.86.74]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2EE501201D8; Fri, 28 Jun 2019 02:33:21 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=10864; q=dns/txt; s=iport; t=1561714401; x=1562924001; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=WjeroL5UZbFW1yFf2mPEkeOgYeer4zgCzqvIZJWOp6o=; b=LyHiKvz6heJDWq/IUWaEeFFUy/8UaQWCbVlQuSIUGmjt5lyPBvHR5UHQ 425nQq3xEVpFQgvpT5PEgHZitNqMsb8N9kGjml3UDOzwELskJikHdi7EF jDBtjJ/H39SPkP+N3dvZVi+yYK2pMbbztxMkK81WumG2iPksUUTobyQoz o=;
IronPort-PHdr: 9a23:SR9ZhRARliiWEuHFerQsUyQJPHJ1sqjoPgMT9pssgq5PdaLm5Zn5IUjD/qs13kTRU9Dd7PRJw6rNvqbsVHZIwK7JsWtKMfkuHwQAld1QmgUhBMCfDkiuNuHrazA9GuxJVURu+DewNk0GUMs=
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0AGAACS3RVd/5hdJa1jAxkBAQEBAQEBAQEBAQEHAQEBAQEBgVMEAQEBAQELAYFDKScDalUgBAsoCoQSg0cDhFKKCoJbfpZGgS4UgRADVAkBAQEMAQEYCwoCAQGDekYCF4JpIzQJDgEDAQEEAQECAQVtijcMhUoBAQEDAQEBEBERDAEBLAsBBAcCAgIBBgIQAQEDAQEBAgIjAwICAhkMCxQBAgYIAQEEAQ0FCBMHgwGBagMODwECDIsBkGACgTiIYHGBMoJ5AQEFhQwYghEJBYEHKAGLXheBQD+BEUaCFzU+gmEBAQIBgSsBCwcBIRUKCxuCQzKCJot0gmuFHpVEbAkCghaGU41AgiuHGI4ejS2HOIwcg0sCBAIEBQIOAQEFgVA4Z3FwFTuCbAmCOIEmAQKCSDOEYYU/cgGBKIw0DxeBCwGBIAEB
X-IronPort-AV: E=Sophos;i="5.63,427,1557187200"; d="scan'208";a="572195432"
Received: from rcdn-core-1.cisco.com ([173.37.93.152]) by rcdn-iport-3.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 28 Jun 2019 09:33:19 +0000
Received: from XCH-ALN-017.cisco.com (xch-aln-017.cisco.com [173.36.7.27]) by rcdn-core-1.cisco.com (8.15.2/8.15.2) with ESMTPS id x5S9XJkm024978 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Fri, 28 Jun 2019 09:33:19 GMT
Received: from xhs-aln-003.cisco.com (173.37.135.120) by XCH-ALN-017.cisco.com (173.36.7.27) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Fri, 28 Jun 2019 04:33:18 -0500
Received: from xhs-rcd-003.cisco.com (173.37.227.248) by xhs-aln-003.cisco.com (173.37.135.120) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Fri, 28 Jun 2019 04:18:17 -0500
Received: from NAM02-SN1-obe.outbound.protection.outlook.com (72.163.14.9) by xhs-rcd-003.cisco.com (173.37.227.248) with Microsoft SMTP Server (TLS) id 15.0.1473.3 via Frontend Transport; Fri, 28 Jun 2019 04:18:17 -0500
ARC-Seal: i=1; a=rsa-sha256; s=testarcselector01; d=microsoft.com; cv=none; b=GAL8n+Oqpu8tTrziG38vycMyuuH/fhFTH5QX6QLsCrHxfOrmHENdey9TYBF52sp2D22wTaKo4YnBoBmTaVB0VbYce058OedfwSv6xqdVkipln3Jp/tW3OFvZzFUdM9KbWxrIpojuGy1gYqfzX4ALLpqfNyX/Owrnn1zszQmfVFQ=
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=testarcselector01; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=WjeroL5UZbFW1yFf2mPEkeOgYeer4zgCzqvIZJWOp6o=; b=wJ0t7136pm96+o1BGczW281SP2/Pk5rd5YBiqr4pGruyvNL+xCWk7k3Hhzy6VrcC/8AxZcZglkaEsbSa0fCPtkg5jN2EOLcxX965Z01zO+tIG3+n/UvSYbgloGcCpOoyCo/zP4xxIO31IDTrvpj50lZgICWmV74bMZmPmcC8VT0=
ARC-Authentication-Results: i=1; test.office365.com 1;spf=none;dmarc=none;dkim=none;arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector2-cisco-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=WjeroL5UZbFW1yFf2mPEkeOgYeer4zgCzqvIZJWOp6o=; b=BF4U5RCXREtCJbfnIkkTAE9I8+u0aU4ev4L8zsJHI8gTUmyIdF3ax0zxHM15FX/+jQlH/WOeuvOm0WzKh9p+Who0H1KvfCW0GSANGjL/H5FLItExZAHJD2qyeOrAlv/v3N5ucMOrW8Yth3PdEQcW3JZHvOFhw/am6gwYEPLoBqE=
Received: from BYAPR11MB2631.namprd11.prod.outlook.com (52.135.227.28) by BYAPR11MB3798.namprd11.prod.outlook.com (20.178.239.28) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2008.16; Fri, 28 Jun 2019 09:18:16 +0000
Received: from BYAPR11MB2631.namprd11.prod.outlook.com ([fe80::ed99:b6a8:d6fb:5045]) by BYAPR11MB2631.namprd11.prod.outlook.com ([fe80::ed99:b6a8:d6fb:5045%4]) with mapi id 15.20.2008.018; Fri, 28 Jun 2019 09:18:16 +0000
From: "Rob Wilton (rwilton)" <rwilton@cisco.com>
To: "Fengchong (frank)" <frank.fengchong@huawei.com>, Juergen Schoenwaelder <j.schoenwaelder@jacobs-university.de>
CC: "netconf@ietf.org" <netconf@ietf.org>, "netmod@ietf.org" <netmod@ietf.org>, "Zhangwei (SS)" <zhangwei70@huawei.com>
Thread-Topic: [netmod] pls clarify get operation
Thread-Index: AdUsiu4JIzTUBFYNTIGSUYTtxnFLqwA1gt7QAApPi5AAARItAAAAl7IAAAAVygA=
Date: Fri, 28 Jun 2019 09:18:16 +0000
Message-ID: <BYAPR11MB2631B6688BB094D93BACAD6AB5FC0@BYAPR11MB2631.namprd11.prod.outlook.com>
References: <5756FB984666AD4BB8E1D63E2E3AA3D001ED5E20@dggemm513-mbx.china.huawei.com> <BYAPR11MB2631D3A01E398ADDBB294588B5FC0@BYAPR11MB2631.namprd11.prod.outlook.com> <20190628085014.ljxh73fcmiu6iqx7@anna.jacobs.jacobs-university.de> <5756FB984666AD4BB8E1D63E2E3AA3D001ED6082@dggemm513-mbx.china.huawei.com>
In-Reply-To: <5756FB984666AD4BB8E1D63E2E3AA3D001ED6082@dggemm513-mbx.china.huawei.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=rwilton@cisco.com;
x-originating-ip: [173.38.220.34]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 86a44f53-2be7-47f0-3927-08d6fba98dc9
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600148)(711020)(4605104)(1401327)(2017052603328)(7193020); SRVR:BYAPR11MB3798;
x-ms-traffictypediagnostic: BYAPR11MB3798:
x-ms-exchange-purlcount: 4
x-microsoft-antispam-prvs: <BYAPR11MB3798B3604A4A8B4171099FD0B5FC0@BYAPR11MB3798.namprd11.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:8273;
x-forefront-prvs: 00826B6158
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(136003)(39860400002)(346002)(396003)(376002)(366004)(51444003)(13464003)(53754006)(199004)(189003)(64756008)(66946007)(76116006)(66476007)(66556008)(73956011)(2906002)(110136005)(66446008)(54906003)(316002)(486006)(7736002)(76176011)(81166006)(81156014)(26005)(8676002)(186003)(74316002)(4326008)(7696005)(305945005)(53546011)(6506007)(6246003)(11346002)(102836004)(446003)(966005)(476003)(14454004)(25786009)(99286004)(8936002)(478600001)(68736007)(229853002)(5024004)(14444005)(256004)(33656002)(6436002)(86362001)(71200400001)(71190400001)(9686003)(66066001)(5660300002)(55016002)(53936002)(6116002)(6306002)(52536014)(3846002); DIR:OUT; SFP:1101; SCL:1; SRVR:BYAPR11MB3798; H:BYAPR11MB2631.namprd11.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1;
received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: Nn0BSgiCVryU9pbKGTsflP4B7Y3jqIyfK5HFWPz1jwzdtIq+xxmcbKP9R6aiMKVl/Vf3uJ2SP3Q0MqsaZ07/YLGWzDTZNKBYw+XlIRF9KsWxmc0CL3cfsJQAYqlwJyPlPvE6z+KmvxRzlePiIuXHy1M3AolmWg77Cd2JEN7RlvETAwWP4GSYGl9i+Get953sG6HnHvwBUD7yK+kreLXWrtCqO1T8B5hQxziaVmVFoXbRRIvJ9f7tGo+gK0N00ExBHBKNTl0yRNowbR4L8z7t9e52P1GpW0Td+QcMlGPx67wQ+JP9Fmc90A5Sj9GaZ2NqHcHqrnl7EHVZ1KGiVQVEpn4J2f9bNOEDOGYjxwBWCe7PxsXi59FNbj8c9KZ9ERqvA4+YE2SFcQIiMZIsL2ROf7dMaTcpYNBIjNhUxXSEc+o=
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 86a44f53-2be7-47f0-3927-08d6fba98dc9
X-MS-Exchange-CrossTenant-originalarrivaltime: 28 Jun 2019 09:18:16.4214 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: rwilton@cisco.com
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR11MB3798
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.36.7.27, xch-aln-017.cisco.com
X-Outbound-Node: rcdn-core-1.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/netmod/IqNVpl6mRrpLF6iu0XEGK2OR6_M>
Subject: Re: [netmod] pls clarify get operation
X-BeenThere: netmod@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NETMOD WG list <netmod.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netmod>, <mailto:netmod-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netmod/>
List-Post: <mailto:netmod@ietf.org>
List-Help: <mailto:netmod-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netmod>, <mailto:netmod-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 28 Jun 2019 09:33:25 -0000

Hi Frank,

You can't just change definitions in RFCs.  It breaks all existing clients/servers.  Besides, what you suggest doesn't really work (path clashes between configuration and operational state), unless you return two trees ... which starts to look extremely similar to the NMDA architecture ...

IETF has already explored this problem and there is already a published IETF solution to the problem that you describe: Migrate to NMDA.  The NMDA architecture has many other benefits as well (E.g. allows for templating, inactive configuration, dynamic configuration, consistent OIR handling).

Thanks,
Rob


-----Original Message-----
From: Fengchong (frank) <frank.fengchong@huawei.com> 
Sent: 28 June 2019 10:07
To: Juergen Schoenwaelder <j.schoenwaelder@jacobs-university.de>; Rob Wilton (rwilton) <rwilton@cisco.com>
Cc: netconf@ietf.org; netmod@ietf.org; Zhangwei (SS) <zhangwei70@huawei.com>
Subject: 答复: [netmod] pls clarify get operation

Should we change the definition of get operation? Like this, get operation can retrieve all running operational data including running configuration, system configuration.
Otherwise, we have no way to get the information of system-controlled data according a NMDA-style YANG module(because has no config false copy ) unless we implement NMDA.
-----邮件原件-----
发件人: Juergen Schoenwaelder [mailto:j.schoenwaelder@jacobs-university.de]
发送时间: 2019年6月28日 16:50
收件人: Rob Wilton (rwilton) <rwilton@cisco.com>
抄送: Fengchong (frank) <frank.fengchong@huawei.com>; netconf@ietf.org; netmod@ietf.org; Zhangwei (SS) <zhangwei70@huawei.com>
主题: Re: [netmod] pls clarify get operation

Yes, both the NETCONF <get> operation and the RESTCONF GET on the unified view of the underlying datastores have limitations and a solution in situations where these limitations hurt is to move towards NMDA.

/js

On Fri, Jun 28, 2019 at 08:38:38AM +0000, Rob Wilton (rwilton) wrote:
> Hi Frank,
> 
> Pre NMDA:
> 
>   *   You have a the <running> datastore, along with some others like <candidate> and <startup> that you can ignore for the purposes of this discussion.
>   *   The <running> datastore can only contains data for schema nodes that are marked as “config true” in YANG (i.e. “rw” in your tree output below).
>   *   The system may also have some operational state data that is marked as “config false” in YANG (i.e. “ro” in your tree output below).
> 
> The NETCONF <get-config> operation returns the contents of the <running> datastore.
> The NETCONF <get> operation returns the contents of the <running> datastore combined with all the operational state as well.  Filters can be applied to return a subset of the data.
> 
> Regarding your question about user created configuration vs system created configuration, it depends on whether the devices instantiates the configuration in <running> or not.  If it does, then it would be returned in <get> and <get-config> operations.  If it doesn’t then it would not.  Different vendors/devices will likely implement this in different ways.
> 
> Generally, I think that <running> should only contain the configuration explicitly configured by the operator’s systems.  But this means that there isn’t a clean way to represent system created configuration or applied configuration, unless you make a config false copy of every config true node in YANG.  This is approach that was taken by the original IETF YANG models (e.g. RFC 7223) before they were superseded by NMDA, and also the OpenConfig YANG models (but using a different structure – which also struggles to cleanly represent system created configuration data).
> 
> The NMDA architecture was written to solve this problem in a clean way without requiring duplication in the YANG data models.
> 
> Hopefully this helps clarify.
> 
> Thanks,
> Rob
> 
> 
> From: netmod <netmod-bounces@ietf.org> On Behalf Of Fengchong (frank)
> Sent: 28 June 2019 04:29
> To: netconf@ietf.org; netmod@ietf.org
> Cc: Zhangwei (SS) <zhangwei70@huawei.com>
> Subject: [netmod] 答复: pls clarify get operation
> 
> Hi all,
> 
>      Pls clarify this question. I have been confused for a long time.
> 
> ________________________________
> 华为技术有限公司 Huawei Technologies Co., Ltd.
> [Company_logo]
> 个人签名:冯冲
> 手  机:13776612983
> 电子邮件:frank.fengchong@huawei.com<mailto:frank.fengchong@huawei.com>
> 公司网址:www.huawei.com<http://www.huawei.com>
> ________________________________
>  本邮件及其附件含有华为公司的保密信息,仅限于发送给上面地址中列出的个人或群组。禁
> 止任何其他人以任何形式使用(包括但不限于全部或部分地泄露、复制、或散发)本邮件中
> 的信息。如果您错收了本邮件,请您立即电话或邮件通知发件人并删除本邮件!
> This e-mail and its attachments contain confidential information from 
> HUAWEI, which is intended only for the person or entity whose address 
> is listed above. Any use of the information contained herein in any 
> way (including, but not limited to, total or partial disclosure, 
> reproduction, or dissemination) by persons other than the intended
> recipient(s) is prohibited. If you receive this e-mail in error, 
> please notify the sender by phone or email immediately and delete it!
> 
> 发件人: Fengchong (frank)
> 发送时间: 2019年6月27日 9:59
> 收件人: 'netconf@ietf.org' <netconf@ietf.org<mailto:netconf@ietf.org>>;
> netmod@ietf.org<mailto:netmod@ietf.org>
> 抄送: Yangshouchuan
> <yangshouchuan@huawei.com<mailto:yangshouchuan@huawei.com>>; Zhangwei
> (SS) <zhangwei70@huawei.com<mailto:zhangwei70@huawei.com>>
> 主题: pls clarify get operation
> 
> Hi all,
> In RFC6241, get operation is defined as:
> 7.7<https://tools.ietf.org/html/rfc6241#section-7.7>.  <get>
> 
>    Description:  Retrieve running configuration and device state
> 
>       information.
> This description is too simply, so I think it should be clarified.
> 
> The case is: a data node modelled by one yang can be configured by user, but also can be created/modified by system or other protocols. If client issues get operation to retrieve this node,
>           The data is created/modified by system or other protocols SHOULD be returned?
>           For example:
>           Rib can be configured by user and also can be created by routing protocols. In RFC 8349, the rib list is defined as:
> 
> 
> 
>       +--rw ribs
> 
>          +--rw rib* [name]
> 
>             +--rw name              string
> 
>             +--rw address-family?   identityref
> 
>             +--ro default-rib?      boolean {multiple-ribs}?
> 
>             +--ro routes
> 
>             |  +--ro route*
> 
>             |        ...
> 
>             +---x active-route
> 
>             |  +---w input
> 
>             |  |  +---w v4ur:destination-address?   inet:ipv4-address
> 
>             |  |  +---w v6ur:destination-address?   inet:ipv6-address
> 
>             |  +--ro output
> 
>             |        ...
> 
>             +--rw description?      string
> 
> 
> 
>        If client issued get operation to retrieve ribs from non-NMDA device, rib instance created by routing protocols should be returned?
> 
>        Another associated question: If client issued get-config operation from non-NMDA device, only user-controlled rib instance should be returned?
> 



> _______________________________________________
> netmod mailing list
> netmod@ietf.org
> https://www.ietf.org/mailman/listinfo/netmod


-- 
Juergen Schoenwaelder           Jacobs University Bremen gGmbH
Phone: +49 421 200 3587         Campus Ring 1 | 28759 Bremen | Germany
Fax:   +49 421 200 3103         <https://www.jacobs-university.de/>