Re: [netmod] 答复: pls clarify get operation

"Rob Wilton (rwilton)" <rwilton@cisco.com> Fri, 28 June 2019 09:35 UTC

Return-Path: <rwilton@cisco.com>
X-Original-To: netmod@ietfa.amsl.com
Delivered-To: netmod@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5EB5A1201D6; Fri, 28 Jun 2019 02:35:00 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.5
X-Spam-Level:
X-Spam-Status: No, score=-14.5 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=YB1f4GKY; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=0fqMch3p
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 58C_5-nHXg53; Fri, 28 Jun 2019 02:34:58 -0700 (PDT)
Received: from rcdn-iport-3.cisco.com (rcdn-iport-3.cisco.com [173.37.86.74]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2CDD9120111; Fri, 28 Jun 2019 02:34:58 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=12486; q=dns/txt; s=iport; t=1561714498; x=1562924098; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=5eRxw/y7HM/IMn5Hi4Xc+HyKG2m3xn254yvvCW9gIkw=; b=YB1f4GKYq6nGE+bzsBTzzlcqKloDl255lfSuGDX+4/1TfpYg33NT48Sg R4mTY55XB+Y98mTPSKLBvt/A2k0L13BwchZtydRilaYgyvdYlnqQgfGuf Tt5Vno/I0oGCPEPE2WHlR/aPC7hbUawBhGYMMCowenyWVDzlfD4VT0XIH w=;
IronPort-PHdr: 9a23:FBplJxfUw4t+AkBNLLp7uFiylGMj4e+mNxMJ6pchl7NFe7ii+JKnJkHE+PFxlwGRD57D5adCjOzb++D7VGoM7IzJkUhKcYcEFnpnwd4TgxRmBceEDUPhK/u/dTM7GNhFUndu/mqwNg5eH8OtL1A=
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0AGAAAM3xVd/5RdJa1jAxkBAQEBAQEBAQEBAQEHAQEBAQEBgVMEAQEBAQELAYFDKScDalUgBAsoCoQSg0cDhFKKCYJbfpZGgS4UgRADVAkBAQEMAQEYCwoCAQGDekYCF4JpIzQJDgEDAQEEAQECAQVtijcMhUoBAQEEAQEQEREMAQEsCwELAgICAQYCEAEBAwEBAQICIwMCAgIZDAsUAQIDAwgCBAENBQgTB4MBgWoDHQECDIsCkGACgTiIYHGBMoJ5AQEFhQwYghEJBYEHKAGLXheBQD+BEUaCFzU+gmEBAQIBgSsBCwcBIRUKCxuCQzKCJot0gmuFHpVEbAkCghaGU41AgiuHGI4egySKCYc4jByDSwIEAgQFAg4BAQWBUDhncXAVO4JsCYI4UlQBAoJIM4RhhT9yAYEojDQPF4ELAYEgAQE
X-IronPort-AV: E=Sophos;i="5.63,427,1557187200"; d="scan'208";a="572196303"
Received: from rcdn-core-12.cisco.com ([173.37.93.148]) by rcdn-iport-3.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 28 Jun 2019 09:34:42 +0000
Received: from XCH-ALN-019.cisco.com (xch-aln-019.cisco.com [173.36.7.29]) by rcdn-core-12.cisco.com (8.15.2/8.15.2) with ESMTPS id x5S9YgDu014438 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Fri, 28 Jun 2019 09:34:42 GMT
Received: from xhs-rtp-001.cisco.com (64.101.210.228) by XCH-ALN-019.cisco.com (173.36.7.29) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Fri, 28 Jun 2019 04:34:41 -0500
Received: from xhs-rtp-003.cisco.com (64.101.210.230) by xhs-rtp-001.cisco.com (64.101.210.228) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Fri, 28 Jun 2019 05:34:40 -0400
Received: from NAM03-BY2-obe.outbound.protection.outlook.com (64.101.32.56) by xhs-rtp-003.cisco.com (64.101.210.230) with Microsoft SMTP Server (TLS) id 15.0.1473.3 via Frontend Transport; Fri, 28 Jun 2019 05:34:40 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector2-cisco-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=5eRxw/y7HM/IMn5Hi4Xc+HyKG2m3xn254yvvCW9gIkw=; b=0fqMch3p/hifufVE4EhQwgnymudawizyhwBM4ixSuKvABaEn307H+jj1v6qWv7YPqyh7hwZYYBO5lR5Ma0Ek0inHE5SHdrEWZS24BmG07x3eGBNayES0RgnbySBgMoKCwOgnVt/gO81RpSAY2AAfsoZQIlPVzjollgfS5wK/ea8=
Received: from BYAPR11MB2631.namprd11.prod.outlook.com (52.135.227.28) by BYAPR11MB3846.namprd11.prod.outlook.com (20.178.239.206) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2032.17; Fri, 28 Jun 2019 09:34:39 +0000
Received: from BYAPR11MB2631.namprd11.prod.outlook.com ([fe80::ed99:b6a8:d6fb:5045]) by BYAPR11MB2631.namprd11.prod.outlook.com ([fe80::ed99:b6a8:d6fb:5045%4]) with mapi id 15.20.2008.018; Fri, 28 Jun 2019 09:34:39 +0000
From: "Rob Wilton (rwilton)" <rwilton@cisco.com>
To: "Fengchong (frank)" <frank.fengchong@huawei.com>, Juergen Schoenwaelder <j.schoenwaelder@jacobs-university.de>
CC: "netconf@ietf.org" <netconf@ietf.org>, "netmod@ietf.org" <netmod@ietf.org>, "Zhangwei (SS)" <zhangwei70@huawei.com>
Thread-Topic: 答复: [netmod] pls clarify get operation
Thread-Index: AdUsiu4JIzTUBFYNTIGSUYTtxnFLqwA1gt7QAApPi5AAARItAAAAl7IAAAByl4AAAFKOgAAAIX+Q
Date: Fri, 28 Jun 2019 09:34:38 +0000
Message-ID: <BYAPR11MB263161C43CCD6E383AC3679CB5FC0@BYAPR11MB2631.namprd11.prod.outlook.com>
References: <5756FB984666AD4BB8E1D63E2E3AA3D001ED5E20@dggemm513-mbx.china.huawei.com> <BYAPR11MB2631D3A01E398ADDBB294588B5FC0@BYAPR11MB2631.namprd11.prod.outlook.com> <20190628085014.ljxh73fcmiu6iqx7@anna.jacobs.jacobs-university.de> <5756FB984666AD4BB8E1D63E2E3AA3D001ED6082@dggemm513-mbx.china.huawei.com> <20190628092001.koixu7ea6dfew6k3@anna.jacobs.jacobs-university.de> <5756FB984666AD4BB8E1D63E2E3AA3D001ED60DE@dggemm513-mbx.china.huawei.com>
In-Reply-To: <5756FB984666AD4BB8E1D63E2E3AA3D001ED60DE@dggemm513-mbx.china.huawei.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=rwilton@cisco.com;
x-originating-ip: [173.38.220.34]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 14414746-6127-4601-ea6d-08d6fbabd75f
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600148)(711020)(4605104)(1401327)(2017052603328)(7193020); SRVR:BYAPR11MB3846;
x-ms-traffictypediagnostic: BYAPR11MB3846:
x-ms-exchange-purlcount: 4
x-microsoft-antispam-prvs: <BYAPR11MB384658942DCF4FE66B165629B5FC0@BYAPR11MB3846.namprd11.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-forefront-prvs: 00826B6158
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(39860400002)(366004)(346002)(136003)(376002)(396003)(199004)(189003)(51444003)(53754006)(13464003)(52536014)(66946007)(73956011)(6246003)(256004)(14444005)(5024004)(64756008)(66446008)(9686003)(54906003)(305945005)(76116006)(66476007)(66556008)(110136005)(74316002)(33656002)(316002)(6116002)(224303003)(3846002)(6306002)(2906002)(86362001)(6436002)(71190400001)(71200400001)(4326008)(76176011)(14454004)(486006)(53546011)(6506007)(26005)(446003)(66066001)(476003)(11346002)(966005)(25786009)(5660300002)(99286004)(186003)(102836004)(478600001)(7696005)(7736002)(53936002)(55016002)(68736007)(81156014)(8936002)(81166006)(229853002); DIR:OUT; SFP:1101; SCL:1; SRVR:BYAPR11MB3846; H:BYAPR11MB2631.namprd11.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1;
received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: SQHsWGLlzb6B8eiqNbSz6Ba052Jvm0b6KfnXEMHT/eh54rxAWmNVZbfC8C3CwxZXiKLaWGRRy3bwy3vz2clDBQvS6omrpv+IRSfh1sJo0odZ3XS58RuH+zdw3kyZ3YdvUrD+qSeNKShylcuxMVZwvR011kGvl0iw+StpTQrEWspeFJNp4PoJz77/IP4fZSG7nkxDT4/3oAK95piLCQMertM5y6BjTCwN4puYcc1KqetSNzu6PqTmUnHA7BT5NPnZdKURHn7F2Qa9Sq3Gr118vDyKHUBLQ7e9rhFCqX2bXYdgIvQn3iRuKNG/4BTM1hp5e0Mt3wp+MpTeZbyAqLDrBr0C0IChWcF8hdqvI+iZePJwaihGNcZ7qqOzQ7qqM1x36JberT+pR3bLs+KF2pf7OGBfThG7OrCiUdWIGXgtD3M=
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 14414746-6127-4601-ea6d-08d6fbabd75f
X-MS-Exchange-CrossTenant-originalarrivaltime: 28 Jun 2019 09:34:38.9071 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: rwilton@cisco.com
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR11MB3846
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.36.7.29, xch-aln-019.cisco.com
X-Outbound-Node: rcdn-core-12.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/netmod/VwrJe65YCQ4GSV0U967Gq5q01T8>
Subject: Re: [netmod] 答复: pls clarify get operation
X-BeenThere: netmod@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NETMOD WG list <netmod.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netmod>, <mailto:netmod-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netmod/>
List-Post: <mailto:netmod@ietf.org>
List-Help: <mailto:netmod-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netmod>, <mailto:netmod-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 28 Jun 2019 09:35:00 -0000

Hi Frank,

See my previous reply for an example of why this does not work.

<get-data> does not have this problem because it does not combine <running> and <operational> together.  Each <get-data> request acts on a single datastore.

Thanks,
Rob


-----Original Message-----
From: Fengchong (frank) <frank.fengchong@huawei.com> 
Sent: 28 June 2019 10:29
To: Juergen Schoenwaelder <j.schoenwaelder@jacobs-university.de>
Cc: Rob Wilton (rwilton) <rwilton@cisco.com>; netconf@ietf.org; netmod@ietf.org; Zhangwei (SS) <zhangwei70@huawei.com>
Subject: 答复: 答复: [netmod] pls clarify get operation

--- Data elements with the same key can be different in <running> and <operational> and merging them together simply does not work.

Frank: why? If it does not work, I think it also does not work when we use <get-data> operation.
-----邮件原件-----
发件人: Juergen Schoenwaelder [mailto:j.schoenwaelder@jacobs-university.de]
发送时间: 2019年6月28日 17:20
收件人: Fengchong (frank) <frank.fengchong@huawei.com>
抄送: Rob Wilton (rwilton) <rwilton@cisco.com>; netconf@ietf.org; netmod@ietf.org; Zhangwei (SS) <zhangwei70@huawei.com>
主题: Re: 答复: [netmod] pls clarify get operation

The <get> operation has limitations. Data elements with the same key can be different in <running> and <operational> and merging them together simply does not work. The workaround is to duplicate data models or to move to NMDA.  NMDA may seem initially costly but is getting cheaper the larger your collection of data models grows.

/js

On Fri, Jun 28, 2019 at 09:07:12AM +0000, Fengchong (frank) wrote:
> Should we change the definition of get operation? Like this, get operation can retrieve all running operational data including running configuration, system configuration.
> Otherwise, we have no way to get the information of system-controlled data according a NMDA-style YANG module(because has no config false copy ) unless we implement NMDA.
> -----邮件原件-----
> 发件人: Juergen Schoenwaelder
> [mailto:j.schoenwaelder@jacobs-university.de]
> 发送时间: 2019年6月28日 16:50
> 收件人: Rob Wilton (rwilton) <rwilton@cisco.com>
> 抄送: Fengchong (frank) <frank.fengchong@huawei.com>; netconf@ietf.org; 
> netmod@ietf.org; Zhangwei (SS) <zhangwei70@huawei.com>
> 主题: Re: [netmod] pls clarify get operation
> 
> Yes, both the NETCONF <get> operation and the RESTCONF GET on the unified view of the underlying datastores have limitations and a solution in situations where these limitations hurt is to move towards NMDA.
> 
> /js
> 
> On Fri, Jun 28, 2019 at 08:38:38AM +0000, Rob Wilton (rwilton) wrote:
> > Hi Frank,
> > 
> > Pre NMDA:
> > 
> >   *   You have a the <running> datastore, along with some others like <candidate> and <startup> that you can ignore for the purposes of this discussion.
> >   *   The <running> datastore can only contains data for schema nodes that are marked as “config true” in YANG (i.e. “rw” in your tree output below).
> >   *   The system may also have some operational state data that is marked as “config false” in YANG (i.e. “ro” in your tree output below).
> > 
> > The NETCONF <get-config> operation returns the contents of the <running> datastore.
> > The NETCONF <get> operation returns the contents of the <running> datastore combined with all the operational state as well.  Filters can be applied to return a subset of the data.
> > 
> > Regarding your question about user created configuration vs system created configuration, it depends on whether the devices instantiates the configuration in <running> or not.  If it does, then it would be returned in <get> and <get-config> operations.  If it doesn’t then it would not.  Different vendors/devices will likely implement this in different ways.
> > 
> > Generally, I think that <running> should only contain the configuration explicitly configured by the operator’s systems.  But this means that there isn’t a clean way to represent system created configuration or applied configuration, unless you make a config false copy of every config true node in YANG.  This is approach that was taken by the original IETF YANG models (e.g. RFC 7223) before they were superseded by NMDA, and also the OpenConfig YANG models (but using a different structure – which also struggles to cleanly represent system created configuration data).
> > 
> > The NMDA architecture was written to solve this problem in a clean way without requiring duplication in the YANG data models.
> > 
> > Hopefully this helps clarify.
> > 
> > Thanks,
> > Rob
> > 
> > 
> > From: netmod <netmod-bounces@ietf.org> On Behalf Of Fengchong
> > (frank)
> > Sent: 28 June 2019 04:29
> > To: netconf@ietf.org; netmod@ietf.org
> > Cc: Zhangwei (SS) <zhangwei70@huawei.com>
> > Subject: [netmod] 答复: pls clarify get operation
> > 
> > Hi all,
> > 
> >      Pls clarify this question. I have been confused for a long time.
> > 
> > ________________________________
> > 华为技术有限公司 Huawei Technologies Co., Ltd.
> > [Company_logo]
> > 个人签名:冯冲
> > 手  机:13776612983
> > 电子邮件:frank.fengchong@huawei.com<mailto:frank.fengchong@huawei.com>
> > 公司网址:www.huawei.com<http://www.huawei.com>
> > ________________________________
> >  本邮件及其附件含有华为公司的保密信息,仅限于发送给上面地址中列出的个人或群组。禁
> > 止任何其他人以任何形式使用(包括但不限于全部或部分地泄露、复制、或散发)本邮件中
> > 的信息。如果您错收了本邮件,请您立即电话或邮件通知发件人并删除本邮件!
> > This e-mail and its attachments contain confidential information 
> > from HUAWEI, which is intended only for the person or entity whose 
> > address is listed above. Any use of the information contained herein 
> > in any way (including, but not limited to, total or partial 
> > disclosure, reproduction, or dissemination) by persons other than 
> > the intended
> > recipient(s) is prohibited. If you receive this e-mail in error, 
> > please notify the sender by phone or email immediately and delete it!
> > 
> > 发件人: Fengchong (frank)
> > 发送时间: 2019年6月27日 9:59
> > 收件人: 'netconf@ietf.org' <netconf@ietf.org<mailto:netconf@ietf.org>>;
> > netmod@ietf.org<mailto:netmod@ietf.org>
> > 抄送: Yangshouchuan
> > <yangshouchuan@huawei.com<mailto:yangshouchuan@huawei.com>>;
> > Zhangwei
> > (SS) <zhangwei70@huawei.com<mailto:zhangwei70@huawei.com>>
> > 主题: pls clarify get operation
> > 
> > Hi all,
> > In RFC6241, get operation is defined as:
> > 7.7<https://tools.ietf.org/html/rfc6241#section-7.7>.  <get>
> > 
> >    Description:  Retrieve running configuration and device state
> > 
> >       information.
> > This description is too simply, so I think it should be clarified.
> > 
> > The case is: a data node modelled by one yang can be configured by user, but also can be created/modified by system or other protocols. If client issues get operation to retrieve this node,
> >           The data is created/modified by system or other protocols SHOULD be returned?
> >           For example:
> >           Rib can be configured by user and also can be created by routing protocols. In RFC 8349, the rib list is defined as:
> > 
> > 
> > 
> >       +--rw ribs
> > 
> >          +--rw rib* [name]
> > 
> >             +--rw name              string
> > 
> >             +--rw address-family?   identityref
> > 
> >             +--ro default-rib?      boolean {multiple-ribs}?
> > 
> >             +--ro routes
> > 
> >             |  +--ro route*
> > 
> >             |        ...
> > 
> >             +---x active-route
> > 
> >             |  +---w input
> > 
> >             |  |  +---w v4ur:destination-address?   inet:ipv4-address
> > 
> >             |  |  +---w v6ur:destination-address?   inet:ipv6-address
> > 
> >             |  +--ro output
> > 
> >             |        ...
> > 
> >             +--rw description?      string
> > 
> > 
> > 
> >        If client issued get operation to retrieve ribs from non-NMDA device, rib instance created by routing protocols should be returned?
> > 
> >        Another associated question: If client issued get-config operation from non-NMDA device, only user-controlled rib instance should be returned?
> > 
> 
> 
> 
> > _______________________________________________
> > netmod mailing list
> > netmod@ietf.org
> > https://www.ietf.org/mailman/listinfo/netmod
> 
> 
> -- 
> Juergen Schoenwaelder           Jacobs University Bremen gGmbH
> Phone: +49 421 200 3587         Campus Ring 1 | 28759 Bremen | Germany
> Fax:   +49 421 200 3103         <https://www.jacobs-university.de/>

-- 
Juergen Schoenwaelder           Jacobs University Bremen gGmbH
Phone: +49 421 200 3587         Campus Ring 1 | 28759 Bremen | Germany
Fax:   +49 421 200 3103         <https://www.jacobs-university.de/>