Re: [netmod] OpsState Direction Impact on Recommended IETF YANG Model Structure

"Xufeng Liu" <xufeng.liu.ietf@gmail.com> Wed, 27 July 2016 18:22 UTC

Return-Path: <xufeng.liu.ietf@gmail.com>
X-Original-To: netmod@ietfa.amsl.com
Delivered-To: netmod@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3751F12D1BC for <netmod@ietfa.amsl.com>; Wed, 27 Jul 2016 11:22:39 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.689
X-Spam-Level:
X-Spam-Status: No, score=-2.689 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001, T_KAM_HTML_FONT_INVALID=0.01] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id SvYKZ9hP_eW0 for <netmod@ietfa.amsl.com>; Wed, 27 Jul 2016 11:22:37 -0700 (PDT)
Received: from mail-lf0-x230.google.com (mail-lf0-x230.google.com [IPv6:2a00:1450:4010:c07::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 518D412D1BB for <netmod@ietf.org>; Wed, 27 Jul 2016 11:22:36 -0700 (PDT)
Received: by mail-lf0-x230.google.com with SMTP id g62so33192692lfe.3 for <netmod@ietf.org>; Wed, 27 Jul 2016 11:22:36 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:to:references:in-reply-to:subject:date:message-id:mime-version :thread-index:content-language; bh=ZHWZGXIOufZQavwKUmP5aoTj9fMgGoApxNS37hzjAVk=; b=tvwQIAQNhJ3zEUfo54Uwl6TUckVgP/i9OXXplqSLZcLUrYikbyM6W1t0EjeKDtaWUx 7ZVD+1Wd8XFAXV4XCYeY904GdWqkBr4OonXrVT83UNJdD8HHOg2f11+1UcB0/jsu752G pL2/+de7zeIcbVHELxKtPqvyagkXOmUpUNLyyW/VQ1CZrxR7Y8C1F67ookCD8lpOyU9s eeDQq7H+IqTBsNpIdFMQkVYfvglcIL3Q4zcx+FUNidUpiA0bXXOLX7HIy6TbHcFAjb4Z KdHKsuLDCrP5HfsXgSztmYTtflHoLNZaU1w7nxqvLqPMdpJ3IXZ96Ww84Txr/qpfC174 DBfA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:to:references:in-reply-to:subject:date :message-id:mime-version:thread-index:content-language; bh=ZHWZGXIOufZQavwKUmP5aoTj9fMgGoApxNS37hzjAVk=; b=L4/Hsyq/U9O7qJ5gMg6HPpy+NistjoDbHlYOLuSs+Dverf/Um5+v4G9R/TtLwm4T5x xrMh4xZC03pIvauKPCIS+2YvhOeY9FmDrsaI9KSjCh2WAOShz+Lb4X5NlRb25W8nzLB5 j2Wgjhz51WI0aajWkS4ZZuE30yphoM06g4p2nL6Ivg0rFLwR/CRY9ip4eRPa/pbs3whr 8bFM3nKctBasAq33AfMs0GWlTLEsVl7BLhOg5bZavvRPO2S2eAUSSZcq1G6gNRF5cWbb 9IXJ64wtSL0S9ROg/uLASuNXGhRnxqfT3H2aN/HtTbTKPrNtrDZra8JWoGK03UnMfhQ5 LW7g==
X-Gm-Message-State: AEkoouuqlwLtiebgAhjn1IrH9JJO1dIMGns+l9KVLVdCtwhf1troCERVsHU+TxQLhCrRKA==
X-Received: by 10.46.1.162 with SMTP id f34mr11155301lji.22.1469643754474; Wed, 27 Jul 2016 11:22:34 -0700 (PDT)
Received: from xliuus (wsip-98-191-72-170.dc.dc.cox.net. [98.191.72.170]) by smtp.gmail.com with ESMTPSA id 136sm1205263ljj.0.2016.07.27.11.22.32 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 27 Jul 2016 11:22:33 -0700 (PDT)
From: Xufeng Liu <xufeng.liu.ietf@gmail.com>
To: 'Robert Wilton' <rwilton@cisco.com>, 'Kent Watsen' <kwatsen@juniper.net>, 'netmod WG' <netmod@ietf.org>
References: <D3A935F0.6A4DC%acee@cisco.com> <eb15fd23-2c0a-50c4-1ebc-7c0e4867dfd8@cisco.com> <20160721174033.GB54646@elstar.local> <d18f5dd0-64d0-e223-88a9-faa4df4b7866@cisco.com> <DCB3EBBF-5EB1-4C8E-AA55-F59C4B5A8E4D@juniper.net> <bed9398c-0e6a-450e-d2ac-b381b6bebf87@cisco.com> <5296754B-8178-4B1B-B4A6-FE228ABB8E7F@juniper.net> <9367f4b1-7814-e175-32e8-d518438b841d@cisco.com>
In-Reply-To: <9367f4b1-7814-e175-32e8-d518438b841d@cisco.com>
Date: Wed, 27 Jul 2016 14:22:30 -0400
Message-ID: <044701d1e833$d7ec0380$87c40a80$@gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="----=_NextPart_000_0448_01D1E812.50DA6380"
X-Mailer: Microsoft Outlook 16.0
Thread-Index: AQEBF8iMQfbRFcZwNG9L6nB4vEZAEgJJ+p6NAhyU320B/nMjcgI3H0tOAykuHswBf4yxYgLIvBs2oU3K9IA=
Content-Language: en-us
Archived-At: <https://mailarchive.ietf.org/arch/msg/netmod/kkvpDqE3JtMgP6tNWhcPdqEuhzo>
Subject: Re: [netmod] OpsState Direction Impact on Recommended IETF YANG Model Structure
X-BeenThere: netmod@ietf.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: NETMOD WG list <netmod.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netmod>, <mailto:netmod-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netmod/>
List-Post: <mailto:netmod@ietf.org>
List-Help: <mailto:netmod-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netmod>, <mailto:netmod-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 27 Jul 2016 18:22:39 -0000

The assumption of “I suspect that all the routing models will be structured similarly” is not correct. Very few models in routing area structure this way.

 

Regards,

 

- Xufeng

 

From: netmod [mailto:netmod-bounces@ietf.org] On Behalf Of Robert Wilton
Sent: Wednesday, July 27, 2016 1:05 PM
To: Kent Watsen <kwatsen@juniper.net>; netmod WG <netmod@ietf.org>
Subject: Re: [netmod] OpsState Direction Impact on Recommended IETF YANG Model Structure

 

 

 

On 26/07/2016 21:36, Kent Watsen wrote:

 

<Rob Wilton writes>


So my thinking is that if we can't merge "foo-state" into "foo" then instead we should have consistent rules that explicitly state that for all IETF models "foo" and "foo-state" are separate trees with a consistent naming convention and structure.  That should hopefully allow tooling to programmatically relate the two separate trees together.  It may give a path to allow "foo-state" to be merged into "foo" in future, but once IETF has standardized 600+ models with separate sub-trees, I cannot see that they would get merged back together again.

What other alternatives are available?  As a WG we need to tell the other WGs how the IETF YANG models should be structured.

In short, unfortunately I think that we have probably already missed the opportunity to merge "foo" and "foo-state" subtrees together ...




</Rob Wilton>

 

 

Firstly, I’m trying to get a sense of how big a problem this foo/foo-state thing is.  [Note: by foo-state, I’m only referring to counters, not opstate].

RW:
By counters, I think that we also mean any config false nodes that don't directly represent "applied configuration", right?  E.g. is an interface operationally up or down.




   I know about RFC 7223, which was done out of consideration for system-generated interfaces, but how many other such models are there envisioned to be?

RW:
- Any models that augment RFC 7223 and have config false nodes will be impacted.
- I thought that quite a lot of other IETF models that are in the process of being standardized have a top level split between "foo" and "foo-state".  E.g the ISIS model (draft-ietf-isis-yang-isis-cfg-08) has this split.  I suspect that all the routing models will be structured similarly.
- Although it is perhaps worth pointing out that I think that the OpenConfig modules effectively have exactly this same issue (e.g. they have a combined interfaces tree keyed by config true leaves), and they pragmatically just ignore the issue of system created interface entries.




 Is this issue currently blocking models from progressing, or are we getting ourselves wrapped around a hypothetical?

RW:
I think that it is blocking models from progressing.

The current guidance for "intended vs applied" is clear.  I.e. there must not be "config false" leaves in the IETF YANG data models to represent "applied config".

But there is no clear guidance for the rest of operational state that isn't applied config.  The other WGs need clear guidance (effectively now) to ensure that they can start publishing models as RFCs.





  If RFC 7223 is an outlier, then we can address it as a special case (perhaps via the related-state/related-config YANG annotations).  What do you think?

RW:
Personally, I would like one common convention that applies to all IETF YANG models.

Idealistically I would like foo and foo-state to be merged because I think that will make the models easier to use and maintain in the long term, but I don't know if we are just too late to go in that direction.  It seems to me that the NETMOD WG really should try to come to a decision quite quickly on this, but I don't know how to encourage that.  A virtual interim on just this topic perhaps?




 

Next, regarding paths forward (assuming 7223 is not an outlier), I’m thinking the opposite.  I’m quite sure that we would never merge the 600+ models with separate subtrees back together again.  So I’m thinking we immediately merge foo and foo-state in all active YANG models (so that the YANG “conceptual” models are stable and good) *and* then we use your idea to programmatically generate the “foo-state” tree, presumably only when needed.  This foo-state tree could be generated offline by tools and provided as a second YANG module in drafts.  In this way, servers (opstate aware or not) can advertise if clients can access the foo-state tree (an opstate-aware server may still advertise it for business reasons, and it can ‘deprecate’ the tree when no longer needed).   We could do the same without tools today by just using a feature statement on, for instance, the interfaces-state container, but I like pushing for tooling upfront so that we’re guaranteed mergeability later.  Thoughts?

RW:
So the generated "foo-state" tree would contain a copy of all config false nodes in the YANG schema and a "config false copy" of any config true nodes in the YANG schema that are required to provide parental structure for the descendant config false nodes.
- The Xpath expressions would also need to be adjusted, and possibly some of those might break (or need to be fixed by hand).
- Groupings might be a problem, but potentially they could be expanded.

Technically this solution might work, but is it possible to get everyone to agree that this is the right direction to go in before we spend time on this?

Thanks,
Rob





 

Kent // as a contributor