Re: [netmod] xpath expressions in JSON
Ladislav Lhotka <lhotka@nic.cz> Tue, 23 October 2018 07:37 UTC
Return-Path: <lhotka@nic.cz>
X-Original-To: netmod@ietfa.amsl.com
Delivered-To: netmod@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D8180130EF1 for <netmod@ietfa.amsl.com>; Tue, 23 Oct 2018 00:37:07 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level:
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id tGGlBz5YNTZc for <netmod@ietfa.amsl.com>; Tue, 23 Oct 2018 00:37:00 -0700 (PDT)
Received: from trail.lhotka.name (trail.lhotka.name [77.48.224.143]) by ietfa.amsl.com (Postfix) with ESMTP id 19A29130EEF for <netmod@ietf.org>; Tue, 23 Oct 2018 00:37:00 -0700 (PDT)
Received: by trail.lhotka.name (Postfix, from userid 109) id 70D89182113A; Tue, 23 Oct 2018 09:44:21 +0200 (CEST)
Received: from localhost (unknown [195.113.220.121]) by trail.lhotka.name (Postfix) with ESMTPSA id 802AF1820053; Tue, 23 Oct 2018 09:44:19 +0200 (CEST)
From: Ladislav Lhotka <lhotka@nic.cz>
To: Martin Bjorklund <mbj@tail-f.com>, bill.wu@huawei.com
Cc: netmod@ietf.org
In-Reply-To: <20181023.084254.2257754077098127031.mbj@tail-f.com>
References: <20181022.145605.1533686864301630023.mbj@tail-f.com> <c65c0eaf9054242c5378f50c001789a84b3007c2.camel@nic.cz> <B8F9A780D330094D99AF023C5877DABA9B0BC6A0@nkgeml513-mbx.china.huawei.com> <20181023.084254.2257754077098127031.mbj@tail-f.com>
Mail-Followup-To: Martin Bjorklund <mbj@tail-f.com>, bill.wu@huawei.com, netmod@ietf.org
Date: Tue, 23 Oct 2018 09:36:55 +0200
Message-ID: <87d0s1azc8.fsf@nic.cz>
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: <https://mailarchive.ietf.org/arch/msg/netmod/mYMNu8c63xa1YHYbXcywRXSFpQc>
Subject: Re: [netmod] xpath expressions in JSON
X-BeenThere: netmod@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NETMOD WG list <netmod.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netmod>, <mailto:netmod-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netmod/>
List-Post: <mailto:netmod@ietf.org>
List-Help: <mailto:netmod-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netmod>, <mailto:netmod-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 23 Oct 2018 07:37:08 -0000
Martin Bjorklund <mbj@tail-f.com> writes: > Qin Wu <bill.wu@huawei.com> wrote: >> -----邮件原件----- >> 发件人: netmod [mailto:netmod-bounces@ietf.org] 代表 Ladislav Lhotka >> 发送时间: 2018年10月22日 21:12 >> 收件人: Martin Bjorklund >> 抄送: netmod@ietf.org >> 主题: Re: [netmod] xpath expressions in JSON >> >> On Mon, 2018-10-22 at 14:56 +0200, Martin Bjorklund wrote: >> > Ladislav Lhotka <lhotka@nic.cz> wrote: >> > > Martin Bjorklund <mbj@tail-f.com> writes: >> > > >> > > > Hi, >> > > > >> > > > Going back to the most urgent issue, what is this WG's >> > > > recommendation for the subscribed-notifications draft in NETCONF >> > > > wrt/ their usage of >> > > > yang:xpath1.0 in filters? >> > > > >> > > > To summarize: >> > > > >> > > > We already have >> > > > >> > > > o instance-identifier in XML uses prefixes from the XML document >> > > > o instance-identifier in JSON uses module names as prefixes >> > > > o XPath in NETCONF filter uses prefixes from the XML document >> > > > o XPath in JSON query filter uses module names as prefixes >> > > > >> > > > >> > > > Alternative A: >> > > > -------------- >> > > > >> > > > Use different encodings for "stream-xpath-filter" as well, >> > > > depending on if it is XML or JSON. >> > > > >> > > > We would do in SN: >> > > > >> > > > o If the node is encoded in XML, the set of namespace >> > > > declarations are those in scope on the >> > > > 'stream-xpath-filter' leaf element. >> > > > >> > > > o If the node is encoded in JSON, the set of namespace >> > > > declarations is the set of prefix and namespace pairs >> > > > for all supported YANG modules, where the prefix is >> > > >> > > Is "supported" the same as "implemented", or something else? >> > >> > It should be "implemented". >> > >> > > > the YANG module name and the namespace is as defined >> > > > by the "namespace" statement in the YANG module. >> > > > >> > > > Pro: the format is consistent within each encoding. >> > > > >> > > > Con: unclear how to handle other encodings. >> > > > Con: we keep using context-depending encodings. >> > > >> > > Con: XPath expressions in JSON can get pretty long (I assume it's not >> > > just an instance identifier but may contain predicates etc.). We >> > > cannot use the trick with the default namespace as in YANG, so all >> > > data node names will have to carry the prefix. >> > >> > Yes. >> > >> > > > We could probably add that CBOR uses the same representation as JSON. >> > > > >> > > > Example in XML: >> > > > >> > > > <stream-xpath-filter >> > > > xmlns:if="urn:ietf:params:xml:ns:yang:ietf-interfaces" >> > > > xmlns:ip="urn:ietf:params:xml:ns:yang:ietf-ip"> >> > > > /if:interfaces/if:interface/ip:ipv4 >> > > > </stream-xpath-filter> >> > > > >> > > > Example in JSON: >> > > > >> > > > "stream-xpath-filter": >> > > > "/ietf-interfaces:interfaces/ietf-interfaces:interface/ietf-ip:ipv4" >> > > > >> > > > >> > > > >> > > > Alternative B: >> > > > -------------- >> > > > >> > > > Use a non-context depending encoding, with the module name as prefix. >> > > > >> > > > We would do in SN: >> > > > >> > > > o The set of namespace >> > > > declarations is the set of prefix and namespace pairs >> > > > for all supported YANG modules, where the prefix is >> > > > the YANG module name and the namespace is as defined >> > > > by the "namespace" statement in the YANG module. >> > > > >> > > > Pro: the format is independent from the protocol encoding >> > > > >> > > > Con: in XML, this leaf is treated differently from other XPath >> > > > expressions, such as get-config filter and nacm rules. >> > > > >> > > > Example in XML: >> > > > >> > > > <stream-xpath-filter> >> > > > /ietf-interfaces:interfaces/ietf-interfaces:interface/ietf-ip:ipv4 >> > > > </stream-xpath-filter> >> > > > >> > > > Example in JSON: >> > > > >> > > > "stream-xpath-filter": >> > > > "/ietf-interfaces:interfaces/ietf-interfaces:interface/ietf-ip:ipv4" >> > > > >> > > > >> > > > My proposal is A. I think it is more important with consistency >> > > > within each encoding than across encodings. >> > > >> > > I would suggest to consider declaring prefixes & namespaces >> > > explicitly in the data, as in the schema mount document. It is >> > > independent of encoding and the expressions can be kept short. In >> > > fact, one of the namespaces can be declared as default, so this use >> > > of XPath would then be very similar to YANG. >> > >> > Ok, so this is another alternative that works today, and achieves the >> > goal of being encoding-independent. It is still context-dependent >> > though. >> >> Yes, every module that uses XPath in data will have to deal with this. There may potentially be multiple independent prefix declarations (this is actually a con). >> >> > >> > BTW, when used in filters, it is nice to let an unprefixed name to >> > match any namespace; i.e., treat "foo" as syntactic sugar for >> > "local-name(.) = 'foo'". ("*:foo" is not legal...) >> >> Hmm, I think this is a bad idea because it departs even further from the original XPath semantics. Such chameleon names should IMO be pretty rare, and if they are needed, local-name() is always available. >> >> [Qin]: Agree with Lada, Referencing RFC8407, section 4.6.2, I think the below guideline is relevant. >> " >> The "local-name" function SHOULD NOT be used to reference local names >> outside of the YANG module that defines the must or when expression >> containing the "local-name" function. Example of a "local-name" >> function that should not be used: >> >> /*[local-name()='foo'] > > This guideline is for must/when expressions *within* YANG modules. > > I'm talking about a different use case, namely filtering. It is > pretty convenient for users to send a filter: > > /interfaces/interface[name='eth0'/ipv4 This is impossible if we want to call it XPath. With an explicit namespace/prefix declaration, for example "namespace": [ { "prefix": "if", "uri": "urn:ietf:params:xml:ns:yang:ietf-interfaces", "default": true }, { "prefix": "ip", "uri": "urn:ietf:params:xml:ns:yang:ietf-ip" } ] it would be /interfaces/interface[name='eth0']/ip:ipv4 which is not too bad either. Lada > > and get back what they expect. Even in the rare case of local name > clashes, this filter works and gives back what was expected (+ > additional nodes). > > I have no plans on writing up this as a proposal; I'm just pointing > out that when XPath is used in filters, this is convenient. > > > /martin -- Ladislav Lhotka Head, CZ.NIC Labs PGP Key ID: 0xB8F92B08A9F76C67
- [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Reshad Rahman (rrahman)
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Qin Wu
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Vladimir Vassilev
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Vladimir Vassilev
- Re: [netmod] xpath expressions in JSON Vladimir Vassilev
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Reshad Rahman (rrahman)
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Reshad Rahman (rrahman)
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Reshad Rahman (rrahman)
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Vladimir Vassilev
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Reshad Rahman (rrahman)
- Re: [netmod] xpath expressions in JSON Vladimir Vassilev
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Juergen Schoenwaelder
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Juergen Schoenwaelder
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Qin Wu
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Juergen Schoenwaelder
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Juergen Schoenwaelder
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Juergen Schoenwaelder
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Kent Watsen