Re: [netmod] xpath expressions in JSON

Ladislav Lhotka <lhotka@nic.cz> Tue, 23 October 2018 07:37 UTC

Return-Path: <lhotka@nic.cz>
X-Original-To: netmod@ietfa.amsl.com
Delivered-To: netmod@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D8180130EF1 for <netmod@ietfa.amsl.com>; Tue, 23 Oct 2018 00:37:07 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level:
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id tGGlBz5YNTZc for <netmod@ietfa.amsl.com>; Tue, 23 Oct 2018 00:37:00 -0700 (PDT)
Received: from trail.lhotka.name (trail.lhotka.name [77.48.224.143]) by ietfa.amsl.com (Postfix) with ESMTP id 19A29130EEF for <netmod@ietf.org>; Tue, 23 Oct 2018 00:37:00 -0700 (PDT)
Received: by trail.lhotka.name (Postfix, from userid 109) id 70D89182113A; Tue, 23 Oct 2018 09:44:21 +0200 (CEST)
Received: from localhost (unknown [195.113.220.121]) by trail.lhotka.name (Postfix) with ESMTPSA id 802AF1820053; Tue, 23 Oct 2018 09:44:19 +0200 (CEST)
From: Ladislav Lhotka <lhotka@nic.cz>
To: Martin Bjorklund <mbj@tail-f.com>, bill.wu@huawei.com
Cc: netmod@ietf.org
In-Reply-To: <20181023.084254.2257754077098127031.mbj@tail-f.com>
References: <20181022.145605.1533686864301630023.mbj@tail-f.com> <c65c0eaf9054242c5378f50c001789a84b3007c2.camel@nic.cz> <B8F9A780D330094D99AF023C5877DABA9B0BC6A0@nkgeml513-mbx.china.huawei.com> <20181023.084254.2257754077098127031.mbj@tail-f.com>
Mail-Followup-To: Martin Bjorklund <mbj@tail-f.com>, bill.wu@huawei.com, netmod@ietf.org
Date: Tue, 23 Oct 2018 09:36:55 +0200
Message-ID: <87d0s1azc8.fsf@nic.cz>
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: <https://mailarchive.ietf.org/arch/msg/netmod/mYMNu8c63xa1YHYbXcywRXSFpQc>
Subject: Re: [netmod] xpath expressions in JSON
X-BeenThere: netmod@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NETMOD WG list <netmod.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netmod>, <mailto:netmod-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netmod/>
List-Post: <mailto:netmod@ietf.org>
List-Help: <mailto:netmod-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netmod>, <mailto:netmod-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 23 Oct 2018 07:37:08 -0000

Martin Bjorklund <mbj@tail-f.com> writes:

> Qin Wu <bill.wu@huawei.com> wrote:
>> -----邮件原件-----
>> 发件人: netmod [mailto:netmod-bounces@ietf.org] 代表 Ladislav Lhotka
>> 发送时间: 2018年10月22日 21:12
>> 收件人: Martin Bjorklund
>> 抄送: netmod@ietf.org
>> 主题: Re: [netmod] xpath expressions in JSON
>> 
>> On Mon, 2018-10-22 at 14:56 +0200, Martin Bjorklund wrote:
>> > Ladislav Lhotka <lhotka@nic.cz> wrote:
>> > > Martin Bjorklund <mbj@tail-f.com> writes:
>> > > 
>> > > > Hi,
>> > > >
>> > > > Going back to the most urgent issue, what is this WG's 
>> > > > recommendation for the subscribed-notifications draft in NETCONF 
>> > > > wrt/ their usage of
>> > > > yang:xpath1.0 in filters?
>> > > >
>> > > > To summarize:
>> > > >
>> > > > We already have
>> > > >
>> > > >   o  instance-identifier in XML uses prefixes from the XML document
>> > > >   o  instance-identifier in JSON uses module names as prefixes
>> > > >   o  XPath in NETCONF filter uses prefixes from the XML document
>> > > >   o  XPath in JSON query filter uses module names as prefixes
>> > > >
>> > > >
>> > > > Alternative A:
>> > > > --------------
>> > > >
>> > > > Use different encodings for "stream-xpath-filter" as well, 
>> > > > depending on if it is XML or JSON.
>> > > >
>> > > > We would do in SN:
>> > > >
>> > > >     o  If the node is encoded in XML, the set of namespace
>> > > >        declarations are those in scope on the
>> > > >        'stream-xpath-filter' leaf element.
>> > > >
>> > > >     o  If the node is encoded in JSON, the set of namespace
>> > > >        declarations is the set of prefix and namespace pairs
>> > > >        for all supported YANG modules, where the prefix is
>> > > 
>> > > Is "supported" the same as "implemented", or something else?
>> > 
>> > It should be "implemented".
>> > 
>> > > >        the YANG module name and the namespace is as defined
>> > > >        by the "namespace" statement in the YANG module.
>> > > >
>> > > > Pro: the format is consistent within each encoding.
>> > > >
>> > > > Con: unclear how to handle other encodings.
>> > > > Con: we keep using context-depending encodings.
>> > > 
>> > >   Con: XPath expressions in JSON can get pretty long (I assume it's not
>> > >   just an instance identifier but may contain predicates etc.). We
>> > >   cannot use the trick with the default namespace as in YANG, so all
>> > >   data node names will have to carry the prefix.
>> > 
>> > Yes.
>> > 
>> > > > We could probably add that CBOR uses the same representation as JSON.
>> > > >
>> > > > Example in XML:
>> > > >
>> > > >   <stream-xpath-filter
>> > > >       xmlns:if="urn:ietf:params:xml:ns:yang:ietf-interfaces"
>> > > >       xmlns:ip="urn:ietf:params:xml:ns:yang:ietf-ip">
>> > > >     /if:interfaces/if:interface/ip:ipv4
>> > > >   </stream-xpath-filter>
>> > > >
>> > > > Example in JSON:
>> > > >
>> > > >   "stream-xpath-filter":
>> > > >     "/ietf-interfaces:interfaces/ietf-interfaces:interface/ietf-ip:ipv4"
>> > > >
>> > > >
>> > > >
>> > > > Alternative B:
>> > > > --------------
>> > > >
>> > > > Use a non-context depending encoding, with the module name as prefix.
>> > > >
>> > > > We would do in SN:
>> > > >
>> > > >     o  The set of namespace
>> > > >        declarations is the set of prefix and namespace pairs
>> > > >        for all supported YANG modules, where the prefix is
>> > > >        the YANG module name and the namespace is as defined
>> > > >        by the "namespace" statement in the YANG module.
>> > > >
>> > > > Pro: the format is independent from the protocol encoding
>> > > >
>> > > > Con: in XML, this leaf is treated differently from other XPath
>> > > >      expressions, such as get-config filter and nacm rules.
>> > > >
>> > > > Example in XML:
>> > > >
>> > > >   <stream-xpath-filter>
>> > > >     /ietf-interfaces:interfaces/ietf-interfaces:interface/ietf-ip:ipv4
>> > > >   </stream-xpath-filter>
>> > > >
>> > > > Example in JSON:
>> > > >
>> > > >   "stream-xpath-filter":
>> > > >     "/ietf-interfaces:interfaces/ietf-interfaces:interface/ietf-ip:ipv4"
>> > > >
>> > > >
>> > > > My proposal is A.  I think it is more important with consistency 
>> > > > within each encoding than across encodings.
>> > > 
>> > > I would suggest to consider declaring prefixes & namespaces 
>> > > explicitly in the data, as in the schema mount document. It is 
>> > > independent of encoding and the expressions can be kept short. In 
>> > > fact, one of the namespaces can be declared as default, so this use 
>> > > of XPath would then be very similar to YANG.
>> > 
>> > Ok, so this is another alternative that works today, and achieves the 
>> > goal of being encoding-independent.  It is still context-dependent 
>> > though.
>> 
>> Yes, every module that uses XPath in data will have to deal with this. There may potentially be multiple independent prefix declarations (this is actually a con). 
>> 
>> > 
>> > BTW, when used in filters, it is nice to let an unprefixed name to 
>> > match any namespace; i.e., treat "foo" as syntactic sugar for
>> > "local-name(.) = 'foo'".  ("*:foo" is not legal...)
>> 
>> Hmm, I think this is a bad idea because it departs even further from the original XPath semantics. Such chameleon names should IMO be pretty rare, and if they are needed, local-name() is always available.
>> 
>> [Qin]: Agree with Lada, Referencing RFC8407, section 4.6.2, I think the below guideline is relevant.
>> "
>> The "local-name" function SHOULD NOT be used to reference local names
>>    outside of the YANG module that defines the must or when expression
>>    containing the "local-name" function.  Example of a "local-name"
>>    function that should not be used:
>> 
>>       /*[local-name()='foo']
>
> This guideline is for must/when expressions *within* YANG modules.
>
> I'm talking about a different use case, namely filtering.  It is
> pretty convenient for users to send a filter:
>
>   /interfaces/interface[name='eth0'/ipv4

This is impossible if we want to call it XPath. With an explicit
namespace/prefix declaration, for example

  "namespace": [
    {
      "prefix": "if",
      "uri": "urn:ietf:params:xml:ns:yang:ietf-interfaces",
      "default": true
    },
    {
      "prefix": "ip",
      "uri": "urn:ietf:params:xml:ns:yang:ietf-ip"
    }
  ]

it would be

  /interfaces/interface[name='eth0']/ip:ipv4

which is not too bad either.

Lada


>
> and get back what they expect.  Even in the rare case of local name
> clashes, this filter works and gives back what was expected (+
> additional nodes).
>
> I have no plans on writing up this as a proposal; I'm just pointing
> out that when XPath is used in filters, this is convenient.
>
>
> /martin

-- 
Ladislav Lhotka
Head, CZ.NIC Labs
PGP Key ID: 0xB8F92B08A9F76C67