Re: [netmod] xpath expressions in JSON
Robert Wilton <rwilton@cisco.com> Thu, 11 October 2018 10:43 UTC
Return-Path: <rwilton@cisco.com>
X-Original-To: netmod@ietfa.amsl.com
Delivered-To: netmod@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 20BA7130E73 for <netmod@ietfa.amsl.com>; Thu, 11 Oct 2018 03:43:36 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.956
X-Spam-Level:
X-Spam-Status: No, score=-14.956 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.456, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qp3wWy_fMgec for <netmod@ietfa.amsl.com>; Thu, 11 Oct 2018 03:43:33 -0700 (PDT)
Received: from aer-iport-2.cisco.com (aer-iport-2.cisco.com [173.38.203.52]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id D034A130E69 for <netmod@ietf.org>; Thu, 11 Oct 2018 03:43:32 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=7234; q=dns/txt; s=iport; t=1539254613; x=1540464213; h=subject:to:cc:references:from:message-id:date: mime-version:in-reply-to:content-transfer-encoding; bh=gBjbKb5fNyIzKE+/q0vu/gSiBLIagPqj2rnp18QdKXk=; b=LXLBUG6bij1R+hA1JMnjx6cpMWpYcu1w3NR2SStpn7h9RNfUKGOzmxMr GQac59CbxArzjKEmJLiMKXDOHFiHq3ySKLepK4yUUo06hXcklIg1bjRb/ O0MkIjLHMFwmuSEFzZyfvDC92aXUpZYSf8OUCAkbhWphCtfANFcSUw7BR Y=;
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0A9AABeKL9b/xbLJq1YChkBAQEBAQEBAQEBAQEHAQEBAQEBgWWCan8og3WIdY1kmHoNGAuEA0YChHY4FgEDAQECAQECbRwMhTkBAQEBAgEBASEECwEFNgsQCw4KAgImAgInMAYBCQMGAgEBgxwBgXkID6V1ezOEd4ReBYELilGBQT+BOYJrgxsBAYE2FYMXglcCiD2Fdo9dCZBOBheBT4dWhmyJFIZKhjSBWSGBVTMaCBsVO4JsixeFPz4wjGEBAQ
X-IronPort-AV: E=Sophos;i="5.54,368,1534809600"; d="scan'208";a="7157774"
Received: from aer-iport-nat.cisco.com (HELO aer-core-4.cisco.com) ([173.38.203.22]) by aer-iport-2.cisco.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 11 Oct 2018 10:43:30 +0000
Received: from [10.63.23.158] (dhcp-ensft1-uk-vla370-10-63-23-158.cisco.com [10.63.23.158]) by aer-core-4.cisco.com (8.15.2/8.15.2) with ESMTP id w9BAhTWJ010065; Thu, 11 Oct 2018 10:43:30 GMT
To: Martin Bjorklund <mbj@tail-f.com>, andy@yumaworks.com
Cc: netmod@ietf.org
References: <CABCOCHT32pSP3raNj6pP3BY9ji4DnOoOAaKVY7QyfV4tqqp9KA@mail.gmail.com> <20181011.083904.763170181197608903.mbj@tail-f.com> <CABCOCHQ58Z0TpVLGVcw_TT-OG+1pWQERyCnU7NFO_Gob7JLLcA@mail.gmail.com> <20181011.122137.1647095802972927089.mbj@tail-f.com>
From: Robert Wilton <rwilton@cisco.com>
Message-ID: <461820e8-4ed9-823b-a2c4-a04c74e4f7c1@cisco.com>
Date: Thu, 11 Oct 2018 11:43:28 +0100
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1
MIME-Version: 1.0
In-Reply-To: <20181011.122137.1647095802972927089.mbj@tail-f.com>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Transfer-Encoding: 8bit
Content-Language: en-US
X-Outbound-SMTP-Client: 10.63.23.158, dhcp-ensft1-uk-vla370-10-63-23-158.cisco.com
X-Outbound-Node: aer-core-4.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/netmod/Zk1ANTdUUUCo36C5yfgTSzUXXHM>
Subject: Re: [netmod] xpath expressions in JSON
X-BeenThere: netmod@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NETMOD WG list <netmod.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netmod>, <mailto:netmod-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netmod/>
List-Post: <mailto:netmod@ietf.org>
List-Help: <mailto:netmod-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netmod>, <mailto:netmod-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 11 Oct 2018 10:43:44 -0000
On 11/10/2018 11:21, Martin Bjorklund wrote: > Andy Bierman <andy@yumaworks.com> wrote: >> On Wed, Oct 10, 2018 at 11:39 PM, Martin Bjorklund <mbj@tail-f.com> wrote: >> >>> Andy Bierman <andy@yumaworks.com> wrote: >>>> On Wed, Oct 10, 2018 at 6:59 PM, Reshad Rahman (rrahman) < >>> rrahman@cisco.com> >>>> wrote: >>>> >>>>> On 2018-10-10, 9:59 AM, "netmod on behalf of Martin Bjorklund" < >>>>> netmod-bounces@ietf.org on behalf of mbj@tail-f.com> wrote: >>>>> >>>>> Ladislav Lhotka <lhotka@nic.cz> wrote: >>>>> > Martin Bjorklund <mbj@tail-f.com> writes: >>>>> > >>>>> > > Hi, >>>>> > > >>>>> > > While reviewing restconf-notif, I saw this example: >>>>> > > >>>>> > > { >>>>> > > "ietf-subscribed-notifications:input": { >>>>> > > "stream": "NETCONF", >>>>> > > "stream-xpath-filter": "/ds:foo/", >>>>> > > "dscp": "10" >>>>> > > } >>>>> > > } >>>>> > > >>>>> > > Note the "stream-xpath-filter". It has a prefix in the XPath >>>>> string. >>>>> > > How are prefixes declared when JSON is used? >>>>> > > >>>>> > > The leaf "stream-xpath-filter" says: >>>>> > > >>>>> > > o The set of namespace declarations are those in >>>>> scope on >>>>> > > the 'stream-xpath-filter' leaf element. >>>>> > > >>>>> > > (I think I provided that text...) >>>>> > > >>>>> > > This assumes that the encoding is XML, or at leas that the >>> encoding >>>>> > > can somehow transfer namespace declarations. >>>>> > >>>>> > It can't. There are two options: >>>>> > >>>>> > 1. have different representations of this value in XML and JSON, >>>>> > analogically to instance indentifiers (sec. 6.11 in RFC 7951). >>>>> > >>>>> > 2. use a module name rather than a prefix in XML, too. >>>>> > >>>>> > I would suggest #2. >>>>> <RR> But that means making non-backwards compatible change to the XML >>>>> representation? >>>>> >>>> Not really. It means NETMOD WG would be creating its own special variant >>> of >>>> XPath. >>> Not at all. What I propose is perfectly fine, legal XPath 1.0. >>> >>> XPath 1.0 says that an XPath expression is evaluated in a context. >>> One item in the context is a set of mappings from <prefix> to <uri>, >>> where <prefix> is used to lookup prefixes used in the XPath >>> expression, e.g. in "/foo:interfaces" "foo" is the prefix. >>> >>> It is perfectly fine to say that the prefix mapping set is this: >>> >>> "ietf-interfaces" -> "urn:ietf:params:xml:ns:yang:ietf-interfaces" >>> "ietf-ip" -> "urn:ietf:params:xml:ns:yang:ietf-ip" >>> >>> and use that to evaluate the expression >>> >>> /ietf-interfaces:interfaces/ietf-interfaces:interface/ietf-ip/ipv4 >>> >>> >>> >> The XPath expression is normally parsed within an XML instance document. >> There are "xmlns" attributes present that map the prefix to a namespace URI. >> These mappings will not be present in the JSON at all. >> >> A custom XPath implementation is required to magically identify the prefix >> as a module name and magically find the namespace URI for the module >> name. > I disagree. You need an XPath implementation + custom code to set up > the environment. This is OK, but can we just use the JSON encoding instance identifier format exactly? I.e .RFC 7951 section 6.11. So "/ietf-interfaces:interfaces/interface/ietf-ip:ipv4/enabled" can trivially be expanded to: "/ietf-interfaces:interfaces/ietf-interfaces:interface/ietf-ip:ipv4/ietf-ip:enabled", and then interpreted with the context: "ietf-interfaces" -> "urn:ietf:params:xml:ns:yang:ietf-interfaces" "ietf-ip" -> "urn:ietf:params:xml:ns:yang:ietf-ip" Thanks, Rob > > There is no standard XPath implementation that can just take an XML > instance document + YANG module and figure out what to do. Custom > code is needed to connect things together. This proposal doesn't > change this. > > > /martin > > >> A normal XPath implementation will not find any namespace mapping for the >> prefixes. >> >> An XPath expression has no concept of the "current module" inherited from >> the parent >> like the JSON encoding. This is problematic for predicates >> >> /ietf-interfaces:interfaces/interface[name='eth0'] >> >> XPath says the missing prefixes for 'interface' and 'name' are simply >> missing (no namespace). >> The JSON encoding says "ietf-interfaces" is used for 'interfaces'. and >> 'interface'. >> There is no specification for the 'name' node inside a predicate. >> >> So you must mean the full module name will be used at every node: >> >> /ietf-interfaces:interfaces/ietf-interfaces:interface[ietf-interfaces:name='eth0'] >> >> >> >>> /martin >>> >>> >> Andy >> >> >>>> >>>>> Hmm, so you mean change the leaf "stream-xpath-filter" to say: >>>>> >>>>> o The set of namespace declarations has one member for >>> each >>>>> YANG module supported by the server. This member maps >>>>> from the YANG module name to the YANG module namespace. >>>>> >>>>> This means that in the XPath expression, the module >>> name >>>>> serves as the prefix. >>>>> >>>>> .... and then also give an example of this. >>>>> >>>>> This is probably what we need to do in all places where >>> yang:xpath1.0 >>>>> is used, going forward. Maybe even define a new type >>>>> yang:xpath1.0-2 (name?) with the set of namespace declarations >>>>> built-in. >>>>> >>>> >>>> We should avoid making off-the-shelf implementations of standards like >>>> XPath unusable. >>>> At the very least this should be only available if the server supports it >>>> (with a capability URI) >>>> >>>> >>>> >>>>> <RR> So we need an update to RFC7951? >>>>> >>>>> Regards, >>>>> Reshad. >>>>> >>>>> >>>> Andy >>>> >>>> >>>>> /martin >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> > >>>>> > Lada >>>>> > >>>>> > > >>>>> > > How is this supposed to work with JSON? >>>>> > > >>>>> > > >>>>> > > /martin >>>>> > > >>>>> > > _______________________________________________ >>>>> > > netmod mailing list >>>>> > > netmod@ietf.org >>>>> > > https://www.ietf.org/mailman/listinfo/netmod >>>>> > >>>>> > -- >>>>> > Ladislav Lhotka >>>>> > Head, CZ.NIC Labs >>>>> > PGP Key ID: 0xB8F92B08A9F76C67 >>>>> > >>>>> >>>>> _______________________________________________ >>>>> netmod mailing list >>>>> netmod@ietf.org >>>>> https://www.ietf.org/mailman/listinfo/netmod >>>>> >>>>> >>>>> _______________________________________________ >>>>> netmod mailing list >>>>> netmod@ietf.org >>>>> https://www.ietf.org/mailman/listinfo/netmod >>>>> > _______________________________________________ > netmod mailing list > netmod@ietf.org > https://www.ietf.org/mailman/listinfo/netmod > . >
- [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Reshad Rahman (rrahman)
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Qin Wu
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Vladimir Vassilev
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Vladimir Vassilev
- Re: [netmod] xpath expressions in JSON Vladimir Vassilev
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Reshad Rahman (rrahman)
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Reshad Rahman (rrahman)
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Reshad Rahman (rrahman)
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Vladimir Vassilev
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Reshad Rahman (rrahman)
- Re: [netmod] xpath expressions in JSON Vladimir Vassilev
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Juergen Schoenwaelder
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Juergen Schoenwaelder
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Andy Bierman
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Qin Wu
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Juergen Schoenwaelder
- Re: [netmod] xpath expressions in JSON Robert Wilton
- Re: [netmod] xpath expressions in JSON Juergen Schoenwaelder
- Re: [netmod] xpath expressions in JSON Ladislav Lhotka
- Re: [netmod] xpath expressions in JSON Juergen Schoenwaelder
- Re: [netmod] xpath expressions in JSON Martin Bjorklund
- Re: [netmod] xpath expressions in JSON Kent Watsen