Re: [netmod] xpath expressions in JSON

Robert Wilton <rwilton@cisco.com> Thu, 11 October 2018 10:43 UTC

Return-Path: <rwilton@cisco.com>
X-Original-To: netmod@ietfa.amsl.com
Delivered-To: netmod@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 20BA7130E73 for <netmod@ietfa.amsl.com>; Thu, 11 Oct 2018 03:43:36 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.956
X-Spam-Level:
X-Spam-Status: No, score=-14.956 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.456, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qp3wWy_fMgec for <netmod@ietfa.amsl.com>; Thu, 11 Oct 2018 03:43:33 -0700 (PDT)
Received: from aer-iport-2.cisco.com (aer-iport-2.cisco.com [173.38.203.52]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id D034A130E69 for <netmod@ietf.org>; Thu, 11 Oct 2018 03:43:32 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=7234; q=dns/txt; s=iport; t=1539254613; x=1540464213; h=subject:to:cc:references:from:message-id:date: mime-version:in-reply-to:content-transfer-encoding; bh=gBjbKb5fNyIzKE+/q0vu/gSiBLIagPqj2rnp18QdKXk=; b=LXLBUG6bij1R+hA1JMnjx6cpMWpYcu1w3NR2SStpn7h9RNfUKGOzmxMr GQac59CbxArzjKEmJLiMKXDOHFiHq3ySKLepK4yUUo06hXcklIg1bjRb/ O0MkIjLHMFwmuSEFzZyfvDC92aXUpZYSf8OUCAkbhWphCtfANFcSUw7BR Y=;
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0A9AABeKL9b/xbLJq1YChkBAQEBAQEBAQEBAQEHAQEBAQEBgWWCan8og3WIdY1kmHoNGAuEA0YChHY4FgEDAQECAQECbRwMhTkBAQEBAgEBASEECwEFNgsQCw4KAgImAgInMAYBCQMGAgEBgxwBgXkID6V1ezOEd4ReBYELilGBQT+BOYJrgxsBAYE2FYMXglcCiD2Fdo9dCZBOBheBT4dWhmyJFIZKhjSBWSGBVTMaCBsVO4JsixeFPz4wjGEBAQ
X-IronPort-AV: E=Sophos;i="5.54,368,1534809600"; d="scan'208";a="7157774"
Received: from aer-iport-nat.cisco.com (HELO aer-core-4.cisco.com) ([173.38.203.22]) by aer-iport-2.cisco.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 11 Oct 2018 10:43:30 +0000
Received: from [10.63.23.158] (dhcp-ensft1-uk-vla370-10-63-23-158.cisco.com [10.63.23.158]) by aer-core-4.cisco.com (8.15.2/8.15.2) with ESMTP id w9BAhTWJ010065; Thu, 11 Oct 2018 10:43:30 GMT
To: Martin Bjorklund <mbj@tail-f.com>, andy@yumaworks.com
Cc: netmod@ietf.org
References: <CABCOCHT32pSP3raNj6pP3BY9ji4DnOoOAaKVY7QyfV4tqqp9KA@mail.gmail.com> <20181011.083904.763170181197608903.mbj@tail-f.com> <CABCOCHQ58Z0TpVLGVcw_TT-OG+1pWQERyCnU7NFO_Gob7JLLcA@mail.gmail.com> <20181011.122137.1647095802972927089.mbj@tail-f.com>
From: Robert Wilton <rwilton@cisco.com>
Message-ID: <461820e8-4ed9-823b-a2c4-a04c74e4f7c1@cisco.com>
Date: Thu, 11 Oct 2018 11:43:28 +0100
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1
MIME-Version: 1.0
In-Reply-To: <20181011.122137.1647095802972927089.mbj@tail-f.com>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Transfer-Encoding: 8bit
Content-Language: en-US
X-Outbound-SMTP-Client: 10.63.23.158, dhcp-ensft1-uk-vla370-10-63-23-158.cisco.com
X-Outbound-Node: aer-core-4.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/netmod/Zk1ANTdUUUCo36C5yfgTSzUXXHM>
Subject: Re: [netmod] xpath expressions in JSON
X-BeenThere: netmod@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NETMOD WG list <netmod.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netmod>, <mailto:netmod-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netmod/>
List-Post: <mailto:netmod@ietf.org>
List-Help: <mailto:netmod-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netmod>, <mailto:netmod-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 11 Oct 2018 10:43:44 -0000


On 11/10/2018 11:21, Martin Bjorklund wrote:
> Andy Bierman <andy@yumaworks.com> wrote:
>> On Wed, Oct 10, 2018 at 11:39 PM, Martin Bjorklund <mbj@tail-f.com> wrote:
>>
>>> Andy Bierman <andy@yumaworks.com> wrote:
>>>> On Wed, Oct 10, 2018 at 6:59 PM, Reshad Rahman (rrahman) <
>>> rrahman@cisco.com>
>>>> wrote:
>>>>
>>>>> On 2018-10-10, 9:59 AM, "netmod on behalf of Martin Bjorklund" <
>>>>> netmod-bounces@ietf.org on behalf of mbj@tail-f.com> wrote:
>>>>>
>>>>>      Ladislav Lhotka <lhotka@nic.cz> wrote:
>>>>>      > Martin Bjorklund <mbj@tail-f.com> writes:
>>>>>      >
>>>>>      > > Hi,
>>>>>      > >
>>>>>      > > While reviewing restconf-notif, I saw this example:
>>>>>      > >
>>>>>      > >    {
>>>>>      > >       "ietf-subscribed-notifications:input": {
>>>>>      > >          "stream": "NETCONF",
>>>>>      > >          "stream-xpath-filter": "/ds:foo/",
>>>>>      > >          "dscp": "10"
>>>>>      > >       }
>>>>>      > >    }
>>>>>      > >
>>>>>      > > Note the "stream-xpath-filter".  It has a prefix in the XPath
>>>>> string.
>>>>>      > > How are prefixes declared when JSON is used?
>>>>>      > >
>>>>>      > > The leaf "stream-xpath-filter" says:
>>>>>      > >
>>>>>      > >               o  The set of namespace declarations are those in
>>>>> scope on
>>>>>      > >                  the 'stream-xpath-filter' leaf element.
>>>>>      > >
>>>>>      > > (I think I provided that text...)
>>>>>      > >
>>>>>      > > This assumes that the encoding is XML, or at leas that the
>>> encoding
>>>>>      > > can somehow transfer namespace declarations.
>>>>>      >
>>>>>      > It can't. There are two options:
>>>>>      >
>>>>>      > 1. have different representations of this value in XML and JSON,
>>>>>      >    analogically to instance indentifiers (sec. 6.11 in RFC 7951).
>>>>>      >
>>>>>      > 2. use a module name rather than a prefix in XML, too.
>>>>>      >
>>>>>      > I would suggest #2.
>>>>> <RR> But that means making non-backwards compatible change to the XML
>>>>> representation?
>>>>>
>>>> Not really. It means NETMOD WG would be creating its own special variant
>>> of
>>>> XPath.
>>> Not at all.  What I propose is perfectly fine, legal XPath 1.0.
>>>
>>> XPath 1.0 says that an XPath expression is evaluated in a context.
>>> One item in the context is a set of mappings from <prefix> to <uri>,
>>> where <prefix> is used to lookup prefixes used in the XPath
>>> expression, e.g. in "/foo:interfaces" "foo" is the prefix.
>>>
>>> It is perfectly fine to say that the prefix mapping set is this:
>>>
>>>     "ietf-interfaces" -> "urn:ietf:params:xml:ns:yang:ietf-interfaces"
>>>     "ietf-ip"         -> "urn:ietf:params:xml:ns:yang:ietf-ip"
>>>
>>> and use that to evaluate the expression
>>>
>>>    /ietf-interfaces:interfaces/ietf-interfaces:interface/ietf-ip/ipv4
>>>
>>>
>>>
>> The XPath expression is normally parsed within an XML instance document.
>> There are "xmlns" attributes present that map the prefix to a namespace URI.
>> These mappings will not be present in the JSON at all.
>>
>> A custom XPath implementation is required to magically identify the prefix
>> as a module name and magically find the namespace URI for the module
>> name.
> I disagree.  You need an XPath implementation + custom code to set up
> the environment.
This is OK, but can we just use the JSON encoding instance identifier 
format exactly?  I.e .RFC 7951 section 6.11.

So "/ietf-interfaces:interfaces/interface/ietf-ip:ipv4/enabled"

can trivially be expanded to:

"/ietf-interfaces:interfaces/ietf-interfaces:interface/ietf-ip:ipv4/ietf-ip:enabled",

and then interpreted with the context:
  
    "ietf-interfaces" -> "urn:ietf:params:xml:ns:yang:ietf-interfaces"
    "ietf-ip"         -> "urn:ietf:params:xml:ns:yang:ietf-ip"

Thanks,
Rob
  

>
> There is no standard XPath implementation that can just take an XML
> instance document + YANG module and figure out what to do.  Custom
> code is needed to connect things together.  This proposal doesn't
> change this.
>
>
> /martin
>
>
>> A normal XPath implementation will not find any namespace mapping for the
>> prefixes.
>>
>> An XPath expression has no concept of the "current module" inherited from
>> the parent
>> like the JSON encoding. This is problematic for predicates
>>
>>     /ietf-interfaces:interfaces/interface[name='eth0']
>>
>> XPath says the missing prefixes for 'interface' and 'name' are simply
>> missing (no namespace).
>> The JSON encoding says "ietf-interfaces" is used for 'interfaces'. and
>> 'interface'.
>> There is no specification for the 'name' node inside a predicate.
>>
>> So you must mean the full module name will be used at every node:
>>
>>   /ietf-interfaces:interfaces/ietf-interfaces:interface[ietf-interfaces:name='eth0']
>>
>>
>>
>>> /martin
>>>
>>>
>> Andy
>>
>>
>>>>
>>>>>      Hmm, so you mean change the leaf "stream-xpath-filter" to say:
>>>>>
>>>>>               o  The set of namespace declarations has one member for
>>> each
>>>>>                  YANG module supported by the server.  This member maps
>>>>>                  from the YANG module name to the YANG module namespace.
>>>>>
>>>>>                  This means that in the XPath expression, the module
>>> name
>>>>>                  serves as the prefix.
>>>>>
>>>>>      .... and then also give an example of this.
>>>>>
>>>>>      This is probably what we need to do in all places where
>>> yang:xpath1.0
>>>>>      is used, going forward.  Maybe even define a new type
>>>>>      yang:xpath1.0-2 (name?) with the set of namespace declarations
>>>>>      built-in.
>>>>>
>>>>
>>>> We should avoid making off-the-shelf implementations of standards like
>>>> XPath unusable.
>>>> At the very least this should be only available if the server supports it
>>>> (with a capability URI)
>>>>
>>>>
>>>>
>>>>> <RR> So we need an update to RFC7951?
>>>>>
>>>>> Regards,
>>>>> Reshad.
>>>>>
>>>>>
>>>> Andy
>>>>
>>>>
>>>>>      /martin
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>      >
>>>>>      > Lada
>>>>>      >
>>>>>      > >
>>>>>      > > How is this supposed to work with JSON?
>>>>>      > >
>>>>>      > >
>>>>>      > > /martin
>>>>>      > >
>>>>>      > > _______________________________________________
>>>>>      > > netmod mailing list
>>>>>      > > netmod@ietf.org
>>>>>      > > https://www.ietf.org/mailman/listinfo/netmod
>>>>>      >
>>>>>      > --
>>>>>      > Ladislav Lhotka
>>>>>      > Head, CZ.NIC Labs
>>>>>      > PGP Key ID: 0xB8F92B08A9F76C67
>>>>>      >
>>>>>
>>>>>      _______________________________________________
>>>>>      netmod mailing list
>>>>>      netmod@ietf.org
>>>>>      https://www.ietf.org/mailman/listinfo/netmod
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> netmod mailing list
>>>>> netmod@ietf.org
>>>>> https://www.ietf.org/mailman/listinfo/netmod
>>>>>
> _______________________________________________
> netmod mailing list
> netmod@ietf.org
> https://www.ietf.org/mailman/listinfo/netmod
> .
>