Re: [netmod] xpath expressions in JSON

Martin Bjorklund <mbj@tail-f.com> Thu, 18 October 2018 20:32 UTC

Return-Path: <mbj@tail-f.com>
X-Original-To: netmod@ietfa.amsl.com
Delivered-To: netmod@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4705A130E21 for <netmod@ietfa.amsl.com>; Thu, 18 Oct 2018 13:32:53 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.901
X-Spam-Level:
X-Spam-Status: No, score=-1.901 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id BSE2LfbrVgEn for <netmod@ietfa.amsl.com>; Thu, 18 Oct 2018 13:32:50 -0700 (PDT)
Received: from mail.tail-f.com (mail.tail-f.com [46.21.102.45]) by ietfa.amsl.com (Postfix) with ESMTP id 00851130E1B for <netmod@ietf.org>; Thu, 18 Oct 2018 13:32:49 -0700 (PDT)
Received: from localhost (h-80-27.A165.priv.bahnhof.se [212.85.80.27]) by mail.tail-f.com (Postfix) with ESMTPSA id 1CAC81AE033A; Thu, 18 Oct 2018 22:32:49 +0200 (CEST)
Date: Thu, 18 Oct 2018 22:32:48 +0200
Message-Id: <20181018.223248.2170782709410525886.mbj@tail-f.com>
To: andy@yumaworks.com
Cc: vladimir@transpacket.com, netmod@ietf.org
From: Martin Bjorklund <mbj@tail-f.com>
In-Reply-To: <CABCOCHQRtE_qxSA_LbetRE21=NiCrfDh1NJ-M=t2PDvZPmpXMA@mail.gmail.com>
References: <CABCOCHRufR6S8NCp5n+UXgG0Y_OJ368XZZmzFR8wEHc0CLw+HQ@mail.gmail.com> <20181018.215826.2271077466982765895.mbj@tail-f.com> <CABCOCHQRtE_qxSA_LbetRE21=NiCrfDh1NJ-M=t2PDvZPmpXMA@mail.gmail.com>
X-Mailer: Mew version 6.7 on Emacs 24.5 / Mule 6.0 (HANACHIRUSATO)
Mime-Version: 1.0
Content-Type: Text/Plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/netmod/jIg-D48EfyYvsU_wq0fALWDRrSQ>
Subject: Re: [netmod] xpath expressions in JSON
X-BeenThere: netmod@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NETMOD WG list <netmod.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netmod>, <mailto:netmod-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netmod/>
List-Post: <mailto:netmod@ietf.org>
List-Help: <mailto:netmod-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netmod>, <mailto:netmod-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Oct 2018 20:32:53 -0000

Andy Bierman <andy@yumaworks.com> wrote:
> On Thu, Oct 18, 2018 at 12:58 PM, Martin Bjorklund <mbj@tail-f.com> wrote:
> 
> > Andy Bierman <andy@yumaworks.com> wrote:
> > > Hi,
> > >
> > > I strongly agree that a new data type is needed (ypath1.0 or just ypath
> > is
> > > fine)
> > > Adding new semantics or requirements to published data types is
> > > unacceptable.
> > >
> > > Also, we must get the type and module containing the data type right on
> > the
> > > first try.
> > > No moving it later because the import looks bad. That said, a "quick
> > > 6991-bis" is unrealistic,
> > > and a multi-year 6991-bis is unhelpful.
> > >
> > > Should there be a canonical format, based on module-names as prefixes?
> > > Consider how to compare 2 values using this data type.
> >
> > Ok.  So which alternative do you prefer for stream-xpath-filter, which
> > is supposed to work also for JSON?  The current definition doesn't
> > work for JSON.
> >
> >
> 
> I don't like calling it xpath when it is not XPath any more.

But stream-xpath-filter *is* XPath.  The alternative solutions differ
only in how the prefix mapping is defined.

> It should be as clear as possible to readers and designers that xpath
> means XPath and ypath is not XPath.
> 
> I would prefer a new encoding that allows the parent node module-name to be
> used somehow,
> consistent with the JSON encoding used now.
> 
> Perhaps each absolute-path expression starts with a module-name step and
> relative-path
> expressions assume the module name of the context node if there is no
> module-name.
> 
> Neither alternative below is a good long-term solution.

Agreed, but we need to find a solution for stream-xpath-filter, or
else we should remove it from SN.

> The old problems come up again:
> 
>   Client A writes the /foo node in XML.
>   Client B reads the /foo node returned in JSON
> 
> Which format is returned? Does the server magically convert the value for
> each encoding type?

Yes, just like it does with i-i and identityref.

> If we bother to fix this problem at all, then we should get rid of reliance
> on prefix to namespace mappings.

Long-term, yes!


/martin


> 
> 
> 
> 
> 
> > /martin
> >
> >
> 
> Andy
> 
> 
> >
> > >
> > >
> > > Andy
> > >
> > >
> > > On Thu, Oct 18, 2018 at 10:42 AM, Vladimir Vassilev <
> > > vladimir@transpacket.com> wrote:
> > >
> > > > Hi,
> > > >
> > > > Seems this discussion affects 10 draft modules using the xpath1.0 type.
> > > > The proposed boilerplate description text that was not added to some
> > RFC
> > > > modules like ietf-netconf-monitoring@2010-10-04.yang
> > > >
> > > > should be as consistent as possible (or skipped based on the
> > > > ietf-netconf-monitoring precedent) until a better alternative is
> > available.
> > > > Here is an example of a better alternative.
> > > >
> > > >    typedef ypath1.0 {
> > > >     type xpath1.0;
> > > >     description
> > > >      "This type represents subset of XPATH 1.0 expressions
> > > >       that apply to a data tree conforming to a YANG model.
> > > >
> > > >       Each encoding should allow conversion to an encoding
> > > >       independent lexical representation where data node
> > > >       prefixes are resolved to and substituted with module
> > > >       names.
> > > >
> > > >       When a schema node is defined that uses this type, the
> > > >       description of the schema node MUST specify the
> > > >       context in which the expression is evaluated if it
> > > >       is different from the default context.
> > > >
> > > >       The default context is as follows:
> > > >
> > > >         o  The set of variable bindings is empty.
> > > >
> > > >         o  The function library is the core function library, and
> > > >            the XPath functions defined in section 10 in RFC 7950.
> > > >
> > > >         o  The context node is the leaf node.
> > > >
> > > >       ";
> > > >     reference
> > > >      "XPATH: XML Path Language (XPath) Version 1.0";
> > > >   }
> > > >
> > > > That said I do not object to short-term application of alternative A as
> > > > long as a long-term solution is on its way for future modules.
> > > >
> > > > Vladimir
> > > >
> > > > On 10/18/18 12:30 PM, Martin Bjorklund wrote:
> > > >
> > > >> Hi,
> > > >>
> > > >> Going back to the most urgent issue, what is this WG's recommendation
> > > >> for the subscribed-notifications draft in NETCONF wrt/ their usage of
> > > >> yang:xpath1.0 in filters?
> > > >>
> > > >> To summarize:
> > > >>
> > > >> We already have
> > > >>
> > > >>    o  instance-identifier in XML uses prefixes from the XML document
> > > >>    o  instance-identifier in JSON uses module names as prefixes
> > > >>    o  XPath in NETCONF filter uses prefixes from the XML document
> > > >>    o  XPath in JSON query filter uses module names as prefixes
> > > >>
> > > >>
> > > >> Alternative A:
> > > >> --------------
> > > >>
> > > >> Use different encodings for "stream-xpath-filter" as well, depending
> > > >> on if it is XML or JSON.
> > > >>
> > > >> We would do in SN:
> > > >>
> > > >>      o  If the node is encoded in XML, the set of namespace
> > > >>         declarations are those in scope on the
> > > >>         'stream-xpath-filter' leaf element.
> > > >>
> > > >>      o  If the node is encoded in JSON, the set of namespace
> > > >>         declarations is the set of prefix and namespace pairs
> > > >>         for all supported YANG modules, where the prefix is
> > > >>         the YANG module name and the namespace is as defined
> > > >>         by the "namespace" statement in the YANG module.
> > > >>
> > > >> Pro: the format is consistent within each encoding.
> > > >>
> > > >> Con: unclear how to handle other encodings.
> > > >> Con: we keep using context-depending encodings.
> > > >>
> > > >> We could probably add that CBOR uses the same representation as JSON.
> > > >>
> > > >> Example in XML:
> > > >>
> > > >>    <stream-xpath-filter
> > > >>        xmlns:if="urn:ietf:params:xml:ns:yang:ietf-interfaces"
> > > >>        xmlns:ip="urn:ietf:params:xml:ns:yang:ietf-ip">
> > > >>      /if:interfaces/if:interface/ip:ipv4
> > > >>    </stream-xpath-filter>
> > > >>
> > > >> Example in JSON:
> > > >>
> > > >>    "stream-xpath-filter":
> > > >>      "/ietf-interfaces:interfaces/ietf-interfaces:interface/
> > ietf-ip:ipv4"
> > > >>
> > > >>
> > > >>
> > > >> Alternative B:
> > > >> --------------
> > > >>
> > > >> Use a non-context depending encoding, with the module name as prefix.
> > > >>
> > > >> We would do in SN:
> > > >>
> > > >>      o  The set of namespace
> > > >>         declarations is the set of prefix and namespace pairs
> > > >>         for all supported YANG modules, where the prefix is
> > > >>         the YANG module name and the namespace is as defined
> > > >>         by the "namespace" statement in the YANG module.
> > > >>
> > > >> Pro: the format is independent from the protocol encoding
> > > >>
> > > >> Con: in XML, this leaf is treated differently from other XPath
> > > >>       expressions, such as get-config filter and nacm rules.
> > > >>
> > > >> Example in XML:
> > > >>
> > > >>    <stream-xpath-filter>
> > > >>      /ietf-interfaces:interfaces/ietf-interfaces:interface/
> > ietf-ip:ipv4
> > > >>    </stream-xpath-filter>
> > > >>
> > > >> Example in JSON:
> > > >>
> > > >>    "stream-xpath-filter":
> > > >>      "/ietf-interfaces:interfaces/ietf-interfaces:interface/
> > ietf-ip:ipv4"
> > > >>
> > > >>
> > > >> My proposal is A.  I think it is more important with consistency
> > > >> within each encoding than across encodings.
> > > >>
> > > >> (This said, I would like to have a context-independent encoding of all
> > > >> YANG types in the future.  But not now.)
> > > >>
> > > >>
> > > >>
> > > >>
> > > >> /martin
> > > >>
> > > >> _______________________________________________
> > > >> netmod mailing list
> > > >> netmod@ietf.org
> > > >> https://www.ietf.org/mailman/listinfo/netmod
> > > >>
> > > >
> > > > _______________________________________________
> > > > netmod mailing list
> > > > netmod@ietf.org
> > > > https://www.ietf.org/mailman/listinfo/netmod
> > > >
> >