Re: [netmod] Deviations and augmentations

Andy Bierman <andy@yumaworks.com> Tue, 13 November 2018 21:27 UTC

Return-Path: <andy@yumaworks.com>
X-Original-To: netmod@ietfa.amsl.com
Delivered-To: netmod@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B0520130E08 for <netmod@ietfa.amsl.com>; Tue, 13 Nov 2018 13:27:44 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.901
X-Spam-Level:
X-Spam-Status: No, score=-1.901 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=yumaworks-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NDYDwVH82RzU for <netmod@ietfa.amsl.com>; Tue, 13 Nov 2018 13:27:41 -0800 (PST)
Received: from mail-lj1-x235.google.com (mail-lj1-x235.google.com [IPv6:2a00:1450:4864:20::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B5FFF130E0A for <netmod@ietf.org>; Tue, 13 Nov 2018 13:27:40 -0800 (PST)
Received: by mail-lj1-x235.google.com with SMTP id t9-v6so12210448ljh.6 for <netmod@ietf.org>; Tue, 13 Nov 2018 13:27:40 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yumaworks-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=1XwFW6NrfwRcyL4Tnhq34FGrpbUsz0FAEEeJgv69wxc=; b=NfNr5GKwCuPQhfuZMjbTc0r+qZ4lqLdkXV3oVcrPyd8IdZgslmbOSKq11gGdFgU9Pe +8DU6d+O6hOvufJRt9fRkgc2OYbq3CwEECuPYmPJGQ5wLYTdQ5N02Dy5mn8u/WB0Dhjp wqkx+SWiOJE4ZucW5uwBDqJvyHl+R+A8d0e2XIq+0LA7t5odrC5anp7jI6VDo+7rs03h Lxl6t6DzpcdYhwKbvo2oqryadiBZ6qIVHhV7RKgyS9i+db6HpdOnxhp6frmq63SeTVdm se+sWUh3x8QGNdogzPibbogNPkessQBWtQI8ANQ63pt/u04q40FJ9T8hlzyZMBhS0X90 8ubQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=1XwFW6NrfwRcyL4Tnhq34FGrpbUsz0FAEEeJgv69wxc=; b=cMgr2g8+XC6UJKxBHkBUAy1+lzKj/8YafFNn0l0Z2bTpsJz+tV6MRIVmbMKXjlOjLg O8afCZHjZhBY4n0gvl3Haops9+GPVG1oL1IzrjyC+qxO5EHSigBwNDEyQpJr6ubbJ57m qIJjBo3c0SSrJApYt5V/4ApeHnbLGk4tMXtRL0xq37au7hYkSu+NYH4i5FDzkTbnsLEH YdrczR6ca9P0sZqg3O3I4wsIsz9OmHB/mWISvo8Md+11rp0Q9ng9IVJ1EjOBFiFOcaYL aO/xorr18MTGRumofu8qYkY2d5uWkF5uleOa2DR/uPhX3BOe09UXqqpnKjxEry76H6F5 syTA==
X-Gm-Message-State: AGRZ1gITYedHKsCnq88JNHz9Zpgmlz2TJhbmDRLyo3w+qJzcMdYRaZsv 9D4jXr01SVlChQhsv5L9Dk8ans+13WewpkfGIwDiCA==
X-Google-Smtp-Source: AJdET5e7+OR0+cnHuzRIfQi7j17KSgJhDS3mq+cL8G2FgB50hr4lzycdGaIIRaJ+LOs+a085PVyl34PRUYbwACcAGks=
X-Received: by 2002:a2e:2019:: with SMTP id g25-v6mr3921907ljg.20.1542144458674; Tue, 13 Nov 2018 13:27:38 -0800 (PST)
MIME-Version: 1.0
Received: by 2002:a19:1f87:0:0:0:0:0 with HTTP; Tue, 13 Nov 2018 13:27:37 -0800 (PST)
In-Reply-To: <77b69d64-2ce2-29d9-77a9-04a7159003a9@ericsson.com>
References: <a8c912c8-a7a5-1852-d053-10f0f11076e8@cisco.com> <20181112.173351.1984161388756642220.mbj@tail-f.com> <cbe0103b-112e-4687-e119-0698ea6cb9f4@cisco.com> <77b69d64-2ce2-29d9-77a9-04a7159003a9@ericsson.com>
From: Andy Bierman <andy@yumaworks.com>
Date: Tue, 13 Nov 2018 13:27:37 -0800
Message-ID: <CABCOCHR_+FETE47YgDNMZ61RnzWaj=SWZ3SQA4AhMhEPoJY1mw@mail.gmail.com>
To: Balázs Lengyel <balazs.lengyel@ericsson.com>
Cc: Robert Wilton <rwilton@cisco.com>, Martin Bjorklund <mbj@tail-f.com>, "netmod@ietf.org" <netmod@ietf.org>
Content-Type: multipart/alternative; boundary="000000000000a6e9ab057a927cc9"
Archived-At: <https://mailarchive.ietf.org/arch/msg/netmod/jFItQNyoxZ0JpKrPpzDUP0Zs2n8>
Subject: Re: [netmod] Deviations and augmentations
X-BeenThere: netmod@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NETMOD WG list <netmod.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netmod>, <mailto:netmod-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netmod/>
List-Post: <mailto:netmod@ietf.org>
List-Help: <mailto:netmod-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netmod>, <mailto:netmod-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 13 Nov 2018 21:27:45 -0000

On Tue, Nov 13, 2018 at 5:46 AM, Balázs Lengyel <balazs.lengyel@ericsson.com
> wrote:

> Hello,
>
> We also need a method for removing stuff. It does happen that some
> functionality is deemed not important enough, outdated, too expensive to
> maintain, so we want to remove it.
>
>    - Augment is clearly not the tool for that.
>    - Deviations are not intended for that  (from rfc 7950: "server
>    deviation: A failure of the server ...")
>
> So we still need Semver(or something akin) and the possibility to do NBC
> changes.
>


This aspect of deviations is unfortunate because it really is a good idea to
limit the number of ways to do the same thing in YANG.

It was a mistake to limit so many legitimate schema alterations and also a
mistake
to characterize all schema modifications as a server failure. Maybe if it
was called "patch"
instead of "deviation".

We should encourage servers to provide the most accurate schema possible.
Many vendors already maintain detailed deviations modules.

Balazs
>

Andy


> On 2018. 11. 12. 18:08, Robert Wilton wrote:
>
>
>
> On 12/11/2018 16:33, Martin Bjorklund wrote:
>
> Robert Wilton <rwilton@cisco.com> <rwilton@cisco.com> wrote:
>
> In the Thursday Netmod meeting, it was interesting to hear Rob Shakir
> describe how deviations and augmentations are used in OpenConfig to
> add functionality into an older YANG model where the semver rules
> prevent the version number from being incremented.
>
> Further, I think that someone (Martin?) stated on the audio bridge
> that this was an intended/allowed behavior for deviations.
>
> I said that using augmentations (not deviations) was one idea we
> originally had for solving the "branching problem".
>
> Ah, OK. I agree that makes sense.
>
>
> I think that this works for OC b/c they don't branch their modules.
> Hence I think it is important that we decide if branching is a
> requirement or not.
>
> So, I think that this probably works for adding enhancements, but not for
> the (arguably more important) bug fix case, unless there is a reasonable
> solution to having two config data nodes both modifying the same underlying
> property.  Perhaps under some reasonable constraints this could be made to
> work - but I don't know.
>
> Of course, even for enhancements it is not necessarily a perfect
> solution.  E.g. backporting some subset of a module already
> coded/implemented in latest to an older release.  And yes, we really do get
> asked to do this sometimes, although it is relatively rare.
>
> Thanks,
> Rob
>
>
>
> /martin
>
>
> This surprised me, because I thought that RFC 7950 was quite explicit
> that this is not what deviations are intended for.  My reading of RFC
> 7950 is that the deviation statement represents the case where the
> server *implementation* does not match the *specification*.  However,
> the versioning issue that we are discussing are bug fixes/changes in
> the specification rather than the bug fixes in the implementation.
>
> Personally, I'm really not keen on using deviations to represent bug
> fixes to older YANG models for three reasons:
>
> (i) It is changing the meaning of deviation.  It is much cleaner to
> keep the meaning of deviation statements as they are defined today,
> and not conflate their semantics.
> (ii) A different mechanism is used to put a bug fix into an older
> branch rather than in the head of the development.
> (iii) For clients to track the lifecycle of modules they would not
> only need to know the module version number but would also need to
> find and track all associated deviation modules.  This seems
> significantly more complex for clients than the modified semver that
> was proposed.
>
> ---
>
> I think that has also been some suggestion that augmentations (or
> duplicate YANG modules with their major version number changed) can be
> used to make bug fixes in a completely backwards compatible way.
> However, I still don't understand a robust scheme of how this works.
>
> ---
>
> Finally, there were some comments about using augmentation modules for
> enhancements.  This is fine, where appropriate (e.g. a non trivial
> number of data nodes are being added as an enhancement) then a
> separate module may be the right way to go. But here, I presume that
> the new functionality will always be tracked by that separate module.
> If that functionality folds back into the original module at some
> point in the future, then obviously a non backwards compatible version
> change is being forced on to the client, along with additional work on
> the server as well.
>
> I think that there are also many cases where the number of data nodes
> being added via an enhancement is small compared to the size of the
> module being updated.  In this case I believe that it better to add
> these data nodes into the module itself, perhaps predicated under
> if-feature if appropriate.
>
> Thanks,
> Rob
>
>
> _______________________________________________
> netmod mailing list
> netmod@ietf.org
> https://www.ietf.org/mailman/listinfo/netmod
>
> .
>
>
> _______________________________________________
> netmod mailing list
> netmod@ietf.org
> https://www.ietf.org/mailman/listinfo/netmod
>
> --
> Balazs Lengyel                       Ericsson Hungary Ltd.
> Senior Specialist
> Mobile: +36-70-330-7909              email: Balazs.Lengyel@ericsson.com
>
>
> _______________________________________________
> netmod mailing list
> netmod@ietf.org
> https://www.ietf.org/mailman/listinfo/netmod
>
>