Re: [netmod] Deviations and augmentations

Andy Bierman <andy@yumaworks.com> Tue, 13 November 2018 16:19 UTC

Return-Path: <andy@yumaworks.com>
X-Original-To: netmod@ietfa.amsl.com
Delivered-To: netmod@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8D06B128B14 for <netmod@ietfa.amsl.com>; Tue, 13 Nov 2018 08:19:51 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.901
X-Spam-Level:
X-Spam-Status: No, score=-1.901 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=yumaworks-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id uf3gBsrd7A1l for <netmod@ietfa.amsl.com>; Tue, 13 Nov 2018 08:19:48 -0800 (PST)
Received: from mail-lf1-x130.google.com (mail-lf1-x130.google.com [IPv6:2a00:1450:4864:20::130]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DF9D6128A6E for <netmod@ietf.org>; Tue, 13 Nov 2018 08:19:47 -0800 (PST)
Received: by mail-lf1-x130.google.com with SMTP id p17so9262735lfh.4 for <netmod@ietf.org>; Tue, 13 Nov 2018 08:19:47 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yumaworks-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=5KbKeviwKyWH3/thResjdMhU1YxK1V3j0DIhLRYuzFk=; b=av13KnFQxPa6ykTdOutuae0lbF9WsAyi+DNso+U1TX7jAnEPbvD6DGjD+JwzRc3Zek HVM3WXoY158uPz2O9Q63doHYzcn/QaTX/Q7qSdQBQ4EbxwINOET3g8hcKi8Llq35t9NR lx6yU6BB8/+6Yg17oJ8UAvifUp/UUDuFLpm6WtWJTJ3tbEr7ySY4rcts/Z9F02sVpkTP 0I4/6aequXEwHzsVyBJZRsQjdkd6A1iuwOhr3nb48TBBeD6Lvo81m5/taQPv7I0fypE5 boSTuG7bhFI96mQBsHLEEJHY1cryXXMfddRoNm+CfUO5yx0PV5BpCemw6pUBSXGRPAGG 1C7w==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=5KbKeviwKyWH3/thResjdMhU1YxK1V3j0DIhLRYuzFk=; b=oaNjRf6JTHH/iUsKQiLk7HcxAu1szOr/amXjV3wHzkay/3hkeyAgR9bvJjYb0rhGoG Yo0IG6wyY6n7JJRa/Z+xBFSPpnhQYwpRRCp757izOVUDlL0CXcp6XRRLmZVZxn0ucZEG v+u64osR5Oo7qtpS6X7WFcPFLAUZLtFewpVkZJah/aH/E8R0wYar+TFBzZlyxnXpZiKh rQV8sCxAJLLjWtn2Yr9MNRubrcImVlXsOA0apEvDpPpbrLFFQnekGAuxYQo07DMXOsPv MzRUVTYWFlKk0x9BlsqZY4Eg1ONTD4fgI/RmnsK3ourgMJgW3NKUn1UTdXXoWyGYnYDx fvjg==
X-Gm-Message-State: AGRZ1gLVW5Vjw5BmRVcuTZBCrDsZzz7Qt7vrGjdobm1xV3UiZqi0gyzr cc3xxcQn1hUbleSAlOYXEHBbLNVc6o3dr7ONC702CPdcOy0=
X-Google-Smtp-Source: AJdET5dzEbGF4DLzpluAH6DKP5K0RR9WagaOkJ8L/sZQpzBH5FpxktU7Ui413OeuyVBt9wcx8/2Ap2dLpN89o+bEMHo=
X-Received: by 2002:a19:d58e:: with SMTP id m136mr3621173lfg.70.1542125985753; Tue, 13 Nov 2018 08:19:45 -0800 (PST)
MIME-Version: 1.0
Received: by 2002:a19:1f87:0:0:0:0:0 with HTTP; Tue, 13 Nov 2018 08:19:44 -0800 (PST)
In-Reply-To: <453368b2-aa52-f09a-ea0b-960255bce46b@cisco.com>
References: <a8c912c8-a7a5-1852-d053-10f0f11076e8@cisco.com> <20181112.173351.1984161388756642220.mbj@tail-f.com> <cbe0103b-112e-4687-e119-0698ea6cb9f4@cisco.com> <77b69d64-2ce2-29d9-77a9-04a7159003a9@ericsson.com> <CABCOCHQmA1PaVTu7oLiECXLrCULqW1KJddDRvYaDmE4xWu5AmA@mail.gmail.com> <98d6293c-d762-4d21-a9e2-c9cb20f74135@cisco.com> <CABCOCHR-vygv+Fq8JWGMm59-V6CB4PkqfSA_5mR8xBUqwi6xDw@mail.gmail.com> <453368b2-aa52-f09a-ea0b-960255bce46b@cisco.com>
From: Andy Bierman <andy@yumaworks.com>
Date: Tue, 13 Nov 2018 08:19:44 -0800
Message-ID: <CABCOCHSAzpsYnvx6zXx7wgwmXJtMjG0JE1=ZxPbhqMwAtaYJ-Q@mail.gmail.com>
To: Robert Wilton <rwilton@cisco.com>
Cc: Balázs Lengyel <balazs.lengyel@ericsson.com>, Martin Bjorklund <mbj@tail-f.com>, "netmod@ietf.org" <netmod@ietf.org>
Content-Type: multipart/alternative; boundary="000000000000948cbe057a8e2f57"
Archived-At: <https://mailarchive.ietf.org/arch/msg/netmod/qm_jcUE9VrFSNrsyug3GC80vFwI>
Subject: Re: [netmod] Deviations and augmentations
X-BeenThere: netmod@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NETMOD WG list <netmod.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netmod>, <mailto:netmod-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netmod/>
List-Post: <mailto:netmod@ietf.org>
List-Help: <mailto:netmod-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netmod>, <mailto:netmod-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 13 Nov 2018 16:19:51 -0000

On Tue, Nov 13, 2018 at 7:54 AM, Robert Wilton <rwilton@cisco.com> wrote:

>
> On 13/11/2018 15:32, Andy Bierman wrote:
>
>
>
> On Tue, Nov 13, 2018 at 7:28 AM, Robert Wilton <rwilton@cisco.com> wrote:
>
>>
>> On 13/11/2018 15:17, Andy Bierman wrote:
>>
>>
>>
>> On Tue, Nov 13, 2018 at 5:46 AM, Balázs Lengyel <
>> balazs.lengyel@ericsson.com> wrote:
>>
>>> Hello,
>>>
>>> We also need a method for removing stuff. It does happen that some
>>> functionality is deemed not important enough, outdated, too expensive to
>>> maintain, so we want to remove it.
>>>
>>>    - Augment is clearly not the tool for that.
>>>    - Deviations are not intended for that  (from rfc 7950: "server
>>>    deviation: A failure of the server ...")
>>>
>>>
>> Removing nodes is easy with the status-stmt. Update the module and set
>> the status to deprecated or obsolete.
>>
>> Yes, but obsoleting nodes should be regarded as a
>> non-backwards-compatible change because it can break clients that were
>> relying on those nodes.
>>
>
> I don't think RFC 7950 says that.
>
> RFC 7950 states '"obsolete" means that the definition is obsolete and
> SHOULD NOT be implemented and/or can be removed from implementations.'
>
> So if there was a client using those definitions it would break, hence it
> is a non-backwards-compatible change.
>
>
>
>From RFC 7950, sec 11:

   o  A "status" statement may be added, or changed from "current" to
      "deprecated" or "obsolete", or changed from "deprecated" to
      "obsolete".



> Removing outdated functionality is exactly what the status-stmt is for.
>
> Agreed.
>
>
> IMO we should learn to use the YANG that is already there.
>
> We are trying to make what we have today better.
>
> Specifically, so that a client can look at a semver numbers between two
> modules revisions and determine whether or not they might be broken by that
> change.
>
> Today, just using the status element alone to mark removed nodes means
> that a client would have to check for all changes in the module between two
> revisions to determine whether or not the new module revision is backwards
> compatible with the old one.
>


It is quite easy to check if the status-stmt is set to deprecated or
obsolete.
SEMVER is not very useful, especially if the major version is incremented
even though there were no NBC changes.




> Thanks,
> Rob
>
>
>

Andy


>
>
>> Thanks,
>> Rob
>>
>>
>>
> Andy
>
>
>>
>>
>> Andy
>>
>>
>>
>>
>>>
>>>
>>> So we still need Semver(or something akin) and the possibility to do NBC
>>> changes.
>>>
>>> Balazs
>>> On 2018. 11. 12. 18:08, Robert Wilton wrote:
>>>
>>>
>>>
>>> On 12/11/2018 16:33, Martin Bjorklund wrote:
>>>
>>> Robert Wilton <rwilton@cisco.com> <rwilton@cisco.com> wrote:
>>>
>>> In the Thursday Netmod meeting, it was interesting to hear Rob Shakir
>>> describe how deviations and augmentations are used in OpenConfig to
>>> add functionality into an older YANG model where the semver rules
>>> prevent the version number from being incremented.
>>>
>>> Further, I think that someone (Martin?) stated on the audio bridge
>>> that this was an intended/allowed behavior for deviations.
>>>
>>> I said that using augmentations (not deviations) was one idea we
>>> originally had for solving the "branching problem".
>>>
>>> Ah, OK. I agree that makes sense.
>>>
>>>
>>> I think that this works for OC b/c they don't branch their modules.
>>> Hence I think it is important that we decide if branching is a
>>> requirement or not.
>>>
>>> So, I think that this probably works for adding enhancements, but not
>>> for the (arguably more important) bug fix case, unless there is a
>>> reasonable solution to having two config data nodes both modifying the same
>>> underlying property.  Perhaps under some reasonable constraints this could
>>> be made to work - but I don't know.
>>>
>>> Of course, even for enhancements it is not necessarily a perfect
>>> solution.  E.g. backporting some subset of a module already
>>> coded/implemented in latest to an older release.  And yes, we really do get
>>> asked to do this sometimes, although it is relatively rare.
>>>
>>> Thanks,
>>> Rob
>>>
>>>
>>>
>>> /martin
>>>
>>>
>>> This surprised me, because I thought that RFC 7950 was quite explicit
>>> that this is not what deviations are intended for.  My reading of RFC
>>> 7950 is that the deviation statement represents the case where the
>>> server *implementation* does not match the *specification*.  However,
>>> the versioning issue that we are discussing are bug fixes/changes in
>>> the specification rather than the bug fixes in the implementation.
>>>
>>> Personally, I'm really not keen on using deviations to represent bug
>>> fixes to older YANG models for three reasons:
>>>
>>> (i) It is changing the meaning of deviation.  It is much cleaner to
>>> keep the meaning of deviation statements as they are defined today,
>>> and not conflate their semantics.
>>> (ii) A different mechanism is used to put a bug fix into an older
>>> branch rather than in the head of the development.
>>> (iii) For clients to track the lifecycle of modules they would not
>>> only need to know the module version number but would also need to
>>> find and track all associated deviation modules.  This seems
>>> significantly more complex for clients than the modified semver that
>>> was proposed.
>>>
>>> ---
>>>
>>> I think that has also been some suggestion that augmentations (or
>>> duplicate YANG modules with their major version number changed) can be
>>> used to make bug fixes in a completely backwards compatible way.
>>> However, I still don't understand a robust scheme of how this works.
>>>
>>> ---
>>>
>>> Finally, there were some comments about using augmentation modules for
>>> enhancements.  This is fine, where appropriate (e.g. a non trivial
>>> number of data nodes are being added as an enhancement) then a
>>> separate module may be the right way to go. But here, I presume that
>>> the new functionality will always be tracked by that separate module.
>>> If that functionality folds back into the original module at some
>>> point in the future, then obviously a non backwards compatible version
>>> change is being forced on to the client, along with additional work on
>>> the server as well.
>>>
>>> I think that there are also many cases where the number of data nodes
>>> being added via an enhancement is small compared to the size of the
>>> module being updated.  In this case I believe that it better to add
>>> these data nodes into the module itself, perhaps predicated under
>>> if-feature if appropriate.
>>>
>>> Thanks,
>>> Rob
>>>
>>>
>>> _______________________________________________
>>> netmod mailing list
>>> netmod@ietf.org
>>> https://www.ietf.org/mailman/listinfo/netmod
>>>
>>> .
>>>
>>>
>>> _______________________________________________
>>> netmod mailing list
>>> netmod@ietf.org
>>> https://www.ietf.org/mailman/listinfo/netmod
>>>
>>> --
>>> Balazs Lengyel                       Ericsson Hungary Ltd.
>>> Senior Specialist
>>> Mobile: +36-70-330-7909              email: Balazs.Lengyel@ericsson.com
>>>
>>>
>>> _______________________________________________
>>> netmod mailing list
>>> netmod@ietf.org
>>> https://www.ietf.org/mailman/listinfo/netmod
>>>
>>>
>>
>