Re: [netmod] comments on YANG versioning

Robert Wilton <rwilton@cisco.com> Wed, 14 November 2018 15:48 UTC

Return-Path: <rwilton@cisco.com>
X-Original-To: netmod@ietfa.amsl.com
Delivered-To: netmod@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 367F3130E5D for <netmod@ietfa.amsl.com>; Wed, 14 Nov 2018 07:48:07 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.969
X-Spam-Level:
X-Spam-Status: No, score=-14.969 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.47, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6w48GMmQFqSA for <netmod@ietfa.amsl.com>; Wed, 14 Nov 2018 07:48:05 -0800 (PST)
Received: from aer-iport-3.cisco.com (aer-iport-3.cisco.com [173.38.203.53]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5B3F4124BAA for <netmod@ietf.org>; Wed, 14 Nov 2018 07:48:04 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=13991; q=dns/txt; s=iport; t=1542210484; x=1543420084; h=subject:to:cc:references:from:message-id:date: mime-version:in-reply-to; bh=ZAGIXmx0MZ5WbPSck7nQ0QMl10L9yZvLSCBDT3dU3VA=; b=Jz2gxE5a48Wqef2VMsBVZhp/SVUuWDUO0CgnTnKQb093PSTmCi2Asx6l 8/e6VGBN3yP3g9YZS+n+j2sNiQ8p+7YSW0p196jBPpmzRW26UG++D+BF8 4SrSbB9WYoYxutJXOVUmt1egZbyeRj+DjfMXNqWZbe08HYdv5WpCKrkt4 8=;
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0AKAAAZQ+xb/xbLJq1iGgEBAQEBAgEBAQEHAgEBAQGBUwMBAQEBCwGBDUiBYyESJ4N4iHeMei2RYoVUgXoNgXeCdQKDazYLDQEDAQECAQECbSiFOgEBAQMBI1YQCw4KKgICVwYNBgIBAReDBoF6CKgUgS8fhSGEa4wcgUA/gREngmuEaIMaglcCiUOWGwmRHAYYiVmHHJEohlmBTAsmgVUzGggbFYMnkFo/AzCNZwEB
X-IronPort-AV: E=Sophos;i="5.56,232,1539648000"; d="scan'208,217";a="7986185"
Received: from aer-iport-nat.cisco.com (HELO aer-core-2.cisco.com) ([173.38.203.22]) by aer-iport-3.cisco.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 14 Nov 2018 15:47:59 +0000
Received: from [10.63.23.62] (dhcp-ensft1-uk-vla370-10-63-23-62.cisco.com [10.63.23.62]) by aer-core-2.cisco.com (8.15.2/8.15.2) with ESMTP id wAEFlw0B026003; Wed, 14 Nov 2018 15:47:59 GMT
To: Martin Bjorklund <mbj@tail-f.com>
Cc: andy@yumaworks.com, netmod@ietf.org
References: <CABCOCHTr92=wFcXg0NnPouft3Zkk-XnUzp-FZbRykumvZfMHUg@mail.gmail.com> <daadf16e-82b9-a11e-20f0-2167b4d30f09@cisco.com> <20181114.124841.232214537179191240.mbj@tail-f.com>
From: Robert Wilton <rwilton@cisco.com>
Message-ID: <a96f8858-87cb-b002-b320-9402d860145f@cisco.com>
Date: Wed, 14 Nov 2018 15:47:58 +0000
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.3.0
MIME-Version: 1.0
In-Reply-To: <20181114.124841.232214537179191240.mbj@tail-f.com>
Content-Type: multipart/alternative; boundary="------------C5850CD6CCAB2952939D28DC"
Content-Language: en-US
X-Outbound-SMTP-Client: 10.63.23.62, dhcp-ensft1-uk-vla370-10-63-23-62.cisco.com
X-Outbound-Node: aer-core-2.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/netmod/aXfyXZVMxS6bC_VU_q4OAqhdos8>
Subject: Re: [netmod] comments on YANG versioning
X-BeenThere: netmod@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NETMOD WG list <netmod.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netmod>, <mailto:netmod-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netmod/>
List-Post: <mailto:netmod@ietf.org>
List-Help: <mailto:netmod-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netmod>, <mailto:netmod-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 14 Nov 2018 15:48:07 -0000

Hi Martin,

On 14/11/2018 11:48, Martin Bjorklund wrote:
> Hi,
>
> Robert Wilton <rwilton@cisco.com> wrote:
>> On 08/11/2018 22:52, Andy Bierman wrote:
>>> Hi,
>>>
>>> A few comments on the netmod meeting yesterday
>>>
>>> 1) what is a bugfix?
>>> It is not encouraging that the DT cannot agree on the scope of a
>>> bugfix.
>>> But not sure it matters if NBC updates can occur for any reason.
>>> IMO it is easy to define a bugfix in the IETF -- it is called an
>>> Errata.
>>> If an Errata is approved for a YANG module in an RFC then it is a
>>> bugfix.
>> Ultimately we have customers that will say "this part of your YANG is
>> broken" and we want you to fix it in that release train, either in the
>> next release, or as a software patch.
>>
>> Sometimes vendors will disagree with their customers as to whether it
>> is really a bug fix or an enhancement.  Sometimes we will fix what we
>> think is an obvious bug but that will unfortunately break another
>> customer whom was relying on the existing behavior and then ask us to
>> revert the fix.
>>
>> I think that it should be down to the module author/owner to decide
>> whether or not it is a bug fix or an enhancement, and I would just
>> like a versioning scheme that allows these changes to be expressed.
> So the requirement is that the versioning scheme must support
> branching, and must support expressing NBC changes on any version?

I deem that 1.4 (without the sentence about versioning by software 
release) defines this:

        1.4  The solution MUST allow for backwards-compatible
             enhancements and bug fixes to be allowed in any non-latest
             release.

Although this text is ambiguous, perhaps stating it more clearly, I see 
the requirement as:

        1.4  The solution MUST allow for backwards-compatible
             enhancements, and backward-compatible or non-backwards compatible
             bug fixes to be allowed in non-latest releases.


>
> This requirement isn't present in the current draft, AFAICT.
>
> (not that I support it as a requirement)

But vendors *have* to do this today.  I don't think telling our 
customers that no, we can't fix that bug, because the versioning scheme 
doesn't allow it is really pragmatic.

Rob Shakir also indicated in the Netmod meeting that he does not support 
this requirement.  However, this conflicts with the fact that there are 
examples in OpenConfig when it has been necessary to apply fixes to 
older versions, which has been achieved using deviations.


>
>
>> None of this changes the fact that I think that we should be avoiding
>> making these changes in the first place.  I.e. I think that there is a
>> clear separation between what the versioning scheme should be able to
>> express, and what is recommended practice.
>>
>>
>>>
>>> 2) SEMVER to the rescue?
>>> If every module release can be its own feature release train then the
>>> value of
>>> ascending numeric identifiers is greatly diminished. The (m) and (M)
>>> tags
>>> do not really help.  I strongly agree with the comment that
>>> cherry-picking new
>>> features can (and should) be done with deviations.  Updates of old
>>> revisions needs to be for bugfixes only.
>>>
>>> I prefer the OpenConfig "SEMVER Classic" rather than introducing a new
>>> incompatible complex numbering scheme to support something that
>>> should not be done anyway.
>> SEMVER classic does not support making bug fixes (even bc ones) on
>> older releases.
>>
>> In an older release, SEMVER classic allows:
>>   - editorial changes, e.g. spelling corrections or clarifications in
>> description statements that do not change the API semantics in anyway.
>>   - bug fixes to the *implementation*, but then we are not using SEMVER
>> to version the implementation anyway, only the API.
>>
>> If you want to allow bug fixes (even just bc ones) in an older release
>> then you either need something like modified semver, or a different
>> versioning scheme that allows them.  Or you do what Rob Shakir
>> suggests and use deviations for this instead, which I think is a
>> misuse of deviations.
> But, as you state in the solution draft, not even modified semver can
> determine if a specific change is NBC or not.  It seems you would need
> the entire history to determine this - which goes against the original
> idea that a client should be able to easily determine if a new version
> is NBC or not, compared to the version the client knows.

The (m|M) is intended to be a tool of last resort.  So provide a 
mechanism to make bug fixes to older versions, but don't encourage it.  
It provides a mechanism to provide bug fixes on an existing release, but 
at the cost that you lose some of the benefits of semver (which is 
unavoidable).

If the server is on a version of the form "A.B.X(m)" then the client 
knows that all changes between "A.B.0" and "A.B.X(m)" are backwards 
compatible.  If the version is "A.B.X(M)" then the client knows that 
there is at least one nbc change between "A.B.0" and "A.B.X(M)".  The 
client does not know whether going from "A.B.X(m|M)" to "A.B+1.0" is a 
backwards incompatible change or not.

Thanks,
Rob


>
>
> /martin
> .
>