Re: [netmod] backward compatibility requirements in draft-verdt-netmod-yang-versioning-reqs-00

Andy Bierman <andy@yumaworks.com> Mon, 23 July 2018 14:08 UTC

Return-Path: <andy@yumaworks.com>
X-Original-To: netmod@ietfa.amsl.com
Delivered-To: netmod@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 88D3712F1AC for <netmod@ietfa.amsl.com>; Mon, 23 Jul 2018 07:08:09 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.91
X-Spam-Level:
X-Spam-Status: No, score=-1.91 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=yumaworks-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id BlTwXtfEsm-W for <netmod@ietfa.amsl.com>; Mon, 23 Jul 2018 07:08:07 -0700 (PDT)
Received: from mail-lj1-x243.google.com (mail-lj1-x243.google.com [IPv6:2a00:1450:4864:20::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7A572127148 for <netmod@ietf.org>; Mon, 23 Jul 2018 07:08:06 -0700 (PDT)
Received: by mail-lj1-x243.google.com with SMTP id j19-v6so665356ljc.7 for <netmod@ietf.org>; Mon, 23 Jul 2018 07:08:06 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yumaworks-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=n9UGgaYu2Kfcph8I7x/9ELK3QUeA58Zq+riJEiw8zuQ=; b=lIVLhxmQvIy/LMmLKh1KIy3SPE+YCcBHA6OgUObF4La+3vsvzwXgLR8oBX14vUupn8 CJHFLVMgERkCkN+443HCQvFl9vZvwKXVZ6XtVe6rR9DZBPBMkXReje3rKd57PIcaBj2v zqx04GjsExwcPtkF2gtlfNjj2o5XSMU29VnBGwMRlI0yY3qnZvt5/SKmGVaTI+l9zN+R oICwMWorNilks4PpBmgQIvrzCW14ee9j/MZWYgYLVRpvoKN2JG8IPExoHR2lNRmrKGFc kkEfaaFMN8iM88BBPOQr0qjqd5DuUApMX2TQM3USLnCmlAlBVJOEOU+gGrEfOKqq/aYD wzpw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=n9UGgaYu2Kfcph8I7x/9ELK3QUeA58Zq+riJEiw8zuQ=; b=RwOSzilM//UTVD4xpjml5Uequt4+5aKStQXaU+nv4NQwwvYq5HyX5xhk6VV77Mb86q +ZbqgVZ1opNMyVhR7K4UNGojFfABmnKzlsdnr+ZkYroAYdvjjYDvjcyai7Bb8y1J9XsG pvwby2CUuDt7LUkEZQ5Z8ZRur1MecGXVZZC9NwGB41IoXjD51q2ffUWaCyVvpDctLqVi EIAJetCi//17HuJaDkBpI4bgBPgWp/UlQwblBeJpxW51e5UspJuxpKsBvSxuTmUcCG2V NFY3cd9kVU8kBteeGheJR4uzdiNiHh32DRPAy+m51bYECkFBKq/MJNDt35m7ob83G4+/ d3pg==
X-Gm-Message-State: AOUpUlEqYPdylZREMYuGcbzca/FF5A0UP77sWr4BgtB/5W4qlA/EiaNH fzFZox2Pv10icN2aXuKWZja9SFDOjb78LRdTGBbE0vJf
X-Google-Smtp-Source: AAOMgpewQhH/YG4ui4+ooIJ6W4gK0GqHSg6BJy2EsVGyJEs+rQWBtL62k20Y93xdbuU58ifuKdsgVRNC2lWT6PkWPbc=
X-Received: by 2002:a2e:2ac3:: with SMTP id q186-v6mr8769211ljq.123.1532354884555; Mon, 23 Jul 2018 07:08:04 -0700 (PDT)
MIME-Version: 1.0
Received: by 2002:a19:aa46:0:0:0:0:0 with HTTP; Mon, 23 Jul 2018 07:08:03 -0700 (PDT)
In-Reply-To: <fd9ff226-b0a1-53f4-1b98-b4f6ecf3ce01@cisco.com>
References: <CABCOCHQ47ztJTPaZMZK7FWHsRPk1jN6SuuAWtg08rmtVgUPEWw@mail.gmail.com> <87va981svk.fsf@chopps.org> <a4ea8559-1f1f-8e7f-3dc5-29cb45fd4c7b@cisco.com> <CABCOCHT-NukBjvr6O02Meuz7fzD=8g5HvWNwkkEazQiLAsGM7A@mail.gmail.com> <fd9ff226-b0a1-53f4-1b98-b4f6ecf3ce01@cisco.com>
From: Andy Bierman <andy@yumaworks.com>
Date: Mon, 23 Jul 2018 07:08:03 -0700
Message-ID: <CABCOCHS55qPk0X_wihLhS6QxPABQ8aH1CvXiLUYW9QcSDL4A_A@mail.gmail.com>
To: Robert Wilton <rwilton@cisco.com>
Cc: Christian Hopps <chopps@chopps.org>, NetMod WG <netmod@ietf.org>
Content-Type: multipart/alternative; boundary="000000000000907a1a0571ab2cfe"
Archived-At: <https://mailarchive.ietf.org/arch/msg/netmod/_iqVt67lM_fXnQd07yPhIzVWchY>
Subject: Re: [netmod] backward compatibility requirements in draft-verdt-netmod-yang-versioning-reqs-00
X-BeenThere: netmod@ietf.org
X-Mailman-Version: 2.1.27
Precedence: list
List-Id: NETMOD WG list <netmod.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netmod>, <mailto:netmod-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netmod/>
List-Post: <mailto:netmod@ietf.org>
List-Help: <mailto:netmod-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netmod>, <mailto:netmod-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 23 Jul 2018 14:08:09 -0000

On Mon, Jul 23, 2018 at 6:24 AM, Robert Wilton <rwilton@cisco.com> wrote:

>
>
> On 23/07/2018 12:54, Andy Bierman wrote:
>
>
>
> On Mon, Jul 23, 2018 at 2:50 AM, Robert Wilton <rwilton@cisco.com> wrote:
>
>> Hi Chris, Andy,
>>
>>
>> On 21/07/2018 17:00, Christian Hopps wrote:
>>
>>> As I pointed out at the mic @102 this requirement derives directly from
>>> the 1.x requirement of not changing the name of the module/namespace. If
>>> you allow for changing the namespace/module name for "major" (i.e.,
>>> incompatible) changes (i.e., like today) then this 3.1 requirement goes
>>> away.
>>>
>> Not sure that I agree.
>>
>> I think that you have made an assumption here that the server will
>> continue to support both old and new major revision (with different name)
>> of the module at the same time.  However, these is nothing in the existing
>> YANG upgrade rules that requires that.
>>
>> Ultimately, there is a choice whether supporting older module versions is
>> the servers problem or the clients problem, or perhaps a combination of the
>> two.
>>
>> The aim of requirement 3.1 is to ensure that there is a standard
>> mechanism available so that server implementations that want the
>> flexibility of supporting older client versions have a standard way of
>> doing so.  My intention is that this part of the solution would be optional
>> to implement and hence decided by the market, which is why the text in the
>> requirement is "to allow servers" rather than "to require servers".
>>
>>
>
> API versioning is usually done on the message exchanges.
> Trying to do the same for datastore contents is not going to work.
>
> A YANG schema can be considered an API.  Particularly looking at say the
> OpenConfig YANG schema.  I doubt all implementations will store all their
> configuration and operational state in a central place.
>
> You can write the word MUST in all caps as many times as you want,
> but that will not change anything.
>
>
> I disagree.  Marking a requirement as a MUST means that requirement has to
> be met for a solution to be considered viable.
>
> I previously had some text in the draft explaining how RFC 2119 text
> translates to evaluating the requirements, but was asked to take it out
> because it is obvious.  Perhaps it should go back in ...
>
>
So you can answer the question how YANG validation works when multiple
revisions of a
module are implemented?  I do not doubt that you can find a leaf somewhere
that can
be changed.  Not at all convinced the validation rules can be rewritten to
account
for actual incompatible changes, like changing the type of data node or
replacing nodes
with completely different configuration.  Even less convinced that this
complexity is
worth the cost.



Thanks,
> Rob
>
>
Andy


>
>
>> Thanks,
>> Rob
>>
>
> Andy
>
>
>>
>>
>>
>>> I think the plan is to reword some of these to get closer to the
>>> intention which I believe is to allow for smoother transition from one
>>> module to the next while making incompatible but mostly non-impacting
>>> changes.
>>>
>>> Thanks,
>>> Chris.
>>>
>>> Andy Bierman <andy@yumaworks.com> writes:
>>>
>>> Hi,
>>>>
>>>> I strongly object to requirement 3.1:
>>>>
>>>>
>>>>     3.1  The solution MUST provide a mechanism to allow servers to
>>>>             support existing clients in a backward compatible way.
>>>>
>>>>
>>>>
>>>> This is not what servers do today at all.
>>>> They provide only one version of an implemented module, as specified in
>>>> RFC
>>>> 7950.
>>>>
>>>> It is a vendor and operator decision when to upgrade a server such that
>>>> non-backward compatible changes are made. They must decide if/when it
>>>> is ok
>>>> based on the client applications in use.
>>>>
>>>> This requirement says you cannot make backward-incompatible changes
>>>> which completely contradicts requirements 1.1 and 1.2.
>>>>
>>>> IMO requirement 3.1 should be removed, or change MUST to MAY
>>>>
>>>>
>>>> Andy
>>>> _______________________________________________
>>>> netmod mailing list
>>>> netmod@ietf.org
>>>> https://www.ietf.org/mailman/listinfo/netmod
>>>>
>>>
>>> _______________________________________________
>>> netmod mailing list
>>> netmod@ietf.org
>>> https://www.ietf.org/mailman/listinfo/netmod
>>> .
>>>
>>>
>>
>
>