[OPSAWG] 4026 as a downref: Document shepherd review of draft-ietf-opsawg-yang-vpn-service-pm-06

Adrian Farrel <adrian@olddog.co.uk> Thu, 05 May 2022 08:59 UTC

Return-Path: <adrian@olddog.co.uk>
X-Original-To: opsawg@ietfa.amsl.com
Delivered-To: opsawg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1EAC1C159A31; Thu, 5 May 2022 01:59:11 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -5.895
X-Spam-Level:
X-Spam-Status: No, score=-5.895 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, MAY_BE_FORGED=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id s3UQEwu4JMHm; Thu, 5 May 2022 01:59:06 -0700 (PDT)
Received: from mta6.iomartmail.com (mta6.iomartmail.com [62.128.193.156]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B737FC157B47; Thu, 5 May 2022 01:59:02 -0700 (PDT)
Received: from vs2.iomartmail.com (vs2.iomartmail.com [10.12.10.123]) by mta6.iomartmail.com (8.14.7/8.14.7) with ESMTP id 2458wwCr011825; Thu, 5 May 2022 09:58:58 +0100
Received: from vs2.iomartmail.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id E3DA946052; Thu, 5 May 2022 09:58:57 +0100 (BST)
Received: from vs2.iomartmail.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id CDC614604C; Thu, 5 May 2022 09:58:57 +0100 (BST)
Received: from asmtp3.iomartmail.com (unknown [10.12.10.224]) by vs2.iomartmail.com (Postfix) with ESMTPS; Thu, 5 May 2022 09:58:57 +0100 (BST)
Received: from LAPTOPK7AS653V (229.197.bbplus.pte-ag1.dyn.plus.net [81.174.197.229] (may be forged)) (authenticated bits=0) by asmtp3.iomartmail.com (8.14.7/8.14.7) with ESMTP id 2458wtYa003405 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Thu, 5 May 2022 09:58:57 +0100
Reply-To: adrian@olddog.co.uk
From: Adrian Farrel <adrian@olddog.co.uk>
To: 'tom petch' <ietfc@btconnect.com>, "'Wubo (lana)'" <lana.wubo=40huawei.com@dmarc.ietf.org>, draft-ietf-opsawg-yang-vpn-service-pm@ietf.org
Cc: 'opsawg' <opsawg@ietf.org>
Date: Thu, 05 May 2022 09:58:55 +0100
Organization: Old Dog Consulting
Message-ID: <043701d8605e$5b417b40$11c471c0$@olddog.co.uk>
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Mailer: Microsoft Outlook 16.0
Content-Language: en-gb
Thread-Index: AdhgXjBZ7obm63ALThyEo8160DqeHA==
X-Originating-IP: 81.174.197.229
X-Thinkmail-Auth: adrian@olddog.co.uk
X-TM-AS-GCONF: 00
X-TM-AS-Product-Ver: IMSVA-9.1.0.2090-9.0.0.1002-26874.006
X-TM-AS-Result: No--19.575-10.0-31-10
X-imss-scan-details: No--19.575-10.0-31-10
X-TMASE-Version: IMSVA-9.1.0.2090-9.0.1002-26874.006
X-TMASE-Result: 10--19.574500-10.000000
X-TMASE-MatchedRID: er5VKMiLVuBSr2+67Jvlw8LFswCykyAWAajW+EL+laN3de2OoBqgwoSW HYnJJld9K52HYCW7VBN1cgRJLEBdHJlbG0HPEaFButvHF25zoU/KrKWVfpQki9bZhgeyVPQjAsF xluGrbm2QPt0G3h0TaZw6kSS19ACeDkYiOjmaAHZswYo64ufkVSKpn/iCVxz84RGOK0vhCyu0dz 44aFByLoyuYlbd+W376jnqk9Rz/arv1ItBfIbu0LU+IyHhkXf1DvKSaIxu6koM74Nf6tTB9gC7A ZSleJMNo+CuWO5x939H1t/3L+o216Zr0BlzDkMAxDiakrJ+SpmV3TRDlI7Srlc/Cedjlcvk9+px IMCSswDY6l6Q0ccySrELv3XiWfgG7aXkNnpvXLIvun/+8u/hs5Q7eT0DII9NUoXFjv/N8aI5xj+ OQMYqInqcFJPjHKssSfiLM9K7EO+KNxixgCTQet5x7RpGJf1aaX6dBsOAfDyvloAnGr4qhnxzNO 8jNav+YcwHvZUk/Qujp64yUKGpZPNdJuin94YmlFz9z7doHVH8555uznRV4FSOymiJfTYXRAENU PO9mPUWm/gAtjCd7N0xKzZ4CqOtEwrLJRWzqcxW04a/r/flJdhQO8CvZj/X0XVZGnalJVuKUmaU XynhB/Guh+TBcNihcWDkBZ3nhB7HQV0i1/ABgvPCLqGbMJ+/ocSvEPKGO+e4Wf11l3allYr89wC 5UuPWri99y3ZFr5mZnWpi5AlVu+4imrbcRTzF9dFc7Qbe8mpMVCcj56k8hpm3OIVSf4P5cmMmAc pqutNvniwqV+WTky8gJXl1HMzcRuaE7xFhkfueAiCmPx4NwLTrdaH1ZWqCpvI8UZOf47iCRQiqb NkvTiiNG0gFH6Rw3QfwsVk0UbtuRXh7bFKB7iS6c2QoDcqlSO2cOtAqvSGlYoOLgoniV0f8uu3B 9sHXXwjihSrlWBo=
X-TMASE-SNAP-Result: 1.821001.0001-0-1-22:0,33:0,34:0-0
Archived-At: <https://mailarchive.ietf.org/arch/msg/opsawg/iSCfN6b6RlbkEbizffN3RZxXMaY>
Subject: [OPSAWG] 4026 as a downref: Document shepherd review of draft-ietf-opsawg-yang-vpn-service-pm-06
X-BeenThere: opsawg@ietf.org
X-Mailman-Version: 2.1.34
Precedence: list
List-Id: OPSA Working Group Mail List <opsawg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/opsawg>, <mailto:opsawg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/opsawg/>
List-Post: <mailto:opsawg@ietf.org>
List-Help: <mailto:opsawg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/opsawg>, <mailto:opsawg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 05 May 2022 08:59:11 -0000

Just chiming in on this thread.

Don't be frightened of downrefs.  They are just a small piece of process
easily handled.

Better to set the reference correctly. If it is necessary to read RFC 4026
in order to understand part of this document, then it is a normative
reference. Otherwise, of course, it is an Informative reference.

Adrian

-----Original Message-----
From: tom petch <ietfc@btconnect.com> 
Sent: 27 April 2022 12:35
To: Wubo (lana) <lana.wubo=40huawei.com@dmarc.ietf.org>;
adrian@olddog.co.uk; draft-ietf-opsawg-yang-vpn-service-pm@ietf.org
Cc: 'opsawg' <opsawg@ietf.org>
Subject: Re: Document shepherd review of
draft-ietf-opsawg-yang-vpn-service-pm-06

From: OPSAWG <opsawg-bounces@ietf.org> on behalf of Wubo (lana)
<lana.wubo=40huawei.com@dmarc.ietf.org>
Sent: 25 April 2022 14:13

Hi Adrian,

About the issue on Normative Reference, RFC4026 as specific, the authors
think this will cause downref since RFC4026 is an Informational draft.

<tp>

True but totally irrelevant.  The issue is whether or not the RFC is needed
in order to understand the I-D, the consequences thereof are irrelevant.
IMHO it is needed to make sense of 'p' so it is a Normative Reference.  To
do otherwise is to game the system (which opsawg-l3sm-l3nn does!).

Tom Petch

p.s. I am feeling stroppy today - where has the IETF e-mail service gone?
DoS attack?

We still suggest RFC4026 as an informative reference because the model just
references it as informational.

Thanks,
Bo

-----Original Message-----
From: OPSAWG [mailto:opsawg-bounces@ietf.org] On Behalf Of Wubo (lana)
Sent: Monday, April 25, 2022 4:44 PM
To: adrian@olddog.co.uk; draft-ietf-opsawg-yang-vpn-service-pm@ietf.org
Cc: 'opsawg' <opsawg@ietf.org>
Subject: Re: [OPSAWG] Document shepherd review of
draft-ietf-opsawg-yang-vpn-service-pm-06

Hi Adrian,

Many thanks for your detailed review. We have released Rev-07 to address
these issues, see if they are fully addressed.
https://www.ietf.org/rfcdiff?url2=draft-ietf-opsawg-yang-vpn-service-pm-07

Please also find some replies inline.

Thanks,
Bo

-----Original Message-----
From: Adrian Farrel [mailto:adrian@olddog.co.uk]
Sent: Saturday, April 23, 2022 12:35 AM
To: draft-ietf-opsawg-yang-vpn-service-pm@ietf.org
Cc: 'opsawg' <opsawg@ietf.org>
Subject: Document shepherd review of
draft-ietf-opsawg-yang-vpn-service-pm-06

Hi,

I'm the document shepherd for this document as it moves beyond the WG for
requested publication as an RFC.

I reviewed the draft at -03 during WG last call, so my comments here are
basically editorial with only a few small questions.

If the authors could produce a new revision, I will start work on the
shepherd write-up.

One other point: can someone say whether this draft has been shared with the
IPPM working group?

Thanks,
Adrian

===

Introduction.

First sentence could use a reference to RFC 6020.
[Bo Wu] Fixed.

---

Introduction

OLD
   It defines that the performance
   measurement telemetry model to be tied with the service, such as
   Layer 3 VPN and Layer 2 VPN, or network models to monitor the overall
   network performance or Service Level Agreement (SLA).
NEW
   It defines that the performance
   measurement telemetry model should be tied to the services (such as
   a Layer 3 VPN or Layer 2 VPN) or to the network models to monitor the
   overall network performance and the Service Level Agreements (SLAs).
END

 [Bo Wu] Fixed.
---

2.1

OLD
   SLA     Service Level Agreements
NEW
   SLA     Service Level Agreement
END

[Bo Wu] Fixed.
---

3.

   For example, the
   controller can use information from [RFC8345], [I-D.ietf-opsawg-sap]
   or VPN instances.

I think this is where there should be a reference to RFC 9182 and
draft-ietf-opsawg-l2nm.

[Bo Wu] Fixed.
---

3.1

s/dynamic-changing/dynamic/
[Bo Wu] Fixed.

---

4.

OLD
   This document defines the YANG module, "ietf-network-vpn-pm", which
   is an augmentation to the "ietf-network" and "ietf-network-topology".
NEW
   This document defines the YANG module, "ietf-network-vpn-pm", which
   is an augmentation to the "ietf-network" and "ietf-network-topology"
   modules.
END

[Bo Wu] Fixed.
---

4.

Would it be more consistent if the box on the right of Figure 2 showed
"ietf-network-vpn-pm"?
[Bo Wu] Fixed.

---

I think that Figure 3 could use a little tidying.
- Some gaps in lines
- A couple of lines slightly out of place
- S2A and S2B are confusinly places
- The cross-over of VN3-N2 and VN1-N1 is unclear
- Wording of the Legend a little unclear

How about...


                     VPN 1                       VPN 2
          +------------------------+   +------------------------+
         /                        /   /                        /
        / S1C_[VN3]:::           /   /                        /
       /         \   :::::      /   / S2A_[VN1]____[VN3]_S2B /
      /           \       :::  /   /      :          :      / Overlay
     /             \         :::::::::::: :          :     /
    / S1B_[VN2]____[VN1]_S1A /   /       :           :    /
   +---------:-------:------+   +-------:-:----------:---+
             :        :     ::::::::::::   :         :
             :         :   :                :        :
   Site-1A   :  +-------:-:------------------:-------:-----+ Site-1C
     [CE1]___:_/_______[N1]___________________[N2]___:____/__[CE3]
             :/       / / \             _____//     :    /
   [CE5]_____:_______/ /    \     _____/     /    ::    /
 Site-2A    /:        /       \  /          /   ::     /
           / :                [N5]         /  ::      / Underlay Network
          /   :     /       __/ \__       / ::       /
         /     :   /    ___/       \__   /::        /
Site-1B /       : / ___/              \ /:         /  Site-2B
[CE2]__/________[N4]__________________[N3]________/____[CE4]
      /                                          /
     +------------------------------------------+

    Legend:
    N:Node   VN:VPN-Node  S:Site  CE:Customer Edge
    __  Link within a network layer
    :   Mapping between network layers

[Bo Wu] Fixed. Thanks for helping to correct the figure.
---

4.1

s/topologies are both built/topologies are built/ [Bo Wu] Fixed.

---

The legend for Figure 4 should include "TP" (if TPs are actually relevant to
the figure and aren't something you should remove - the text doesn't mention
them, and they don't really seem to be important in Section 4.1).

Probably, TP should be added to the list in Section 2.1 with a reference to
where TP is properly explained. 4.4 would then be able to lean on that
definition.

[Bo Wu] Fixed. Thanks for catching this. The reference of TP has been added
in Section 2.1.
---

4.1

s/VPN PM can provides/VPN PM can provide/

[Bo Wu] Fixed.
---

4.2

s/[RFC9181])./[RFC9181]./

[Bo Wu] Fixed.
---

4.2 etc.

Not sure why 'mac-num' has that name when you use 'ipv4' and 'ipv6'
not 'ipv4-num' and 'ipv6-num'.  This is highly unimportant, but might be
something to fix purely for consistency of appearance.

[Bo Wu] Fixed.
---

4.4

   The 'links' are classified into two types: topology link defined in
   [RFC8345] and abstract link of a VPN between PEs.

Would be nice to give a reference for the abstract link as well.
[Bo Wu] Fixed. The abstract one is defined in this module.

---

4.4

   The performance data of a link is a collection of counters that
   report the performance status.

Perhaps "counters and gauges"?
[Bo Wu] Fixed.

---

5. and  10.

I think that all documents referenced from 'reference' clauses should be
Normative References. I found 3 (4026, 4364, 8571) that are not.
There might be a good reason (if so tell me) or this could be an oversight.
[Bo Wu] Fixed. Sorry for the oversight, not fully corrected. Tom also
pointed this out .

---

5.

It's not really your fault, but I hate to see types redefined, especially
with the same name.

     typedef percentage {
       type decimal64 {
         fraction-digits 5;
         range "0..100";
       }
       description
         "Percentage.";
     }

...appears exactly like this in RFC 8532. This makes me think that it should
possibly be in a common types module somewhere. Possibly nothing you can do
about this at this stage.

Do we have a way of flagging desirable common types to Netmod?

Is there value in you using a different name for this type just to set it in
the context of your work?
[Bo Wu] Thanks for pointing this out. And I need more guidance on this
issue. The definition of percentage in this draft is the same as that in RFC
8532, which is also for "loss-ratio". Actually, this value may derive from
the mechanism of RFC 8532. We have imported "ietf-lime-time-types" from RFC
8532. But "percentage" is defined in "ietf-connectionless-oam". As
"ietf-connectionless-oam" is a device model, I'm not sure if a network
configuration model could import "ietf-connectionless-oam".

---

5.

vpn-pm-type has a case for inter-vpn-access-interface that is empty and
described as a placeholder. And that is all good.

But I expected some text (not a lot) explaining:
- why this is empty
- how/why it might be used in future (presumably through augmentation)

I suspect this belongs in the "VPN PM type" hanging text in Section 4.4 [Bo
Wu] Our consideration is inter-vpn-access-interface PM is VPN-specific
measurement, compared with the tunnel PM that may be shared by multiple
VPNs. And based on this, the measurement could be CE-PE-PE-CE or PE-PE or
other combination. The empty leaf is defined to specify the basic VPN
specific measurement, and allow extension for other measurement
combinations.
Please see whether the new text helps. Here is the text proposed:
"This is a placeholder for inter-vpn-access-interface PM, which is not bound
to a specific VPN access interface. The source or destination VPN access
interface of the measurement can be augmented as needed."

---

OLD
   Appendix A.  Illustrating Examples
NEW
   Appendix A.  Illustrative Examples
OR
   Appendix A.  Examples
END
[Bo Wu] Fixed.

_______________________________________________
OPSAWG mailing list
OPSAWG@ietf.org
https://www.ietf.org/mailman/listinfo/opsawg

_______________________________________________
OPSAWG mailing list
OPSAWG@ietf.org
https://www.ietf.org/mailman/listinfo/opsawg
=