[OPSAWG] AD review for draft-ietf-opsawg-model-automation-framework-04

"Rob Wilton (rwilton)" <rwilton@cisco.com> Fri, 04 September 2020 17:22 UTC

Return-Path: <rwilton@cisco.com>
X-Original-To: opsawg@ietfa.amsl.com
Delivered-To: opsawg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 538593A0C12; Fri, 4 Sep 2020 10:22:27 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.598
X-Spam-Level:
X-Spam-Status: No, score=-9.598 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=YYIOgK2U; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=VDLCfdoM
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ccXKSTqOlqIC; Fri, 4 Sep 2020 10:22:25 -0700 (PDT)
Received: from rcdn-iport-9.cisco.com (rcdn-iport-9.cisco.com [173.37.86.80]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5A10D3A0C11; Fri, 4 Sep 2020 10:22:25 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=5649; q=dns/txt; s=iport; t=1599240145; x=1600449745; h=from:to:subject:date:message-id: content-transfer-encoding:mime-version; bh=76IbYb+vVT26bdc8n5sPGJk+6RkJxJYeJgoFHNDFlrQ=; b=YYIOgK2UgFhdQiunWXBZT4ooQ1BfBVDFfbEVw3/GTig5xlG23VEI8suM m6+BUzvuPHvyMOpnhdMy/bNhnVuK8yleU/WfIVMo/O7a38LrUckVaccKY 5+ZTPBSqIL3lCqcm7xuGeCaff6VMEIT9wdl5i4RDP6MV5qN1pWcHax8O/ A=;
IronPort-PHdr: 9a23:/DfO3B2HWUv/KIgmsmDT+zVfbzU7u7jyIg8e44YmjLQLaKm44pD+JxWGv6dsgUPHG4LB5KEMh+nXtvXmXmoNqdaEvWsZeZNBHxkClY0NngMmDcLEbC+zLPPjYyEgWsgXUlhj8iK6PFRbXsHkaA6arni79zVHHBL5OEJ8Lfj0HYiHicOx2qiy9pTfbh8OiiC6ZOZ5LQ69qkPascxFjA==
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0B+CQAzd1Jf/5BdJa1fgQmDHFEHgUgvLAqHdAOmX4JTA1ULAQEBDAEBLQIEAQGESwKCNgIkOBMCAwEBCwEBBQEBAQIBBgRthVwMhWsgFRMGAQEqBgQEEQEaJEIXDwEEGxoTB4U2Ay4BA6dlAoE5iGF0gQEzgwEBAQWFDRiBIHAJgTiCcYo5G4FBP4ERQ4dKg0iCLZADI4IypBYKgmWaU6BWklGfVwIEAgQFAg4BAQWBayOBV3AVO4JpUBcCDY4rF4NOilZ0NwIGCgEBAwl8jTYtgQYBgRABAQ
X-IronPort-AV: E=Sophos;i="5.76,390,1592870400"; d="scan'208";a="730584596"
Received: from rcdn-core-8.cisco.com ([173.37.93.144]) by rcdn-iport-9.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 04 Sep 2020 17:22:24 +0000
Received: from XCH-RCD-001.cisco.com (xch-rcd-001.cisco.com [173.37.102.11]) by rcdn-core-8.cisco.com (8.15.2/8.15.2) with ESMTPS id 084HMOUn025304 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Fri, 4 Sep 2020 17:22:24 GMT
Received: from xhs-aln-003.cisco.com (173.37.135.120) by XCH-RCD-001.cisco.com (173.37.102.11) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Fri, 4 Sep 2020 12:22:23 -0500
Received: from xhs-rcd-003.cisco.com (173.37.227.248) by xhs-aln-003.cisco.com (173.37.135.120) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Fri, 4 Sep 2020 12:22:23 -0500
Received: from NAM10-MW2-obe.outbound.protection.outlook.com (72.163.14.9) by xhs-rcd-003.cisco.com (173.37.227.248) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Fri, 4 Sep 2020 12:22:23 -0500
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=X2n+NZ9NXFjyHifh+QFEdvOGTEH+cggvC62+KGMr6Ck8HlaWNXRiN+M6LH7NmZoeErG6AdwKBhnEJ7A6WE2COvn7eO+B8+631lacxyR2WDVZ1TP8bUCL09d709/t+rJlzvSspRj/I/2ukpr8MPoJl9eS8dwJMI5MGSWn9ZVEyicHnVpk9V47PsFEPSZFdutbDMH5j+fuDvRTiMsWssZTOAgBTlPAdSijn1Hee9iHoDKygJTJwy1CuNZFB3AVKUnSR19mbItQf1RyIlWg7yCoaWnqczHKlzvIiB4Syis0P8LbHGEJdTMAULWOqfuMtfzURSoaG4aNisVRfR3IwqoUvw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=TH56zrt30PaFRJUq1JvtCDAxq/ICRshWH6+Ea3iXP1c=; b=dZlJdpt6WStlSrat787OVeFMzB0qXKXFmmjmbmyJW3soX6D9DA+KO4Q+D7rBjk8CXBBDjzOKgCNNT59A19nd3EjbGYHUtGiOA65r6/IQIXZCqR73JY6bNOg82rgBeAwLaUMAUAziLiQ5UfIrs+TFW3iUvhVdRa0FEizHgzi5MejI5of8T89D0QcflgGuIelnh9EwOUZTuTjYjB1TmvKsp5uiHbMQ3RViHfMJrFTZYiMqtrYZOglMoOahNaSYVXNTneyg6U3E1vj32ULQv1VxCx2Kf87U1lQoCNgUzFBFro956iXQfaU3SrjaAshT237GZGpPes2DJ9wn3kiKRcD3NA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cisco.com; dmarc=pass action=none header.from=cisco.com; dkim=pass header.d=cisco.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector2-cisco-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=TH56zrt30PaFRJUq1JvtCDAxq/ICRshWH6+Ea3iXP1c=; b=VDLCfdoMoz3f+Kr1YF84y+YVHi4b0BbEYL+Bi4Oznd+teAEa0NGnqpuZZbOO8mSDV9Nzxw8n6/VJxYpXDbW0TtZE+m0ik8FiQAO27ti2JZiMIg25OjQgLXAKbns8di5mMGBIPHmHzvJR2LW5QlkSvOX6mkYn0KNrlmTerPWDJVs=
Received: from MN2PR11MB4366.namprd11.prod.outlook.com (2603:10b6:208:190::17) by BL0PR11MB3250.namprd11.prod.outlook.com (2603:10b6:208:63::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3348.15; Fri, 4 Sep 2020 17:22:22 +0000
Received: from MN2PR11MB4366.namprd11.prod.outlook.com ([fe80::4d3f:f3e:add7:dfc1]) by MN2PR11MB4366.namprd11.prod.outlook.com ([fe80::4d3f:f3e:add7:dfc1%3]) with mapi id 15.20.3348.017; Fri, 4 Sep 2020 17:22:22 +0000
From: "Rob Wilton (rwilton)" <rwilton@cisco.com>
To: opsawg <opsawg@ietf.org>, "draft-ietf-opsawg-model-automation-framework.all@ietf.org" <draft-ietf-opsawg-model-automation-framework.all@ietf.org>
Thread-Topic: AD review for draft-ietf-opsawg-model-automation-framework-04
Thread-Index: AdaC3a2C6z2FO6K2SPCz/hmx2OWKrw==
Date: Fri, 04 Sep 2020 17:22:22 +0000
Message-ID: <MN2PR11MB4366A6F49DE8D6EFD8C5B969B52D0@MN2PR11MB4366.namprd11.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: ietf.org; dkim=none (message not signed) header.d=none;ietf.org; dmarc=none action=none header.from=cisco.com;
x-originating-ip: [82.15.79.32]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: ecf60827-4aef-40d2-5375-08d850f715a2
x-ms-traffictypediagnostic: BL0PR11MB3250:
x-microsoft-antispam-prvs: <BL0PR11MB32508AFF97BCC2A8C6B19F63B52D0@BL0PR11MB3250.namprd11.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: zvNBVld4snOWfoGKQ1ScYnY/bZR3C/Z4Pl9KPilo86sDrLoyZi6bYYrEzXjDxcHjzx+OGfLSLMDrAZKblXvl0keHuu+gN3jhwdiKoisYxLosRgKvgjEAVYTr6zl9VRwqY6iGvvej/srBt1hPezjh7HT2udtYlkAE9B9+wA31CGysMZIzC+CeUTtPuCGBpm4xccGzoC+//YhEA+sgb5FgNKBW0JIwH2SHZwbqJwaUP910Pp6uoUcvnzVnD3GbBpgSbdQL+M95awlDKUNdtgtbXjLbgmGk4+U9qa0h6D4CBN0dtkXqp7S+X/MNflUsB7fey2po6RA/w3eWyGv3kG3lmA==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:MN2PR11MB4366.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(346002)(136003)(366004)(376002)(396003)(39860400002)(26005)(8676002)(6506007)(9686003)(450100002)(66476007)(66946007)(76116006)(186003)(110136005)(52536014)(64756008)(66556008)(66446008)(33656002)(316002)(86362001)(71200400001)(55016002)(5660300002)(7696005)(83380400001)(2906002)(478600001)(8936002); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata: PxE5Y/mQJnCniz9untUkNC9Rgg1PHKH5aTN034/T/Uukvpy6EYib8mZR3xd40Hv92c6+jeDAS7RVcQuvj5NzGg9s4ZIKLgCXnFztrtmYqI4BhpU5RKPoYouzl6ilOQC7RY64KreKONgA/kZU2pJSYANlkcCuDApy5zR5zN49NLi+BqCF5Xm6U34h0XF8B+9kEKoYVoM33WP1k7AgUjxrt69ErefcH7Udk1FUB/aEh/RE7sE9vS3w9ALA02ZZk28BR7iQFQbukgihroDm3jdo5Oc8aMSUGxJrZstzuY3UVj87Ln15RUWb9+yBCYZapTqJBatBFwspkNQ6OUlzo9hq1I59gPnj4SALqPXhk64hSJIB0R9BxsnLdLwZnfEkRi9t7BtU8SETsjd153XEi3IP6SQ4QLAgY/e+8JL5AEyY++PLz2ym23KNVxdRdwinNo/2DPiEaVatm9M1aPJmF3k3eKa8nmT1zx7A7ZJHXNo7DZ3K/k9r5OiAbFm2VW+V+IpkJhmmCTqNCdpfL2yQMzPW4eKpWf2iL4mGjsxW2r8+OR/qwzi1j0Whbd+hIqd9YvnZ0oXlihyiWZPWL5Ng1282NG/kRtcZJQiGmmqEWfVTZK5PYddzCpnKdIy1EzHXfc+cc/YsK/U4jXThln1GGbf2XA==
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: MN2PR11MB4366.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: ecf60827-4aef-40d2-5375-08d850f715a2
X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Sep 2020 17:22:22.1280 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: /Ytw4mNiMQvDkrYB7jz3zzzuQcdws/LwbXN/PRkV2Hi99kSEYDSV4DivIAGBEVAuNHowjetUC3i6DiwNeO0rXw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR11MB3250
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.37.102.11, xch-rcd-001.cisco.com
X-Outbound-Node: rcdn-core-8.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/opsawg/dQlVFQXJO3tV1ghJblC0ioLRjx8>
Subject: [OPSAWG] AD review for draft-ietf-opsawg-model-automation-framework-04
X-BeenThere: opsawg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: OPSA Working Group Mail List <opsawg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/opsawg>, <mailto:opsawg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/opsawg/>
List-Post: <mailto:opsawg@ietf.org>
List-Help: <mailto:opsawg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/opsawg>, <mailto:opsawg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 04 Sep 2020 17:22:27 -0000

Apologies for the lengthy delay in performing the AD review.

I found that this document to be well written so I would like to thank the authors, WG, and doc shepherd for that.  My more significant comments relate to questions on the scope of this architecture.


More significant comments:

1. By "Data Model" does this document mean "YANG data model"?  And if so, does it take this meaning all through this document, or only some of the time?

2. Generically, service data models are not necessarily written in YANG (e.g., I think that MEF are defining them using OpenAPI).  So, related to (1), is this architecture intended to be tied to only service models defined in YANG, or be more broadly applicable?

3. This architecture seems to quite strictly represent 3 layers (service, network, device).  Does it envisage that these layers may themselves be deconstructed?  E.g. a customer service can be constructed from underlying services (e.g., as discussed in section 3.1, but more as an East-West relationship).  Similarly, device models could also be deconstructed, e.g., if the dataplane is decoupled from the control plane, or if a device itself acts as a controller managing other devices.

4. My minimal understanding of the MEF LSO architecture was that they put quite a lot of emphasis on East-West models, probably at the service layer.  Is this effectively the same as what is described in Figure 1 in section 3.1?  Does the potential existence of these East-West APIs need to be described in any more detail?


Minor comments/clarifications:

Section 3.1: Data Models: Layering and Representation

5. Network Models are mainly network resource-facing modules; they
   describe various aspects of a network infrastructure, including
   devices and their subsystems, and relevant protocols operating at the
   link and network layers across multiple devices (e.g., network
   topology and traffic-engineering tunnel modules).
   
Would it be fair to say that Network Models might be protocol specific, or might be generalized?  If so, is that worth mentioning?


6. Re: DOTS & RFC 8783, I'm not sure how well the YANG model defined in that drafts fits into the category of Service YANG model.

7. Pipe vs hose vs funnel.  Are these terms, or do they need to be, defined somewhere?  In particular it is not obvious to me what the distinction is between pipe vs hose.


In Appendix A:
8. Would it be useful to discuss or reference YANG Catalog (as a source of querying YANG models), the public YANG github repository, or YANG module tags as a method of organizing YANG models?

9.
   o  Tunnel identities to ease manipulating extensions to specific
      tunnels [RFC8675].
      
I found this sentence slightly unclear.  Perhaps it could be reworded?

10. 
   o  Generic Policy Model:

   The Simplified Use of Policy Abstractions (SUPA) policy-based ...
   
It does not like this draft is going anywhere, and I'm not convinced that it
is really helpful to reference it here.  Or, if it must be referenced, it
should be caveated accordingly.

11.
A.3.  Device Models: Samples

I think that it would be helpful if this diagram, and the list in section A3.2, had references to the interface YANG module.

12.
A.3.1.  Model Composition

   o  Device Model
   
   [I-D.ietf-rtgwg-device-model] presents ...
   
Again, I'm not sure that this is a helpful reference, given that the approach defined in this draft did not gain traction, and instead, a more loosely coupled structure was preferred.  E.g., I see that tags (and arguably schema mount) solve this organizational problem in a more flexible way.

13.
A.3.1.1.  Schema Mount

   That capability does not cover design time.

This sentence is unclear on its own.  Perhaps either expand it or remove it.

Also, I wouldn't regard schema mount as necessarily being specific to device models, and could be used for network and service YANG models as well.  Although there may not be a good place to put it.

14. 
A.3.2.  Device Models: Samples

As above, having a section for interfaces/interface management would be useful.  I also think think it would be good to have a section for device management (e.g. system, nacm)

I would potentially reorder the list of modules:
   - Move Core Routing up, near the top of the list (above BGP)
   - L2VPN (next to) but before EVPN
   - Perhaps move BGP down, and having routing policy next to it might be helpful
   - NAT and Stateless Address Sharing could perhaps move down.


Editorial nits to check:

1. Network Operator -> network operator?
2. Perhaps "it can accommodate modules" -> "it can also accommodate modules"?
3. "follow top-down approach" -> "follow a top-down approach"
4. "validated during the implementation time" -> "validated during implementation"
5. For Diagram A2, possibly could have just used the full names and not requried the legend.
6. "[RFC8345] with TE topologies specifics." -> "[RFC8345] with TE topology related content."
7. "Network Topology Models" -> Network Topologies Model"?
8. "TE Topology Models" => "TE Topology Model"?
9. "Layer 3 Topology Models:" -> "Layer 3 Topology Model:"
10. "Layer 3 topologies specifics" -> "Layer 3 topology specifics"
11. "Layer 2 Topology Models:" -> "Layer 2 Topology Model:"
12. "Layer 2 topologies specifics" -> "Layer 2 topology specifics"
13. Figure 4: "Config Validate" -> "Config Validation", and realign "Monitoring"

Regards,
Rob