[Gen-art] Gen-ART Last Call review of draft-ietf-opsawg-service-assurance-architecture-11

Paul Kyzivat <pkyzivat@alum.mit.edu> Tue, 15 November 2022 16:07 UTC

Return-Path: <pkyzivat@alum.mit.edu>
X-Original-To: gen-art@ietfa.amsl.com
Delivered-To: gen-art@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 96155C1522DA; Tue, 15 Nov 2022 08:07:07 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.998
X-Spam-Level:
X-Spam-Status: No, score=-6.998 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=alum.mit.edu
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id TB1MNmMosSuM; Tue, 15 Nov 2022 08:07:03 -0800 (PST)
Received: from NAM12-BN8-obe.outbound.protection.outlook.com (mail-bn8nam12on2062b.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe5b::62b]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 10AAEC1524A2; Tue, 15 Nov 2022 08:06:29 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=j16DippmFj3+FdBzrfHjb46OBeXHe6xbgh/jau/e/Kbt7RPvhnXXXNXyBJzoiNAVH0prV14lpwRbk/aD7u0VsV27aK1mW+shv5Y6RRj76aEgP/A/SKZtzlFnHnNdO595J+AOs2ALqSZ+I2IgG2j1Nyr5EOSyKeaHBKnMd5gg/qQGiubI9iJl+jr1sLiRqxcFNP72QBL78P+eOzVJQQs83N4ELkAANclYfiJb6lGg9klzPN1Ff558sXTgptSU20gUPkqejOYfkw7jkyw2fbSn9VnAMKMHiP/YsaE1KDxv3HdTgrvsfpPQ0lB+5YprHGVdbsZw+zi23LHIjQpF8w+PEg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=CvSxS44Emb0UFJqXq0/eWDT0QZPh4TeQgQAt8y5HRzc=; b=APnLWuWi627LXYGQgKSkPZ6FDrKo4RVhSh3MeJ9lOjYp9YKFp7Ls9GUbVlUZyYm0NeXTxas5nPrNsYvPHYpUB8o39YJzvwndrltYoKF2LactwSHhcDMoCPDi1l7eafdakxhuCgeGu1p1tQ991qjKF/SPtvyoYYzMEbFjQyHCX5Wufx01QVlLwJuXMTQyxfSqo7jyJks0s4lHkYh16VyNGS/rrl2YrYSF+Aa6kJUvy6f0xyKM95gjN9mhXQebObSbJPcw9kRgb1RgIEQ9pVnusWLb06Gh8UR6y0Tc+IA8w6sFLzwyLRjGfy3c7OLxMg0IFTOSWAuUzp9HW16iI53VOg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 18.7.68.33) smtp.rcpttodomain=ietf.org smtp.mailfrom=alum.mit.edu; dmarc=pass (p=none sp=none pct=100) action=none header.from=alum.mit.edu; dkim=none (message not signed); arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=alum.mit.edu; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=CvSxS44Emb0UFJqXq0/eWDT0QZPh4TeQgQAt8y5HRzc=; b=MhXzkRg29CpriXCzfNndKXllShZz2Q7XjwFVvdlC9ZT+rB62dPTlifOEb3mu5iycl4QJUemgguinSW4oUjknzGkCLhrhQx5Ka7KC2tzy97vwl2M/iXXYiwA2p6n3Q1pQxfBQCqtodcyJ3YKBdjnQH82FmdDTNSCF7K+CLHCUqN4=
Received: from DS7PR03CA0284.namprd03.prod.outlook.com (2603:10b6:5:3ad::19) by SA1PR12MB6917.namprd12.prod.outlook.com (2603:10b6:806:24c::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5813.18; Tue, 15 Nov 2022 16:06:26 +0000
Received: from DM3NAM02FT003.eop-nam02.prod.protection.outlook.com (2603:10b6:5:3ad:cafe::c9) by DS7PR03CA0284.outlook.office365.com (2603:10b6:5:3ad::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5813.17 via Frontend Transport; Tue, 15 Nov 2022 16:06:26 +0000
X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 18.7.68.33) smtp.mailfrom=alum.mit.edu; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=alum.mit.edu;
Received-SPF: Pass (protection.outlook.com: domain of alum.mit.edu designates 18.7.68.33 as permitted sender) receiver=protection.outlook.com; client-ip=18.7.68.33; helo=outgoing-alum.mit.edu; pr=C
Received: from outgoing-alum.mit.edu (18.7.68.33) by DM3NAM02FT003.mail.protection.outlook.com (10.13.4.168) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5813.12 via Frontend Transport; Tue, 15 Nov 2022 16:06:25 +0000
Received: from [192.168.1.52] (c-24-62-106-242.hsd1.ma.comcast.net [24.62.106.242]) (authenticated bits=0) (User authenticated as pkyzivat@ALUM.MIT.EDU) by outgoing-alum.mit.edu (8.14.7/8.12.4) with ESMTP id 2AFG6NxS030543 (version=TLSv1/SSLv3 cipher=AES128-GCM-SHA256 bits=128 verify=NOT); Tue, 15 Nov 2022 11:06:24 -0500
Message-ID: <1b666f83-966a-c3ed-734a-54e5e60a83c5@alum.mit.edu>
Date: Tue, 15 Nov 2022 11:06:23 -0500
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0) Gecko/20100101 Thunderbird/102.4.0
From: Paul Kyzivat <pkyzivat@alum.mit.edu>
To: draft-ietf-opsawg-service-assurance-architecture.all@ietf.org
Cc: General Area Review Team <gen-art@ietf.org>
Content-Language: en-US
Content-Type: text/plain; charset="UTF-8"; format="flowed"
Content-Transfer-Encoding: 7bit
X-EOPAttributedMessage: 0
X-MS-PublicTrafficType: Email
X-MS-TrafficTypeDiagnostic: DM3NAM02FT003:EE_|SA1PR12MB6917:EE_
X-MS-Office365-Filtering-Correlation-Id: 1a4b8a8c-1632-4b3b-b851-08dac7235941
X-MS-Exchange-SenderADCheck: 1
X-MS-Exchange-AntiSpam-Relay: 0
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: X49FtSYJ57lW2Y0t5FJh2gNM9IWahZla9wIg4ydjT1y9pudPER1duKlyocap2pZZ1SI0mFiyBUvs7zFdjozKD6nNM3n9HzHKRMEQV07wlOjQeCeuByW9mqokfSQ14Klx1xZQ+2D64hyjFM/AwS3rsVLBo8t16ZUdmbdI3Zr9npZbj9YRGnMZbf5MuGSYpr75qUJUP1b3QYmI7r8EGg8SA08TIdktRjnrdN2ldLi62LUJA0aY9JZYoRsPjVnG2cP42Te1kzpWX+K5d3KGmUDxdwfhb7jHmoA/k4NVEy0+0EZ9z6KSyl+wQBjCrPgsUpszDxZIUUnFTnfn+VlGygQ9Ypbxp+9deyuMTNluGksSXGv7XT7JSOtnPKFeSKbuczFn+NYo4ncwN5LrqLAAsKNnQQFI1cyFWV1rRblyYydME8Y1qF3ziPrlnlUp2okl7KonxUeEkmUlnkeUnv1EqI5KPKPgMij/3uygi0+APygf7IyZJ3TBWvr3e5jDNBDAOW656UbxgXhbf180cQAtHrFSsgDfoPVas199R97Mh5pZlmRggqrQ+3iWW+4Tti7hOYQAKel0Zwqym6sA8VXxBMi/i7Ofu/ljkpLAf5RA3sAlIgtNOYt4dbMncIfELrFl+XBrRB1wfxdM5gLovxbdhI26Hb+y1uB39825aDvHLqMWxZmmYYtnJUsfFxJkBtU/gj0TIvYGWDPebfffxlB0WusHLUX+ntLwYkNRR2ONhuIZ2ejAsz1wZKVGK8rJM+74WzVsUgjFa0XXQ+DOsVTSmnSwgi3MiWDDMF6YzzWkxMX0irQ=
X-Forefront-Antispam-Report: CIP:18.7.68.33; CTRY:US; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:outgoing-alum.mit.edu; PTR:outgoing-alum.mit.edu; CAT:NONE; SFS:(13230022)(39860400002)(376002)(396003)(136003)(346002)(451199015)(46966006)(36840700001)(8676002)(70586007)(70206006)(82310400005)(4326008)(41320700001)(450100002)(83380400001)(36860700001)(4001150100001)(8936002)(41300700001)(5660300002)(7596003)(356005)(47076005)(956004)(40480700001)(2616005)(966005)(186003)(336012)(26005)(75432002)(478600001)(6916009)(86362001)(31696002)(316002)(786003)(82740400003)(2906002)(31686004)(43740500002); DIR:OUT; SFP:1101;
X-OriginatorOrg: alum.mit.edu
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Nov 2022 16:06:25.9733 (UTC)
X-MS-Exchange-CrossTenant-Network-Message-Id: 1a4b8a8c-1632-4b3b-b851-08dac7235941
X-MS-Exchange-CrossTenant-Id: 3326b102-c043-408b-a990-b89e477d582f
X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=3326b102-c043-408b-a990-b89e477d582f; Ip=[18.7.68.33]; Helo=[outgoing-alum.mit.edu]
X-MS-Exchange-CrossTenant-AuthSource: DM3NAM02FT003.eop-nam02.prod.protection.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Anonymous
X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR12MB6917
Archived-At: <https://mailarchive.ietf.org/arch/msg/gen-art/-6ZNHph8My80VstOhYoI8-XOZ4o>
Subject: [Gen-art] Gen-ART Last Call review of draft-ietf-opsawg-service-assurance-architecture-11
X-BeenThere: gen-art@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: "GEN-ART: General Area Review Team" <gen-art.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/gen-art>, <mailto:gen-art-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/gen-art/>
List-Post: <mailto:gen-art@ietf.org>
List-Help: <mailto:gen-art-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/gen-art>, <mailto:gen-art-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 15 Nov 2022 16:07:07 -0000

I am the assigned Gen-ART reviewer for this draft. The General Area
Review Team (Gen-ART) reviews all IETF documents being processed
by the IESG for the IETF Chair.  Please treat these comments just
like any other last call comments.

For more information, please see the FAQ at

<https://trac.ietf.org/trac/gen/wiki/GenArtfaq>.

Document: draft-ietf-opsawg-service-assurance-architecture-11
Reviewer: Paul Kyzivat
Review Date: 2022-11-15
IETF LC End Date: 2022-11-20
IESG Telechat date: ?

Summary:

This draft is on the right track but has open issues, described in the 
review.

Issues: 1
Nits: 8

1) ISSUE: Section 3.6: ambiguity

As best I understand the text "Under Maintenance" is being used in two 
different ways that can cause ambiguity:

- "When a service or subservice is flagged as under maintenance, it must 
report a generic "Under Maintenance" symptom, for propagation towards 
subservices that depend on this specific subservice: any other symptom 
from this service, or by one of its impacting dependencies must not be 
reported."

-  " In more complex cases, for instance with a primary and backup path 
... In such cases, the status of the service instance might include the 
"Under Maintenance" as well as other symptoms (e.g. from the backup path)"

In the latter case, if nothing is wrong with the backup path then there 
might only be the "Under Maintenance" from the primary path, and it 
would be indistinguishable from a case where there was no backup path.

IIUC it is important that these cases be distinguishable.


2) NIT: Section 3: missing word

"Based on the service configuration provided by the service 
orchestrator, the SAIN orchestrator decomposes the assurance graph. It 
then sends to the SAIN agents the assurance graph along some other 
configuration options."

s/along some other/along with some other/


3) NIT: Section 3.3.3: Improper DNS name in example

"Assume that we want to assure a kubernetes cluster https://kubernetes.io."

Examples like this should only use DNS domains intended for examples, 
such as kubernetes.example.org.


4) NIT: Section 3.1.1: missing word

"The status of a should depend on the status of c, d, e, f, g, and h"

s/status of a should/status of a ???? should/


5) NIT: Section 3.6: confusing wording

"Symptoms related to the device-specific subservices, such as the 
interfaces, might be ignored as well as their state changes is probably 
the consequence of the maintenance."

Hard to parse. Does the following work?

"Symptoms related to the device-specific subservices, such as the 
interfaces, might also be ignored because their state changes are 
probably the consequence of the maintenance."


6) NIT: Section 3.6: punctuation

Odd punctuation in:

"... subservices that depend on this specific subservice: any other 
symptom ..."

I think this would be better as two sentences:

"... subservices that depend on this specific subservice. Any other 
symptom ..."


7) NIT: Section 3.7: bad syntax

Syntax problems with:

"One of them is the domain of service management on network elements, 
with also requires its own assurance."

Does the following express the intent?

"One of them is the domain of service management on network elements, 
that also require their own assurance."


8) NIT: Section 3.7: awkward language

The following language is quite awkward:

" Exactly like ...
, exactly like ...
, exactly like ...
. Exactly like ... .

I suggest breaking this out as a list.


9) NIT: Section 3.9: unusual language

The following is IMO unusual phrasing:

"The assurance graph will change along the time"

I think the following would be a better phrasing:

"The assurance graph will change over time"