Re: [OPSAWG] Warren Kumari's No Objection on draft-ietf-opsawg-ntf-11: (with COMMENT)

Haoyu Song <haoyu.song@futurewei.com> Wed, 01 December 2021 17:52 UTC

Return-Path: <haoyu.song@futurewei.com>
X-Original-To: opsawg@ietfa.amsl.com
Delivered-To: opsawg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6D0D23A07FD; Wed, 1 Dec 2021 09:52:25 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.09
X-Spam-Level:
X-Spam-Status: No, score=-2.09 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H2=-0.001, T_SPF_PERMERROR=0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=futurewei.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7Bj8RT4vHxZx; Wed, 1 Dec 2021 09:52:19 -0800 (PST)
Received: from NAM10-BN7-obe.outbound.protection.outlook.com (mail-bn7nam10on2095.outbound.protection.outlook.com [40.107.92.95]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5E5823A07EF; Wed, 1 Dec 2021 09:52:19 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=HwjLphYU48vjnJs0BVvJ/1I9F2ueG02V2cwMsdc8txheqmMQP7zUn52z48zp0mSrGPjB5mL6fjN4VqsppYZyvJCgsS0ceKk8kFD0hDS52oTqSZyfG6IcZh5HxiIf4dSUu58znnUzjyPEko5Sd1x0iAd2CcwgDWDF1aFmOLLmcO5nPjRF0d4rxIZzfkjxwkHaHAMYrUD+lO6yYCMRI2ldYRycTwDS/R+zx83fDi5iQJ7AocHeQWMO7tkg6twDNwV/InQ8SDlIaz0xkC1EHP2/5YmbDZ8yF40NgCZIdxN4p5BMmzD9aoVxHXVSSuEediO+wr7RyZ5eFrSL5874YjhxmQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=6Rwy/o4d2tWO+0ct8j7Qe6DHEsClaeBZ0Qx0bUtDGXs=; b=L4CfRRpQ7hGHlR8ga3bHiJ7w/LVl6E2/KmH1VpUjkFsY2m8YNPY5+QktiZx/bgyxmvdXCuhbKEiqBjcoD49uUlwOq3/085/dA1Pp3lTT8AMOogMjyX7pWIhnJccuKxAJ4OLTHFd70/hpnm3+8ICi3N55/r8Ftx3YJ05YDtnQGIB7FZSKV8QuAp0OXSa5/dvIJ4wFUkm9dQUviYz3HNi9lIePOY99JWRuXL31AYfDG+2bAk1B7rbvRFMF07/T6nAZh5nFBZwxi9WwRTOHBJxB+dbNaw2yDEGcZZbds/FojbuC+Gie7RMKue0rRLiP/ZSI3/Uz8R2FvrEZhfvufaiWeQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=futurewei.com; dmarc=pass action=none header.from=futurewei.com; dkim=pass header.d=futurewei.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Futurewei.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=6Rwy/o4d2tWO+0ct8j7Qe6DHEsClaeBZ0Qx0bUtDGXs=; b=Etx4Y6pOFgs3L8PAk5lF6UP8lE6IzdordaO102HpJvz+uuSNemvmxNHuRbBuD5QbtkJBcq6ubZyTVp4J7fxtE6JGIlpODqFrM/OUfVao9N3ZK1NVQxcpcIY4js7yfFbiFDwouh+QSm9JFfEr8kurQQiRkzcgBZp8W7YR8c3NPEg=
Received: from BY3PR13MB4787.namprd13.prod.outlook.com (2603:10b6:a03:357::13) by BY3PR13MB4932.namprd13.prod.outlook.com (2603:10b6:a03:36c::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4755.8; Wed, 1 Dec 2021 17:52:16 +0000
Received: from BY3PR13MB4787.namprd13.prod.outlook.com ([fe80::618d:61cf:753e:be55]) by BY3PR13MB4787.namprd13.prod.outlook.com ([fe80::618d:61cf:753e:be55%5]) with mapi id 15.20.4778.003; Wed, 1 Dec 2021 17:52:15 +0000
From: Haoyu Song <haoyu.song@futurewei.com>
To: Warren Kumari <warren@kumari.net>, The IESG <iesg@ietf.org>
CC: "draft-ietf-opsawg-ntf@ietf.org" <draft-ietf-opsawg-ntf@ietf.org>, "opsawg-chairs@ietf.org" <opsawg-chairs@ietf.org>, "opsawg@ietf.org" <opsawg@ietf.org>, "ludwig@clemm.org" <ludwig@clemm.org>, "jiangsheng@huawei.com" <jiangsheng@huawei.com>, "opsdir@ietf.org" <opsdir@ietf.org>
Thread-Topic: Warren Kumari's No Objection on draft-ietf-opsawg-ntf-11: (with COMMENT)
Thread-Index: AQHX5tMzjjjdbX6ZRUuZ2854cI1JB6wd6nOA
Date: Wed, 01 Dec 2021 17:52:15 +0000
Message-ID: <BY3PR13MB4787FB08CD76D1B52D484EB69A689@BY3PR13MB4787.namprd13.prod.outlook.com>
References: <163837727453.27774.10447419750382289926@ietfa.amsl.com>
In-Reply-To: <163837727453.27774.10447419750382289926@ietfa.amsl.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=futurewei.com;
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 14301576-0514-4845-9f3c-08d9b4f34fe0
x-ms-traffictypediagnostic: BY3PR13MB4932:
x-microsoft-antispam-prvs: <BY3PR13MB4932E30FA778693163D7844C9A689@BY3PR13MB4932.namprd13.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:5797;
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: k9oom07rNkfRZVYLdWkQtKRiWclXQfy+59u8D41Xm6T72gQ0GJMwts+SeR1b5r0SapMXz5Q/3+3SXce4GNDP91aSQQZnqNc94NURBZJDTRrs72FNjHcRFX6sn0NBW++VdUv5z1QYvDyXDs8IoXV5Y/tWi0zxjG/nudIp6855cRGvJ4zWp3hHxMbM0x4yInBs+KsCQwyBmlvK3lRHvOQptE6r+nKXk+JlqN9OmgwmNNUGZn9WOTTpBSqB/bheLJ4oIFLuhwxiMJVR9k1AdLajAKIcrYJh6CFc1MJGyJaXDgRrQ6b6aqt5cyt3WwwfQmxXyzHs95m89Q3uiT2fvYfZbUSBPpLctpPpbsbQ7lhT+SxzkqPi++y9wAxtlZe6+RXgi5Gj9Z2EgGSZ2Y73/zXivdcfNE8WR6PlrYTI0cIkDU8aRYrN+jzxO4T3fGBEbyyfy6r/IzKKINgHZxqe4txDSVfLAzEgYaBKew3jRHgKyQFIuP2h0SNfet6LL1BueMbu5yzOb6Tk0HXOWCAsSQrwadBNshhTKiVOEPUQ5xiC1fp8PbwlHIu2d+Zj4R/0YGA8TuQXcFLs1ez4MTgksV6y7qDQjDmDqlSlOJiJCLWrLMF7+ziw/q/R/Ur+AQ2Dy9epJeKZEvs4SiF9CnxSR1wRe38nW2qnKH4SeJV24B6HzdppYRy2IOtaKHIKTelWfDiskIaP06taWy5cl1FVQ5fQs5Vl+e+ptbXvZDU1ZzHf5KHHFBfOkdybMzdLgnAoQ7jOVfXygyvItutBbb4e/gkgoY2GAvALyvEMOflJbdsaAFlp6bK2A7ohp5CekUpXlg8DdVffIwj9q5rMEEpkrG1kJi20DM+nQ6Pv+7CHmlRtjdwfaB7P9hdzbYYoZrhlIF3H
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BY3PR13MB4787.namprd13.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(396003)(136003)(39850400004)(346002)(376002)(316002)(33656002)(5660300002)(8936002)(54906003)(38070700005)(110136005)(66556008)(53546011)(44832011)(8676002)(52536014)(2906002)(122000001)(45080400002)(966005)(66476007)(4326008)(76116006)(6506007)(86362001)(9686003)(71200400001)(55016003)(186003)(508600001)(7696005)(83380400001)(38100700002)(66946007)(26005)(64756008)(66446008); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: 7vTuYyfjGx+bj2N6q6sFCmtQKZTxOJYEMmtjE1I31fuXpNWyJzfBRtRHH3IQE6LfHhKvtyhMHoFXqaYW0C1x13qKJGysj7wrLb5Er14RUk0OUbuW13DitT80nAGFeMxmXPf+2y64V7mDAW884z798NwUTXPOCxARe8G5OLmtEC9UWwY9f7HmdDbF+WW/VSrPSg8GIvwXbgC4rn4+B96o5F4l31dwdRe0pb4Wro2SY+KawPfCAxpTKMASEQL4gS5xRwHFZb7C36erFbNYCAdh2wY2rKRl+m9H6a9HPnIs5c2C6hl/OUfz5+uinVmmkAnGabAJ33LuJa1fRRyhQXcLA65ZllElm2Ma1QgHv+Ub+wO4PiN67IzP6wHNM+dQI0ihSqjMOnYnoFBfAOdT+PujvDMrZdL6rRwtRkbdp6LF8p0AVfbiNFLlK3RuBWgQSGX74oXmLgWQvvtZfjCrNBxHennm1ykxyS7+AVtXon7Zs+gwSHRF7lXH7lMtuVjZJWdx1HYRxaP+4Ddz1w8c5qudHCY5MC3MKeFjdUK480tz3WU6//ywfUngdvoICPEtoPA3ZIv7gysCWg/ZllXp0qX0zudK7tNujoU+OYwdzjnejfee1PncHnStWFmNUVroazWppgYVoyvCeCtXkY7Cv9+R+dZ0ezx62Bbbx7FeE2/6BRuOUHfmIpc/hffTkGY8Tnvn09hyJYduVcGjk5r5G9TpKXhaW+1go8e8hP6vtEBsbtowHVeD6mF0CvCIwjihhZEgXIJBliQ9dj6uJsB7w1yDJHy1Ks47zkmjeKGqnoL+MLEPxCS63I+udEohnrxMKi7wnEIo4QYJz11KwwjSvkVPPJ6L55UcXWnd7n5JiZWjMIk0ByC3eCj0GJj7xXeJXpPN30J76E3LAHvHonFlzn/TOYpp6VKizBe+fuiducWoBq1yn8hSqF2V8ltSvEMMI4fd7L9Bzsck3jABMyRYjSjemfOm0zNdaODvgFkrLL2D9K3sBXKb5HkFyXBGMOwi4IoGm3Q4ocnN/+OAk9rlOsK6tH9bBm91XgJFfR+rdY3evWSdwE+md7CA8UB2zWR2jb+7MVo7JwLy64/LfsHwbL5ct67YCQTBAjTHkM7yH4ltZ4ZN+RV14HoJ5JfkS32NA2pdQEZgfUS9QOM4Aia42u+FN9mt3rvwXCRbSXQBtC/+EEBve2DrElTI+E5gSj0OI5FwnW/Wq6Rxf886MGd0EDqsAScgGKq9ey5vYZPVTYpOdzwb9Y27LU5514wx58v6KHV2htaDqzYtayexcCecX2GtmSxMKtwGVdzNA0ZoEG2r91ri7bcM7vTU3AWfKIAMSByWSNdWl6d5IZlRooKZmCs3htewRPSlwg2KkI6U9R3iaQQlVtHW2xtt1oFP4v5GoxQsH4M5jqNq4zNdD4Tbi+zGtUczgb///Djhp0U6+k3uJTvCAHMu3IkwKP0vCWcJU49GREjKPCQZ4P+ROwJ3Yek9ieVHE9O8e5wQWY9YfMbEgOzglpE8+cwZnCswwJ6ntJStgWsJhv6etXUWETFgRxOEjk7nW6WrpDrIBGO1MHLEsWbQHJ9Ywyr5xS2MkFu9p3uh2AdDFOH3LNa4h1Lz9z7SAg==
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: Futurewei.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BY3PR13MB4787.namprd13.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 14301576-0514-4845-9f3c-08d9b4f34fe0
X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Dec 2021 17:52:15.8559 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 0fee8ff2-a3b2-4018-9c75-3a1d5591fedc
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: Lmp5mLSh9TKw3WIdHu6MeW5RIg5+dWsacqlnr/BjKZXJWTeIEd444g10GWcuJ2LZ2ABTNzqzgi3LlchsugNWjQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY3PR13MB4932
Archived-At: <https://mailarchive.ietf.org/arch/msg/opsawg/upF9UmjEMt3sm4fzyy2KJfFusGE>
Subject: Re: [OPSAWG] Warren Kumari's No Objection on draft-ietf-opsawg-ntf-11: (with COMMENT)
X-BeenThere: opsawg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: OPSA Working Group Mail List <opsawg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/opsawg>, <mailto:opsawg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/opsawg/>
List-Post: <mailto:opsawg@ietf.org>
List-Help: <mailto:opsawg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/opsawg>, <mailto:opsawg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 01 Dec 2021 17:52:26 -0000

Hi Warren,

Thank you very much for the review and suggestions. The updates will be reflected in the next revision. 

Best regards,
Haoyu

-----Original Message-----
From: Warren Kumari via Datatracker <noreply@ietf.org> 
Sent: Wednesday, December 1, 2021 8:48 AM
To: The IESG <iesg@ietf.org>
Cc: draft-ietf-opsawg-ntf@ietf.org; opsawg-chairs@ietf.org; opsawg@ietf.org; ludwig@clemm.org; ludwig@clemm.org; jiangsheng@huawei.com; opsdir@ietf.org
Subject: Warren Kumari's No Objection on draft-ietf-opsawg-ntf-11: (with COMMENT)

Warren Kumari has entered the following ballot position for
draft-ietf-opsawg-ntf-11: No Objection

When responding, please keep the subject line intact and reply to all email addresses included in the To and CC lines. (Feel free to cut this introductory paragraph, however.)


Please refer to https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ietf.org%2Fblog%2Fhandling-iesg-ballot-positions%2F&amp;data=04%7C01%7Chaoyu.song%40futurewei.com%7Ce6ee493481e5413e70a808d9b4ea53a0%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C1%7C637739740803203416%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&amp;sdata=Nhl%2BkeF2n0R5M2BaTTY%2B4HY9s%2F6W8p8Yy2hSktjWna4%3D&amp;reserved=0
for more information about how to handle DISCUSS and COMMENT positions.


The document, along with other ballot positions, can be found here:
https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdatatracker.ietf.org%2Fdoc%2Fdraft-ietf-opsawg-ntf%2F&amp;data=04%7C01%7Chaoyu.song%40futurewei.com%7Ce6ee493481e5413e70a808d9b4ea53a0%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C1%7C637739740803203416%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&amp;sdata=OiOy1DDu2%2BiXqomz4zNzqtXpMLkZYSDiafgCPVlH2J4%3D&amp;reserved=0



----------------------------------------------------------------------
COMMENT:
----------------------------------------------------------------------

Firstly, thank you for writing this, and thanks to Sheng Jiang for the OpsDir review.

 I personally think that these sort of "overview" / framework documents are  really useful; I've often had to get spun up on some new technology and  reading an RFC which specifies the packet format without a good overview  document (like this one ) is not helpful...

Anyway, with that soapbox rant over, I have 2 substantive comments and some nits to help make the document better / more readable. There is no need to reply to each comment (or at all) - these are non-blocking comments, but fixing them will help make the RFC Editor's job easier and help ensure that none sneak through...

1:S1 - Introduction
"All the modules are internally structured in the same way, including components that allow to configure data sources in ..." P: "that allow for the configuration" or "that allow the <subject - operator? system?> to configure what data to..."

"The framework can also simplify the tasks for designing, maintaining, and understanding a network telemetry system." P:"the task of designing" (or just "simplify the design, maintenance and understanding of ..."

"At last, we outline the evolution stages of the network telemetry system and discuss the potential security concerns." P: "Finally, ..." or "Lastly, ...".
Actually, I think "In addition...." would be even better.

S 2.2 Use Cases
"Intent, as defined in [I-D.irtf-nmrg-ibn-concepts-definitions], is a set of operational goal that a network ..." s/goal/goals/

"SLA Compliance: A Service-Level Agreement (SLA) defines the level of service a user expects from a network operator," I disagree with this -- an SLA is what a network operator has agreed to provide, usually with a contract and penalty to missing it. As a user I *expect* my network operator to always exceed the SLA - if the SLA specifies 95% uptime, I don't really expect 36 hours of downtime each month :-P. Also, in many cases I (sadly) *expect* much worse service than the SLA actually specifies... The Wikipedia
https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fen.wikipedia.org%2Fwiki%2FService-level_agreement&amp;data=04%7C01%7Chaoyu.song%40futurewei.com%7Ce6ee493481e5413e70a808d9b4ea53a0%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C1%7C637739740803203416%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&amp;sdata=akdpqX9UKUSalGgZZOumuCeuZJnrP%2BiYLHE89HsVACg%3D&amp;reserved=0 page has some good text you could use...

"Root Cause Analysis: Any network failure can be the effect of a sequence of chained events." The use of "Any" here seems odd / wrong -- perhaps "Network failures are often ..." or "Many network failures..." or just drop the first sentence and start with "Troubleshooting and recovery require ..."

S 2.3
"The poll-based low-frequency data collection is ill-suited..."
Drop the "The", or s/The/This/

"Subscription-based streaming data directly pushed from the data source (e.g., the forwarding chip) is preferred to provide enough data quantity and precision at scale." Suggest s/enough/sufficient/ (just for flow)

"Comprehensive data is needed from packet processing engine to traffic manager, from line cards to main control board,..." s/engine/engines/, or, better, "from the packet processing engine to the traffic manager..."

S 3.1. Top Level Modules
"Therefore, we categorize the network telemetry into four distinct modules with each having its own interface to Network Operation Applications." It would be really helpful to list the "four distinct modules" here -- I spent quite a while looking at the figure (with 5 boxes :-)) trying to infer what you meant.
Just adding them in a parenthetical would work well.

"For example, the forwarding chip has high throughput but limited capacity for processing complex data and maintaining states, while ..." s/states/state/ (Yes, I get that the forwarding engine manages many different sets of state, but "maintaining states" still seems weird...)

Again, thank you for writing this, and also for considering / addressing these nits...