Re: [OPSAWG] WGLC: Comments on draft-opsawg-ntf

Haoyu Song <haoyu.song@futurewei.com> Wed, 07 October 2020 20:34 UTC

Return-Path: <haoyu.song@futurewei.com>
X-Original-To: opsawg@ietfa.amsl.com
Delivered-To: opsawg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 258313A135A; Wed, 7 Oct 2020 13:34:50 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.089
X-Spam-Level:
X-Spam-Status: No, score=-2.089 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, T_SPF_PERMERROR=0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=futurewei.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jX48hmqkY4LM; Wed, 7 Oct 2020 13:34:48 -0700 (PDT)
Received: from NAM12-BN8-obe.outbound.protection.outlook.com (mail-bn8nam12on2109.outbound.protection.outlook.com [40.107.237.109]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id CEC7F3A1357; Wed, 7 Oct 2020 13:34:47 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=cARObfOj2kxIs739olmJFglPNJ0bSJl/KLSYORHpQCCMl9mKAQ2EcenhvNXH9RT5FqYqDAN9l2vSKYf3VPDUxnXXCvxism17O/E4ruuo1Rmv3pHXUw7WmEywQ88Ns9X+lbQ8ffe1N98/n/8IQC7doWCq2NPaW8pNG+kT4eMEoyfmiS5hnhehRjS1sH36xvuwRHZh1wKXyb+B6D9dlsn0FahF5DZOTWFZVvu0ShUYgIXiCBmPCZl6DYXaFRFmZq2JKCr81f0ccVgah453Jerv6d0bOujmPbzuppP95Ap20HmNV7oyFu4Gbx6wz5eatPSHiqz3RawUIsjxIa5sn1SNZA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=idASO/5YqCBVUatR1Dy0zDoMw8rJ4t4egWOLKqvEkPU=; b=M9Dfqpz97QObLNIyCwOUkUpctfDys5TYNd8/MyhQvIVU3GVb80aP26dhkbF31E0M4lhz5XyWZzZqdng6ut1wVPPogu02x0HTKJYiGMGzAUNYE/4d2+YlWaxPUm9HHx+vTDyCwM0DsU96fEXfxYoByV5zKHoNUroOYTkzreSoxLNTr9adwTrCXV6sSVwk1KIbu3ASCQRXqYEYeEKtgJB/Qq28jCfLXiYTlZfFES4SLl7UtT+sackFPh1RK8Wck8ZwOQvts4gIV9A5fYwbNPh4HJ4TVhtEE8SvoUYHpVAn260lCXpnwCuVIQwF8QoR/SxuMtVHKNGwVL9Oge8ECI9KSQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=futurewei.com; dmarc=pass action=none header.from=futurewei.com; dkim=pass header.d=futurewei.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Futurewei.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=idASO/5YqCBVUatR1Dy0zDoMw8rJ4t4egWOLKqvEkPU=; b=bqYMtzCkdZrOZ+NHN4h5A6uSJ5TXMCCYQvGr3QAAvRgb9NAi23MLRm7ziGLr5yVzE2tsUvAaNUG4tPUtB6sIDGeP9dhQZoswyTaBvaZqh6bFyy7MlL1ZiMYlN76PSkj4C+9FvYapblqrPAUfTbvfASFGkEv5yJ56E7nFH7qrEYE=
Received: from DM6PR13MB2762.namprd13.prod.outlook.com (2603:10b6:5:13c::13) by DM5PR13MB0937.namprd13.prod.outlook.com (2603:10b6:3:77::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3455.15; Wed, 7 Oct 2020 20:34:44 +0000
Received: from DM6PR13MB2762.namprd13.prod.outlook.com ([fe80::3166:aa2e:cd89:f88a]) by DM6PR13MB2762.namprd13.prod.outlook.com ([fe80::3166:aa2e:cd89:f88a%6]) with mapi id 15.20.3455.023; Wed, 7 Oct 2020 20:34:44 +0000
From: Haoyu Song <haoyu.song@futurewei.com>
To: Greg Mirsky <gregimirsky@gmail.com>, "draft-opsawg-ntf@ietf.org" <draft-opsawg-ntf@ietf.org>, "opsawg@ietf.org" <opsawg@ietf.org>
Thread-Topic: [OPSAWG] WGLC: Comments on draft-opsawg-ntf
Thread-Index: AQHWnEX2nDwqClw/PUaNtfe1aUmVr6mMjCfw
Date: Wed, 07 Oct 2020 20:34:43 +0000
Message-ID: <DM6PR13MB2762E2E6D282F53D753C22829A0A0@DM6PR13MB2762.namprd13.prod.outlook.com>
References: <CA+RyBmU2CuTOa3VP_zF8BKp1WsjkREWbcgju=eLtT9D6t3-jog@mail.gmail.com>
In-Reply-To: <CA+RyBmU2CuTOa3VP_zF8BKp1WsjkREWbcgju=eLtT9D6t3-jog@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: gmail.com; dkim=none (message not signed) header.d=none;gmail.com; dmarc=none action=none header.from=futurewei.com;
x-originating-ip: [2600:1700:38c4:650:690d:1d9e:fa11:6404]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: c016531f-0ba4-4d26-42bd-08d86b006cce
x-ms-traffictypediagnostic: DM5PR13MB0937:
x-microsoft-antispam-prvs: <DM5PR13MB0937370AEA2E6F464505528A9A0A0@DM5PR13MB0937.namprd13.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: Ar5QAEMm+Yv7nlpAMA4zCiNSeDSWeIkubD5U8XSXErUobUQbazHYtCxlDs3GNG5tD9c0fRiMvmgCZyfHdoOM5/KbPnECP3NVFo/07yvLjG0Vs0gTaU+IeRb3vVrIOd7yBkwlCjtpHM5CECgTSEoEWbHd9xwNYLnaWCDLwoZX5s9In0mp9eOLQTxPIntfetQ1gk0mMhgcUXBYivnLQlwoNGrHTVujyZHPdD81wJhZg0NgkwU+BrQkLNj9gl4wBJXzF1XV8YKigwag00TB6vpHI2HtalGFoYAinWqsanS5bZ8pB/Bd+0cNwK24wtjPPKzFqKVegghC0aY70kl5gWn0ug==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DM6PR13MB2762.namprd13.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(39840400004)(346002)(396003)(366004)(136003)(376002)(9686003)(5660300002)(2906002)(66476007)(8936002)(83380400001)(66556008)(478600001)(86362001)(33656002)(52536014)(53546011)(66946007)(6506007)(7696005)(64756008)(8676002)(71200400001)(76116006)(44832011)(9326002)(110136005)(186003)(55016002)(316002)(66446008); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata: 6e8GRgqNvr4uovEbtmgrDps7zKHIARhY8Ns9oAAgXQb+KcmPLI8nyZmOb7mhQ+gt8tkCu/hytmcs/DPjIJrcqc/aOZvlXi4L6N+QXR3VDzGZo9eTVNyQV7rHVGcir/LXPvs0bWIZh0jM1AQ1tVIqUPkWQXYvAtrqWbnmxt28YajDzJdSnu5W3f80aqWxqzkwDPtMHrMGmlUb8ez18011t8Mt26sTGeFbu1AKLP76j9OQpcDu0EBu3FsUypwmho+uFERm2uHklgPo9EOnc9dxMSEoCW35m1MHLK7lu44XDsh1mBQ+Hsb6cBMeb8xGE7NO0tBLAiSP5qaReGOHVreV0DyegH6QqsH1C9SE8vNuKGsYTMRP/6ynouL+SYGgm+1letD1UrIpqSoc5aEJ8F45yOnLN+Jx6zsLcyDA7smcgqPghEx2421NqVO3z0oZN515zTxcN+ds5KGAf8DEd2PPUS1pP4JbmwRW7/95Yj0J6RhCNd64PVyWkTOmbZqUsrFY3bwPj7cM2RQv6L3jAxJnuFKtxMKpk9vKhloiB+4wMDxbUh+saMTInQOkDY/mmRWNZhTJdLedcZgl8Z0uLf29Onx5mAQFNMsWRqObkAOJ1s4jkWzu6TX/w5+1kf7KvEACqRDJ3ySrcBfSPcs9Tk16YruGA7Y8whhlsquE1abuZ8OKd+P6VyKnQoJproIAwNgfa1HrU9falpNtCtLOy1KTxw==
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_DM6PR13MB2762E2E6D282F53D753C22829A0A0DM6PR13MB2762namp_"
MIME-Version: 1.0
X-OriginatorOrg: Futurewei.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: DM6PR13MB2762.namprd13.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: c016531f-0ba4-4d26-42bd-08d86b006cce
X-MS-Exchange-CrossTenant-originalarrivaltime: 07 Oct 2020 20:34:43.9805 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 0fee8ff2-a3b2-4018-9c75-3a1d5591fedc
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: dUOcaoOiJmkqvf43ZnIrj657V8reG3STbwwK4mBnu8UMuQJR4yWsuQ8YZ9rcN0EXJqSIgdXFFrC6nkwsSRtVZg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM5PR13MB0937
Archived-At: <https://mailarchive.ietf.org/arch/msg/opsawg/KatQTaexR3Qz3ys-ufANgqOv5XI>
Subject: Re: [OPSAWG] WGLC: Comments on draft-opsawg-ntf
X-BeenThere: opsawg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: OPSA Working Group Mail List <opsawg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/opsawg>, <mailto:opsawg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/opsawg/>
List-Post: <mailto:opsawg@ietf.org>
List-Help: <mailto:opsawg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/opsawg>, <mailto:opsawg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 07 Oct 2020 20:34:50 -0000

Hi Greg,

Thank you very much for the review and comments!
We agree that network telemetry doesn’t contradict with OAM, and in fact, OAM is an important part of network telemetry. We will take your insight and reword the corresponding paragraphs for clarification. Please see inline for more response.

Best regards,
Haoyu

From: OPSAWG <opsawg-bounces@ietf.org> On Behalf Of Greg Mirsky
Sent: Tuesday, October 6, 2020 6:05 PM
To: draft-opsawg-ntf@ietf.org; opsawg@ietf.org
Subject: [OPSAWG] WGLC: Comments on draft-opsawg-ntf

Dear Authors,
thank you for your work on this document. I believe that it is important to analyze and explain what is network telemetry, how it relates to the established tools that support network operations, administration, and maintenance (OAM).

Traditionally, OAM tools support two components of the FCAPS network management model - Fault Management (FM) and Performance Monitoring (PM). The former, FM, in addition to a failure detection tool, may include, for example, a protection switchover coordination protocol. Both FM and PM, when in use, produce information that reflects the state of the network.

Network telemetry may be viewed in two aspects - telemetry information that reflects the state of the network and methods used to collect and transport telemetry information.

At this point, I believe, we see that OAM and telemetry have something in common - information that characterizes the state of the network, a part of the network. If that is the case, then I think that statements about the relationship between OAM and telemetry:
   As evidenced by the defining
   characteristics and industry practice, network telemetry covers
   technologies and protocols beyond the conventional network
   Operations, Administration, and Management (OAM).  Network telemetry
   promises better flexibility, scalability, accuracy, coverage, and
   performance and allows automated control loops to suit both today's
   and tomorrow's network operation requirements.
or
   One difference between the network telemetry and the network OAM is
   that the network telemetry assumes machines as data consumer, while
   the conventional network OAM usually assumes human operators.
are arguable, at the minimum. I believe that there's no contradiction between OAM protocols and telemetry collection methods. On the contrary, each is essential and is complementary to the other, especially when detecting a network failure. To illustrate the latter, I can offer a case of monitoring a standby path that protects a working path. While an on-path method of collecting information can be used to monitor the condition of the working path, the standby can be monitored, in my opinion, only using an active OAM method injecting specially constructed test probes.

Another, rather general comment I have is on using RFC 7799 classification of PM methods. I think that the first reference to RFC 7799 is appropriate in or before Section 2.4.

[HS] will do.

Further, in Section 3, the document differentiates between Event-triggered Data and Streaming Data. I think that, based on the current definitions, there's little if anything that differentiates these two. Consider the definition of Streaming Data:
   Streaming Data:  The data are continuously or periodically generated.
      It can be time series or the dump of databases.  The streaming
      data reflect realtime network states and metrics and require large
      bandwidth and processing power.
Can timer expiration be viewed as an event? Also, If the timer that defines the frequency of data set export is long, is the information truly real-time? Or, doesn't Event-triggered Data reflects the state in real-time?

[HS] I think I see your point. Timer expiration is an event for sure. I think the difference is subtle.  For example, event-triggered data can be actively pushed (so it’s real-time) or passively polled (so it’s not real-time), but streaming data are always pushed. I’ll make the definition and description of streaming data more rigid to differentiate it from the event-triggered data.

Information collected in Figure 3 (could be tagged as a table) is very interesting. I think that it would be beneficial to add more explanation to the content of the table.

[HS] Do you really mean Figure 3 or some other figure?

Regards,
Greg