Re: [OPSAWG] Genart last call review of draft-ietf-opsawg-ntf-09

Haoyu Song <haoyu.song@futurewei.com> Mon, 25 October 2021 17:07 UTC

Return-Path: <haoyu.song@futurewei.com>
X-Original-To: opsawg@ietfa.amsl.com
Delivered-To: opsawg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id AC5593A0A97; Mon, 25 Oct 2021 10:07:49 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.09
X-Spam-Level:
X-Spam-Status: No, score=-2.09 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H2=-0.001, T_SPF_PERMERROR=0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=futurewei.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id RIi10Jcxk2cS; Mon, 25 Oct 2021 10:07:44 -0700 (PDT)
Received: from NAM10-MW2-obe.outbound.protection.outlook.com (mail-mw2nam10on2092.outbound.protection.outlook.com [40.107.94.92]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 17CD33A0940; Mon, 25 Oct 2021 10:07:43 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=gwFZbt/hv3X9rrD3Fx2fFBzLmCuDU3Fd6hyQl6zkj8xTMfr4zaxt6SeZlbvhxbSBCKDH+VylUWtwHPfLMESTI2SC1BEwB+oZzMI/U0ZUq08gtWguL1fwoNKaFmc7nCTYs9Ew/W3euvCgnR3drj+aFkyRg/7XLKKYcJ4mKTMc720kTS4PZbKMEwn0VaBwQkWesJsoxfTM0UXfTvX5ddjOGxqvv1lQhaQuNHzKAPgcXus8F/6pRn7JjplQdn6tHUrlJYWa/nOknYKT5P0IlSUko2iDyZclFO4NMlA3CYoA91kQNN1FiIAuDQiwazipMJTB+YzN0Bvu2fw2LR14l/eh8g==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=gueKBVsIB9G4czlNTMotCFBr8vG7ymBo2uHFubE8WEk=; b=MXrl5DcZtQzhpxa0A/lVcFyDgEoFwRTxPyfhwlnNpfhMOwHVpuYuyendA7tu6BADaDMNPg9/tIaF5RKRKqF5le7ZMI59wZqsFlLESQY+BLGmSfz5/N+BiJh3bYi54gJOzGil49//Tsnvqm2mAQKZ4wP2i0IBvYULV1ORi6vfKAPjJod8UtQZorIhM60J5dA1t3UAHzb0iyYP9ZT0elEIplhfp6/ibZD26qm0OzIizIXuk8HCSUh7wW73Ynk6h2A5o3KkwpSgF1LZWnGXybWcp5HU2f0hQVg18DjGgEhIKKub3hgEt9ahbjk/S7Y/1vxOaIjZxVSyJYJYcPzOaVLOHQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=futurewei.com; dmarc=pass action=none header.from=futurewei.com; dkim=pass header.d=futurewei.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Futurewei.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=gueKBVsIB9G4czlNTMotCFBr8vG7ymBo2uHFubE8WEk=; b=geMJupPqUhMdYDVL9THc8Fg6+FuhIwZOCKMfZ1sGV4Er2UreFfBKUeroV/uumUgVMgJhByjdEwb6Mfx9ZkKWRbGLIBm17jNHQVsS5goN+wbldKriadrDZl5lyf8OC+G5YJ/JasYmiXmwf4YPCIooJcVmd03RCN+e05vQ8ViKZ+s=
Received: from BY3PR13MB4787.namprd13.prod.outlook.com (2603:10b6:a03:357::13) by BY5PR13MB3331.namprd13.prod.outlook.com (2603:10b6:a03:1a2::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4649.13; Mon, 25 Oct 2021 17:07:27 +0000
Received: from BY3PR13MB4787.namprd13.prod.outlook.com ([fe80::410d:64ed:3b3a:a6b5]) by BY3PR13MB4787.namprd13.prod.outlook.com ([fe80::410d:64ed:3b3a:a6b5%7]) with mapi id 15.20.4649.013; Mon, 25 Oct 2021 17:07:27 +0000
From: Haoyu Song <haoyu.song@futurewei.com>
To: Gyan Mishra <hayabusagsm@gmail.com>, "gen-art@ietf.org" <gen-art@ietf.org>
CC: "draft-ietf-opsawg-ntf.all@ietf.org" <draft-ietf-opsawg-ntf.all@ietf.org>, "last-call@ietf.org" <last-call@ietf.org>, "opsawg@ietf.org" <opsawg@ietf.org>
Thread-Topic: Genart last call review of draft-ietf-opsawg-ntf-09
Thread-Index: AQHXyHBv1QQFsqa54UelqtKp5sG8mqvj8ftQ
Date: Mon, 25 Oct 2021 17:07:27 +0000
Message-ID: <BY3PR13MB4787A895B71606D000EA94BD9A839@BY3PR13MB4787.namprd13.prod.outlook.com>
References: <163503631556.3316.15136256360109032302@ietfa.amsl.com>
In-Reply-To: <163503631556.3316.15136256360109032302@ietfa.amsl.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: gmail.com; dkim=none (message not signed) header.d=none;gmail.com; dmarc=none action=none header.from=futurewei.com;
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 85e06371-9857-4ca6-7634-08d997d9ec00
x-ms-traffictypediagnostic: BY5PR13MB3331:
x-microsoft-antispam-prvs: <BY5PR13MB3331D0F1A785CFC546302A569A839@BY5PR13MB3331.namprd13.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: fiyQOjsMav1jxH+k9CVK35muxRt51y8Q10dbT6lVEy5feV93muntmzEK/5tVVORCdL+4nmbB2Yqhuyi+Ay0a5sjqW9dXYMDggVJtAl4ZICMry5l5yck/OphkqOx+5RjAmCqoKrW+Z3NwdBsT5GhGR6SRuUCOKJygZNmHMW01Q/Ih4LqyBoagywcEiG+CjLJXrTKx0HtOPEH4inRyXx5/eWRDVLXYck73/w/d5r5n/e6MyaG4KGprFCVs3Cw0DbG1YqbRFw9Yzp22nGaL5/h3KOvFh9gVVpXm5TKY62gtuvflxQtiIWhDw+IT+FAVGWjdGJfDLhmwMQS8Hox85HrcjU1QzXwheEiCPOEs84Cnl1LRk+PuwxC9neVQijQ0UHuMbPxh4uOAKxj7NYhfEeuF0v2fimddX6eTat3KMYXR1qrSuwi55YA0bjYOqpwVragqlY/eKOPcbCY2xVTfnkhePqGWiUUJf8UMp0hf3izEE/3TlbzrT+gvAqU/ZasQshLMUnahPYsHCWA84rcAD5oI0ZuCV9Q4P5V45wS9vwRz5U9jjhHTyp0plPZGh9ZDWjSgXtnPEkT/DW+pYZyFoLYfDjxLyN+HvrwEc+yWxzWpBgrAvx/f5G/oVsNhdiTwbtkpV3JD8WT6Ud3wiJ7ZdcIta551wNMpP4z3nrcFL2XCcWyRWqusWaCSDuSSlNtIPeO7N+C+OBbtNdsNLt58i3QSJ1Jw9x/7O/NWX8+viNhoZoya6gbN8WKP542/iDe2lFzWkmxQvF2RwbyghFCti6GEBEgTFcm6Rm/aDirqX+qGe54=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BY3PR13MB4787.namprd13.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(4001150100001)(2906002)(66476007)(55016002)(186003)(64756008)(316002)(76116006)(508600001)(66556008)(8676002)(66446008)(66946007)(122000001)(38100700002)(86362001)(33656002)(26005)(44832011)(52536014)(71200400001)(7696005)(53546011)(9686003)(110136005)(54906003)(4326008)(5660300002)(38070700005)(6506007)(8936002)(83380400001); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: g4cLCXuqX9aNafKrg8604sRMl4+TPYcSqoH2+pFI2RekyQ9/B1Lza0bSVCHqpDNljLMkDJrxgotQhXmp1H+eDTwvR/g1rOusRI1WgPMTyd1H5bF+q2UHSdA05s0GDsDqgjiiznTmyLc7BFFLd3VStYzPQ3UCbmq385qaIJy5rQT823WntzADHRnXpjL2nTiNktrfwc3vvWulczIH08XOqa+IykWBDYOm6cKY2/OJBKvbIuv0cSVJRQZ5TUntoj1z4hKUb5FgObjknIPDA+HoACaGYP7vK4euRVgH2p9eeBjDpOLy8QOKR+Ll0udKiKtqKpcD6klNQX0XsjTWU9Z5HxXQmsu65oYZmkZ1i+I1aNG198zJ5tPx/J9E0y8aI0L1rYFP1bTOpH8oMmY+QqKaNEde0W6RLpCGK8/0To0d5di0Aqvg5InMAd5etkZzhnRGtfqGhQBt2CIz3BQOUK5EEJXEUsd4qM86GaSaCTrg2KDdTeAPo+3ZdGXVGI8Fslxw3GUcpIKCk3mR6T78Im97TyAGe/f3o4m4F+aV7CD+IhsdC3q5LUTzsH759bp4FQ/mrReo+qkNVNRgKghV8c2uxnmXKl86EGg93D6mYnOW4WxikKTBQ95HpxsoowWlTvi5jhbM5xq75ozg7BzWtDeb3vm5JEAK/izAWKF2E9SSZYniuUmpZ0wFmSJK37KRfmVNL4WsDLHG4iTRFbcEBoLemaApbXGs7RobOuheDjKAtzmmODAf1pLqmvzeNIojgbF7aFYHmkq2ZODQ5HYCPQ3mq/+JRZeVPYpJSRN1ca8F1pUhWdCeR1IfbrO8a/AsgJqXiuWJPOTtg5EVqGBhmDv7Iu4ewQj9GfCIv6dPEn6n1L274u3gW9dI14Iysme0J+GCLdTT2U5hfjC+zBRwKvgfXtBkJUrzZ04vZN42iBSdMWtsPD3Ame7W8V/rpxmwPHYfPH1z/NFXF60RBDlQu9ndV31F9M9ytRBzbDiP/t3X9VHJKNmf6PzkurZqmHkoXYfjrSHokCGicnO0YwMCg/469T4N3Yy7dwJVk7VRi/Fw0UoFrnT0ZMyh2Ru2VZhsDKZFVBOqaSK92PAiVFxs96ZxuPP3WvX3BoIHofbFI2BMRr6WN7u8JRWlP6a6VbRoGBv/D95x3GSHq+Oyma4hHWCLvCudtSndyo4Gmlkd7cC0jm9ZWBHMuX/POuJ25VBlyqgIYHckpPHlgBTfNTmlr35Kk9wfe9GM0SGAAQv7YkHsuVs9iqBLEmMyciaHB0/7QxcWPbVisjg30R35f71mAofEceEvZd0eYFKODdzKzEA0YN7Uoka8zMfOQA8WH67EEUq6PRARYwUATOca4lqG+gZzALnl5Flq+lP6KeC1j4bQcsmS6ANYNV+Odq4GMqtc3OEHUjENK0JofVIC6iXpSWG+IFZL+vDp0qio43jCZfljtbKOtztz1YhhrZWUuzWYTTqdOnC/2ECQ/RUOd03YVexbaicnYiV2aHS4agQtS8NZtCVSTW+sMKq1rtrHuJfV29FGOb/Bvy9zS8/GR2knKDzPCBp6x8H3/y/5cHHC4qChuNepxm9inP8JXv0DB9rdZw4Z7mHE6++K6g0616MBI0+BXA==
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: Futurewei.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BY3PR13MB4787.namprd13.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 85e06371-9857-4ca6-7634-08d997d9ec00
X-MS-Exchange-CrossTenant-originalarrivaltime: 25 Oct 2021 17:07:27.0874 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 0fee8ff2-a3b2-4018-9c75-3a1d5591fedc
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: SEZWFcCqsSiSkzK/QppgCDNzC8NM9/4R+TtNEQ6jsZCY32IQ1gtJOo6noG9KDdxQ2nHthdnuIVIrZigbPfSh5A==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY5PR13MB3331
Archived-At: <https://mailarchive.ietf.org/arch/msg/opsawg/Aerpv89USgDpZtP2L4HG5HUrWiA>
Subject: Re: [OPSAWG] Genart last call review of draft-ietf-opsawg-ntf-09
X-BeenThere: opsawg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: OPSA Working Group Mail List <opsawg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/opsawg>, <mailto:opsawg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/opsawg/>
List-Post: <mailto:opsawg@ietf.org>
List-Help: <mailto:opsawg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/opsawg>, <mailto:opsawg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 25 Oct 2021 17:07:50 -0000

Hi Gyan,

Thank you very much for your review and feedback!

I have added reference to STAMP and RESTCONF as you suggested. 
I'm a little confused by the difference between OAM-based ping and non OAM-based ping. Could you please elaborate on this?
Please also note that we don't intend to provide an exhaustive survey on all existing OAM tools and proposals, rather we just give some typical representative for each category. Also, we focus more on the underlying techniques (e.g., ping) rather than their adaptation to various dataplanes. Of course, if you think it's important to include those, I'll add a paragraph in the dataplane telemetry subsection.

Best regards,
Haoyu  

-----Original Message-----
From: Gyan Mishra via Datatracker <noreply@ietf.org> 
Sent: Saturday, October 23, 2021 5:45 PM
To: gen-art@ietf.org
Cc: draft-ietf-opsawg-ntf.all@ietf.org; last-call@ietf.org; opsawg@ietf.org
Subject: Genart last call review of draft-ietf-opsawg-ntf-09

Reviewer: Gyan Mishra
Review result: Ready with Nits

I am the assigned Gen-ART reviewer for this draft. The General Area Review Team (Gen-ART) reviews all IETF documents being processed by the IESG for the IETF Chair.  Please treat these comments just like any other last call comments.

For more information, please see the FAQ at

<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftrac.ietf.org%2Ftrac%2Fgen%2Fwiki%2FGenArtfaq&amp;data=04%7C01%7Chaoyu.song%40futurewei.com%7C0dd4f94d2979459a271508d996878f14%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C1%7C637706331261985874%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&amp;sdata=DSab4L9VbFk5ow3f8GuLa5EDgvTjB%2Fs6e2A3g54Oej0%3D&amp;reserved=0>.

Document: draft-ietf-opsawg-ntf-??
Reviewer: Gyan Mishra
Review Date: 2021-10-23
IETF LC End Date: 2021-10-27
IESG Telechat date: Not scheduled for a telechat

Summary:
This draft analyzes the overall framework of network telemetry technologies that exist today and future evolution of telemetry technology and data gathering from a control plane, data plane and management plane perspective. 
Document is well written.

Major issues:
None

Minor issues:
None
Nits/editorial comments:

Section 4.1.3 Forwarding plane telemetry does not include STAMP RFC 8762.  
Mention traditional non OAM based ping ICMP Echo snd Echo-Reply.

 Also for OAM based maybe list the variety of OAM based ping such as for all  data planes such as MPLS, RSVP-TE,  L2 VPN pdeudowire OAM ping VCCV (Virtual  Circuit Connection Verification) RFC 5085 RFC 7189, RFC 5586 GACH PW OAM.

Any of the RFCs listed here maybe include as informative references.

Also NVO3 VXLAN and BIER OAM.  SFC service plane RFC 8924 SFC OAM.

Also DETNET forwarding and service sub planes DETNET OAM.

SDN and SD-WAN, PCEP, BGP all centralized controller based architecture can also be used for network telemetry.

RESTCONF REST API is missing should be mentioned